climateprediction.net home page
Task 22300209

Task 22300209

Name oifs_43r3_ps_0033_2013050100_123_982_12198677_1
Workunit 12198677
Created 20 Jan 2023, 3:44:04 UTC
Sent 20 Jan 2023, 4:00:46 UTC
Report deadline 21 Mar 2023, 4:00:46 UTC
Received 21 Jan 2023, 2:08:30 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1531398
Run time 17 hours 42 min 16 sec
CPU time 17 hours 29 min 33 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.92 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,798.52 MB
Peak swap size 4,978.07 MB
Peak disk usage 2,829.92 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
c/slots/14/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_99.zip
Uploading the intermediate file: upload_file_99.zip
  19:22:51 STEP 2401 H=2401:00 +CPU= 16.917
  19:23:08 STEP 2402 H=2402:00 +CPU= 16.790
  19:23:34 STEP 2403 H=2403:00 +CPU= 25.732
  19:23:51 STEP 2404 H=2404:00 +CPU= 16.978
  19:24:08 STEP 2405 H=2405:00 +CPU= 16.514
  19:24:34 STEP 2406 H=2406:00 +CPU= 25.929
  19:24:51 STEP 2407 H=2407:00 +CPU= 16.446
  19:25:09 STEP 2408 H=2408:00 +CPU= 16.961
  19:25:35 STEP 2409 H=2409:00 +CPU= 26.026
  19:25:53 STEP 2410 H=2410:00 +CPU= 17.274
  19:26:10 STEP 2411 H=2411:00 +CPU= 16.639
  19:26:39 STEP 2412 H=2412:00 +CPU= 29.102
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002412
  19:26:56 STEP 2413 H=2413:00 +CPU= 16.733
  19:27:14 STEP 2414 H=2414:00 +CPU= 17.257
  19:27:41 STEP 2415 H=2415:00 +CPU= 26.093
  19:27:58 STEP 2416 H=2416:00 +CPU= 17.426
  19:28:15 STEP 2417 H=2417:00 +CPU= 16.334
  19:28:41 STEP 2418 H=2418:00 +CPU= 25.498
  19:28:57 STEP 2419 H=2419:00 +CPU= 16.407
  19:29:15 STEP 2420 H=2420:00 +CPU= 17.595
  19:29:41 STEP 2421 H=2421:00 +CPU= 24.999
  19:29:59 STEP 2422 H=2422:00 +CPU= 17.643
  19:30:16 STEP 2423 H=2423:00 +CPU= 17.177
  19:30:47 STEP 2424 H=2424:00 +CPU= 29.284
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_100.zip
Uploading the intermediate file: upload_file_100.zip
  19:31:04 STEP 2425 H=2425:00 +CPU= 16.884
  19:31:21 STEP 2426 H=2426:00 +CPU= 17.155
  19:31:47 STEP 2427 H=2427:00 +CPU= 25.256
  19:32:05 STEP 2428 H=2428:00 +CPU= 17.534
  19:32:22 STEP 2429 H=2429:00 +CPU= 16.518
  19:32:48 STEP 2430 H=2430:00 +CPU= 25.952
  19:33:06 STEP 2431 H=2431:00 +CPU= 17.160
  19:33:23 STEP 2432 H=2432:00 +CPU= 16.984
  19:33:49 STEP 2433 H=2433:00 +CPU= 25.458
  19:34:07 STEP 2434 H=2434:00 +CPU= 17.754
  19:34:24 STEP 2435 H=2435:00 +CPU= 16.582
  19:34:53 STEP 2436 H=2436:00 +CPU= 27.855
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002436
  19:35:10 STEP 2437 H=2437:00 +CPU= 16.897
  19:35:27 STEP 2438 H=2438:00 +CPU= 17.293
  19:35:53 STEP 2439 H=2439:00 +CPU= 24.785
  19:36:10 STEP 2440 H=2440:00 +CPU= 17.381
  19:36:27 STEP 2441 H=2441:00 +CPU= 16.633
  19:36:54 STEP 2442 H=2442:00 +CPU= 26.290
  19:37:11 STEP 2443 H=2443:00 +CPU= 16.750
  19:37:29 STEP 2444 H=2444:00 +CPU= 17.185
  19:37:55 STEP 2445 H=2445:00 +CPU= 26.000
  19:38:13 STEP 2446 H=2446:00 +CPU= 17.275
  19:38:31 STEP 2447 H=2447:00 +CPU= 17.399
  19:39:01 STEP 2448 H=2448:00 +CPU= 29.574
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_101.zip
Uploading the intermediate file: upload_file_101.zip
  19:39:18 STEP 2449 H=2449:00 +CPU= 16.562
  19:39:35 STEP 2450 H=2450:00 +CPU= 17.012
  19:40:01 STEP 2451 H=2451:00 +CPU= 25.455
  19:40:19 STEP 2452 H=2452:00 +CPU= 17.424
  19:40:36 STEP 2453 H=2453:00 +CPU= 16.993
  19:41:03 STEP 2454 H=2454:00 +CPU= 26.417
  19:41:20 STEP 2455 H=2455:00 +CPU= 16.635
  19:41:37 STEP 2456 H=2456:00 +CPU= 16.731
  19:42:07 STEP 2457 H=2457:00 +CPU= 25.455
  19:42:25 STEP 2458 H=2458:00 +CPU= 17.220
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2013050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0033
(argv4) batchid: 982
(argv5) wuid: 12198677
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/14
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/14/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/14/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_bc5f1f2701e5e5b74cb0045a67e7935d to: /var/lib/boinc/slots/14/oifs_43r3_ps_0033_2013050100_123_982_12198677.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/14/oifs_43r3_ps_0033_2013050100_123_982_12198677.zip
ic_ancil_file: ic_ancil_12198677
ifsdata_file: ifsdata_12198677
climate_data_file: clim_data_12198677
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_a29e9ed92f022875f2c5b4cf80b11b13 to: /var/lib/boinc/slots/14/ic_ancil_12198677.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/14/ic_ancil_12198677.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_56daeebc2523f9bf7ac1f51bc43336e1 to: /var/lib/boinc/slots/14/ifsdata/ifsdata_12198677.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/14/ifsdata/ifsdata_12198677.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/14/159l_2/clim_data_12198677.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/14/159l_2/clim_data_12198677.zip
Checking for progress XML file: /var/lib/boinc/slots/14/progress_file_12198677.xml
Opened progress file ok : /var/lib/boinc/slots/14/progress_file_12198677.xml
-- Model is restarting --
Adjusting last_iter, 2459, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/14/progress_file_12198677.xml
last_cpu_time: 53038
upload_file_number: 102
last_iter: 2447
last_upload: 8812800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173
The child process has been launched with process id: 18960
Executing the command: /var/lib/boinc/slots/14/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:18960:18960] [20230120:200150:1674244910:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  20:02:21 STEP 2448 H=2448:00 +CPU= 27.946
  20:02:37 STEP 2449 H=2449:00 +CPU= 16.551
  20:02:55 STEP 2450 H=2450:00 +CPU= 17.299
  20:03:20 STEP 2451 H=2451:00 +CPU= 24.799
  20:03:38 STEP 2452 H=2452:00 +CPU= 17.242
  20:03:55 STEP 2453 H=2453:00 +CPU= 16.495
  20:04:20 STEP 2454 H=2454:00 +CPU= 25.222
  20:04:37 STEP 2455 H=2455:00 +CPU= 16.012
  20:04:54 STEP 2456 H=2456:00 +CPU= 17.301
  20:05:19 STEP 2457 H=2457:00 +CPU= 24.520
  20:05:37 STEP 2458 H=2458:00 +CPU= 17.561
  20:05:53 STEP 2459 H=2459:00 +CPU= 16.328
  20:06:21 STEP 2460 H=2460:00 +CPU= 27.048
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002460
  20:06:38 STEP 2461 H=2461:00 +CPU= 16.627
  20:06:55 STEP 2462 H=2462:00 +CPU= 17.072
  20:07:20 STEP 2463 H=2463:00 +CPU= 24.668
  20:07:38 STEP 2464 H=2464:00 +CPU= 17.341
  20:07:55 STEP 2465 H=2465:00 +CPU= 16.986
  20:08:22 STEP 2466 H=2466:00 +CPU= 26.084
  20:08:38 STEP 2467 H=2467:00 +CPU= 16.223
  20:08:55 STEP 2468 H=2468:00 +CPU= 17.071
  20:09:20 STEP 2469 H=2469:00 +CPU= 24.672
  20:09:38 STEP 2470 H=2470:00 +CPU= 17.046
  20:09:55 STEP 2471 H=2471:00 +CPU= 16.909
  20:10:25 STEP 2472 H=2472:00 +CPU= 29.385
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_102.zip
Uploading the intermediate file: upload_file_102.zip
  20:10:42 STEP 2473 H=2473:00 +CPU= 16.385
  20:10:59 STEP 2474 H=2474:00 +CPU= 16.484
  20:11:24 STEP 2475 H=2475:00 +CPU= 24.479
  20:11:41 STEP 2476 H=2476:00 +CPU= 16.455
  20:11:57 STEP 2477 H=2477:00 +CPU= 16.240
  20:12:22 STEP 2478 H=2478:00 +CPU= 25.139
  20:12:39 STEP 2479 H=2479:00 +CPU= 16.243
  20:12:56 STEP 2480 H=2480:00 +CPU= 17.073
  20:13:22 STEP 2481 H=2481:00 +CPU= 25.309
  20:13:40 STEP 2482 H=2482:00 +CPU= 17.482
  20:13:57 STEP 2483 H=2483:00 +CPU= 16.670
  20:14:24 STEP 2484 H=2484:00 +CPU= 27.065
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002484
  20:14:41 STEP 2485 H=2485:00 +CPU= 16.089
  20:14:58 STEP 2486 H=2486:00 +CPU= 16.927
  20:15:23 STEP 2487 H=2487:00 +CPU= 24.837
  20:15:41 STEP 2488 H=2488:00 +CPU= 16.936
  20:15:58 STEP 2489 H=2489:00 +CPU= 17.377
  20:16:24 STEP 2490 H=2490:00 +CPU= 25.306
  20:16:41 STEP 2491 H=2491:00 +CPU= 17.155
  20:16:59 STEP 2492 H=2492:00 +CPU= 17.428
  20:17:25 STEP 2493 H=2493:00 +CPU= 25.071
  20:17:42 STEP 2494 H=2494:00 +CPU= 17.379
  20:18:00 STEP 2495 H=2495:00 +CPU= 17.069
  20:18:30 STEP 2496 H=2496:00 +CPU= 28.877
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_103.zip
Uploading the intermediate file: upload_file_103.zip
  20:18:46 STEP 2497 H=2497:00 +CPU= 16.554
  20:19:04 STEP 2498 H=2498:00 +CPU= 16.906
  20:19:29 STEP 2499 H=2499:00 +CPU= 25.065
  20:19:47 STEP 2500 H=2500:00 +CPU= 17.644
  20:20:05 STEP 2501 H=2501:00 +CPU= 17.155
  20:20:31 STEP 2502 H=2502:00 +CPU= 25.990
  20:20:49 STEP 2503 H=2503:00 +CPU= 17.080
  20:21:06 STEP 2504 H=2504:00 +CPU= 17.094
  20:21:32 STEP 2505 H=2505:00 +CPU= 25.656
  20:21:50 STEP 2506 H=2506:00 +CPU= 17.403
  20:22:07 STEP 2507 H=2507:00 +CPU= 16.332
  20:22:35 STEP 2508 H=2508:00 +CPU= 28.301
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002508
  20:22:52 STEP 2509 H=2509:00 +CPU= 16.772
  20:23:10 STEP 2510 H=2510:00 +CPU= 17.037
  20:23:35 STEP 2511 H=2511:00 +CPU= 24.982
  20:23:53 STEP 2512 H=2512:00 +CPU= 17.461
  20:24:10 STEP 2513 H=2513:00 +CPU= 16.315
  20:24:36 STEP 2514 H=2514:00 +CPU= 25.728
  20:24:53 STEP 2515 H=2515:00 +CPU= 16.604
  20:25:10 STEP 2516 H=2516:00 +CPU= 16.634
  20:25:35 STEP 2517 H=2517:00 +CPU= 25.217
  20:25:53 STEP 2518 H=2518:00 +CPU= 17.073
  20:26:10 STEP 2519 H=2519:00 +CPU= 16.974
  20:26:40 STEP 2520 H=2520:00 +CPU= 29.156
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_104.zip
Uploading the intermediate file: upload_file_104.zip
  20:26:58 STEP 2521 H=2521:00 +CPU= 16.571
  20:27:14 STEP 2522 H=2522:00 +CPU= 16.624
  20:27:40 STEP 2523 H=2523:00 +CPU= 24.741
  20:27:57 STEP 2524 H=2524:00 +CPU= 17.031
  20:28:14 STEP 2525 H=2525:00 +CPU= 16.392
  20:28:41 STEP 2526 H=2526:00 +CPU= 26.276
  20:28:57 STEP 2527 H=2527:00 +CPU= 16.621
  20:29:14 STEP 2528 H=2528:00 +CPU= 16.920
  20:29:40 STEP 2529 H=2529:00 +CPU= 25.410
  20:29:58 STEP 2530 H=2530:00 +CPU= 17.207
  20:30:15 STEP 2531 H=2531:00 +CPU= 16.488
  20:30:43 STEP 2532 H=2532:00 +CPU= 28.416
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002532
  20:31:01 STEP 2533 H=2533:00 +CPU= 16.786
  20:31:18 STEP 2534 H=2534:00 +CPU= 16.861
  20:31:43 STEP 2535 H=2535:00 +CPU= 25.132
  20:32:01 STEP 2536 H=2536:00 +CPU= 17.812
  20:32:18 STEP 2537 H=2537:00 +CPU= 16.693
  20:32:44 STEP 2538 H=2538:00 +CPU= 25.715
  20:33:01 STEP 2539 H=2539:00 +CPU= 16.710
  20:33:19 STEP 2540 H=2540:00 +CPU= 17.187
  20:33:45 STEP 2541 H=2541:00 +CPU= 25.547
  20:34:02 STEP 2542 H=2542:00 +CPU= 17.280
  20:34:20 STEP 2543 H=2543:00 +CPU= 17.286
  20:34:50 STEP 2544 H=2544:00 +CPU= 29.784
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_105.zip
Uploading the intermediate file: upload_file_105.zip
  20:35:08 STEP 2545 H=2545:00 +CPU= 16.908
  20:35:25 STEP 2546 H=2546:00 +CPU= 17.029
  20:35:51 STEP 2547 H=2547:00 +CPU= 25.422
  20:36:09 STEP 2548 H=2548:00 +CPU= 17.240
  20:36:25 STEP 2549 H=2549:00 +CPU= 16.239
  20:36:51 STEP 2550 H=2550:00 +CPU= 25.800
  20:37:08 STEP 2551 H=2551:00 +CPU= 16.268
  20:37:25 STEP 2552 H=2552:00 +CPU= 16.907
  20:37:51 STEP 2553 H=2553:00 +CPU= 25.094
  20:38:08 STEP 2554 H=2554:00 +CPU= 17.052
  20:38:25 STEP 2555 H=2555:00 +CPU= 16.278
  20:38:53 STEP 2556 H=2556:00 +CPU= 27.910
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002556
  20:39:10 STEP 2557 H=2557:00 +CPU= 16.910
  20:39:28 STEP 2558 H=2558:00 +CPU= 17.167
  20:39:52 STEP 2559 H=2559:00 +CPU= 24.416
  20:40:10 STEP 2560 H=2560:00 +CPU= 17.170
  20:40:27 STEP 2561 H=2561:00 +CPU= 16.569
  20:40:53 STEP 2562 H=2562:00 +CPU= 25.218
  20:41:09 STEP 2563 H=2563:00 +CPU= 16.304
  20:41:27 STEP 2564 H=2564:00 +CPU= 17.380
  20:41:53 STEP 2565 H=2565:00 +CPU= 25.651
  20:42:10 STEP 2566 H=2566:00 +CPU= 16.850
  20:42:27 STEP 2567 H=2567:00 +CPU= 16.882
  20:42:58 STEP 2568 H=2568:00 +CPU= 30.037
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_106.zip
Uploading the intermediate file: upload_file_106.zip
  20:43:15 STEP 2569 H=2569:00 +CPU= 16.959
  20:43:33 STEP 2570 H=2570:00 +CPU= 17.114
  20:43:58 STEP 2571 H=2571:00 +CPU= 25.115
  20:44:15 STEP 2572 H=2572:00 +CPU= 16.662
  20:44:32 STEP 2573 H=2573:00 +CPU= 16.162
  20:44:58 STEP 2574 H=2574:00 +CPU= 25.480
  20:45:15 STEP 2575 H=2575:00 +CPU= 16.860
  20:45:32 STEP 2576 H=2576:00 +CPU= 16.874
  20:45:58 STEP 2577 H=2577:00 +CPU= 25.562
  20:46:15 STEP 2578 H=2578:00 +CPU= 17.112
  20:46:32 STEP 2579 H=2579:00 +CPU= 16.422
  20:47:00 STEP 2580 H=2580:00 +CPU= 27.700
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002580
  20:47:17 STEP 2581 H=2581:00 +CPU= 16.402
  20:47:34 STEP 2582 H=2582:00 +CPU= 16.614
  20:48:00 STEP 2583 H=2583:00 +CPU= 25.475
  20:48:17 STEP 2584 H=2584:00 +CPU= 16.744
  20:48:33 STEP 2585 H=2585:00 +CPU= 16.242
  20:49:00 STEP 2586 H=2586:00 +CPU= 26.050
  20:49:16 STEP 2587 H=2587:00 +CPU= 16.262
  20:49:33 STEP 2588 H=2588:00 +CPU= 16.563
  20:49:58 STEP 2589 H=2589:00 +CPU= 24.894
  20:50:16 STEP 2590 H=2590:00 +CPU= 17.479
  20:50:33 STEP 2591 H=2591:00 +CPU= 16.631
  20:51:03 STEP 2592 H=2592:00 +CPU= 29.357
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_107.zip
Uploading the intermediate file: upload_file_107.zip
  20:51:20 STEP 2593 H=2593:00 +CPU= 16.560
  20:51:37 STEP 2594 H=2594:00 +CPU= 16.275
  20:52:02 STEP 2595 H=2595:00 +CPU= 24.872
  20:52:20 STEP 2596 H=2596:00 +CPU= 17.137
  20:52:36 STEP 2597 H=2597:00 +CPU= 16.377
  20:53:03 STEP 2598 H=2598:00 +CPU= 26.094
  20:53:19 STEP 2599 H=2599:00 +CPU= 16.044
  20:53:36 STEP 2600 H=2600:00 +CPU= 16.746
  20:54:02 STEP 2601 H=2601:00 +CPU= 25.625
  20:54:19 STEP 2602 H=2602:00 +CPU= 16.773
  20:54:36 STEP 2603 H=2603:00 +CPU= 16.568
  20:55:05 STEP 2604 H=2604:00 +CPU= 28.184
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002604
  20:55:22 STEP 2605 H=2605:00 +CPU= 16.712
  20:55:39 STEP 2606 H=2606:00 +CPU= 16.911
  20:56:05 STEP 2607 H=2607:00 +CPU= 24.936
  20:56:22 STEP 2608 H=2608:00 +CPU= 16.698
  20:56:38 STEP 2609 H=2609:00 +CPU= 16.208
  20:57:04 STEP 2610 H=2610:00 +CPU= 25.401
  20:57:21 STEP 2611 H=2611:00 +CPU= 16.510
  20:57:38 STEP 2612 H=2612:00 +CPU= 16.451
  20:58:03 STEP 2613 H=2613:00 +CPU= 24.552
  20:58:21 STEP 2614 H=2614:00 +CPU= 17.350
  20:58:37 STEP 2615 H=2615:00 +CPU= 16.717
  20:59:08 STEP 2616 H=2616:00 +CPU= 29.538
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_108.zip
Uploading the intermediate file: upload_file_108.zip
  20:59:24 STEP 2617 H=2617:00 +CPU= 15.981
  20:59:41 STEP 2618 H=2618:00 +CPU= 16.821
  21:00:06 STEP 2619 H=2619:00 +CPU= 24.876
  21:00:24 STEP 2620 H=2620:00 +CPU= 17.267
  21:00:41 STEP 2621 H=2621:00 +CPU= 16.373
  21:01:06 STEP 2622 H=2622:00 +CPU= 25.496
  21:01:23 STEP 2623 H=2623:00 +CPU= 16.571
  21:01:40 STEP 2624 H=2624:00 +CPU= 16.709
  21:02:05 STEP 2625 H=2625:00 +CPU= 24.779
  21:02:23 STEP 2626 H=2626:00 +CPU= 17.079
  21:02:40 STEP 2627 H=2627:00 +CPU= 16.791
  21:03:08 STEP 2628 H=2628:00 +CPU= 27.698
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002628
  21:03:25 STEP 2629 H=2629:00 +CPU= 17.085
  21:03:42 STEP 2630 H=2630:00 +CPU= 16.337
  21:04:08 STEP 2631 H=2631:00 +CPU= 25.180
  21:04:25 STEP 2632 H=2632:00 +CPU= 16.968
  21:04:41 STEP 2633 H=2633:00 +CPU= 16.147
  21:05:07 STEP 2634 H=2634:00 +CPU= 25.537
  21:05:24 STEP 2635 H=2635:00 +CPU= 16.747
  21:05:42 STEP 2636 H=2636:00 +CPU= 17.608
  21:06:08 STEP 2637 H=2637:00 +CPU= 24.910
  21:06:25 STEP 2638 H=2638:00 +CPU= 16.655
  21:06:42 STEP 2639 H=2639:00 +CPU= 16.765
  21:07:11 STEP 2640 H=2640:00 +CPU= 28.955
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_109.zip
Uploading the intermediate file: upload_file_109.zip
  21:07:27 STEP 2641 H=2641:00 +CPU= 15.616
  21:07:45 STEP 2642 H=2642:00 +CPU= 16.974
  21:08:10 STEP 2643 H=2643:00 +CPU= 25.311
  21:08:27 STEP 2644 H=2644:00 +CPU= 16.094
  21:08:43 STEP 2645 H=2645:00 +CPU= 16.193
  21:09:09 STEP 2646 H=2646:00 +CPU= 24.965
  21:09:24 STEP 2647 H=2647:00 +CPU= 15.494
  21:09:41 STEP 2648 H=2648:00 +CPU= 16.449
  21:10:07 STEP 2649 H=2649:00 +CPU= 25.018
  21:10:23 STEP 2650 H=2650:00 +CPU= 16.372
  21:10:40 STEP 2651 H=2651:00 +CPU= 16.156
  21:11:07 STEP 2652 H=2652:00 +CPU= 27.045
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002652
  21:11:24 STEP 2653 H=2653:00 +CPU= 16.582
  21:11:41 STEP 2654 H=2654:00 +CPU= 16.655
  21:12:05 STEP 2655 H=2655:00 +CPU= 24.497
  21:12:23 STEP 2656 H=2656:00 +CPU= 16.936
  21:12:39 STEP 2657 H=2657:00 +CPU= 16.206
  21:13:05 STEP 2658 H=2658:00 +CPU= 25.581
  21:13:23 STEP 2659 H=2659:00 +CPU= 16.872
  21:13:40 STEP 2660 H=2660:00 +CPU= 16.736
  21:14:04 STEP 2661 H=2661:00 +CPU= 24.422
  21:14:21 STEP 2662 H=2662:00 +CPU= 16.354
  21:14:37 STEP 2663 H=2663:00 +CPU= 16.104
  21:15:07 STEP 2664 H=2664:00 +CPU= 28.914
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_110.zip
Uploading the intermediate file: upload_file_110.zip
  21:15:24 STEP 2665 H=2665:00 +CPU= 16.086
  21:15:41 STEP 2666 H=2666:00 +CPU= 16.452
  21:16:05 STEP 2667 H=2667:00 +CPU= 24.246
  21:16:23 STEP 2668 H=2668:00 +CPU= 16.956
  21:16:39 STEP 2669 H=2669:00 +CPU= 16.228
  21:17:05 STEP 2670 H=2670:00 +CPU= 25.437
  21:17:22 STEP 2671 H=2671:00 +CPU= 16.640
  21:17:38 STEP 2672 H=2672:00 +CPU= 16.532
  21:18:04 STEP 2673 H=2673:00 +CPU= 24.917
  21:18:20 STEP 2674 H=2674:00 +CPU= 16.386
  21:18:37 STEP 2675 H=2675:00 +CPU= 15.740
  21:19:05 STEP 2676 H=2676:00 +CPU= 27.660
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002676
  21:19:21 STEP 2677 H=2677:00 +CPU= 15.627
  21:19:38 STEP 2678 H=2678:00 +CPU= 16.736
  21:20:03 STEP 2679 H=2679:00 +CPU= 25.245
  21:20:20 STEP 2680 H=2680:00 +CPU= 16.350
  21:20:37 STEP 2681 H=2681:00 +CPU= 16.252
  21:21:02 STEP 2682 H=2682:00 +CPU= 25.129
  21:21:18 STEP 2683 H=2683:00 +CPU= 15.891
  21:21:35 STEP 2684 H=2684:00 +CPU= 16.516
  21:22:00 STEP 2685 H=2685:00 +CPU= 24.149
  21:22:17 STEP 2686 H=2686:00 +CPU= 16.886
  21:22:33 STEP 2687 H=2687:00 +CPU= 16.153
  21:23:03 STEP 2688 H=2688:00 +CPU= 28.458
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_111.zip
Uploading the intermediate file: upload_file_111.zip
  21:23:19 STEP 2689 H=2689:00 +CPU= 16.223
Uploading trickle at timestep: 9676800
  21:23:37 STEP 2690 H=2690:00 +CPU= 16.844
  21:24:02 STEP 2691 H=2691:00 +CPU= 25.022
  21:24:19 STEP 2692 H=2692:00 +CPU= 16.258
  21:24:35 STEP 2693 H=2693:00 +CPU= 15.942
  21:25:01 STEP 2694 H=2694:00 +CPU= 25.455
  21:25:17 STEP 2695 H=2695:00 +CPU= 15.901
  21:25:34 STEP 2696 H=2696:00 +CPU= 16.517
  21:25:59 STEP 2697 H=2697:00 +CPU= 25.069
  21:26:16 STEP 2698 H=2698:00 +CPU= 16.513
  21:26:32 STEP 2699 H=2699:00 +CPU= 15.806
  21:27:00 STEP 2700 H=2700:00 +CPU= 27.200
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002700
  21:27:16 STEP 2701 H=2701:00 +CPU= 15.755
  21:27:32 STEP 2702 H=2702:00 +CPU= 16.017
  21:27:57 STEP 2703 H=2703:00 +CPU= 24.862
  21:28:14 STEP 2704 H=2704:00 +CPU= 16.493
  21:28:30 STEP 2705 H=2705:00 +CPU= 15.811
  21:28:56 STEP 2706 H=2706:00 +CPU= 25.412
  21:29:12 STEP 2707 H=2707:00 +CPU= 15.817
  21:29:29 STEP 2708 H=2708:00 +CPU= 16.286
  21:29:54 STEP 2709 H=2709:00 +CPU= 24.465
  21:30:11 STEP 2710 H=2710:00 +CPU= 16.520
  21:30:27 STEP 2711 H=2711:00 +CPU= 16.577
  21:30:57 STEP 2712 H=2712:00 +CPU= 29.159
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_112.zip
Uploading the intermediate file: upload_file_112.zip
  21:31:14 STEP 2713 H=2713:00 +CPU= 16.123
  21:31:30 STEP 2714 H=2714:00 +CPU= 15.985
  21:31:55 STEP 2715 H=2715:00 +CPU= 24.431
  21:32:12 STEP 2716 H=2716:00 +CPU= 16.217
  21:32:27 STEP 2717 H=2717:00 +CPU= 15.344
  21:32:53 STEP 2718 H=2718:00 +CPU= 24.947
  21:33:09 STEP 2719 H=2719:00 +CPU= 16.246
  21:33:26 STEP 2720 H=2720:00 +CPU= 16.474
  21:33:52 STEP 2721 H=2721:00 +CPU= 25.124
  21:34:08 STEP 2722 H=2722:00 +CPU= 16.222
  21:34:24 STEP 2723 H=2723:00 +CPU= 15.909
  21:34:53 STEP 2724 H=2724:00 +CPU= 27.784
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002724
  21:35:09 STEP 2725 H=2725:00 +CPU= 15.924
  21:35:26 STEP 2726 H=2726:00 +CPU= 16.554
  21:35:50 STEP 2727 H=2727:00 +CPU= 24.351
  21:36:07 STEP 2728 H=2728:00 +CPU= 16.589
  21:36:24 STEP 2729 H=2729:00 +CPU= 16.204
  21:36:50 STEP 2730 H=2730:00 +CPU= 25.519
  21:37:06 STEP 2731 H=2731:00 +CPU= 16.128
  21:37:23 STEP 2732 H=2732:00 +CPU= 16.315
  21:37:48 STEP 2733 H=2733:00 +CPU= 24.448
  21:38:05 STEP 2734 H=2734:00 +CPU= 16.973
  21:38:22 STEP 2735 H=2735:00 +CPU= 16.795
  21:38:52 STEP 2736 H=2736:00 +CPU= 29.232
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_113.zip
Uploading the intermediate file: upload_file_113.zip
  21:39:08 STEP 2737 H=2737:00 +CPU= 16.166
  21:39:25 STEP 2738 H=2738:00 +CPU= 16.277
  21:39:50 STEP 2739 H=2739:00 +CPU= 24.826
  21:40:07 STEP 2740 H=2740:00 +CPU= 16.419
  21:40:23 STEP 2741 H=2741:00 +CPU= 15.708
  21:40:48 STEP 2742 H=2742:00 +CPU= 25.015
  21:41:05 STEP 2743 H=2743:00 +CPU= 16.212
  21:41:21 STEP 2744 H=2744:00 +CPU= 16.131
  21:41:46 STEP 2745 H=2745:00 +CPU= 24.790
  21:42:03 STEP 2746 H=2746:00 +CPU= 16.719
  21:42:19 STEP 2747 H=2747:00 +CPU= 15.903
  21:42:47 STEP 2748 H=2748:00 +CPU= 27.579
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002748
  21:43:04 STEP 2749 H=2749:00 +CPU= 15.965
  21:43:20 STEP 2750 H=2750:00 +CPU= 16.414
  21:43:46 STEP 2751 H=2751:00 +CPU= 24.557
  21:44:03 STEP 2752 H=2752:00 +CPU= 16.968
  21:44:19 STEP 2753 H=2753:00 +CPU= 15.849
  21:44:45 STEP 2754 H=2754:00 +CPU= 25.848
  21:45:02 STEP 2755 H=2755:00 +CPU= 16.490
  21:45:19 STEP 2756 H=2756:00 +CPU= 16.439
  21:45:44 STEP 2757 H=2757:00 +CPU= 24.764
  21:46:01 STEP 2758 H=2758:00 +CPU= 16.732
  21:46:18 STEP 2759 H=2759:00 +CPU= 16.323
  21:46:48 STEP 2760 H=2760:00 +CPU= 29.353
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_114.zip
Uploading the intermediate file: upload_file_114.zip
  21:47:04 STEP 2761 H=2761:00 +CPU= 15.873
  21:47:21 STEP 2762 H=2762:00 +CPU= 17.070
  21:47:47 STEP 2763 H=2763:00 +CPU= 25.400
  21:48:05 STEP 2764 H=2764:00 +CPU= 17.129
  21:48:21 STEP 2765 H=2765:00 +CPU= 15.936
  21:48:48 STEP 2766 H=2766:00 +CPU= 26.225
  21:49:04 STEP 2767 H=2767:00 +CPU= 15.903
  21:49:21 STEP 2768 H=2768:00 +CPU= 16.423
  21:49:46 STEP 2769 H=2769:00 +CPU= 24.836
  21:50:03 STEP 2770 H=2770:00 +CPU= 16.415
  21:50:20 STEP 2771 H=2771:00 +CPU= 16.541
  21:50:49 STEP 2772 H=2772:00 +CPU= 28.637
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002772
  21:51:05 STEP 2773 H=2773:00 +CPU= 16.085
  21:51:22 STEP 2774 H=2774:00 +CPU= 16.709
  21:51:48 STEP 2775 H=2775:00 +CPU= 25.156
  21:52:04 STEP 2776 H=2776:00 +CPU= 16.283
  21:52:20 STEP 2777 H=2777:00 +CPU= 15.594
  21:52:46 STEP 2778 H=2778:00 +CPU= 25.697
  21:53:02 STEP 2779 H=2779:00 +CPU= 15.689
  21:53:19 STEP 2780 H=2780:00 +CPU= 16.443
  21:53:45 STEP 2781 H=2781:00 +CPU= 25.596
  21:54:02 STEP 2782 H=2782:00 +CPU= 16.150
  21:54:19 STEP 2783 H=2783:00 +CPU= 16.835
  21:54:49 STEP 2784 H=2784:00 +CPU= 29.753
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_115.zip
Uploading the intermediate file: upload_file_115.zip
  21:55:06 STEP 2785 H=2785:00 +CPU= 16.046
  21:55:23 STEP 2786 H=2786:00 +CPU= 16.515
  21:55:49 STEP 2787 H=2787:00 +CPU= 25.684
  21:56:05 STEP 2788 H=2788:00 +CPU= 16.460
  21:56:22 STEP 2789 H=2789:00 +CPU= 15.927
  21:56:48 STEP 2790 H=2790:00 +CPU= 25.685
  21:57:05 STEP 2791 H=2791:00 +CPU= 16.771
  21:57:21 STEP 2792 H=2792:00 +CPU= 16.190
  21:57:47 STEP 2793 H=2793:00 +CPU= 25.321
  21:58:03 STEP 2794 H=2794:00 +CPU= 16.225
  21:58:20 STEP 2795 H=2795:00 +CPU= 16.113
  21:58:48 STEP 2796 H=2796:00 +CPU= 27.483
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002796
  21:59:05 STEP 2797 H=2797:00 +CPU= 16.874
  21:59:22 STEP 2798 H=2798:00 +CPU= 16.713
  21:59:48 STEP 2799 H=2799:00 +CPU= 25.516
  22:00:04 STEP 2800 H=2800:00 +CPU= 16.091
  22:00:21 STEP 2801 H=2801:00 +CPU= 16.302
  22:00:47 STEP 2802 H=2802:00 +CPU= 25.514
  22:01:03 STEP 2803 H=2803:00 +CPU= 16.134
  22:01:20 STEP 2804 H=2804:00 +CPU= 16.367
  22:01:46 STEP 2805 H=2805:00 +CPU= 25.619
  22:02:03 STEP 2806 H=2806:00 +CPU= 16.400
  22:02:20 STEP 2807 H=2807:00 +CPU= 16.422
  22:02:49 STEP 2808 H=2808:00 +CPU= 28.682
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_116.zip
Uploading the intermediate file: upload_file_116.zip
  22:03:05 STEP 2809 H=2809:00 +CPU= 15.936
  22:03:22 STEP 2810 H=2810:00 +CPU= 16.623
  22:03:47 STEP 2811 H=2811:00 +CPU= 24.545
  22:04:04 STEP 2812 H=2812:00 +CPU= 16.529
  22:04:21 STEP 2813 H=2813:00 +CPU= 16.056
  22:04:47 STEP 2814 H=2814:00 +CPU= 25.375
  22:05:03 STEP 2815 H=2815:00 +CPU= 16.146
  22:05:21 STEP 2816 H=2816:00 +CPU= 17.096
  22:05:46 STEP 2817 H=2817:00 +CPU= 25.241
  22:06:03 STEP 2818 H=2818:00 +CPU= 16.545
  22:06:20 STEP 2819 H=2819:00 +CPU= 16.803
  22:06:49 STEP 2820 H=2820:00 +CPU= 27.777
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002820
  22:07:05 STEP 2821 H=2821:00 +CPU= 15.856
  22:07:23 STEP 2822 H=2822:00 +CPU= 17.498
  22:07:48 STEP 2823 H=2823:00 +CPU= 25.296
  22:08:05 STEP 2824 H=2824:00 +CPU= 16.876
  22:08:22 STEP 2825 H=2825:00 +CPU= 16.086
  22:08:47 STEP 2826 H=2826:00 +CPU= 25.267
  22:09:04 STEP 2827 H=2827:00 +CPU= 16.473
  22:09:22 STEP 2828 H=2828:00 +CPU= 17.014
  22:09:46 STEP 2829 H=2829:00 +CPU= 24.487
  22:10:03 STEP 2830 H=2830:00 +CPU= 16.512
  22:10:20 STEP 2831 H=2831:00 +CPU= 16.402
  22:10:50 STEP 2832 H=2832:00 +CPU= 29.409
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_117.zip
Uploading the intermediate file: upload_file_117.zip
  22:11:07 STEP 2833 H=2833:00 +CPU= 16.198
  22:11:24 STEP 2834 H=2834:00 +CPU= 16.908
  22:11:49 STEP 2835 H=2835:00 +CPU= 24.493
  22:12:06 STEP 2836 H=2836:00 +CPU= 16.769
  22:12:23 STEP 2837 H=2837:00 +CPU= 16.243
  22:12:48 STEP 2838 H=2838:00 +CPU= 25.010
  22:13:05 STEP 2839 H=2839:00 +CPU= 16.278
  22:13:21 STEP 2840 H=2840:00 +CPU= 16.680
  22:13:46 STEP 2841 H=2841:00 +CPU= 24.649
  22:14:03 STEP 2842 H=2842:00 +CPU= 16.710
  22:14:20 STEP 2843 H=2843:00 +CPU= 16.348
  22:14:48 STEP 2844 H=2844:00 +CPU= 27.547
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002844
  22:15:05 STEP 2845 H=2845:00 +CPU= 16.237
  22:15:21 STEP 2846 H=2846:00 +CPU= 16.197
  22:15:47 STEP 2847 H=2847:00 +CPU= 25.285
  22:16:04 STEP 2848 H=2848:00 +CPU= 16.653
  22:16:21 STEP 2849 H=2849:00 +CPU= 16.503
  22:16:46 STEP 2850 H=2850:00 +CPU= 25.319
  22:17:04 STEP 2851 H=2851:00 +CPU= 16.901
  22:17:21 STEP 2852 H=2852:00 +CPU= 16.797
  22:17:46 STEP 2853 H=2853:00 +CPU= 24.476
  22:18:03 STEP 2854 H=2854:00 +CPU= 16.763
  22:18:20 STEP 2855 H=2855:00 +CPU= 16.986
  22:18:49 STEP 2856 H=2856:00 +CPU= 28.768
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_118.zip
Uploading the intermediate file: upload_file_118.zip
  22:19:05 STEP 2857 H=2857:00 +CPU= 15.764
  22:19:23 STEP 2858 H=2858:00 +CPU= 16.372
  22:19:48 STEP 2859 H=2859:00 +CPU= 24.901
  22:20:05 STEP 2860 H=2860:00 +CPU= 16.599
  22:20:22 STEP 2861 H=2861:00 +CPU= 16.480
  22:20:48 STEP 2862 H=2862:00 +CPU= 25.771
  22:21:05 STEP 2863 H=2863:00 +CPU= 16.365
  22:21:22 STEP 2864 H=2864:00 +CPU= 16.583
  22:21:47 STEP 2865 H=2865:00 +CPU= 24.809
  22:22:04 STEP 2866 H=2866:00 +CPU= 16.359
  22:22:21 STEP 2867 H=2867:00 +CPU= 16.572
  22:22:49 STEP 2868 H=2868:00 +CPU= 27.210
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002868
  22:23:05 STEP 2869 H=2869:00 +CPU= 16.295
  22:23:22 STEP 2870 H=2870:00 +CPU= 16.379
  22:23:48 STEP 2871 H=2871:00 +CPU= 25.215
  22:24:05 STEP 2872 H=2872:00 +CPU= 17.075
  22:24:21 STEP 2873 H=2873:00 +CPU= 16.116
  22:24:47 STEP 2874 H=2874:00 +CPU= 25.339
  22:25:04 STEP 2875 H=2875:00 +CPU= 16.201
  22:25:21 STEP 2876 H=2876:00 +CPU= 16.506
  22:25:46 STEP 2877 H=2877:00 +CPU= 24.988
  22:26:03 STEP 2878 H=2878:00 +CPU= 16.787
  22:26:20 STEP 2879 H=2879:00 +CPU= 16.366
  22:26:49 STEP 2880 H=2880:00 +CPU= 29.330
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_119.zip
Uploading the intermediate file: upload_file_119.zip
  22:27:06 STEP 2881 H=2881:00 +CPU= 16.219
  22:27:24 STEP 2882 H=2882:00 +CPU= 17.484
  22:27:50 STEP 2883 H=2883:00 +CPU= 24.925
  22:28:07 STEP 2884 H=2884:00 +CPU= 16.730
  22:28:23 STEP 2885 H=2885:00 +CPU= 15.758
  22:28:49 STEP 2886 H=2886:00 +CPU= 25.378
  22:29:05 STEP 2887 H=2887:00 +CPU= 16.221
  22:29:22 STEP 2888 H=2888:00 +CPU= 16.085
  22:29:47 STEP 2889 H=2889:00 +CPU= 25.239
  22:30:03 STEP 2890 H=2890:00 +CPU= 16.283
  22:30:21 STEP 2891 H=2891:00 +CPU= 17.050
  22:30:49 STEP 2892 H=2892:00 +CPU= 27.457
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002892
  22:31:05 STEP 2893 H=2893:00 +CPU= 16.077
  22:31:23 STEP 2894 H=2894:00 +CPU= 17.043
  22:31:48 STEP 2895 H=2895:00 +CPU= 24.935
  22:32:05 STEP 2896 H=2896:00 +CPU= 16.597
  22:32:21 STEP 2897 H=2897:00 +CPU= 16.262
  22:32:47 STEP 2898 H=2898:00 +CPU= 24.841
  22:33:03 STEP 2899 H=2899:00 +CPU= 15.976
  22:33:19 STEP 2900 H=2900:00 +CPU= 16.239
  22:33:44 STEP 2901 H=2901:00 +CPU= 24.375
  22:34:01 STEP 2902 H=2902:00 +CPU= 16.673
  22:34:18 STEP 2903 H=2903:00 +CPU= 16.758
  22:34:49 STEP 2904 H=2904:00 +CPU= 29.291
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_120.zip
Uploading the intermediate file: upload_file_120.zip
  22:35:06 STEP 2905 H=2905:00 +CPU= 15.899
  22:35:23 STEP 2906 H=2906:00 +CPU= 16.831
  22:35:50 STEP 2907 H=2907:00 +CPU= 24.750
  22:36:08 STEP 2908 H=2908:00 +CPU= 16.732
  22:36:24 STEP 2909 H=2909:00 +CPU= 15.929
  22:36:51 STEP 2910 H=2910:00 +CPU= 25.631
  22:37:08 STEP 2911 H=2911:00 +CPU= 16.329
  22:37:25 STEP 2912 H=2912:00 +CPU= 16.150
  22:37:50 STEP 2913 H=2913:00 +CPU= 24.892
  22:38:08 STEP 2914 H=2914:00 +CPU= 17.131
  22:38:25 STEP 2915 H=2915:00 +CPU= 16.244
  22:38:53 STEP 2916 H=2916:00 +CPU= 27.848
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002916
  22:39:10 STEP 2917 H=2917:00 +CPU= 16.474
  22:39:27 STEP 2918 H=2918:00 +CPU= 16.354
  22:39:53 STEP 2919 H=2919:00 +CPU= 24.641
  22:40:10 STEP 2920 H=2920:00 +CPU= 16.623
  22:40:26 STEP 2921 H=2921:00 +CPU= 15.816
  22:40:53 STEP 2922 H=2922:00 +CPU= 25.758
  22:41:10 STEP 2923 H=2923:00 +CPU= 16.419
  22:41:27 STEP 2924 H=2924:00 +CPU= 16.550
  22:41:53 STEP 2925 H=2925:00 +CPU= 24.769
  22:42:10 STEP 2926 H=2926:00 +CPU= 16.358
  22:42:28 STEP 2927 H=2927:00 +CPU= 16.968
  22:42:57 STEP 2928 H=2928:00 +CPU= 28.148
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_121.zip
Uploading the intermediate file: upload_file_121.zip
  22:43:12 STEP 2929 H=2929:00 +CPU= 14.774
Uploading trickle at timestep: 10540800
  22:43:28 STEP 2930 H=2930:00 +CPU= 15.247
  22:43:50 STEP 2931 H=2931:00 +CPU= 21.658
  22:44:04 STEP 2932 H=2932:00 +CPU= 13.913
  22:44:18 STEP 2933 H=2933:00 +CPU= 13.396
  22:44:39 STEP 2934 H=2934:00 +CPU= 21.541
  22:44:53 STEP 2935 H=2935:00 +CPU= 13.110
  22:45:07 STEP 2936 H=2936:00 +CPU= 14.180
  22:45:30 STEP 2937 H=2937:00 +CPU= 22.379
  22:45:46 STEP 2938 H=2938:00 +CPU= 15.314
  22:46:02 STEP 2939 H=2939:00 +CPU= 15.154
  22:46:30 STEP 2940 H=2940:00 +CPU= 26.588
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002940
  22:46:47 STEP 2941 H=2941:00 +CPU= 16.240
  22:47:05 STEP 2942 H=2942:00 +CPU= 16.894
  22:47:35 STEP 2943 H=2943:00 +CPU= 26.361
  22:47:57 STEP 2944 H=2944:00 +CPU= 17.711
  22:48:16 STEP 2945 H=2945:00 +CPU= 17.082
  22:48:49 STEP 2946 H=2946:00 +CPU= 27.001
  22:49:08 STEP 2947 H=2947:00 +CPU= 16.876
  22:49:29 STEP 2948 H=2948:00 +CPU= 17.947
  22:50:00 STEP 2949 H=2949:00 +CPU= 26.492
  22:50:21 STEP 2950 H=2950:00 +CPU= 17.535
  22:50:42 STEP 2951 H=2951:00 +CPU= 18.233
  22:51:17 STEP 2952 H=2952:00 +CPU= 30.321
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc/slots/14/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/14/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc/slots/14/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12198677/ICMSHhq0f+002940
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0033_2013050100_123_982_12198677_1_r1912724173_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
22:54:41 (18931): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:32:11 1531398 22300209 oifs_43r3_ps_0033_2013050100_123_982_12198677_1 10,623,600 62,973 0.0059
09 May 2023 16:32:11 1531398 22300209 oifs_43r3_ps_0033_2013050100_123_982_12198677_1 10,540,800 62,517 0.0059
09 May 2023 16:31:48 1531398 22300209 oifs_43r3_ps_0033_2013050100_123_982_12198677_1 9,676,800 57,822 0.0060
09 May 2023 16:31:16 1531398 22300209 oifs_43r3_ps_0033_2013050100_123_982_12198677_1 7,776,000 46,921 0.0060
09 May 2023 16:31:10 1531398 22300209 oifs_43r3_ps_0033_2013050100_123_982_12198677_1 6,912,000 41,720 0.0060
09 May 2023 16:31:05 1531398 22300209 oifs_43r3_ps_0033_2013050100_123_982_12198677_1 6,048,000 36,343 0.0060
09 May 2023 16:30:54 1531398 22300209 oifs_43r3_ps_0033_2013050100_123_982_12198677_1 5,184,000 30,981 0.0060
09 May 2023 16:30:48 1531398 22300209 oifs_43r3_ps_0033_2013050100_123_982_12198677_1 4,320,000 25,557 0.0059
09 May 2023 16:30:36 1531398 22300209 oifs_43r3_ps_0033_2013050100_123_982_12198677_1 3,456,000 19,819 0.0057
09 May 2023 16:30:24 1531398 22300209 oifs_43r3_ps_0033_2013050100_123_982_12198677_1 2,592,000 14,214 0.0055
09 May 2023 16:30:18 1531398 22300209 oifs_43r3_ps_0033_2013050100_123_982_12198677_1 1,728,000 9,775 0.0057
09 May 2023 16:30:11 1531398 22300209 oifs_43r3_ps_0033_2013050100_123_982_12198677_1 864,000 5,307 0.0061


©2024 climateprediction.net