climateprediction.net home page
Task 22267364

Task 22267364

Name oifs_43r3_ps_0629_1996050100_123_965_12182273_0
Workunit 12182273
Created 22 Dec 2022, 11:28:30 UTC
Sent 17 Jan 2023, 0:44:54 UTC
Report deadline 18 Mar 2023, 0:44:54 UTC
Received 26 Jan 2023, 23:57:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1507867
Run time 15 hours 50 min 35 sec
CPU time 15 hours 41 min
Validate state Invalid
Credit 14,873.04
Device peak FLOPS 7.16 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,608.68 MB
Peak swap size 4,978.08 MB
Peak disk usage 2,024.49 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<message>
Process still present 5 min after writing finish file; aborting</message>
<stderr_txt>
CPU= 15.913
  14:43:41 STEP 2418 H=2418:00 +CPU= 25.515
  14:43:55 STEP 2419 H=2419:00 +CPU= 13.901
  14:44:08 STEP 2420 H=2420:00 +CPU= 12.708
  14:44:28 STEP 2421 H=2421:00 +CPU= 20.038
  14:44:41 STEP 2422 H=2422:00 +CPU= 13.127
  14:44:54 STEP 2423 H=2423:00 +CPU= 13.173
  14:45:17 STEP 2424 H=2424:00 +CPU= 22.342
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_100.zip
Uploading the intermediate file: upload_file_100.zip
  14:45:29 STEP 2425 H=2425:00 +CPU= 12.582
  14:45:42 STEP 2426 H=2426:00 +CPU= 13.037
  14:46:02 STEP 2427 H=2427:00 +CPU= 19.744
  14:46:15 STEP 2428 H=2428:00 +CPU= 13.343
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1996050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0629
(argv4) batchid: 965
(argv5) wuid: 12182273
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/8
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_16ca489b8ae5bfe2504ace308461c9d5 to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0629_1996050100_123_965_12182273.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0629_1996050100_123_965_12182273.zip
ic_ancil_file: ic_ancil_12182273
ifsdata_file: ifsdata_12182273
climate_data_file: clim_data_12182273
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_4387845d464a18fd8193f1d4e7c4830f to: /var/lib/boinc-client/slots/8/ic_ancil_12182273.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/8/ic_ancil_12182273.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_03d730c53bb14f405d8c2b07f92c89c7 to: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12182273.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12182273.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/8/159l_2/clim_data_12182273.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/8/159l_2/clim_data_12182273.zip
Checking for progress XML file: /var/lib/boinc-client/slots/8/progress_file_12182273.xml
Opened progress file ok : /var/lib/boinc-client/slots/8/progress_file_12182273.xml
-- Model is restarting --
Adjusting last_iter, 2429, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/8/progress_file_12182273.xml
last_cpu_time: 49055
upload_file_number: 101
last_iter: 2423
last_upload: 8726400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335
The child process has been launched with process id: 269264
Executing the command: /var/lib/boinc-client/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:yaupon:1:1:269264:269264] [20230126:144943:1674766183:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  14:50:05 STEP 2424 H=2424:00 +CPU= 20.464
  14:50:17 STEP 2425 H=2425:00 +CPU= 11.622
  14:50:29 STEP 2426 H=2426:00 +CPU= 11.771
  14:50:47 STEP 2427 H=2427:00 +CPU= 17.853
  14:50:58 STEP 2428 H=2428:00 +CPU= 11.808
  14:51:10 STEP 2429 H=2429:00 +CPU= 11.503
  14:51:28 STEP 2430 H=2430:00 +CPU= 18.293
  14:51:40 STEP 2431 H=2431:00 +CPU= 11.527
  14:51:52 STEP 2432 H=2432:00 +CPU= 11.870
  14:52:10 STEP 2433 H=2433:00 +CPU= 17.948
  14:52:21 STEP 2434 H=2434:00 +CPU= 11.878
  14:52:33 STEP 2435 H=2435:00 +CPU= 11.599
  14:52:53 STEP 2436 H=2436:00 +CPU= 20.046
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002436
  14:53:05 STEP 2437 H=2437:00 +CPU= 11.579
  14:53:17 STEP 2438 H=2438:00 +CPU= 11.905
  14:53:35 STEP 2439 H=2439:00 +CPU= 18.048
  14:53:47 STEP 2440 H=2440:00 +CPU= 11.846
  14:53:58 STEP 2441 H=2441:00 +CPU= 11.550
  14:54:16 STEP 2442 H=2442:00 +CPU= 18.354
  14:54:28 STEP 2443 H=2443:00 +CPU= 11.565
  14:54:40 STEP 2444 H=2444:00 +CPU= 11.825
  14:54:58 STEP 2445 H=2445:00 +CPU= 17.877
  14:55:10 STEP 2446 H=2446:00 +CPU= 11.810
  14:55:21 STEP 2447 H=2447:00 +CPU= 11.821
  14:55:43 STEP 2448 H=2448:00 +CPU= 21.486
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_101.zip
Uploading the intermediate file: upload_file_101.zip
  14:55:55 STEP 2449 H=2449:00 +CPU= 11.426
  14:56:07 STEP 2450 H=2450:00 +CPU= 11.711
  14:56:24 STEP 2451 H=2451:00 +CPU= 17.966
  14:56:36 STEP 2452 H=2452:00 +CPU= 11.805
  14:56:48 STEP 2453 H=2453:00 +CPU= 11.555
  14:57:06 STEP 2454 H=2454:00 +CPU= 18.324
  14:57:18 STEP 2455 H=2455:00 +CPU= 11.521
  14:57:29 STEP 2456 H=2456:00 +CPU= 11.659
  14:57:47 STEP 2457 H=2457:00 +CPU= 17.785
  14:57:59 STEP 2458 H=2458:00 +CPU= 11.558
  14:58:10 STEP 2459 H=2459:00 +CPU= 11.373
  14:58:30 STEP 2460 H=2460:00 +CPU= 20.186
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002460
  14:58:42 STEP 2461 H=2461:00 +CPU= 11.599
  14:58:54 STEP 2462 H=2462:00 +CPU= 11.823
  14:59:12 STEP 2463 H=2463:00 +CPU= 17.988
  14:59:24 STEP 2464 H=2464:00 +CPU= 11.838
  14:59:35 STEP 2465 H=2465:00 +CPU= 11.470
  14:59:53 STEP 2466 H=2466:00 +CPU= 18.237
  15:00:05 STEP 2467 H=2467:00 +CPU= 11.453
  15:00:16 STEP 2468 H=2468:00 +CPU= 11.732
  15:00:34 STEP 2469 H=2469:00 +CPU= 17.898
  15:00:46 STEP 2470 H=2470:00 +CPU= 11.732
  15:00:58 STEP 2471 H=2471:00 +CPU= 11.756
  15:01:20 STEP 2472 H=2472:00 +CPU= 21.427
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_102.zip
Uploading the intermediate file: upload_file_102.zip
  15:01:31 STEP 2473 H=2473:00 +CPU= 11.451
  15:01:43 STEP 2474 H=2474:00 +CPU= 11.730
  15:02:01 STEP 2475 H=2475:00 +CPU= 17.874
  15:02:13 STEP 2476 H=2476:00 +CPU= 11.764
  15:02:24 STEP 2477 H=2477:00 +CPU= 11.448
  15:02:42 STEP 2478 H=2478:00 +CPU= 18.313
  15:02:54 STEP 2479 H=2479:00 +CPU= 11.499
  15:03:06 STEP 2480 H=2480:00 +CPU= 11.775
  15:03:24 STEP 2481 H=2481:00 +CPU= 17.969
  15:03:35 STEP 2482 H=2482:00 +CPU= 11.894
  15:03:47 STEP 2483 H=2483:00 +CPU= 11.579
  15:04:07 STEP 2484 H=2484:00 +CPU= 19.990
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002484
  15:04:18 STEP 2485 H=2485:00 +CPU= 11.406
  15:04:30 STEP 2486 H=2486:00 +CPU= 11.650
  15:04:48 STEP 2487 H=2487:00 +CPU= 17.804
  15:05:00 STEP 2488 H=2488:00 +CPU= 11.624
  15:05:11 STEP 2489 H=2489:00 +CPU= 11.292
  15:05:29 STEP 2490 H=2490:00 +CPU= 18.159
  15:05:40 STEP 2491 H=2491:00 +CPU= 11.347
  15:05:52 STEP 2492 H=2492:00 +CPU= 11.620
  15:06:10 STEP 2493 H=2493:00 +CPU= 17.806
  15:06:22 STEP 2494 H=2494:00 +CPU= 11.778
  15:06:33 STEP 2495 H=2495:00 +CPU= 11.840
  15:06:56 STEP 2496 H=2496:00 +CPU= 21.654
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_103.zip
Uploading the intermediate file: upload_file_103.zip
  15:07:07 STEP 2497 H=2497:00 +CPU= 11.558
  15:07:19 STEP 2498 H=2498:00 +CPU= 11.713
  15:07:37 STEP 2499 H=2499:00 +CPU= 17.833
  15:07:48 STEP 2500 H=2500:00 +CPU= 11.665
  15:08:00 STEP 2501 H=2501:00 +CPU= 11.311
  15:08:18 STEP 2502 H=2502:00 +CPU= 18.091
  15:08:29 STEP 2503 H=2503:00 +CPU= 11.221
  15:08:40 STEP 2504 H=2504:00 +CPU= 11.515
  15:08:58 STEP 2505 H=2505:00 +CPU= 17.692
  15:09:10 STEP 2506 H=2506:00 +CPU= 11.551
  15:09:21 STEP 2507 H=2507:00 +CPU= 11.295
  15:09:41 STEP 2508 H=2508:00 +CPU= 20.013
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002508
  15:09:52 STEP 2509 H=2509:00 +CPU= 11.504
  15:10:04 STEP 2510 H=2510:00 +CPU= 11.819
  15:10:22 STEP 2511 H=2511:00 +CPU= 17.995
  15:10:34 STEP 2512 H=2512:00 +CPU= 11.850
  15:10:46 STEP 2513 H=2513:00 +CPU= 11.446
  15:11:04 STEP 2514 H=2514:00 +CPU= 18.311
  15:11:15 STEP 2515 H=2515:00 +CPU= 11.542
  15:11:27 STEP 2516 H=2516:00 +CPU= 11.776
  15:11:45 STEP 2517 H=2517:00 +CPU= 17.888
  15:11:57 STEP 2518 H=2518:00 +CPU= 11.779
  15:12:09 STEP 2519 H=2519:00 +CPU= 11.781
  15:12:31 STEP 2520 H=2520:00 +CPU= 21.513
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_104.zip
Uploading the intermediate file: upload_file_104.zip
  15:12:42 STEP 2521 H=2521:00 +CPU= 11.422
  15:12:54 STEP 2522 H=2522:00 +CPU= 11.654
  15:13:12 STEP 2523 H=2523:00 +CPU= 17.914
  15:13:23 STEP 2524 H=2524:00 +CPU= 11.744
  15:13:35 STEP 2525 H=2525:00 +CPU= 11.436
  15:13:53 STEP 2526 H=2526:00 +CPU= 18.311
  15:14:05 STEP 2527 H=2527:00 +CPU= 11.471
  15:14:16 STEP 2528 H=2528:00 +CPU= 11.751
double free or corruption (!prev)
  15:14:34 STEP 2529 H=2529:00 +CPU= 17.893
  15:14:46 STEP 2530 H=2530:00 +CPU= 11.750
  15:14:57 STEP 2531 H=2531:00 +CPU= 11.452
  15:15:17 STEP 2532 H=2532:00 +CPU= 19.814
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002532
  15:15:29 STEP 2533 H=2533:00 +CPU= 11.490
  15:15:40 STEP 2534 H=2534:00 +CPU= 11.569
  15:15:58 STEP 2535 H=2535:00 +CPU= 17.710
  15:16:10 STEP 2536 H=2536:00 +CPU= 11.547
  15:16:21 STEP 2537 H=2537:00 +CPU= 11.217
  15:16:39 STEP 2538 H=2538:00 +CPU= 18.034
  15:16:50 STEP 2539 H=2539:00 +CPU= 11.274
  15:17:02 STEP 2540 H=2540:00 +CPU= 11.588
  15:17:19 STEP 2541 H=2541:00 +CPU= 17.775
  15:17:31 STEP 2542 H=2542:00 +CPU= 11.789
  15:17:43 STEP 2543 H=2543:00 +CPU= 11.842
  15:18:05 STEP 2544 H=2544:00 +CPU= 21.574
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_105.zip
Uploading the intermediate file: upload_file_105.zip
  15:18:17 STEP 2545 H=2545:00 +CPU= 11.540
  15:18:28 STEP 2546 H=2546:00 +CPU= 11.704
  15:18:46 STEP 2547 H=2547:00 +CPU= 17.823
  15:18:58 STEP 2548 H=2548:00 +CPU= 11.580
  15:19:09 STEP 2549 H=2549:00 +CPU= 11.246
  15:19:27 STEP 2550 H=2550:00 +CPU= 18.077
  15:19:38 STEP 2551 H=2551:00 +CPU= 11.239
  15:19:50 STEP 2552 H=2552:00 +CPU= 11.525
  15:20:08 STEP 2553 H=2553:00 +CPU= 17.679
  15:20:19 STEP 2554 H=2554:00 +CPU= 11.604
  15:20:31 STEP 2555 H=2555:00 +CPU= 11.437
  15:20:51 STEP 2556 H=2556:00 +CPU= 19.998
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002556
  15:21:02 STEP 2557 H=2557:00 +CPU= 11.522
  15:21:14 STEP 2558 H=2558:00 +CPU= 11.815
  15:21:32 STEP 2559 H=2559:00 +CPU= 17.961
  15:21:44 STEP 2560 H=2560:00 +CPU= 11.853
  15:21:55 STEP 2561 H=2561:00 +CPU= 11.489
  15:22:14 STEP 2562 H=2562:00 +CPU= 18.318
  15:22:25 STEP 2563 H=2563:00 +CPU= 11.517
  15:22:37 STEP 2564 H=2564:00 +CPU= 11.735
  15:22:55 STEP 2565 H=2565:00 +CPU= 17.885
  15:23:07 STEP 2566 H=2566:00 +CPU= 11.783
  15:23:18 STEP 2567 H=2567:00 +CPU= 11.790
  15:23:40 STEP 2568 H=2568:00 +CPU= 21.677
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_106.zip
Uploading the intermediate file: upload_file_106.zip
  15:23:52 STEP 2569 H=2569:00 +CPU= 11.382
  15:24:04 STEP 2570 H=2570:00 +CPU= 11.706
  15:24:21 STEP 2571 H=2571:00 +CPU= 17.808
  15:24:33 STEP 2572 H=2572:00 +CPU= 11.672
  15:24:44 STEP 2573 H=2573:00 +CPU= 11.346
  15:25:03 STEP 2574 H=2574:00 +CPU= 18.189
  15:25:14 STEP 2575 H=2575:00 +CPU= 11.328
  15:25:26 STEP 2576 H=2576:00 +CPU= 11.631
  15:25:43 STEP 2577 H=2577:00 +CPU= 17.781
  15:25:55 STEP 2578 H=2578:00 +CPU= 11.640
  15:26:06 STEP 2579 H=2579:00 +CPU= 11.410
  15:26:26 STEP 2580 H=2580:00 +CPU= 20.120
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002580
  15:26:38 STEP 2581 H=2581:00 +CPU= 11.616
  15:26:50 STEP 2582 H=2582:00 +CPU= 11.882
  15:27:08 STEP 2583 H=2583:00 +CPU= 18.047
  15:27:20 STEP 2584 H=2584:00 +CPU= 11.906
  15:27:31 STEP 2585 H=2585:00 +CPU= 11.549
  15:27:50 STEP 2586 H=2586:00 +CPU= 18.387
  15:28:01 STEP 2587 H=2587:00 +CPU= 11.572
  15:28:13 STEP 2588 H=2588:00 +CPU= 11.799
  15:28:31 STEP 2589 H=2589:00 +CPU= 18.010
  15:28:43 STEP 2590 H=2590:00 +CPU= 11.842
  15:28:55 STEP 2591 H=2591:00 +CPU= 11.845
  15:29:17 STEP 2592 H=2592:00 +CPU= 21.683
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_107.zip
Uploading the intermediate file: upload_file_107.zip
  15:29:29 STEP 2593 H=2593:00 +CPU= 11.493
  15:29:40 STEP 2594 H=2594:00 +CPU= 11.752
  15:29:58 STEP 2595 H=2595:00 +CPU= 17.923
  15:30:10 STEP 2596 H=2596:00 +CPU= 11.618
  15:30:21 STEP 2597 H=2597:00 +CPU= 11.395
  15:30:40 STEP 2598 H=2598:00 +CPU= 18.250
  15:30:51 STEP 2599 H=2599:00 +CPU= 11.431
  15:31:03 STEP 2600 H=2600:00 +CPU= 11.642
  15:31:21 STEP 2601 H=2601:00 +CPU= 17.848
  15:31:32 STEP 2602 H=2602:00 +CPU= 11.665
  15:31:44 STEP 2603 H=2603:00 +CPU= 11.436
  15:32:04 STEP 2604 H=2604:00 +CPU= 20.040
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002604
  15:32:15 STEP 2605 H=2605:00 +CPU= 11.536
  15:32:27 STEP 2606 H=2606:00 +CPU= 11.824
  15:32:45 STEP 2607 H=2607:00 +CPU= 17.988
  15:32:57 STEP 2608 H=2608:00 +CPU= 11.893
  15:33:08 STEP 2609 H=2609:00 +CPU= 11.480
  15:33:27 STEP 2610 H=2610:00 +CPU= 18.395
  15:33:38 STEP 2611 H=2611:00 +CPU= 11.537
  15:33:50 STEP 2612 H=2612:00 +CPU= 11.756
  15:34:08 STEP 2613 H=2613:00 +CPU= 17.929
  15:34:20 STEP 2614 H=2614:00 +CPU= 11.798
  15:34:32 STEP 2615 H=2615:00 +CPU= 11.774
  15:34:54 STEP 2616 H=2616:00 +CPU= 21.690
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_108.zip
Uploading the intermediate file: upload_file_108.zip
  15:35:05 STEP 2617 H=2617:00 +CPU= 11.467
  15:35:17 STEP 2618 H=2618:00 +CPU= 11.798
  15:35:35 STEP 2619 H=2619:00 +CPU= 17.921
  15:35:47 STEP 2620 H=2620:00 +CPU= 11.750
  15:35:58 STEP 2621 H=2621:00 +CPU= 11.506
  15:36:16 STEP 2622 H=2622:00 +CPU= 18.232
  15:36:28 STEP 2623 H=2623:00 +CPU= 11.420
  15:36:39 STEP 2624 H=2624:00 +CPU= 11.645
  15:36:58 STEP 2625 H=2625:00 +CPU= 18.070
  15:37:09 STEP 2626 H=2626:00 +CPU= 11.785
  15:37:21 STEP 2627 H=2627:00 +CPU= 11.573
  15:37:41 STEP 2628 H=2628:00 +CPU= 20.100
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002628
  15:37:53 STEP 2629 H=2629:00 +CPU= 11.629
  15:38:04 STEP 2630 H=2630:00 +CPU= 11.786
  15:38:22 STEP 2631 H=2631:00 +CPU= 17.995
  15:38:34 STEP 2632 H=2632:00 +CPU= 11.904
  15:38:46 STEP 2633 H=2633:00 +CPU= 11.515
  15:39:04 STEP 2634 H=2634:00 +CPU= 18.341
  15:39:16 STEP 2635 H=2635:00 +CPU= 11.582
  15:39:28 STEP 2636 H=2636:00 +CPU= 11.813
  15:39:45 STEP 2637 H=2637:00 +CPU= 17.872
  15:39:57 STEP 2638 H=2638:00 +CPU= 11.792
  15:40:09 STEP 2639 H=2639:00 +CPU= 11.851
  15:40:32 STEP 2640 H=2640:00 +CPU= 21.639
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_109.zip
Uploading the intermediate file: upload_file_109.zip
  15:40:44 STEP 2641 H=2641:00 +CPU= 11.525
  15:40:56 STEP 2642 H=2642:00 +CPU= 11.749
  15:41:13 STEP 2643 H=2643:00 +CPU= 17.933
  15:41:25 STEP 2644 H=2644:00 +CPU= 11.800
  15:41:37 STEP 2645 H=2645:00 +CPU= 11.492
  15:41:55 STEP 2646 H=2646:00 +CPU= 18.361
  15:42:07 STEP 2647 H=2647:00 +CPU= 11.495
  15:42:18 STEP 2648 H=2648:00 +CPU= 11.787
  15:42:36 STEP 2649 H=2649:00 +CPU= 17.962
  15:42:48 STEP 2650 H=2650:00 +CPU= 11.824
  15:43:00 STEP 2651 H=2651:00 +CPU= 11.499
  15:43:20 STEP 2652 H=2652:00 +CPU= 19.899
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002652
  15:43:31 STEP 2653 H=2653:00 +CPU= 11.485
  15:43:43 STEP 2654 H=2654:00 +CPU= 11.686
  15:44:01 STEP 2655 H=2655:00 +CPU= 17.910
  15:44:12 STEP 2656 H=2656:00 +CPU= 11.730
  15:44:24 STEP 2657 H=2657:00 +CPU= 11.428
  15:44:42 STEP 2658 H=2658:00 +CPU= 18.247
  15:44:53 STEP 2659 H=2659:00 +CPU= 11.365
  15:45:05 STEP 2660 H=2660:00 +CPU= 11.646
  15:45:23 STEP 2661 H=2661:00 +CPU= 17.709
  15:45:34 STEP 2662 H=2662:00 +CPU= 11.605
  15:45:46 STEP 2663 H=2663:00 +CPU= 11.690
  15:46:08 STEP 2664 H=2664:00 +CPU= 21.475
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_110.zip
Uploading the intermediate file: upload_file_110.zip
  15:46:20 STEP 2665 H=2665:00 +CPU= 11.496
  15:46:31 STEP 2666 H=2666:00 +CPU= 11.830
Uploading trickle at timestep: 9590400
  15:46:49 STEP 2667 H=2667:00 +CPU= 17.980
  15:47:01 STEP 2668 H=2668:00 +CPU= 11.786
  15:47:13 STEP 2669 H=2669:00 +CPU= 11.485
  15:47:31 STEP 2670 H=2670:00 +CPU= 18.358
  15:47:43 STEP 2671 H=2671:00 +CPU= 11.511
  15:47:54 STEP 2672 H=2672:00 +CPU= 11.868
  15:48:12 STEP 2673 H=2673:00 +CPU= 18.026
  15:48:24 STEP 2674 H=2674:00 +CPU= 11.814
  15:48:36 STEP 2675 H=2675:00 +CPU= 11.594
  15:48:56 STEP 2676 H=2676:00 +CPU= 19.872
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002676
  15:49:07 STEP 2677 H=2677:00 +CPU= 11.527
  15:49:19 STEP 2678 H=2678:00 +CPU= 11.776
  15:49:37 STEP 2679 H=2679:00 +CPU= 17.956
  15:49:49 STEP 2680 H=2680:00 +CPU= 11.870
  15:50:00 STEP 2681 H=2681:00 +CPU= 11.491
  15:50:19 STEP 2682 H=2682:00 +CPU= 18.268
  15:50:30 STEP 2683 H=2683:00 +CPU= 11.477
  15:50:42 STEP 2684 H=2684:00 +CPU= 11.759
  15:51:00 STEP 2685 H=2685:00 +CPU= 17.882
  15:51:12 STEP 2686 H=2686:00 +CPU= 11.754
  15:51:23 STEP 2687 H=2687:00 +CPU= 11.781
  15:51:45 STEP 2688 H=2688:00 +CPU= 21.431
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_111.zip
Uploading the intermediate file: upload_file_111.zip
  15:51:57 STEP 2689 H=2689:00 +CPU= 11.470
  15:52:08 STEP 2690 H=2690:00 +CPU= 11.745
  15:52:26 STEP 2691 H=2691:00 +CPU= 17.964
  15:52:38 STEP 2692 H=2692:00 +CPU= 11.794
  15:52:50 STEP 2693 H=2693:00 +CPU= 11.478
  15:53:08 STEP 2694 H=2694:00 +CPU= 18.443
  15:53:20 STEP 2695 H=2695:00 +CPU= 11.571
  15:53:32 STEP 2696 H=2696:00 +CPU= 11.869
  15:53:50 STEP 2697 H=2697:00 +CPU= 18.080
  15:54:01 STEP 2698 H=2698:00 +CPU= 11.871
  15:54:13 STEP 2699 H=2699:00 +CPU= 11.547
  15:54:33 STEP 2700 H=2700:00 +CPU= 19.966
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002700
  15:54:45 STEP 2701 H=2701:00 +CPU= 11.525
  15:54:56 STEP 2702 H=2702:00 +CPU= 11.769
  15:55:14 STEP 2703 H=2703:00 +CPU= 17.949
  15:55:26 STEP 2704 H=2704:00 +CPU= 11.727
  15:55:37 STEP 2705 H=2705:00 +CPU= 11.459
  15:55:56 STEP 2706 H=2706:00 +CPU= 18.165
  15:56:07 STEP 2707 H=2707:00 +CPU= 11.319
  15:56:19 STEP 2708 H=2708:00 +CPU= 11.655
  15:56:36 STEP 2709 H=2709:00 +CPU= 17.777
  15:56:48 STEP 2710 H=2710:00 +CPU= 11.633
  15:57:00 STEP 2711 H=2711:00 +CPU= 11.719
  15:57:22 STEP 2712 H=2712:00 +CPU= 21.356
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_112.zip
Uploading the intermediate file: upload_file_112.zip
  15:57:33 STEP 2713 H=2713:00 +CPU= 11.441
  15:57:45 STEP 2714 H=2714:00 +CPU= 11.720
  15:58:03 STEP 2715 H=2715:00 +CPU= 17.920
  15:58:14 STEP 2716 H=2716:00 +CPU= 11.782
  15:58:26 STEP 2717 H=2717:00 +CPU= 11.459
  15:58:44 STEP 2718 H=2718:00 +CPU= 18.228
  15:58:56 STEP 2719 H=2719:00 +CPU= 11.497
  15:59:07 STEP 2720 H=2720:00 +CPU= 11.726
  15:59:25 STEP 2721 H=2721:00 +CPU= 17.891
  15:59:37 STEP 2722 H=2722:00 +CPU= 11.683
  15:59:49 STEP 2723 H=2723:00 +CPU= 11.569
  16:00:08 STEP 2724 H=2724:00 +CPU= 19.951
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002724
  16:00:20 STEP 2725 H=2725:00 +CPU= 11.530
  16:00:32 STEP 2726 H=2726:00 +CPU= 11.742
  16:00:50 STEP 2727 H=2727:00 +CPU= 17.889
  16:01:01 STEP 2728 H=2728:00 +CPU= 11.818
  16:01:13 STEP 2729 H=2729:00 +CPU= 11.439
  16:01:31 STEP 2730 H=2730:00 +CPU= 18.264
  16:01:43 STEP 2731 H=2731:00 +CPU= 11.510
  16:01:54 STEP 2732 H=2732:00 +CPU= 11.712
  16:02:12 STEP 2733 H=2733:00 +CPU= 17.876
  16:02:24 STEP 2734 H=2734:00 +CPU= 11.779
  16:02:36 STEP 2735 H=2735:00 +CPU= 11.822
  16:02:58 STEP 2736 H=2736:00 +CPU= 21.513
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_113.zip
Uploading the intermediate file: upload_file_113.zip
  16:03:09 STEP 2737 H=2737:00 +CPU= 11.531
  16:03:21 STEP 2738 H=2738:00 +CPU= 11.712
  16:03:39 STEP 2739 H=2739:00 +CPU= 17.858
  16:03:51 STEP 2740 H=2740:00 +CPU= 11.696
  16:04:02 STEP 2741 H=2741:00 +CPU= 11.402
  16:04:20 STEP 2742 H=2742:00 +CPU= 18.168
  16:04:32 STEP 2743 H=2743:00 +CPU= 11.370
  16:04:43 STEP 2744 H=2744:00 +CPU= 11.660
  16:05:01 STEP 2745 H=2745:00 +CPU= 17.805
  16:05:13 STEP 2746 H=2746:00 +CPU= 11.675
  16:05:24 STEP 2747 H=2747:00 +CPU= 11.424
  16:05:44 STEP 2748 H=2748:00 +CPU= 19.964
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002748
  16:05:56 STEP 2749 H=2749:00 +CPU= 11.535
  16:06:07 STEP 2750 H=2750:00 +CPU= 11.808
  16:06:25 STEP 2751 H=2751:00 +CPU= 17.916
  16:06:37 STEP 2752 H=2752:00 +CPU= 11.830
  16:06:49 STEP 2753 H=2753:00 +CPU= 11.508
  16:07:07 STEP 2754 H=2754:00 +CPU= 18.291
  16:07:19 STEP 2755 H=2755:00 +CPU= 11.528
  16:07:30 STEP 2756 H=2756:00 +CPU= 11.844
  16:07:48 STEP 2757 H=2757:00 +CPU= 17.934
  16:08:00 STEP 2758 H=2758:00 +CPU= 11.802
  16:08:12 STEP 2759 H=2759:00 +CPU= 11.786
  16:08:34 STEP 2760 H=2760:00 +CPU= 21.484
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_114.zip
Uploading the intermediate file: upload_file_114.zip
  16:08:45 STEP 2761 H=2761:00 +CPU= 11.471
  16:08:57 STEP 2762 H=2762:00 +CPU= 11.738
  16:09:15 STEP 2763 H=2763:00 +CPU= 17.959
  16:09:27 STEP 2764 H=2764:00 +CPU= 11.788
  16:09:38 STEP 2765 H=2765:00 +CPU= 11.471
  16:09:56 STEP 2766 H=2766:00 +CPU= 18.351
  16:10:08 STEP 2767 H=2767:00 +CPU= 11.495
  16:10:20 STEP 2768 H=2768:00 +CPU= 11.778
  16:10:38 STEP 2769 H=2769:00 +CPU= 17.988
  16:10:49 STEP 2770 H=2770:00 +CPU= 11.792
  16:11:01 STEP 2771 H=2771:00 +CPU= 11.590
  16:11:21 STEP 2772 H=2772:00 +CPU= 20.076
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002772
  16:11:33 STEP 2773 H=2773:00 +CPU= 11.516
  16:11:44 STEP 2774 H=2774:00 +CPU= 11.744
  16:12:02 STEP 2775 H=2775:00 +CPU= 17.900
  16:12:14 STEP 2776 H=2776:00 +CPU= 11.822
  16:12:26 STEP 2777 H=2777:00 +CPU= 11.468
  16:12:44 STEP 2778 H=2778:00 +CPU= 18.291
  16:12:55 STEP 2779 H=2779:00 +CPU= 11.495
  16:13:07 STEP 2780 H=2780:00 +CPU= 11.718
  16:13:25 STEP 2781 H=2781:00 +CPU= 17.981
  16:13:37 STEP 2782 H=2782:00 +CPU= 11.767
  16:13:49 STEP 2783 H=2783:00 +CPU= 11.855
  16:14:11 STEP 2784 H=2784:00 +CPU= 21.762
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_115.zip
Uploading the intermediate file: upload_file_115.zip
  16:14:23 STEP 2785 H=2785:00 +CPU= 11.497
  16:14:34 STEP 2786 H=2786:00 +CPU= 11.720
  16:14:52 STEP 2787 H=2787:00 +CPU= 17.952
  16:15:04 STEP 2788 H=2788:00 +CPU= 11.874
  16:15:16 STEP 2789 H=2789:00 +CPU= 11.523
  16:15:34 STEP 2790 H=2790:00 +CPU= 18.337
  16:15:46 STEP 2791 H=2791:00 +CPU= 11.566
  16:15:57 STEP 2792 H=2792:00 +CPU= 11.797
  16:16:15 STEP 2793 H=2793:00 +CPU= 17.956
  16:16:27 STEP 2794 H=2794:00 +CPU= 11.778
  16:16:39 STEP 2795 H=2795:00 +CPU= 11.674
  16:16:59 STEP 2796 H=2796:00 +CPU= 19.935
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002796
  16:17:10 STEP 2797 H=2797:00 +CPU= 11.548
  16:17:22 STEP 2798 H=2798:00 +CPU= 11.780
  16:17:40 STEP 2799 H=2799:00 +CPU= 17.987
  16:17:52 STEP 2800 H=2800:00 +CPU= 11.835
  16:18:03 STEP 2801 H=2801:00 +CPU= 11.429
  16:18:22 STEP 2802 H=2802:00 +CPU= 18.275
  16:18:33 STEP 2803 H=2803:00 +CPU= 11.466
  16:18:45 STEP 2804 H=2804:00 +CPU= 11.693
  16:19:03 STEP 2805 H=2805:00 +CPU= 17.870
  16:19:14 STEP 2806 H=2806:00 +CPU= 11.738
  16:19:26 STEP 2807 H=2807:00 +CPU= 11.815
  16:19:48 STEP 2808 H=2808:00 +CPU= 21.620
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_116.zip
Uploading the intermediate file: upload_file_116.zip
  16:20:00 STEP 2809 H=2809:00 +CPU= 11.527
  16:20:12 STEP 2810 H=2810:00 +CPU= 11.703
  16:20:30 STEP 2811 H=2811:00 +CPU= 18.003
  16:20:41 STEP 2812 H=2812:00 +CPU= 11.741
  16:20:53 STEP 2813 H=2813:00 +CPU= 11.473
  16:21:11 STEP 2814 H=2814:00 +CPU= 18.248
  16:21:22 STEP 2815 H=2815:00 +CPU= 11.417
  16:21:34 STEP 2816 H=2816:00 +CPU= 11.697
  16:21:52 STEP 2817 H=2817:00 +CPU= 17.862
  16:22:04 STEP 2818 H=2818:00 +CPU= 11.697
  16:22:15 STEP 2819 H=2819:00 +CPU= 11.464
  16:22:35 STEP 2820 H=2820:00 +CPU= 19.984
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002820
  16:22:47 STEP 2821 H=2821:00 +CPU= 11.498
  16:22:58 STEP 2822 H=2822:00 +CPU= 11.850
  16:23:16 STEP 2823 H=2823:00 +CPU= 17.940
  16:23:28 STEP 2824 H=2824:00 +CPU= 11.817
  16:23:40 STEP 2825 H=2825:00 +CPU= 11.505
  16:23:58 STEP 2826 H=2826:00 +CPU= 18.267
  16:24:10 STEP 2827 H=2827:00 +CPU= 11.531
  16:24:21 STEP 2828 H=2828:00 +CPU= 11.914
  16:24:39 STEP 2829 H=2829:00 +CPU= 17.878
  16:24:51 STEP 2830 H=2830:00 +CPU= 11.735
  16:25:03 STEP 2831 H=2831:00 +CPU= 11.711
  16:25:25 STEP 2832 H=2832:00 +CPU= 21.532
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_117.zip
Uploading the intermediate file: upload_file_117.zip
  16:25:36 STEP 2833 H=2833:00 +CPU= 11.450
  16:25:48 STEP 2834 H=2834:00 +CPU= 11.685
  16:26:06 STEP 2835 H=2835:00 +CPU= 17.837
  16:26:18 STEP 2836 H=2836:00 +CPU= 11.789
  16:26:29 STEP 2837 H=2837:00 +CPU= 11.453
  16:26:47 STEP 2838 H=2838:00 +CPU= 18.288
  16:26:59 STEP 2839 H=2839:00 +CPU= 11.545
  16:27:11 STEP 2840 H=2840:00 +CPU= 11.785
  16:27:28 STEP 2841 H=2841:00 +CPU= 17.887
  16:27:40 STEP 2842 H=2842:00 +CPU= 11.765
  16:27:52 STEP 2843 H=2843:00 +CPU= 11.474
  16:28:12 STEP 2844 H=2844:00 +CPU= 19.939
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002844
  16:28:23 STEP 2845 H=2845:00 +CPU= 11.496
  16:28:35 STEP 2846 H=2846:00 +CPU= 11.787
  16:28:53 STEP 2847 H=2847:00 +CPU= 17.866
  16:29:05 STEP 2848 H=2848:00 +CPU= 11.806
  16:29:16 STEP 2849 H=2849:00 +CPU= 11.497
  16:29:34 STEP 2850 H=2850:00 +CPU= 18.192
  16:29:46 STEP 2851 H=2851:00 +CPU= 11.459
  16:29:58 STEP 2852 H=2852:00 +CPU= 11.859
  16:30:16 STEP 2853 H=2853:00 +CPU= 17.980
  16:30:27 STEP 2854 H=2854:00 +CPU= 11.825
  16:30:39 STEP 2855 H=2855:00 +CPU= 11.769
  16:31:01 STEP 2856 H=2856:00 +CPU= 21.536
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_118.zip
Uploading the intermediate file: upload_file_118.zip
  16:31:13 STEP 2857 H=2857:00 +CPU= 11.463
  16:31:24 STEP 2858 H=2858:00 +CPU= 11.701
  16:31:42 STEP 2859 H=2859:00 +CPU= 17.865
  16:31:54 STEP 2860 H=2860:00 +CPU= 11.802
  16:32:06 STEP 2861 H=2861:00 +CPU= 11.527
  16:32:24 STEP 2862 H=2862:00 +CPU= 18.274
  16:32:35 STEP 2863 H=2863:00 +CPU= 11.517
  16:32:47 STEP 2864 H=2864:00 +CPU= 11.767
  16:33:05 STEP 2865 H=2865:00 +CPU= 17.887
  16:33:17 STEP 2866 H=2866:00 +CPU= 11.808
  16:33:28 STEP 2867 H=2867:00 +CPU= 11.546
  16:33:49 STEP 2868 H=2868:00 +CPU= 20.041
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002868
  16:34:00 STEP 2869 H=2869:00 +CPU= 11.589
  16:34:12 STEP 2870 H=2870:00 +CPU= 11.873
  16:34:30 STEP 2871 H=2871:00 +CPU= 17.908
  16:34:42 STEP 2872 H=2872:00 +CPU= 11.845
  16:34:53 STEP 2873 H=2873:00 +CPU= 11.560
  16:35:12 STEP 2874 H=2874:00 +CPU= 18.323
  16:35:23 STEP 2875 H=2875:00 +CPU= 11.590
  16:35:35 STEP 2876 H=2876:00 +CPU= 11.900
  16:35:53 STEP 2877 H=2877:00 +CPU= 17.945
  16:36:05 STEP 2878 H=2878:00 +CPU= 11.857
  16:36:17 STEP 2879 H=2879:00 +CPU= 11.786
  16:36:39 STEP 2880 H=2880:00 +CPU= 21.527
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_119.zip
Uploading the intermediate file: upload_file_119.zip
  16:36:50 STEP 2881 H=2881:00 +CPU= 11.502
  16:37:02 STEP 2882 H=2882:00 +CPU= 11.697
  16:37:20 STEP 2883 H=2883:00 +CPU= 17.851
  16:37:31 STEP 2884 H=2884:00 +CPU= 11.758
  16:37:43 STEP 2885 H=2885:00 +CPU= 11.365
  16:38:01 STEP 2886 H=2886:00 +CPU= 18.192
  16:38:12 STEP 2887 H=2887:00 +CPU= 11.472
  16:38:24 STEP 2888 H=2888:00 +CPU= 11.674
  16:38:42 STEP 2889 H=2889:00 +CPU= 17.946
  16:38:54 STEP 2890 H=2890:00 +CPU= 11.784
  16:39:05 STEP 2891 H=2891:00 +CPU= 11.465
  16:39:25 STEP 2892 H=2892:00 +CPU= 19.881
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002892
  16:39:37 STEP 2893 H=2893:00 +CPU= 11.553
  16:39:49 STEP 2894 H=2894:00 +CPU= 11.861
  16:40:07 STEP 2895 H=2895:00 +CPU= 18.037
  16:40:19 STEP 2896 H=2896:00 +CPU= 11.946
  16:40:30 STEP 2897 H=2897:00 +CPU= 11.636
  16:40:49 STEP 2898 H=2898:00 +CPU= 18.445
  16:41:00 STEP 2899 H=2899:00 +CPU= 11.614
  16:41:12 STEP 2900 H=2900:00 +CPU= 11.918
  16:41:30 STEP 2901 H=2901:00 +CPU= 17.961
  16:41:42 STEP 2902 H=2902:00 +CPU= 11.849
  16:41:54 STEP 2903 H=2903:00 +CPU= 11.776
  16:42:16 STEP 2904 H=2904:00 +CPU= 21.563
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_120.zip
Uploading the intermediate file: upload_file_120.zip
  16:42:27 STEP 2905 H=2905:00 +CPU= 11.464
  16:42:39 STEP 2906 H=2906:00 +CPU= 11.689
Uploading trickle at timestep: 10454400
  16:42:57 STEP 2907 H=2907:00 +CPU= 17.876
  16:43:09 STEP 2908 H=2908:00 +CPU= 11.812
  16:43:20 STEP 2909 H=2909:00 +CPU= 11.426
  16:43:38 STEP 2910 H=2910:00 +CPU= 18.264
  16:43:50 STEP 2911 H=2911:00 +CPU= 11.547
  16:44:02 STEP 2912 H=2912:00 +CPU= 11.775
  16:44:20 STEP 2913 H=2913:00 +CPU= 18.015
  16:44:32 STEP 2914 H=2914:00 +CPU= 11.888
  16:44:43 STEP 2915 H=2915:00 +CPU= 11.547
  16:45:03 STEP 2916 H=2916:00 +CPU= 20.037
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002916
  16:45:15 STEP 2917 H=2917:00 +CPU= 11.554
  16:45:27 STEP 2918 H=2918:00 +CPU= 11.849
  16:45:45 STEP 2919 H=2919:00 +CPU= 17.874
  16:45:56 STEP 2920 H=2920:00 +CPU= 11.864
  16:46:08 STEP 2921 H=2921:00 +CPU= 11.554
  16:46:26 STEP 2922 H=2922:00 +CPU= 18.278
  16:46:38 STEP 2923 H=2923:00 +CPU= 11.584
  16:46:50 STEP 2924 H=2924:00 +CPU= 11.921
  16:47:08 STEP 2925 H=2925:00 +CPU= 18.146
  16:47:20 STEP 2926 H=2926:00 +CPU= 11.800
  16:47:31 STEP 2927 H=2927:00 +CPU= 11.791
  16:47:53 STEP 2928 H=2928:00 +CPU= 21.603
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_121.zip
Uploading the intermediate file: upload_file_121.zip
  16:48:05 STEP 2929 H=2929:00 +CPU= 11.513
  16:48:17 STEP 2930 H=2930:00 +CPU= 11.745
  16:48:35 STEP 2931 H=2931:00 +CPU= 17.946
  16:48:47 STEP 2932 H=2932:00 +CPU= 11.843
  16:48:58 STEP 2933 H=2933:00 +CPU= 11.470
  16:49:16 STEP 2934 H=2934:00 +CPU= 18.242
  16:49:28 STEP 2935 H=2935:00 +CPU= 11.510
  16:49:40 STEP 2936 H=2936:00 +CPU= 11.780
  16:49:57 STEP 2937 H=2937:00 +CPU= 17.881
  16:50:09 STEP 2938 H=2938:00 +CPU= 11.774
  16:50:21 STEP 2939 H=2939:00 +CPU= 11.531
  16:50:41 STEP 2940 H=2940:00 +CPU= 19.803
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002940
  16:50:51 STEP 2941 H=2941:00 +CPU= 10.906
  16:51:03 STEP 2942 H=2942:00 +CPU= 11.208
  16:51:20 STEP 2943 H=2943:00 +CPU= 17.257
  16:51:31 STEP 2944 H=2944:00 +CPU= 11.246
  16:51:42 STEP 2945 H=2945:00 +CPU= 10.940
  16:52:00 STEP 2946 H=2946:00 +CPU= 17.496
  16:52:11 STEP 2947 H=2947:00 +CPU= 10.936
  16:52:22 STEP 2948 H=2948:00 +CPU= 11.242
  16:52:39 STEP 2949 H=2949:00 +CPU= 17.171
  16:52:50 STEP 2950 H=2950:00 +CPU= 11.160
  16:53:01 STEP 2951 H=2951:00 +CPU= 11.155
  16:53:21 STEP 2952 H=2952:00 +CPU= 19.793
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12182273/ICMSHhq0f+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0629_1996050100_123_965_12182273_0_r1520148335_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
16:56:44 (269261): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:42:34 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 10,623,600 56,460 0.0053
09 May 2023 16:42:34 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 10,454,400 55,802 0.0053
09 May 2023 16:42:32 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 9,590,400 52,437 0.0055
09 May 2023 16:42:28 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 8,640,000 48,553 0.0056
09 May 2023 16:42:25 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 7,776,000 43,739 0.0056
09 May 2023 16:42:23 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 6,912,000 38,725 0.0056
09 May 2023 16:42:17 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 6,048,000 33,782 0.0056
09 May 2023 16:42:14 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 5,184,000 29,039 0.0056
09 May 2023 16:42:12 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 4,320,000 24,027 0.0056
09 May 2023 16:42:06 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 3,456,000 18,875 0.0055
09 May 2023 16:42:03 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 2,592,000 14,076 0.0054
09 May 2023 16:41:59 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 1,728,000 9,364 0.0054
09 May 2023 16:41:57 1507867 22267364 oifs_43r3_ps_0629_1996050100_123_965_12182273_0 864,000 4,873 0.0056


©2024 climateprediction.net