climateprediction.net home page
Task 22250902

Task 22250902

Name oifs_43r3_ps_0047_1981050100_123_950_12166691_0
Workunit 12166691
Created 20 Dec 2022, 18:29:36 UTC
Sent 20 Dec 2022, 18:31:28 UTC
Report deadline 19 Jan 2023, 18:31:28 UTC
Received 3 Jan 2023, 23:47:41 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1511771
Run time 11 hours 51 min 39 sec
CPU time 11 hours 17 min 40 sec
Validate state Invalid
Credit 8,588.16
Device peak FLOPS 5.49 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,413.89 MB
Peak swap size 4,978.16 MB
Peak disk usage 7,181.31 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
   CNT3 
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230910:1672348150:2192.194] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230910:1672348150:2192.194] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230910:1672348150:2192.194] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230910:1672348150:2192.194] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230910:1672348150:2192.194] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230910:1672348150:2192.194] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230910:1672348150:2192.194] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS              (1001) 
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230910:1672348150:2192.194] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230910:1672348150:2192.194] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230910:1672348150:2192.194] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                CLOUD_LAYER 
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230910:1672348150:2192.194] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 CLOUDSC 
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230911:1672348151:2193.194] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:CLOUD:1:1:1208:1208] [20221229:230911:1672348151:2193.195] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000101CBD8  cloudsc_                  850  cloudsc.F90
oifs_43r3_model.e  0000000001014D57  cloud_layer_              131  cloud_layer.F90
oifs_43r3_model.e  0000000000F10C1B  callpar_                 1011  callpar.F90
oifs_43r3_model.e  0000000000E4940F  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000E3610C  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BFA3D3  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1981050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0047
(argv4) batchid: 950
(argv5) wuid: 12166691
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/11
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/11/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/11/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_50500b5861d076fad4dc3638518c3d3a to: /var/lib/boinc-client/slots/11/oifs_43r3_ps_0047_1981050100_123_950_12166691.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/11/oifs_43r3_ps_0047_1981050100_123_950_12166691.zip
ic_ancil_file: ic_ancil_12166691
ifsdata_file: ifsdata_12166691
climate_data_file: clim_data_12166691
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_e3775ecc26c55b383d30f9de974092f7 to: /var/lib/boinc-client/slots/11/ic_ancil_12166691.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/11/ic_ancil_12166691.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_89c7c2f27b03a0903a633795f0b9c801 to: /var/lib/boinc-client/slots/11/ifsdata/ifsdata_12166691.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/11/ifsdata/ifsdata_12166691.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/11/159l_2/clim_data_12166691.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/11/159l_2/clim_data_12166691.zip
Checking for progress XML file: /var/lib/boinc-client/slots/11/progress_file_12166691.xml
Opened progress file ok : /var/lib/boinc-client/slots/11/progress_file_12166691.xml
-- Model is restarting --
Adjusting last_iter, 1232, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/11/progress_file_12166691.xml
last_cpu_time: 30912
upload_file_number: 51
last_iter: 1223
last_upload: 4406400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311
The child process has been launched with process id: 196561
Executing the command: /var/lib/boinc-client/slots/11/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:CLOUD:1:1:196561:196561] [20230103:222810:1672777690:0.018] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  22:29:34 STEP 1224 H=1224:00 +CPU= 27.161
  22:29:50 STEP 1225 H=1225:00 +CPU= 15.701
  22:30:06 STEP 1226 H=1226:00 +CPU= 15.989
  22:30:30 STEP 1227 H=1227:00 +CPU= 23.785
  22:30:46 STEP 1228 H=1228:00 +CPU= 15.589
  22:31:01 STEP 1229 H=1229:00 +CPU= 14.887
  22:31:26 STEP 1230 H=1230:00 +CPU= 24.943
  22:31:42 STEP 1231 H=1231:00 +CPU= 15.842
  22:31:58 STEP 1232 H=1232:00 +CPU= 16.024
  22:32:22 STEP 1233 H=1233:00 +CPU= 24.063
  22:32:38 STEP 1234 H=1234:00 +CPU= 15.423
  22:32:52 STEP 1235 H=1235:00 +CPU= 14.892
  22:33:18 STEP 1236 H=1236:00 +CPU= 25.562
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001236
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001236
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001236
  22:33:33 STEP 1237 H=1237:00 +CPU= 14.861
  22:33:48 STEP 1238 H=1238:00 +CPU= 15.250
  22:34:11 STEP 1239 H=1239:00 +CPU= 23.254
  22:34:27 STEP 1240 H=1240:00 +CPU= 15.175
  22:34:41 STEP 1241 H=1241:00 +CPU= 14.807
  22:35:05 STEP 1242 H=1242:00 +CPU= 23.677
  22:35:20 STEP 1243 H=1243:00 +CPU= 14.998
  22:35:35 STEP 1244 H=1244:00 +CPU= 15.280
  22:35:59 STEP 1245 H=1245:00 +CPU= 23.209
  22:36:14 STEP 1246 H=1246:00 +CPU= 15.322
  22:36:29 STEP 1247 H=1247:00 +CPU= 15.350
  22:36:58 STEP 1248 H=1248:00 +CPU= 27.131
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_51.zip
Uploading the intermediate file: upload_file_51.zip
  22:37:13 STEP 1249 H=1249:00 +CPU= 14.982
  22:37:28 STEP 1250 H=1250:00 +CPU= 15.379
  22:37:52 STEP 1251 H=1251:00 +CPU= 23.343
  22:38:07 STEP 1252 H=1252:00 +CPU= 15.292
  22:38:22 STEP 1253 H=1253:00 +CPU= 14.927
  22:38:46 STEP 1254 H=1254:00 +CPU= 24.057
  22:39:01 STEP 1255 H=1255:00 +CPU= 15.181
  22:39:17 STEP 1256 H=1256:00 +CPU= 15.868
  22:39:41 STEP 1257 H=1257:00 +CPU= 23.715
  22:39:56 STEP 1258 H=1258:00 +CPU= 15.500
  22:40:11 STEP 1259 H=1259:00 +CPU= 15.072
  22:40:37 STEP 1260 H=1260:00 +CPU= 25.859
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001260
  22:40:52 STEP 1261 H=1261:00 +CPU= 14.976
  22:41:08 STEP 1262 H=1262:00 +CPU= 15.479
  22:41:31 STEP 1263 H=1263:00 +CPU= 23.664
  22:41:47 STEP 1264 H=1264:00 +CPU= 15.354
  22:42:02 STEP 1265 H=1265:00 +CPU= 15.180
  22:42:26 STEP 1266 H=1266:00 +CPU= 23.916
  22:42:41 STEP 1267 H=1267:00 +CPU= 15.118
  22:42:57 STEP 1268 H=1268:00 +CPU= 16.167
  22:43:22 STEP 1269 H=1269:00 +CPU= 24.534
  22:43:38 STEP 1270 H=1270:00 +CPU= 16.012
  22:43:54 STEP 1271 H=1271:00 +CPU= 15.954
  22:44:23 STEP 1272 H=1272:00 +CPU= 28.532
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001260
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_52.zip
Uploading the intermediate file: upload_file_52.zip
  22:44:39 STEP 1273 H=1273:00 +CPU= 15.768
  22:44:55 STEP 1274 H=1274:00 +CPU= 16.201
  22:45:20 STEP 1275 H=1275:00 +CPU= 24.800
  22:45:36 STEP 1276 H=1276:00 +CPU= 16.075
  22:45:52 STEP 1277 H=1277:00 +CPU= 15.783
  22:46:17 STEP 1278 H=1278:00 +CPU= 25.359
  22:46:33 STEP 1279 H=1279:00 +CPU= 15.509
  22:46:49 STEP 1280 H=1280:00 +CPU= 16.116
  22:47:14 STEP 1281 H=1281:00 +CPU= 25.014
  22:47:30 STEP 1282 H=1282:00 +CPU= 16.064
  22:47:46 STEP 1283 H=1283:00 +CPU= 15.743
  22:48:13 STEP 1284 H=1284:00 +CPU= 27.238
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001284
  22:48:29 STEP 1285 H=1285:00 +CPU= 15.736
  22:48:45 STEP 1286 H=1286:00 +CPU= 16.047
  22:49:10 STEP 1287 H=1287:00 +CPU= 24.919
  22:49:27 STEP 1288 H=1288:00 +CPU= 16.462
  22:49:42 STEP 1289 H=1289:00 +CPU= 15.465
  22:50:07 STEP 1290 H=1290:00 +CPU= 25.278
  22:50:23 STEP 1291 H=1291:00 +CPU= 16.007
  22:50:40 STEP 1292 H=1292:00 +CPU= 16.304
  22:51:04 STEP 1293 H=1293:00 +CPU= 24.824
  22:51:21 STEP 1294 H=1294:00 +CPU= 16.394
  22:51:37 STEP 1295 H=1295:00 +CPU= 16.043
  22:52:07 STEP 1296 H=1296:00 +CPU= 29.765
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001284
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_53.zip
Uploading the intermediate file: upload_file_53.zip
  22:52:23 STEP 1297 H=1297:00 +CPU= 15.623
  22:52:39 STEP 1298 H=1298:00 +CPU= 16.001
  22:53:03 STEP 1299 H=1299:00 +CPU= 24.769
  22:53:20 STEP 1300 H=1300:00 +CPU= 16.119
  22:53:35 STEP 1301 H=1301:00 +CPU= 15.897
  22:54:01 STEP 1302 H=1302:00 +CPU= 25.494
  22:54:17 STEP 1303 H=1303:00 +CPU= 15.710
  22:54:33 STEP 1304 H=1304:00 +CPU= 16.242
  22:54:58 STEP 1305 H=1305:00 +CPU= 25.027
  22:55:14 STEP 1306 H=1306:00 +CPU= 16.398
  22:55:31 STEP 1307 H=1307:00 +CPU= 16.137
  22:55:58 STEP 1308 H=1308:00 +CPU= 27.745
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001308
  22:56:14 STEP 1309 H=1309:00 +CPU= 15.807
  22:56:31 STEP 1310 H=1310:00 +CPU= 16.368
  22:56:56 STEP 1311 H=1311:00 +CPU= 25.250
  22:57:12 STEP 1312 H=1312:00 +CPU= 16.205
  22:57:28 STEP 1313 H=1313:00 +CPU= 15.589
  22:57:53 STEP 1314 H=1314:00 +CPU= 25.634
  22:58:09 STEP 1315 H=1315:00 +CPU= 15.814
  22:58:25 STEP 1316 H=1316:00 +CPU= 16.053
  22:58:50 STEP 1317 H=1317:00 +CPU= 24.647
  22:59:06 STEP 1318 H=1318:00 +CPU= 16.040
  22:59:22 STEP 1319 H=1319:00 +CPU= 16.257
  22:59:51 STEP 1320 H=1320:00 +CPU= 28.997
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001308
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_54.zip
Uploading the intermediate file: upload_file_54.zip
  23:00:07 STEP 1321 H=1321:00 +CPU= 15.802
  23:00:23 STEP 1322 H=1322:00 +CPU= 15.878
  23:00:48 STEP 1323 H=1323:00 +CPU= 24.965
  23:01:04 STEP 1324 H=1324:00 +CPU= 16.008
  23:01:20 STEP 1325 H=1325:00 +CPU= 15.443
  23:01:45 STEP 1326 H=1326:00 +CPU= 25.293
  23:02:01 STEP 1327 H=1327:00 +CPU= 15.835
  23:02:17 STEP 1328 H=1328:00 +CPU= 16.148
  23:02:42 STEP 1329 H=1329:00 +CPU= 24.821
  23:02:58 STEP 1330 H=1330:00 +CPU= 15.913
  23:03:13 STEP 1331 H=1331:00 +CPU= 15.521
  23:03:40 STEP 1332 H=1332:00 +CPU= 26.989
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001332
  23:03:56 STEP 1333 H=1333:00 +CPU= 15.866
  23:04:12 STEP 1334 H=1334:00 +CPU= 16.392
  23:04:37 STEP 1335 H=1335:00 +CPU= 24.634
  23:04:53 STEP 1336 H=1336:00 +CPU= 16.220
  23:05:09 STEP 1337 H=1337:00 +CPU= 15.462
  23:05:34 STEP 1338 H=1338:00 +CPU= 25.542
  23:05:50 STEP 1339 H=1339:00 +CPU= 15.445
  23:06:06 STEP 1340 H=1340:00 +CPU= 16.087
  23:06:31 STEP 1341 H=1341:00 +CPU= 24.909
  23:06:47 STEP 1342 H=1342:00 +CPU= 16.129
  23:07:03 STEP 1343 H=1343:00 +CPU= 16.219
  23:07:32 STEP 1344 H=1344:00 +CPU= 29.026
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001344
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001344
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_55.zip
Uploading the intermediate file: upload_file_55.zip
  23:07:48 STEP 1345 H=1345:00 +CPU= 15.636
  23:08:04 STEP 1346 H=1346:00 +CPU= 16.156
  23:08:29 STEP 1347 H=1347:00 +CPU= 24.611
  23:08:45 STEP 1348 H=1348:00 +CPU= 16.240
  23:09:01 STEP 1349 H=1349:00 +CPU= 15.520
  23:09:26 STEP 1350 H=1350:00 +CPU= 24.975
  23:09:41 STEP 1351 H=1351:00 +CPU= 15.660
  23:09:57 STEP 1352 H=1352:00 +CPU= 16.077
  23:10:22 STEP 1353 H=1353:00 +CPU= 24.829
  23:10:39 STEP 1354 H=1354:00 +CPU= 16.232
  23:10:54 STEP 1355 H=1355:00 +CPU= 15.706
  23:11:22 STEP 1356 H=1356:00 +CPU= 27.860
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001356
  23:11:38 STEP 1357 H=1357:00 +CPU= 15.894
  23:11:54 STEP 1358 H=1358:00 +CPU= 16.118
  23:12:19 STEP 1359 H=1359:00 +CPU= 24.933
  23:12:35 STEP 1360 H=1360:00 +CPU= 16.339
  23:12:51 STEP 1361 H=1361:00 +CPU= 15.716
  23:13:17 STEP 1362 H=1362:00 +CPU= 25.320
  23:13:32 STEP 1363 H=1363:00 +CPU= 15.821
  23:13:48 STEP 1364 H=1364:00 +CPU= 15.919
  23:14:13 STEP 1365 H=1365:00 +CPU= 24.682
  23:14:29 STEP 1366 H=1366:00 +CPU= 16.333
  23:14:45 STEP 1367 H=1367:00 +CPU= 15.974
  23:15:15 STEP 1368 H=1368:00 +CPU= 29.799
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001356
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_56.zip
Uploading the intermediate file: upload_file_56.zip
  23:15:31 STEP 1369 H=1369:00 +CPU= 15.673
  23:15:47 STEP 1370 H=1370:00 +CPU= 15.990
  23:16:12 STEP 1371 H=1371:00 +CPU= 24.808
  23:16:28 STEP 1372 H=1372:00 +CPU= 16.162
  23:16:44 STEP 1373 H=1373:00 +CPU= 15.608
  23:17:10 STEP 1374 H=1374:00 +CPU= 25.941
  23:17:25 STEP 1375 H=1375:00 +CPU= 15.721
  23:17:41 STEP 1376 H=1376:00 +CPU= 16.102
  23:18:06 STEP 1377 H=1377:00 +CPU= 24.671
  23:18:22 STEP 1378 H=1378:00 +CPU= 16.268
  23:18:38 STEP 1379 H=1379:00 +CPU= 15.800
  23:19:06 STEP 1380 H=1380:00 +CPU= 28.103
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001380
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001380
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001380
  23:19:22 STEP 1381 H=1381:00 +CPU= 15.753
  23:19:38 STEP 1382 H=1382:00 +CPU= 15.816
  23:20:02 STEP 1383 H=1383:00 +CPU= 24.356
  23:20:18 STEP 1384 H=1384:00 +CPU= 15.954
  23:20:34 STEP 1385 H=1385:00 +CPU= 15.831
  23:20:59 STEP 1386 H=1386:00 +CPU= 25.223
  23:21:15 STEP 1387 H=1387:00 +CPU= 15.637
  23:21:31 STEP 1388 H=1388:00 +CPU= 16.115
  23:21:56 STEP 1389 H=1389:00 +CPU= 25.178
  23:22:13 STEP 1390 H=1390:00 +CPU= 16.147
  23:22:29 STEP 1391 H=1391:00 +CPU= 16.175
  23:22:58 STEP 1392 H=1392:00 +CPU= 29.444
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001392
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001392
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001380
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_57.zip
Uploading the intermediate file: upload_file_57.zip
  23:23:14 STEP 1393 H=1393:00 +CPU= 16.009
  23:23:31 STEP 1394 H=1394:00 +CPU= 16.121
  23:23:55 STEP 1395 H=1395:00 +CPU= 24.578
  23:24:11 STEP 1396 H=1396:00 +CPU= 15.982
  23:24:27 STEP 1397 H=1397:00 +CPU= 15.559
  23:24:52 STEP 1398 H=1398:00 +CPU= 25.528
  23:25:08 STEP 1399 H=1399:00 +CPU= 16.067
  23:25:25 STEP 1400 H=1400:00 +CPU= 16.207
  23:25:49 STEP 1401 H=1401:00 +CPU= 24.799
  23:26:06 STEP 1402 H=1402:00 +CPU= 16.005
  23:26:21 STEP 1403 H=1403:00 +CPU= 15.653
  23:26:48 STEP 1404 H=1404:00 +CPU= 27.247
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001404
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001404
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001404
  23:27:04 STEP 1405 H=1405:00 +CPU= 15.776
  23:27:20 STEP 1406 H=1406:00 +CPU= 16.004
  23:27:45 STEP 1407 H=1407:00 +CPU= 24.757
  23:28:01 STEP 1408 H=1408:00 +CPU= 16.125
  23:28:17 STEP 1409 H=1409:00 +CPU= 15.464
  23:28:42 STEP 1410 H=1410:00 +CPU= 25.140
  23:28:57 STEP 1411 H=1411:00 +CPU= 15.568
  23:29:14 STEP 1412 H=1412:00 +CPU= 16.195
  23:29:38 STEP 1413 H=1413:00 +CPU= 24.478
  23:29:54 STEP 1414 H=1414:00 +CPU= 16.028
  23:30:11 STEP 1415 H=1415:00 +CPU= 16.685
  23:30:41 STEP 1416 H=1416:00 +CPU= 29.643
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001404
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_58.zip
Uploading the intermediate file: upload_file_58.zip
  23:30:57 STEP 1417 H=1417:00 +CPU= 15.839
  23:31:13 STEP 1418 H=1418:00 +CPU= 16.074
  23:31:38 STEP 1419 H=1419:00 +CPU= 24.922
  23:31:54 STEP 1420 H=1420:00 +CPU= 16.591
  23:32:10 STEP 1421 H=1421:00 +CPU= 15.422
  23:32:36 STEP 1422 H=1422:00 +CPU= 25.914
  23:32:51 STEP 1423 H=1423:00 +CPU= 15.756
  23:33:08 STEP 1424 H=1424:00 +CPU= 16.199
  23:33:32 STEP 1425 H=1425:00 +CPU= 24.855
  23:33:49 STEP 1426 H=1426:00 +CPU= 16.095
  23:34:04 STEP 1427 H=1427:00 +CPU= 15.545
  23:34:32 STEP 1428 H=1428:00 +CPU= 27.580
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001428
  23:34:47 STEP 1429 H=1429:00 +CPU= 15.668
  23:35:04 STEP 1430 H=1430:00 +CPU= 16.265
  23:35:28 STEP 1431 H=1431:00 +CPU= 24.397
  23:35:44 STEP 1432 H=1432:00 +CPU= 15.913
  23:36:00 STEP 1433 H=1433:00 +CPU= 15.796
  23:36:25 STEP 1434 H=1434:00 +CPU= 25.361
  23:36:41 STEP 1435 H=1435:00 +CPU= 15.722
  23:36:57 STEP 1436 H=1436:00 +CPU= 16.118
  23:37:22 STEP 1437 H=1437:00 +CPU= 24.868
  23:37:38 STEP 1438 H=1438:00 +CPU= 15.991
  23:37:54 STEP 1439 H=1439:00 +CPU= 15.988
  23:38:24 STEP 1440 H=1440:00 +CPU= 29.023
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_59.zip
Uploading the intermediate file: upload_file_59.zip
  23:38:40 STEP 1441 H=1441:00 +CPU= 15.814
  23:38:56 STEP 1442 H=1442:00 +CPU= 16.366
  23:39:21 STEP 1443 H=1443:00 +CPU= 24.697
  23:39:37 STEP 1444 H=1444:00 +CPU= 15.990
  23:39:52 STEP 1445 H=1445:00 +CPU= 15.499
  23:40:18 STEP 1446 H=1446:00 +CPU= 25.275
  23:40:33 STEP 1447 H=1447:00 +CPU= 15.902
  23:40:50 STEP 1448 H=1448:00 +CPU= 16.060
  23:41:14 STEP 1449 H=1449:00 +CPU= 24.940
  23:41:31 STEP 1450 H=1450:00 +CPU= 16.373
  23:41:46 STEP 1451 H=1451:00 +CPU= 15.602
  23:42:14 STEP 1452 H=1452:00 +CPU= 27.507
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001452
  23:42:30 STEP 1453 H=1453:00 +CPU= 15.908
  23:42:46 STEP 1454 H=1454:00 +CPU= 16.133
  23:43:11 STEP 1455 H=1455:00 +CPU= 24.608
  23:43:27 STEP 1456 H=1456:00 +CPU= 15.995
  23:43:42 STEP 1457 H=1457:00 +CPU= 15.623
  23:44:08 STEP 1458 H=1458:00 +CPU= 25.144
  23:44:23 STEP 1459 H=1459:00 +CPU= 15.595
  23:44:39 STEP 1460 H=1460:00 +CPU= 16.091
  23:45:04 STEP 1461 H=1461:00 +CPU= 24.676
  23:45:20 STEP 1462 H=1462:00 +CPU= 16.109
  23:45:36 STEP 1463 H=1463:00 +CPU= 16.027
  23:46:05 STEP 1464 H=1464:00 +CPU= 29.111
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001452
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_60.zip
Uploading the intermediate file: upload_file_60.zip
  23:46:21 STEP 1465 H=1465:00 +CPU= 15.780
Uploading trickle at timestep: 5270400
  23:46:37 STEP 1466 H=1466:00 +CPU= 16.052
  23:47:02 STEP 1467 H=1467:00 +CPU= 24.591
  23:47:18 STEP 1468 H=1468:00 +CPU= 16.366
  23:47:34 STEP 1469 H=1469:00 +CPU= 15.554
  23:47:59 STEP 1470 H=1470:00 +CPU= 25.189
  23:48:15 STEP 1471 H=1471:00 +CPU= 15.880
  23:48:31 STEP 1472 H=1472:00 +CPU= 16.246
  23:48:56 STEP 1473 H=1473:00 +CPU= 24.792
  23:49:12 STEP 1474 H=1474:00 +CPU= 16.161
  23:49:28 STEP 1475 H=1475:00 +CPU= 15.866
  23:49:56 STEP 1476 H=1476:00 +CPU= 27.648
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001476
  23:50:12 STEP 1477 H=1477:00 +CPU= 15.935
  23:50:28 STEP 1478 H=1478:00 +CPU= 16.366
  23:50:53 STEP 1479 H=1479:00 +CPU= 24.919
  23:51:09 STEP 1480 H=1480:00 +CPU= 16.297
  23:51:25 STEP 1481 H=1481:00 +CPU= 15.803
  23:51:51 STEP 1482 H=1482:00 +CPU= 25.557
  23:52:06 STEP 1483 H=1483:00 +CPU= 15.533
  23:52:22 STEP 1484 H=1484:00 +CPU= 15.815
  23:52:47 STEP 1485 H=1485:00 +CPU= 25.143
  23:53:03 STEP 1486 H=1486:00 +CPU= 16.045
  23:53:20 STEP 1487 H=1487:00 +CPU= 16.157
  23:53:49 STEP 1488 H=1488:00 +CPU= 29.396
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001476
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_61.zip
Uploading the intermediate file: upload_file_61.zip
  23:54:05 STEP 1489 H=1489:00 +CPU= 15.555
  23:54:20 STEP 1490 H=1490:00 +CPU= 15.842
  23:54:45 STEP 1491 H=1491:00 +CPU= 24.878
  23:55:02 STEP 1492 H=1492:00 +CPU= 16.442
  23:55:17 STEP 1493 H=1493:00 +CPU= 15.518
  23:55:43 STEP 1494 H=1494:00 +CPU= 25.433
  23:55:58 STEP 1495 H=1495:00 +CPU= 15.552
  23:56:15 STEP 1496 H=1496:00 +CPU= 16.294
  23:56:39 STEP 1497 H=1497:00 +CPU= 24.728
  23:56:56 STEP 1498 H=1498:00 +CPU= 16.213
  23:57:11 STEP 1499 H=1499:00 +CPU= 15.586
  23:57:38 STEP 1500 H=1500:00 +CPU= 26.931
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001500
  23:57:54 STEP 1501 H=1501:00 +CPU= 15.400
  23:58:10 STEP 1502 H=1502:00 +CPU= 16.219
  23:58:34 STEP 1503 H=1503:00 +CPU= 24.578
  23:58:50 STEP 1504 H=1504:00 +CPU= 15.882
  23:59:06 STEP 1505 H=1505:00 +CPU= 15.488
  23:59:31 STEP 1506 H=1506:00 +CPU= 25.295
  23:59:47 STEP 1507 H=1507:00 +CPU= 15.606
  00:00:03 STEP 1508 H=1508:00 +CPU= 15.846
  00:00:28 STEP 1509 H=1509:00 +CPU= 24.904
  00:00:44 STEP 1510 H=1510:00 +CPU= 16.402
  00:01:00 STEP 1511 H=1511:00 +CPU= 16.067
  00:01:29 STEP 1512 H=1512:00 +CPU= 29.352
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001500
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_62.zip
Uploading the intermediate file: upload_file_62.zip
  00:01:45 STEP 1513 H=1513:00 +CPU= 15.784
  00:02:01 STEP 1514 H=1514:00 +CPU= 15.983
  00:02:26 STEP 1515 H=1515:00 +CPU= 24.625
  00:02:42 STEP 1516 H=1516:00 +CPU= 15.870
  00:02:57 STEP 1517 H=1517:00 +CPU= 15.587
  00:03:23 STEP 1518 H=1518:00 +CPU= 25.345
  00:03:38 STEP 1519 H=1519:00 +CPU= 15.615
  00:03:54 STEP 1520 H=1520:00 +CPU= 16.000
  00:04:19 STEP 1521 H=1521:00 +CPU= 24.618
  00:04:35 STEP 1522 H=1522:00 +CPU= 16.061
  00:04:51 STEP 1523 H=1523:00 +CPU= 15.650
  00:05:18 STEP 1524 H=1524:00 +CPU= 26.947
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001524
  00:05:33 STEP 1525 H=1525:00 +CPU= 15.651
  00:05:49 STEP 1526 H=1526:00 +CPU= 15.948
  00:06:14 STEP 1527 H=1527:00 +CPU= 24.667
  00:06:30 STEP 1528 H=1528:00 +CPU= 16.014
  00:06:46 STEP 1529 H=1529:00 +CPU= 15.816
  00:07:11 STEP 1530 H=1530:00 +CPU= 25.431
  00:07:27 STEP 1531 H=1531:00 +CPU= 15.480
  00:07:43 STEP 1532 H=1532:00 +CPU= 16.228
  00:08:08 STEP 1533 H=1533:00 +CPU= 24.962
  00:08:24 STEP 1534 H=1534:00 +CPU= 15.980
  00:08:41 STEP 1535 H=1535:00 +CPU= 16.328
  00:09:10 STEP 1536 H=1536:00 +CPU= 29.739
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_63.zip
Uploading the intermediate file: upload_file_63.zip
  00:09:26 STEP 1537 H=1537:00 +CPU= 15.587
  00:09:42 STEP 1538 H=1538:00 +CPU= 15.810
  00:10:07 STEP 1539 H=1539:00 +CPU= 24.647
  00:10:23 STEP 1540 H=1540:00 +CPU= 16.098
  00:10:38 STEP 1541 H=1541:00 +CPU= 15.541
  00:11:03 STEP 1542 H=1542:00 +CPU= 25.164
  00:11:19 STEP 1543 H=1543:00 +CPU= 15.575
  00:11:35 STEP 1544 H=1544:00 +CPU= 16.207
  00:12:00 STEP 1545 H=1545:00 +CPU= 24.731
  00:12:16 STEP 1546 H=1546:00 +CPU= 16.045
  00:12:31 STEP 1547 H=1547:00 +CPU= 15.396
  00:12:59 STEP 1548 H=1548:00 +CPU= 27.618
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001548
  00:13:15 STEP 1549 H=1549:00 +CPU= 15.789
  00:13:31 STEP 1550 H=1550:00 +CPU= 16.301
  00:13:56 STEP 1551 H=1551:00 +CPU= 24.766
  00:14:12 STEP 1552 H=1552:00 +CPU= 16.100
  00:14:28 STEP 1553 H=1553:00 +CPU= 15.495
  00:14:53 STEP 1554 H=1554:00 +CPU= 25.306
  00:15:09 STEP 1555 H=1555:00 +CPU= 15.644
  00:15:25 STEP 1556 H=1556:00 +CPU= 16.043
  00:15:50 STEP 1557 H=1557:00 +CPU= 24.882
  00:16:06 STEP 1558 H=1558:00 +CPU= 16.060
  00:16:22 STEP 1559 H=1559:00 +CPU= 16.086
  00:16:52 STEP 1560 H=1560:00 +CPU= 29.522
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001548
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_64.zip
Uploading the intermediate file: upload_file_64.zip
  00:17:08 STEP 1561 H=1561:00 +CPU= 15.890
  00:17:24 STEP 1562 H=1562:00 +CPU= 15.988
  00:17:49 STEP 1563 H=1563:00 +CPU= 24.806
  00:18:05 STEP 1564 H=1564:00 +CPU= 16.294
  00:18:21 STEP 1565 H=1565:00 +CPU= 15.701
  00:18:46 STEP 1566 H=1566:00 +CPU= 25.528
  00:19:02 STEP 1567 H=1567:00 +CPU= 15.649
  00:19:18 STEP 1568 H=1568:00 +CPU= 16.209
  00:19:43 STEP 1569 H=1569:00 +CPU= 24.913
  00:20:00 STEP 1570 H=1570:00 +CPU= 16.449
  00:20:16 STEP 1571 H=1571:00 +CPU= 15.838
  00:20:43 STEP 1572 H=1572:00 +CPU= 27.279
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001572
  00:20:59 STEP 1573 H=1573:00 +CPU= 15.614
  00:21:15 STEP 1574 H=1574:00 +CPU= 16.114
  00:21:40 STEP 1575 H=1575:00 +CPU= 24.894
  00:21:56 STEP 1576 H=1576:00 +CPU= 16.052
  00:22:11 STEP 1577 H=1577:00 +CPU= 15.377
  00:22:36 STEP 1578 H=1578:00 +CPU= 25.191
  00:22:52 STEP 1579 H=1579:00 +CPU= 15.483
  00:23:07 STEP 1580 H=1580:00 +CPU= 15.646
  00:23:32 STEP 1581 H=1581:00 +CPU= 24.927
  00:23:48 STEP 1582 H=1582:00 +CPU= 15.940
  00:24:04 STEP 1583 H=1583:00 +CPU= 15.783
  00:24:34 STEP 1584 H=1584:00 +CPU= 29.599
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001572
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_65.zip
Uploading the intermediate file: upload_file_65.zip
  00:24:50 STEP 1585 H=1585:00 +CPU= 15.753
  00:25:06 STEP 1586 H=1586:00 +CPU= 15.960
  00:25:30 STEP 1587 H=1587:00 +CPU= 24.465
  00:25:46 STEP 1588 H=1588:00 +CPU= 15.844
  00:26:01 STEP 1589 H=1589:00 +CPU= 15.176
  00:26:27 STEP 1590 H=1590:00 +CPU= 25.422
  00:26:42 STEP 1591 H=1591:00 +CPU= 15.826
  00:26:58 STEP 1592 H=1592:00 +CPU= 15.765
  00:27:23 STEP 1593 H=1593:00 +CPU= 24.656
  00:27:39 STEP 1594 H=1594:00 +CPU= 15.996
  00:27:54 STEP 1595 H=1595:00 +CPU= 15.553
  00:28:22 STEP 1596 H=1596:00 +CPU= 27.215
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001596
  00:28:37 STEP 1597 H=1597:00 +CPU= 15.641
  00:28:53 STEP 1598 H=1598:00 +CPU= 15.997
  00:29:18 STEP 1599 H=1599:00 +CPU= 24.742
  00:29:34 STEP 1600 H=1600:00 +CPU= 16.244
  00:29:50 STEP 1601 H=1601:00 +CPU= 15.399
  00:30:15 STEP 1602 H=1602:00 +CPU= 25.319
  00:30:31 STEP 1603 H=1603:00 +CPU= 15.866
  00:30:47 STEP 1604 H=1604:00 +CPU= 16.099
  00:31:12 STEP 1605 H=1605:00 +CPU= 24.899
  00:31:28 STEP 1606 H=1606:00 +CPU= 16.098
  00:31:44 STEP 1607 H=1607:00 +CPU= 15.904
  00:32:14 STEP 1608 H=1608:00 +CPU= 29.230
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001596
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_66.zip
Uploading the intermediate file: upload_file_66.zip
  00:32:30 STEP 1609 H=1609:00 +CPU= 15.933
  00:32:46 STEP 1610 H=1610:00 +CPU= 15.805
  00:33:10 STEP 1611 H=1611:00 +CPU= 24.568
  00:33:26 STEP 1612 H=1612:00 +CPU= 16.043
  00:33:41 STEP 1613 H=1613:00 +CPU= 15.238
  00:34:07 STEP 1614 H=1614:00 +CPU= 25.368
  00:34:23 STEP 1615 H=1615:00 +CPU= 15.616
  00:34:39 STEP 1616 H=1616:00 +CPU= 16.016
  00:35:04 STEP 1617 H=1617:00 +CPU= 24.921
  00:35:20 STEP 1618 H=1618:00 +CPU= 16.201
  00:35:35 STEP 1619 H=1619:00 +CPU= 15.530
  00:36:03 STEP 1620 H=1620:00 +CPU= 27.506
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001620
  00:36:19 STEP 1621 H=1621:00 +CPU= 15.714
  00:36:35 STEP 1622 H=1622:00 +CPU= 16.064
  00:36:59 STEP 1623 H=1623:00 +CPU= 24.706
  00:37:15 STEP 1624 H=1624:00 +CPU= 15.992
  00:37:31 STEP 1625 H=1625:00 +CPU= 15.900
  00:37:57 STEP 1626 H=1626:00 +CPU= 25.405
  00:38:13 STEP 1627 H=1627:00 +CPU= 15.843
  00:38:28 STEP 1628 H=1628:00 +CPU= 15.798
  00:38:53 STEP 1629 H=1629:00 +CPU= 24.891
  00:39:09 STEP 1630 H=1630:00 +CPU= 15.784
  00:39:25 STEP 1631 H=1631:00 +CPU= 15.914
  00:39:55 STEP 1632 H=1632:00 +CPU= 29.108
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_67.zip
Uploading the intermediate file: upload_file_67.zip
  00:40:10 STEP 1633 H=1633:00 +CPU= 15.681
  00:40:26 STEP 1634 H=1634:00 +CPU= 15.638
  00:40:51 STEP 1635 H=1635:00 +CPU= 24.575
  00:41:07 STEP 1636 H=1636:00 +CPU= 15.987
  00:41:22 STEP 1637 H=1637:00 +CPU= 15.358
  00:41:47 STEP 1638 H=1638:00 +CPU= 25.511
  00:42:03 STEP 1639 H=1639:00 +CPU= 15.519
  00:42:19 STEP 1640 H=1640:00 +CPU= 15.780
  00:42:44 STEP 1641 H=1641:00 +CPU= 24.930
  00:43:00 STEP 1642 H=1642:00 +CPU= 15.930
  00:43:15 STEP 1643 H=1643:00 +CPU= 15.443
  00:43:42 STEP 1644 H=1644:00 +CPU= 27.035
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001644
  00:43:58 STEP 1645 H=1645:00 +CPU= 15.388
  00:44:13 STEP 1646 H=1646:00 +CPU= 15.835
  00:44:38 STEP 1647 H=1647:00 +CPU= 24.382
  00:44:54 STEP 1648 H=1648:00 +CPU= 15.928
  00:45:09 STEP 1649 H=1649:00 +CPU= 15.093
  00:45:34 STEP 1650 H=1650:00 +CPU= 25.098
  00:45:49 STEP 1651 H=1651:00 +CPU= 15.333
  00:46:05 STEP 1652 H=1652:00 +CPU= 16.046
  00:46:30 STEP 1653 H=1653:00 +CPU= 24.325
  00:46:46 STEP 1654 H=1654:00 +CPU= 15.702
  00:47:01 STEP 1655 H=1655:00 +CPU= 15.721
  00:47:31 STEP 1656 H=1656:00 +CPU= 29.237
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001644
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_68.zip
Uploading the intermediate file: upload_file_68.zip
  00:47:47 STEP 1657 H=1657:00 +CPU= 15.541
  00:48:03 STEP 1658 H=1658:00 +CPU= 15.981
  00:48:27 STEP 1659 H=1659:00 +CPU= 24.391
  00:48:43 STEP 1660 H=1660:00 +CPU= 16.138
  00:48:59 STEP 1661 H=1661:00 +CPU= 15.591
  00:49:24 STEP 1662 H=1662:00 +CPU= 25.120
  00:49:39 STEP 1663 H=1663:00 +CPU= 15.464
  00:49:55 STEP 1664 H=1664:00 +CPU= 15.864
  00:50:20 STEP 1665 H=1665:00 +CPU= 24.803
  00:50:36 STEP 1666 H=1666:00 +CPU= 15.807
  00:50:51 STEP 1667 H=1667:00 +CPU= 15.241
  00:51:18 STEP 1668 H=1668:00 +CPU= 26.914
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001668
  00:51:34 STEP 1669 H=1669:00 +CPU= 15.425
  00:51:49 STEP 1670 H=1670:00 +CPU= 15.595
  00:52:14 STEP 1671 H=1671:00 +CPU= 24.686
  00:52:30 STEP 1672 H=1672:00 +CPU= 15.764
  00:52:45 STEP 1673 H=1673:00 +CPU= 15.409
  00:53:11 STEP 1674 H=1674:00 +CPU= 25.483
  00:53:27 STEP 1675 H=1675:00 +CPU= 15.754
  00:53:42 STEP 1676 H=1676:00 +CPU= 15.626
  00:54:07 STEP 1677 H=1677:00 +CPU= 24.707
  00:54:23 STEP 1678 H=1678:00 +CPU= 16.289
  00:54:39 STEP 1679 H=1679:00 +CPU= 15.757
  00:55:09 STEP 1680 H=1680:00 +CPU= 29.029
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_69.zip
Uploading the intermediate file: upload_file_69.zip
  00:55:24 STEP 1681 H=1681:00 +CPU= 15.496
  00:55:40 STEP 1682 H=1682:00 +CPU= 15.800
  00:56:04 STEP 1683 H=1683:00 +CPU= 24.507
  00:56:21 STEP 1684 H=1684:00 +CPU= 16.333
  00:56:36 STEP 1685 H=1685:00 +CPU= 15.286
  00:57:02 STEP 1686 H=1686:00 +CPU= 25.579
  00:57:17 STEP 1687 H=1687:00 +CPU= 15.563
  00:57:33 STEP 1688 H=1688:00 +CPU= 15.784
  00:57:58 STEP 1689 H=1689:00 +CPU= 24.818
  00:58:14 STEP 1690 H=1690:00 +CPU= 16.128
  00:58:30 STEP 1691 H=1691:00 +CPU= 15.466
  00:58:58 STEP 1692 H=1692:00 +CPU= 28.153
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001692
  00:59:13 STEP 1693 H=1693:00 +CPU= 15.465
  00:59:29 STEP 1694 H=1694:00 +CPU= 15.710
  00:59:54 STEP 1695 H=1695:00 +CPU= 24.900
  01:00:10 STEP 1696 H=1696:00 +CPU= 16.213
  01:00:26 STEP 1697 H=1697:00 +CPU= 15.548
  01:00:51 STEP 1698 H=1698:00 +CPU= 25.329
  01:01:07 STEP 1699 H=1699:00 +CPU= 15.468
  01:01:22 STEP 1700 H=1700:00 +CPU= 15.686
  01:01:47 STEP 1701 H=1701:00 +CPU= 24.768
  01:02:03 STEP 1702 H=1702:00 +CPU= 15.814
  01:02:19 STEP 1703 H=1703:00 +CPU= 15.798
  01:02:49 STEP 1704 H=1704:00 +CPU= 29.229
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_70.zip
Uploading the intermediate file: upload_file_70.zip
  01:03:04 STEP 1705 H=1705:00 +CPU= 15.526
Uploading trickle at timestep: 6134400
  01:03:20 STEP 1706 H=1706:00 +CPU= 16.162
  01:03:45 STEP 1707 H=1707:00 +CPU= 24.733
  01:04:01 STEP 1708 H=1708:00 +CPU= 15.845
  01:04:16 STEP 1709 H=1709:00 +CPU= 15.232
  01:04:42 STEP 1710 H=1710:00 +CPU= 25.398
  01:04:57 STEP 1711 H=1711:00 +CPU= 15.500
  01:05:13 STEP 1712 H=1712:00 +CPU= 15.786
  01:05:38 STEP 1713 H=1713:00 +CPU= 25.179
  01:05:54 STEP 1714 H=1714:00 +CPU= 15.935
  01:06:10 STEP 1715 H=1715:00 +CPU= 15.748
  01:06:37 STEP 1716 H=1716:00 +CPU= 26.976
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001716
  01:06:52 STEP 1717 H=1717:00 +CPU= 15.571
  01:07:08 STEP 1718 H=1718:00 +CPU= 15.841
  01:07:33 STEP 1719 H=1719:00 +CPU= 25.089
  01:07:50 STEP 1720 H=1720:00 +CPU= 16.181
  01:08:05 STEP 1721 H=1721:00 +CPU= 15.443
  01:08:30 STEP 1722 H=1722:00 +CPU= 25.310
  01:08:46 STEP 1723 H=1723:00 +CPU= 15.627
  01:09:02 STEP 1724 H=1724:00 +CPU= 15.535
  01:09:26 STEP 1725 H=1725:00 +CPU= 24.867
  01:09:42 STEP 1726 H=1726:00 +CPU= 15.902
  01:09:59 STEP 1727 H=1727:00 +CPU= 16.241
  01:10:29 STEP 1728 H=1728:00 +CPU= 29.757
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12166691/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0047_1981050100_123_950_12166691_0_r898883311_71.zip
Uploading the intermediate file: upload_file_71.zip
  01:10:44 STEP 1729 H=1729:00 +CPU= 15.516
  01:11:01 STEP 1730 H=1730:00 +CPU= 16.217
  01:11:26 STEP 1731 H=1731:00 +CPU= 25.411
  01:11:42 STEP 1732 H=1732:00 +CPU= 16.211
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:07:21 1511771 22250902 oifs_43r3_ps_0047_1981050100_123_950_12166691_0 6,134,400 40,119 0.0065
09 May 2023 16:07:19 1511771 22250902 oifs_43r3_ps_0047_1981050100_123_950_12166691_0 5,270,400 35,532 0.0067
09 May 2023 15:48:54 1511771 22250902 oifs_43r3_ps_0047_1981050100_123_950_12166691_0 3,456,000 22,426 0.0065
09 May 2023 15:48:48 1511771 22250902 oifs_43r3_ps_0047_1981050100_123_950_12166691_0 2,592,000 17,066 0.0066
09 May 2023 15:48:36 1511771 22250902 oifs_43r3_ps_0047_1981050100_123_950_12166691_0 1,728,000 11,666 0.0068
09 May 2023 15:48:30 1511771 22250902 oifs_43r3_ps_0047_1981050100_123_950_12166691_0 864,000 6,254 0.0072


©2024 climateprediction.net