climateprediction.net home page
Task 22295314

Task 22295314

Name oifs_43r3_ps_0870_1981050100_123_950_12167514_2
Workunit 12167514
Created 3 Jan 2023, 10:24:47 UTC
Sent 11 Jan 2023, 17:45:41 UTC
Report deadline 10 Feb 2023, 17:45:41 UTC
Received 12 Jan 2023, 7:18:32 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1535225
Run time 12 hours 29 min 59 sec
CPU time 12 hours 27 min 37 sec
Validate state Invalid
Credit 8,467.20
Device peak FLOPS 7.18 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,104.78 MB
Peak swap size 4,974.12 MB
Peak disk usage 1,733.59 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
H=1226:00 +CPU= 23.337
  01:54:32 STEP 1227 H=1227:00 +CPU= 32.340
  01:54:56 STEP 1228 H=1228:00 +CPU= 24.065
  01:55:21 STEP 1229 H=1229:00 +CPU= 25.056
  01:55:57 STEP 1230 H=1230:00 +CPU= 35.891
  01:56:21 STEP 1231 H=1231:00 +CPU= 23.892
  01:56:44 STEP 1232 H=1232:00 +CPU= 23.340
  01:57:18 STEP 1233 H=1233:00 +CPU= 34.039
  01:57:41 STEP 1234 H=1234:00 +CPU= 22.767
  01:58:01 STEP 1235 H=1235:00 +CPU= 19.841
  01:58:38 STEP 1236 H=1236:00 +CPU= 37.183
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001236
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001236
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001236
  01:58:59 STEP 1237 H=1237:00 +CPU= 21.104
  01:59:24 STEP 1238 H=1238:00 +CPU= 24.109
  01:59:54 STEP 1239 H=1239:00 +CPU= 30.678
  02:00:21 STEP 1240 H=1240:00 +CPU= 26.415
  02:00:43 STEP 1241 H=1241:00 +CPU= 22.538
  02:01:14 STEP 1242 H=1242:00 +CPU= 30.391
  02:01:34 STEP 1243 H=1243:00 +CPU= 20.238
  02:01:55 STEP 1244 H=1244:00 +CPU= 21.387
  02:02:28 STEP 1245 H=1245:00 +CPU= 32.188
  02:02:53 STEP 1246 H=1246:00 +CPU= 25.272
  02:03:18 STEP 1247 H=1247:00 +CPU= 25.025
  02:03:58 STEP 1248 H=1248:00 +CPU= 39.707
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001248
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001248
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001248
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001224
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001224
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001224
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001236
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001236
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001236
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_51.zip
Uploading the intermediate file: upload_file_51.zip
  02:04:22 STEP 1249 H=1249:00 +CPU= 24.216
  02:04:48 STEP 1250 H=1250:00 +CPU= 26.168
  02:05:18 STEP 1251 H=1251:00 +CPU= 30.185
  02:05:40 STEP 1252 H=1252:00 +CPU= 21.535
  02:06:00 STEP 1253 H=1253:00 +CPU= 20.558
  02:06:34 STEP 1254 H=1254:00 +CPU= 33.670
  02:06:55 STEP 1255 H=1255:00 +CPU= 21.039
  02:07:17 STEP 1256 H=1256:00 +CPU= 21.604
  02:07:51 STEP 1257 H=1257:00 +CPU= 34.672
  02:08:12 STEP 1258 H=1258:00 +CPU= 21.015
  02:08:36 STEP 1259 H=1259:00 +CPU= 23.313
  02:09:13 STEP 1260 H=1260:00 +CPU= 37.335
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001260
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001260
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001260
  02:09:37 STEP 1261 H=1261:00 +CPU= 23.568
  02:09:59 STEP 1262 H=1262:00 +CPU= 21.989
  02:10:32 STEP 1263 H=1263:00 +CPU= 32.884
  02:10:53 STEP 1264 H=1264:00 +CPU= 21.584
  02:11:17 STEP 1265 H=1265:00 +CPU= 23.472
  02:11:49 STEP 1266 H=1266:00 +CPU= 32.072
  02:12:11 STEP 1267 H=1267:00 +CPU= 22.177
  02:12:34 STEP 1268 H=1268:00 +CPU= 22.986
  02:13:04 STEP 1269 H=1269:00 +CPU= 30.081
  02:13:25 STEP 1270 H=1270:00 +CPU= 20.839
  02:13:42 STEP 1271 H=1271:00 +CPU= 16.798
  02:14:16 STEP 1272 H=1272:00 +CPU= 31.901
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001272
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001272
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001272
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001248
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001248
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001248
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001260
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001260
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001260
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_52.zip
Uploading the intermediate file: upload_file_52.zip
  02:14:34 STEP 1273 H=1273:00 +CPU= 18.500
  02:14:55 STEP 1274 H=1274:00 +CPU= 20.354
  02:15:23 STEP 1275 H=1275:00 +CPU= 28.374
  02:15:43 STEP 1276 H=1276:00 +CPU= 19.596
  02:16:03 STEP 1277 H=1277:00 +CPU= 20.250
  02:16:32 STEP 1278 H=1278:00 +CPU= 29.212
  02:16:50 STEP 1279 H=1279:00 +CPU= 18.241
  02:17:10 STEP 1280 H=1280:00 +CPU= 19.132
  02:17:40 STEP 1281 H=1281:00 +CPU= 30.402
  02:17:59 STEP 1282 H=1282:00 +CPU= 19.439
  02:18:16 STEP 1283 H=1283:00 +CPU= 16.956
  02:18:46 STEP 1284 H=1284:00 +CPU= 29.338
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001284
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001284
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001284
  02:19:06 STEP 1285 H=1285:00 +CPU= 20.145
  02:19:25 STEP 1286 H=1286:00 +CPU= 19.387
  02:19:53 STEP 1287 H=1287:00 +CPU= 27.669
  02:20:11 STEP 1288 H=1288:00 +CPU= 18.395
  02:20:28 STEP 1289 H=1289:00 +CPU= 16.109
  02:20:52 STEP 1290 H=1290:00 +CPU= 24.255
  02:21:10 STEP 1291 H=1291:00 +CPU= 17.731
  02:21:29 STEP 1292 H=1292:00 +CPU= 18.957
  02:21:54 STEP 1293 H=1293:00 +CPU= 25.695
  02:22:13 STEP 1294 H=1294:00 +CPU= 18.435
  02:22:30 STEP 1295 H=1295:00 +CPU= 17.303
  02:23:00 STEP 1296 H=1296:00 +CPU= 29.928
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001296
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001296
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001296
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001272
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001272
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001272
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001284
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001284
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001284
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_53.zip
Uploading the intermediate file: upload_file_53.zip
  02:23:17 STEP 1297 H=1297:00 +CPU= 16.582
  02:23:33 STEP 1298 H=1298:00 +CPU= 16.680
  02:24:02 STEP 1299 H=1299:00 +CPU= 28.687
  02:24:19 STEP 1300 H=1300:00 +CPU= 16.743
  02:24:37 STEP 1301 H=1301:00 +CPU= 18.146
  02:25:04 STEP 1302 H=1302:00 +CPU= 27.403
  02:25:21 STEP 1303 H=1303:00 +CPU= 16.958
  02:25:40 STEP 1304 H=1304:00 +CPU= 18.540
  02:26:04 STEP 1305 H=1305:00 +CPU= 23.946
  02:26:21 STEP 1306 H=1306:00 +CPU= 16.953
  02:26:39 STEP 1307 H=1307:00 +CPU= 18.673
  02:27:08 STEP 1308 H=1308:00 +CPU= 28.480
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001308
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001308
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001308
  02:27:25 STEP 1309 H=1309:00 +CPU= 16.940
  02:27:43 STEP 1310 H=1310:00 +CPU= 18.495
  02:28:08 STEP 1311 H=1311:00 +CPU= 24.846
  02:28:25 STEP 1312 H=1312:00 +CPU= 17.302
  02:28:42 STEP 1313 H=1313:00 +CPU= 16.539
  02:29:08 STEP 1314 H=1314:00 +CPU= 26.314
  02:29:27 STEP 1315 H=1315:00 +CPU= 18.586
  02:29:44 STEP 1316 H=1316:00 +CPU= 17.476
  02:30:12 STEP 1317 H=1317:00 +CPU= 27.518
  02:30:29 STEP 1318 H=1318:00 +CPU= 16.702
  02:30:46 STEP 1319 H=1319:00 +CPU= 16.898
  02:31:21 STEP 1320 H=1320:00 +CPU= 31.956
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001320
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001320
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001320
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001296
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001296
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001296
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001308
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001308
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001308
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_54.zip
Uploading the intermediate file: upload_file_54.zip
  02:31:39 STEP 1321 H=1321:00 +CPU= 18.643
  02:31:58 STEP 1322 H=1322:00 +CPU= 19.061
  02:32:25 STEP 1323 H=1323:00 +CPU= 26.762
  02:32:45 STEP 1324 H=1324:00 +CPU= 19.965
  02:33:03 STEP 1325 H=1325:00 +CPU= 18.387
  02:33:30 STEP 1326 H=1326:00 +CPU= 26.762
  02:33:50 STEP 1327 H=1327:00 +CPU= 19.342
  02:34:06 STEP 1328 H=1328:00 +CPU= 16.594
  02:34:34 STEP 1329 H=1329:00 +CPU= 27.853
  02:34:52 STEP 1330 H=1330:00 +CPU= 18.362
  02:35:10 STEP 1331 H=1331:00 +CPU= 17.664
  02:35:40 STEP 1332 H=1332:00 +CPU= 29.453
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001332
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001332
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001332
  02:35:57 STEP 1333 H=1333:00 +CPU= 17.044
  02:36:16 STEP 1334 H=1334:00 +CPU= 18.967
  02:36:43 STEP 1335 H=1335:00 +CPU= 27.745
  02:37:03 STEP 1336 H=1336:00 +CPU= 19.187
  02:37:20 STEP 1337 H=1337:00 +CPU= 17.288
  02:37:49 STEP 1338 H=1338:00 +CPU= 29.281
  02:38:08 STEP 1339 H=1339:00 +CPU= 19.238
  02:38:29 STEP 1340 H=1340:00 +CPU= 20.303
  02:38:58 STEP 1341 H=1341:00 +CPU= 28.960
  02:39:16 STEP 1342 H=1342:00 +CPU= 18.064
  02:39:34 STEP 1343 H=1343:00 +CPU= 18.258
  02:40:07 STEP 1344 H=1344:00 +CPU= 32.698
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001344
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001344
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001344
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001320
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001320
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001320
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001332
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001332
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001332
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_55.zip
Uploading the intermediate file: upload_file_55.zip
  02:40:25 STEP 1345 H=1345:00 +CPU= 18.447
  02:40:42 STEP 1346 H=1346:00 +CPU= 16.247
  02:41:07 STEP 1347 H=1347:00 +CPU= 25.065
  02:41:24 STEP 1348 H=1348:00 +CPU= 17.804
  02:41:43 STEP 1349 H=1349:00 +CPU= 18.582
  02:42:09 STEP 1350 H=1350:00 +CPU= 25.664
  02:42:25 STEP 1351 H=1351:00 +CPU= 16.096
  02:42:42 STEP 1352 H=1352:00 +CPU= 16.732
  02:43:08 STEP 1353 H=1353:00 +CPU= 26.360
  02:43:28 STEP 1354 H=1354:00 +CPU= 20.259
  02:43:48 STEP 1355 H=1355:00 +CPU= 19.616
  02:44:21 STEP 1356 H=1356:00 +CPU= 33.348
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001356
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001356
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001356
  02:44:41 STEP 1357 H=1357:00 +CPU= 19.778
  02:45:00 STEP 1358 H=1358:00 +CPU= 19.441
  02:45:29 STEP 1359 H=1359:00 +CPU= 28.975
  02:45:48 STEP 1360 H=1360:00 +CPU= 18.996
  02:46:08 STEP 1361 H=1361:00 +CPU= 19.484
  02:46:36 STEP 1362 H=1362:00 +CPU= 27.955
  02:46:54 STEP 1363 H=1363:00 +CPU= 18.251
  02:47:12 STEP 1364 H=1364:00 +CPU= 18.206
  02:47:39 STEP 1365 H=1365:00 +CPU= 26.244
  02:47:56 STEP 1366 H=1366:00 +CPU= 17.664
  02:48:15 STEP 1367 H=1367:00 +CPU= 18.827
  02:48:44 STEP 1368 H=1368:00 +CPU= 29.148
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001368
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001368
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001368
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001344
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001344
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001344
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001356
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001356
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001356
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_56.zip
Uploading the intermediate file: upload_file_56.zip
  02:49:01 STEP 1369 H=1369:00 +CPU= 16.695
  02:49:21 STEP 1370 H=1370:00 +CPU= 20.241
  02:49:46 STEP 1371 H=1371:00 +CPU= 25.008
  02:50:04 STEP 1372 H=1372:00 +CPU= 18.082
  02:50:23 STEP 1373 H=1373:00 +CPU= 18.315
  02:50:49 STEP 1374 H=1374:00 +CPU= 26.528
  02:51:07 STEP 1375 H=1375:00 +CPU= 17.732
  02:51:26 STEP 1376 H=1376:00 +CPU= 19.157
  02:51:56 STEP 1377 H=1377:00 +CPU= 29.502
  02:52:16 STEP 1378 H=1378:00 +CPU= 20.513
  02:52:34 STEP 1379 H=1379:00 +CPU= 17.389
  02:53:02 STEP 1380 H=1380:00 +CPU= 28.264
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001380
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001380
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001380
  02:53:19 STEP 1381 H=1381:00 +CPU= 17.549
  02:53:38 STEP 1382 H=1382:00 +CPU= 18.293
  02:54:07 STEP 1383 H=1383:00 +CPU= 29.048
  02:54:24 STEP 1384 H=1384:00 +CPU= 16.859
  02:54:40 STEP 1385 H=1385:00 +CPU= 16.366
  02:55:09 STEP 1386 H=1386:00 +CPU= 28.717
  02:55:27 STEP 1387 H=1387:00 +CPU= 18.418
  02:55:46 STEP 1388 H=1388:00 +CPU= 18.785
  02:56:12 STEP 1389 H=1389:00 +CPU= 25.900
  02:56:30 STEP 1390 H=1390:00 +CPU= 18.223
  02:56:49 STEP 1391 H=1391:00 +CPU= 19.232
  02:57:23 STEP 1392 H=1392:00 +CPU= 33.086
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001392
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001392
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001392
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001368
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001368
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001368
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001380
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001380
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001380
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_57.zip
Uploading the intermediate file: upload_file_57.zip
  02:57:39 STEP 1393 H=1393:00 +CPU= 15.937
  02:57:59 STEP 1394 H=1394:00 +CPU= 19.492
  02:58:27 STEP 1395 H=1395:00 +CPU= 27.852
  02:58:48 STEP 1396 H=1396:00 +CPU= 21.199
  02:59:07 STEP 1397 H=1397:00 +CPU= 19.378
  02:59:36 STEP 1398 H=1398:00 +CPU= 28.306
  02:59:54 STEP 1399 H=1399:00 +CPU= 18.294
  03:00:10 STEP 1400 H=1400:00 +CPU= 15.597
  03:00:39 STEP 1401 H=1401:00 +CPU= 29.242
  03:00:58 STEP 1402 H=1402:00 +CPU= 19.545
  03:01:18 STEP 1403 H=1403:00 +CPU= 19.152
  03:01:49 STEP 1404 H=1404:00 +CPU= 31.099
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001404
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001404
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001404
  03:02:04 STEP 1405 H=1405:00 +CPU= 15.394
  03:02:21 STEP 1406 H=1406:00 +CPU= 17.117
  03:02:49 STEP 1407 H=1407:00 +CPU= 27.444
  03:03:07 STEP 1408 H=1408:00 +CPU= 18.478
  03:03:24 STEP 1409 H=1409:00 +CPU= 17.280
  03:03:52 STEP 1410 H=1410:00 +CPU= 27.115
  03:04:10 STEP 1411 H=1411:00 +CPU= 18.252
  03:04:29 STEP 1412 H=1412:00 +CPU= 18.729
  03:04:53 STEP 1413 H=1413:00 +CPU= 24.849
  03:05:11 STEP 1414 H=1414:00 +CPU= 17.809
  03:05:29 STEP 1415 H=1415:00 +CPU= 17.699
  03:06:02 STEP 1416 H=1416:00 +CPU= 32.837
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001416
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001416
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001416
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001392
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001392
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001392
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001404
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001404
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001404
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_58.zip
Uploading the intermediate file: upload_file_58.zip
  03:06:20 STEP 1417 H=1417:00 +CPU= 18.250
  03:06:41 STEP 1418 H=1418:00 +CPU= 20.916
  03:07:10 STEP 1419 H=1419:00 +CPU= 28.639
  03:07:31 STEP 1420 H=1420:00 +CPU= 21.741
  03:07:51 STEP 1421 H=1421:00 +CPU= 19.266
  03:08:20 STEP 1422 H=1422:00 +CPU= 29.190
  03:08:37 STEP 1423 H=1423:00 +CPU= 17.097
  03:08:55 STEP 1424 H=1424:00 +CPU= 18.377
  03:09:24 STEP 1425 H=1425:00 +CPU= 28.720
  03:09:42 STEP 1426 H=1426:00 +CPU= 17.991
  03:09:58 STEP 1427 H=1427:00 +CPU= 15.749
  03:10:25 STEP 1428 H=1428:00 +CPU= 27.497
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001428
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001428
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001428
  03:10:44 STEP 1429 H=1429:00 +CPU= 18.286
  03:11:01 STEP 1430 H=1430:00 +CPU= 17.642
  03:11:30 STEP 1431 H=1431:00 +CPU= 28.461
  03:11:50 STEP 1432 H=1432:00 +CPU= 19.659
  03:12:08 STEP 1433 H=1433:00 +CPU= 18.221
  03:12:35 STEP 1434 H=1434:00 +CPU= 27.339
  03:12:54 STEP 1435 H=1435:00 +CPU= 18.911
  03:13:13 STEP 1436 H=1436:00 +CPU= 18.915
  03:13:41 STEP 1437 H=1437:00 +CPU= 28.082
  03:14:00 STEP 1438 H=1438:00 +CPU= 18.585
  03:14:18 STEP 1439 H=1439:00 +CPU= 18.633
  03:14:53 STEP 1440 H=1440:00 +CPU= 34.909
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001440
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001440
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001440
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001416
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001416
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001416
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001428
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001428
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001428
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_59.zip
Uploading the intermediate file: upload_file_59.zip
  03:15:13 STEP 1441 H=1441:00 +CPU= 19.950
Uploading trickle at timestep: 5184000
  03:15:33 STEP 1442 H=1442:00 +CPU= 20.087
  03:16:01 STEP 1443 H=1443:00 +CPU= 27.968
  03:16:20 STEP 1444 H=1444:00 +CPU= 18.407
  03:16:38 STEP 1445 H=1445:00 +CPU= 18.325
  03:17:07 STEP 1446 H=1446:00 +CPU= 28.059
  03:17:23 STEP 1447 H=1447:00 +CPU= 16.457
  03:17:41 STEP 1448 H=1448:00 +CPU= 18.183
  03:18:09 STEP 1449 H=1449:00 +CPU= 27.633
  03:18:28 STEP 1450 H=1450:00 +CPU= 18.735
  03:18:46 STEP 1451 H=1451:00 +CPU= 18.054
  03:19:14 STEP 1452 H=1452:00 +CPU= 28.011
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001452
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001452
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001452
  03:19:30 STEP 1453 H=1453:00 +CPU= 15.995
  03:19:50 STEP 1454 H=1454:00 +CPU= 20.273
  03:20:17 STEP 1455 H=1455:00 +CPU= 26.562
  03:20:34 STEP 1456 H=1456:00 +CPU= 17.799
  03:20:54 STEP 1457 H=1457:00 +CPU= 19.882
  03:21:24 STEP 1458 H=1458:00 +CPU= 29.919
  03:21:44 STEP 1459 H=1459:00 +CPU= 19.660
  03:22:02 STEP 1460 H=1460:00 +CPU= 17.707
  03:22:31 STEP 1461 H=1461:00 +CPU= 29.174
  03:22:50 STEP 1462 H=1462:00 +CPU= 19.677
  03:23:11 STEP 1463 H=1463:00 +CPU= 20.062
  03:23:43 STEP 1464 H=1464:00 +CPU= 32.154
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001464
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001464
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001464
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001440
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001440
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001440
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001452
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001452
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001452
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_60.zip
Uploading the intermediate file: upload_file_60.zip
  03:24:00 STEP 1465 H=1465:00 +CPU= 17.357
  03:24:18 STEP 1466 H=1466:00 +CPU= 17.527
  03:24:46 STEP 1467 H=1467:00 +CPU= 28.067
  03:25:04 STEP 1468 H=1468:00 +CPU= 18.192
  03:25:24 STEP 1469 H=1469:00 +CPU= 20.008
  03:25:52 STEP 1470 H=1470:00 +CPU= 27.399
  03:26:11 STEP 1471 H=1471:00 +CPU= 18.972
  03:26:31 STEP 1472 H=1472:00 +CPU= 20.615
  03:27:01 STEP 1473 H=1473:00 +CPU= 30.013
  03:27:21 STEP 1474 H=1474:00 +CPU= 20.136
  03:27:39 STEP 1475 H=1475:00 +CPU= 17.822
  03:28:09 STEP 1476 H=1476:00 +CPU= 30.331
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001476
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001476
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001476
  03:28:27 STEP 1477 H=1477:00 +CPU= 17.900
  03:28:47 STEP 1478 H=1478:00 +CPU= 19.941
  03:29:16 STEP 1479 H=1479:00 +CPU= 28.492
  03:29:35 STEP 1480 H=1480:00 +CPU= 19.424
  03:29:54 STEP 1481 H=1481:00 +CPU= 18.582
  03:30:23 STEP 1482 H=1482:00 +CPU= 28.755
  03:30:42 STEP 1483 H=1483:00 +CPU= 19.132
  03:31:02 STEP 1484 H=1484:00 +CPU= 20.092
  03:31:30 STEP 1485 H=1485:00 +CPU= 27.760
  03:31:48 STEP 1486 H=1486:00 +CPU= 18.284
  03:32:05 STEP 1487 H=1487:00 +CPU= 16.652
  03:32:37 STEP 1488 H=1488:00 +CPU= 32.692
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001488
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001488
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001488
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001464
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001464
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001464
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001476
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001476
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001476
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_61.zip
Uploading the intermediate file: upload_file_61.zip
  03:32:56 STEP 1489 H=1489:00 +CPU= 18.375
  03:33:14 STEP 1490 H=1490:00 +CPU= 17.702
  03:33:39 STEP 1491 H=1491:00 +CPU= 25.106
  03:33:57 STEP 1492 H=1492:00 +CPU= 18.038
  03:34:14 STEP 1493 H=1493:00 +CPU= 17.367
  03:34:40 STEP 1494 H=1494:00 +CPU= 26.299
  03:34:58 STEP 1495 H=1495:00 +CPU= 17.930
  03:35:17 STEP 1496 H=1496:00 +CPU= 18.696
  03:35:47 STEP 1497 H=1497:00 +CPU= 29.569
  03:36:04 STEP 1498 H=1498:00 +CPU= 17.686
  03:36:25 STEP 1499 H=1499:00 +CPU= 21.144
  03:36:58 STEP 1500 H=1500:00 +CPU= 32.298
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001500
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001500
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001500
  03:37:16 STEP 1501 H=1501:00 +CPU= 18.145
  03:37:34 STEP 1502 H=1502:00 +CPU= 18.084
  03:37:59 STEP 1503 H=1503:00 +CPU= 25.358
  03:38:17 STEP 1504 H=1504:00 +CPU= 17.255
  03:38:36 STEP 1505 H=1505:00 +CPU= 19.600
  03:39:05 STEP 1506 H=1506:00 +CPU= 29.082
  03:39:23 STEP 1507 H=1507:00 +CPU= 17.959
  03:39:43 STEP 1508 H=1508:00 +CPU= 19.503
  03:40:11 STEP 1509 H=1509:00 +CPU= 28.193
  03:40:30 STEP 1510 H=1510:00 +CPU= 18.843
  03:40:48 STEP 1511 H=1511:00 +CPU= 18.294
  03:41:19 STEP 1512 H=1512:00 +CPU= 30.657
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001512
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001512
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001512
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001488
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001488
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001488
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001500
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001500
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001500
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_62.zip
Uploading the intermediate file: upload_file_62.zip
  03:41:37 STEP 1513 H=1513:00 +CPU= 17.882
  03:41:57 STEP 1514 H=1514:00 +CPU= 19.762
  03:42:25 STEP 1515 H=1515:00 +CPU= 28.293
  03:42:45 STEP 1516 H=1516:00 +CPU= 19.784
  03:43:05 STEP 1517 H=1517:00 +CPU= 19.876
  03:43:32 STEP 1518 H=1518:00 +CPU= 26.896
  03:43:52 STEP 1519 H=1519:00 +CPU= 20.567
  03:44:12 STEP 1520 H=1520:00 +CPU= 19.742
  03:44:41 STEP 1521 H=1521:00 +CPU= 29.135
  03:45:00 STEP 1522 H=1522:00 +CPU= 18.911
  03:45:20 STEP 1523 H=1523:00 +CPU= 19.829
  03:45:48 STEP 1524 H=1524:00 +CPU= 28.392
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001524
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001524
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001524
  03:46:07 STEP 1525 H=1525:00 +CPU= 19.087
  03:46:26 STEP 1526 H=1526:00 +CPU= 18.564
  03:46:54 STEP 1527 H=1527:00 +CPU= 28.392
  03:47:15 STEP 1528 H=1528:00 +CPU= 20.274
  03:47:34 STEP 1529 H=1529:00 +CPU= 19.759
  03:48:01 STEP 1530 H=1530:00 +CPU= 26.108
  03:48:19 STEP 1531 H=1531:00 +CPU= 18.444
  03:48:38 STEP 1532 H=1532:00 +CPU= 19.354
  03:49:07 STEP 1533 H=1533:00 +CPU= 28.607
  03:49:25 STEP 1534 H=1534:00 +CPU= 18.239
  03:49:45 STEP 1535 H=1535:00 +CPU= 19.405
  03:50:19 STEP 1536 H=1536:00 +CPU= 34.194
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001536
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001536
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001536
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001512
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001512
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001512
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001524
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001524
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001524
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_63.zip
Uploading the intermediate file: upload_file_63.zip
  03:50:39 STEP 1537 H=1537:00 +CPU= 20.523
  03:51:01 STEP 1538 H=1538:00 +CPU= 21.113
  03:51:30 STEP 1539 H=1539:00 +CPU= 28.942
  03:51:49 STEP 1540 H=1540:00 +CPU= 19.262
  03:52:09 STEP 1541 H=1541:00 +CPU= 20.432
  03:52:38 STEP 1542 H=1542:00 +CPU= 29.099
  03:52:59 STEP 1543 H=1543:00 +CPU= 20.491
  03:53:18 STEP 1544 H=1544:00 +CPU= 18.935
  03:53:45 STEP 1545 H=1545:00 +CPU= 26.785
  03:54:03 STEP 1546 H=1546:00 +CPU= 18.150
  03:54:23 STEP 1547 H=1547:00 +CPU= 20.041
  03:54:54 STEP 1548 H=1548:00 +CPU= 31.532
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001548
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001548
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001548
  03:55:14 STEP 1549 H=1549:00 +CPU= 19.808
  03:55:34 STEP 1550 H=1550:00 +CPU= 19.448
  03:56:03 STEP 1551 H=1551:00 +CPU= 29.389
  03:56:24 STEP 1552 H=1552:00 +CPU= 20.656
  03:56:42 STEP 1553 H=1553:00 +CPU= 18.593
  03:57:10 STEP 1554 H=1554:00 +CPU= 27.306
  03:57:30 STEP 1555 H=1555:00 +CPU= 20.424
  03:57:48 STEP 1556 H=1556:00 +CPU= 17.902
  03:58:15 STEP 1557 H=1557:00 +CPU= 26.796
  03:58:33 STEP 1558 H=1558:00 +CPU= 17.670
  03:58:52 STEP 1559 H=1559:00 +CPU= 19.496
  03:59:26 STEP 1560 H=1560:00 +CPU= 33.953
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001560
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001560
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001560
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001536
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001536
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001536
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001548
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001548
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001548
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_64.zip
Uploading the intermediate file: upload_file_64.zip
  03:59:45 STEP 1561 H=1561:00 +CPU= 18.591
  04:00:06 STEP 1562 H=1562:00 +CPU= 20.440
  04:00:34 STEP 1563 H=1563:00 +CPU= 28.054
  04:00:53 STEP 1564 H=1564:00 +CPU= 19.478
  04:01:12 STEP 1565 H=1565:00 +CPU= 18.590
  04:01:43 STEP 1566 H=1566:00 +CPU= 31.285
  04:02:02 STEP 1567 H=1567:00 +CPU= 19.037
  04:02:21 STEP 1568 H=1568:00 +CPU= 18.636
  04:02:47 STEP 1569 H=1569:00 +CPU= 26.498
  04:03:05 STEP 1570 H=1570:00 +CPU= 17.330
  04:03:21 STEP 1571 H=1571:00 +CPU= 16.221
  04:03:52 STEP 1572 H=1572:00 +CPU= 31.504
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001572
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001572
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001572
  04:04:11 STEP 1573 H=1573:00 +CPU= 18.214
  04:04:31 STEP 1574 H=1574:00 +CPU= 19.967
  04:04:58 STEP 1575 H=1575:00 +CPU= 27.396
  04:05:17 STEP 1576 H=1576:00 +CPU= 18.715
  04:05:36 STEP 1577 H=1577:00 +CPU= 19.736
  04:06:07 STEP 1578 H=1578:00 +CPU= 30.450
  04:06:26 STEP 1579 H=1579:00 +CPU= 18.772
  04:06:44 STEP 1580 H=1580:00 +CPU= 18.820
  04:07:10 STEP 1581 H=1581:00 +CPU= 24.999
  04:07:29 STEP 1582 H=1582:00 +CPU= 19.234
  04:07:50 STEP 1583 H=1583:00 +CPU= 21.053
  04:08:24 STEP 1584 H=1584:00 +CPU= 34.518
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001584
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001584
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001584
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001560
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001560
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001560
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001572
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001572
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001572
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_65.zip
Uploading the intermediate file: upload_file_65.zip
  04:08:44 STEP 1585 H=1585:00 +CPU= 19.319
  04:09:04 STEP 1586 H=1586:00 +CPU= 20.595
  04:09:32 STEP 1587 H=1587:00 +CPU= 27.340
  04:09:52 STEP 1588 H=1588:00 +CPU= 19.952
  04:10:12 STEP 1589 H=1589:00 +CPU= 20.162
  04:10:42 STEP 1590 H=1590:00 +CPU= 30.342
  04:11:01 STEP 1591 H=1591:00 +CPU= 18.982
  04:11:22 STEP 1592 H=1592:00 +CPU= 20.689
  04:11:54 STEP 1593 H=1593:00 +CPU= 32.247
  04:12:18 STEP 1594 H=1594:00 +CPU= 23.498
  04:12:39 STEP 1595 H=1595:00 +CPU= 21.007
  04:13:12 STEP 1596 H=1596:00 +CPU= 33.468
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001596
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001596
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001596
  04:13:35 STEP 1597 H=1597:00 +CPU= 22.455
  04:13:56 STEP 1598 H=1598:00 +CPU= 21.240
  04:14:29 STEP 1599 H=1599:00 +CPU= 32.852
  04:14:51 STEP 1600 H=1600:00 +CPU= 21.804
  04:15:10 STEP 1601 H=1601:00 +CPU= 19.352
  04:15:39 STEP 1602 H=1602:00 +CPU= 29.310
  04:16:00 STEP 1603 H=1603:00 +CPU= 20.225
  04:16:20 STEP 1604 H=1604:00 +CPU= 20.713
  04:16:48 STEP 1605 H=1605:00 +CPU= 27.542
  04:17:07 STEP 1606 H=1606:00 +CPU= 18.754
  04:17:25 STEP 1607 H=1607:00 +CPU= 18.451
  04:18:03 STEP 1608 H=1608:00 +CPU= 37.756
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001608
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001608
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001608
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001584
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001584
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001584
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001596
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001596
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001596
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_66.zip
Uploading the intermediate file: upload_file_66.zip
  04:18:20 STEP 1609 H=1609:00 +CPU= 16.897
  04:18:39 STEP 1610 H=1610:00 +CPU= 18.966
  04:19:07 STEP 1611 H=1611:00 +CPU= 28.693
  04:19:26 STEP 1612 H=1612:00 +CPU= 18.309
  04:19:46 STEP 1613 H=1613:00 +CPU= 20.535
  04:20:18 STEP 1614 H=1614:00 +CPU= 31.439
  04:20:40 STEP 1615 H=1615:00 +CPU= 21.863
  04:21:01 STEP 1616 H=1616:00 +CPU= 21.508
  04:21:33 STEP 1617 H=1617:00 +CPU= 32.167
  04:21:55 STEP 1618 H=1618:00 +CPU= 21.368
  04:22:16 STEP 1619 H=1619:00 +CPU= 21.413
  04:22:50 STEP 1620 H=1620:00 +CPU= 34.184
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001620
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001620
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001620
  04:23:12 STEP 1621 H=1621:00 +CPU= 21.132
  04:23:31 STEP 1622 H=1622:00 +CPU= 19.074
  04:23:57 STEP 1623 H=1623:00 +CPU= 26.427
  04:24:17 STEP 1624 H=1624:00 +CPU= 19.935
  04:24:37 STEP 1625 H=1625:00 +CPU= 20.323
  04:25:09 STEP 1626 H=1626:00 +CPU= 31.740
  04:25:28 STEP 1627 H=1627:00 +CPU= 19.344
  04:25:48 STEP 1628 H=1628:00 +CPU= 19.694
  04:26:18 STEP 1629 H=1629:00 +CPU= 29.603
  04:26:38 STEP 1630 H=1630:00 +CPU= 19.977
  04:26:58 STEP 1631 H=1631:00 +CPU= 19.696
  04:27:41 STEP 1632 H=1632:00 +CPU= 35.303
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001632
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001632
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001632
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001608
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001608
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001608
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001620
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001620
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001620
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_67.zip
Uploading the intermediate file: upload_file_67.zip
  04:28:03 STEP 1633 H=1633:00 +CPU= 21.660
  04:28:24 STEP 1634 H=1634:00 +CPU= 21.155
  04:28:57 STEP 1635 H=1635:00 +CPU= 32.649
  04:29:19 STEP 1636 H=1636:00 +CPU= 22.298
  04:29:39 STEP 1637 H=1637:00 +CPU= 20.538
  04:30:13 STEP 1638 H=1638:00 +CPU= 33.728
  04:30:33 STEP 1639 H=1639:00 +CPU= 20.264
  04:30:54 STEP 1640 H=1640:00 +CPU= 20.548
  04:31:25 STEP 1641 H=1641:00 +CPU= 30.781
  04:31:47 STEP 1642 H=1642:00 +CPU= 22.432
  04:32:09 STEP 1643 H=1643:00 +CPU= 21.522
  04:32:43 STEP 1644 H=1644:00 +CPU= 34.365
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001644
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001644
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001644
  04:33:04 STEP 1645 H=1645:00 +CPU= 20.912
  04:33:24 STEP 1646 H=1646:00 +CPU= 20.021
  04:33:56 STEP 1647 H=1647:00 +CPU= 31.782
  04:34:18 STEP 1648 H=1648:00 +CPU= 21.917
  04:34:41 STEP 1649 H=1649:00 +CPU= 22.742
  04:35:15 STEP 1650 H=1650:00 +CPU= 34.744
  04:35:37 STEP 1651 H=1651:00 +CPU= 21.524
  04:35:57 STEP 1652 H=1652:00 +CPU= 20.442
  04:36:30 STEP 1653 H=1653:00 +CPU= 32.182
  04:36:52 STEP 1654 H=1654:00 +CPU= 22.804
  04:37:16 STEP 1655 H=1655:00 +CPU= 24.034
  04:37:55 STEP 1656 H=1656:00 +CPU= 38.287
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001656
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001656
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001656
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001632
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001632
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001632
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001644
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001644
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001644
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_68.zip
Uploading the intermediate file: upload_file_68.zip
  04:38:15 STEP 1657 H=1657:00 +CPU= 20.608
  04:38:38 STEP 1658 H=1658:00 +CPU= 22.804
  04:39:08 STEP 1659 H=1659:00 +CPU= 29.958
  04:39:28 STEP 1660 H=1660:00 +CPU= 19.433
  04:39:51 STEP 1661 H=1661:00 +CPU= 22.917
  04:40:23 STEP 1662 H=1662:00 +CPU= 32.443
  04:40:42 STEP 1663 H=1663:00 +CPU= 18.953
  04:41:05 STEP 1664 H=1664:00 +CPU= 23.248
  04:41:36 STEP 1665 H=1665:00 +CPU= 31.150
  04:41:57 STEP 1666 H=1666:00 +CPU= 20.737
  04:42:17 STEP 1667 H=1667:00 +CPU= 20.257
  04:42:56 STEP 1668 H=1668:00 +CPU= 38.114
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001668
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001668
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001668
  04:43:18 STEP 1669 H=1669:00 +CPU= 22.740
  04:43:40 STEP 1670 H=1670:00 +CPU= 21.617
  04:44:12 STEP 1671 H=1671:00 +CPU= 31.926
  04:44:32 STEP 1672 H=1672:00 +CPU= 20.366
  04:44:53 STEP 1673 H=1673:00 +CPU= 20.648
  04:45:28 STEP 1674 H=1674:00 +CPU= 34.751
  04:45:51 STEP 1675 H=1675:00 +CPU= 23.198
  04:46:10 STEP 1676 H=1676:00 +CPU= 19.072
  04:46:44 STEP 1677 H=1677:00 +CPU= 33.831
  04:47:05 STEP 1678 H=1678:00 +CPU= 20.694
  04:47:25 STEP 1679 H=1679:00 +CPU= 20.070
  04:48:00 STEP 1680 H=1680:00 +CPU= 35.407
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001680
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001680
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001680
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001656
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001656
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001656
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001668
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001668
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001668
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_69.zip
Uploading the intermediate file: upload_file_69.zip
  04:48:18 STEP 1681 H=1681:00 +CPU= 18.174
Uploading trickle at timestep: 6048000
  04:48:40 STEP 1682 H=1682:00 +CPU= 21.787
  04:49:09 STEP 1683 H=1683:00 +CPU= 28.575
  04:49:31 STEP 1684 H=1684:00 +CPU= 22.117
  04:49:50 STEP 1685 H=1685:00 +CPU= 19.045
  04:50:20 STEP 1686 H=1686:00 +CPU= 29.902
  04:50:41 STEP 1687 H=1687:00 +CPU= 21.598
  04:51:04 STEP 1688 H=1688:00 +CPU= 22.173
  04:51:36 STEP 1689 H=1689:00 +CPU= 31.915
  04:51:59 STEP 1690 H=1690:00 +CPU= 23.517
  04:52:22 STEP 1691 H=1691:00 +CPU= 22.513
  04:52:58 STEP 1692 H=1692:00 +CPU= 36.436
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001692
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001692
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001692
  04:53:19 STEP 1693 H=1693:00 +CPU= 21.380
  04:53:43 STEP 1694 H=1694:00 +CPU= 23.384
  04:54:15 STEP 1695 H=1695:00 +CPU= 31.674
  04:54:35 STEP 1696 H=1696:00 +CPU= 20.164
  04:54:56 STEP 1697 H=1697:00 +CPU= 21.232
  04:55:31 STEP 1698 H=1698:00 +CPU= 35.269
  04:55:51 STEP 1699 H=1699:00 +CPU= 19.864
  04:56:10 STEP 1700 H=1700:00 +CPU= 18.947
  04:56:41 STEP 1701 H=1701:00 +CPU= 31.315
  04:57:02 STEP 1702 H=1702:00 +CPU= 20.039
  04:57:21 STEP 1703 H=1703:00 +CPU= 19.223
  04:57:55 STEP 1704 H=1704:00 +CPU= 33.933
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001704
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001704
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001704
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001680
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001680
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001680
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001692
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001692
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001692
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_70.zip
Uploading the intermediate file: upload_file_70.zip
  04:58:15 STEP 1705 H=1705:00 +CPU= 20.027
  04:58:38 STEP 1706 H=1706:00 +CPU= 23.639
  04:59:10 STEP 1707 H=1707:00 +CPU= 31.563
  04:59:29 STEP 1708 H=1708:00 +CPU= 18.887
  04:59:49 STEP 1709 H=1709:00 +CPU= 20.202
  05:00:21 STEP 1710 H=1710:00 +CPU= 31.468
  05:00:40 STEP 1711 H=1711:00 +CPU= 19.523
  05:01:03 STEP 1712 H=1712:00 +CPU= 22.375
  05:01:35 STEP 1713 H=1713:00 +CPU= 32.433
  05:02:00 STEP 1714 H=1714:00 +CPU= 24.987
  05:02:22 STEP 1715 H=1715:00 +CPU= 21.928
  05:02:55 STEP 1716 H=1716:00 +CPU= 32.604
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001716
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001716
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001716
  05:03:16 STEP 1717 H=1717:00 +CPU= 21.420
  05:03:38 STEP 1718 H=1718:00 +CPU= 22.031
  05:04:07 STEP 1719 H=1719:00 +CPU= 29.107
  05:04:28 STEP 1720 H=1720:00 +CPU= 21.006
  05:04:48 STEP 1721 H=1721:00 +CPU= 19.870
  05:05:12 STEP 1722 H=1722:00 +CPU= 23.905
  05:05:31 STEP 1723 H=1723:00 +CPU= 18.498
  05:05:51 STEP 1724 H=1724:00 +CPU= 20.131
  05:06:19 STEP 1725 H=1725:00 +CPU= 28.518
  05:06:39 STEP 1726 H=1726:00 +CPU= 19.986
  05:06:58 STEP 1727 H=1727:00 +CPU= 19.222
  05:07:36 STEP 1728 H=1728:00 +CPU= 37.895
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001728
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001728
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001728
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001704
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001704
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001704
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001716
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001716
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001716
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_71.zip
Uploading the intermediate file: upload_file_71.zip
  05:07:58 STEP 1729 H=1729:00 +CPU= 22.011
  05:08:19 STEP 1730 H=1730:00 +CPU= 20.487
  05:08:54 STEP 1731 H=1731:00 +CPU= 34.647
  05:09:16 STEP 1732 H=1732:00 +CPU= 21.996
  05:09:37 STEP 1733 H=1733:00 +CPU= 20.958
  05:10:10 STEP 1734 H=1734:00 +CPU= 33.446
  05:10:34 STEP 1735 H=1735:00 +CPU= 24.065
  05:10:59 STEP 1736 H=1736:00 +CPU= 24.368
  05:11:33 STEP 1737 H=1737:00 +CPU= 34.695
  05:11:56 STEP 1738 H=1738:00 +CPU= 22.760
  05:12:18 STEP 1739 H=1739:00 +CPU= 22.099
  05:12:51 STEP 1740 H=1740:00 +CPU= 33.222
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001740
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001740
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001740
  05:13:13 STEP 1741 H=1741:00 +CPU= 21.198
  05:13:34 STEP 1742 H=1742:00 +CPU= 21.871
  05:14:03 STEP 1743 H=1743:00 +CPU= 28.120
  05:14:24 STEP 1744 H=1744:00 +CPU= 21.142
  05:14:43 STEP 1745 H=1745:00 +CPU= 19.245
  05:15:12 STEP 1746 H=1746:00 +CPU= 29.176
  05:15:32 STEP 1747 H=1747:00 +CPU= 20.235
  05:15:55 STEP 1748 H=1748:00 +CPU= 22.521
  05:16:21 STEP 1749 H=1749:00 +CPU= 25.948
  05:16:43 STEP 1750 H=1750:00 +CPU= 22.034
  05:17:05 STEP 1751 H=1751:00 +CPU= 22.369
  05:17:43 STEP 1752 H=1752:00 +CPU= 37.281
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001752
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001752
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001752
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001728
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001728
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001728
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001740
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001740
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001740
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_72.zip
Uploading the intermediate file: upload_file_72.zip
  05:18:03 STEP 1753 H=1753:00 +CPU= 20.653
  05:18:26 STEP 1754 H=1754:00 +CPU= 22.409
  05:18:59 STEP 1755 H=1755:00 +CPU= 32.752
  05:19:23 STEP 1756 H=1756:00 +CPU= 24.047
  05:19:44 STEP 1757 H=1757:00 +CPU= 21.358
  05:20:20 STEP 1758 H=1758:00 +CPU= 35.582
  05:20:42 STEP 1759 H=1759:00 +CPU= 22.757
  05:21:03 STEP 1760 H=1760:00 +CPU= 20.544
  05:21:32 STEP 1761 H=1761:00 +CPU= 29.089
  05:21:53 STEP 1762 H=1762:00 +CPU= 21.127
  05:22:14 STEP 1763 H=1763:00 +CPU= 20.675
  05:22:47 STEP 1764 H=1764:00 +CPU= 33.180
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001764
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001764
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001764
  05:23:07 STEP 1765 H=1765:00 +CPU= 20.290
  05:23:28 STEP 1766 H=1766:00 +CPU= 20.326
  05:23:58 STEP 1767 H=1767:00 +CPU= 30.364
  05:24:18 STEP 1768 H=1768:00 +CPU= 20.108
  05:24:37 STEP 1769 H=1769:00 +CPU= 18.945
  05:25:08 STEP 1770 H=1770:00 +CPU= 30.588
  05:25:29 STEP 1771 H=1771:00 +CPU= 21.204
  05:25:50 STEP 1772 H=1772:00 +CPU= 21.466
  05:26:23 STEP 1773 H=1773:00 +CPU= 32.906
  05:26:44 STEP 1774 H=1774:00 +CPU= 21.072
  05:27:07 STEP 1775 H=1775:00 +CPU= 22.200
  05:27:45 STEP 1776 H=1776:00 +CPU= 37.791
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001776
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001776
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001776
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001752
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001752
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001752
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001764
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001764
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001764
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_73.zip
Uploading the intermediate file: upload_file_73.zip
  05:28:08 STEP 1777 H=1777:00 +CPU= 23.370
  05:28:31 STEP 1778 H=1778:00 +CPU= 22.812
  05:29:03 STEP 1779 H=1779:00 +CPU= 32.665
  05:29:26 STEP 1780 H=1780:00 +CPU= 22.945
  05:29:47 STEP 1781 H=1781:00 +CPU= 20.682
  05:30:18 STEP 1782 H=1782:00 +CPU= 30.519
  05:30:39 STEP 1783 H=1783:00 +CPU= 21.560
  05:30:59 STEP 1784 H=1784:00 +CPU= 19.743
  05:31:32 STEP 1785 H=1785:00 +CPU= 33.452
  05:31:53 STEP 1786 H=1786:00 +CPU= 20.412
  05:32:13 STEP 1787 H=1787:00 +CPU= 19.738
  05:32:50 STEP 1788 H=1788:00 +CPU= 37.575
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001788
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001788
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001788
  05:33:12 STEP 1789 H=1789:00 +CPU= 22.073
  05:33:34 STEP 1790 H=1790:00 +CPU= 22.249
  05:34:05 STEP 1791 H=1791:00 +CPU= 30.514
  05:34:28 STEP 1792 H=1792:00 +CPU= 23.236
  05:34:52 STEP 1793 H=1793:00 +CPU= 23.846
  05:35:29 STEP 1794 H=1794:00 +CPU= 36.460
  05:35:52 STEP 1795 H=1795:00 +CPU= 22.968
  05:36:17 STEP 1796 H=1796:00 +CPU= 25.550
  05:36:55 STEP 1797 H=1797:00 +CPU= 37.518
  05:37:18 STEP 1798 H=1798:00 +CPU= 23.462
  05:37:42 STEP 1799 H=1799:00 +CPU= 24.278
  05:38:23 STEP 1800 H=1800:00 +CPU= 40.613
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001800
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001800
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001800
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001776
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001776
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001776
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001788
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001788
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001788
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_74.zip
Uploading the intermediate file: upload_file_74.zip
  05:38:48 STEP 1801 H=1801:00 +CPU= 24.758
  05:39:14 STEP 1802 H=1802:00 +CPU= 26.075
  05:39:51 STEP 1803 H=1803:00 +CPU= 36.633
  05:40:13 STEP 1804 H=1804:00 +CPU= 22.600
  05:40:36 STEP 1805 H=1805:00 +CPU= 22.325
  05:41:09 STEP 1806 H=1806:00 +CPU= 33.772
  05:41:32 STEP 1807 H=1807:00 +CPU= 22.398
  05:41:53 STEP 1808 H=1808:00 +CPU= 21.098
  05:42:24 STEP 1809 H=1809:00 +CPU= 31.421
  05:42:48 STEP 1810 H=1810:00 +CPU= 23.157
  05:43:09 STEP 1811 H=1811:00 +CPU= 21.490
  05:43:46 STEP 1812 H=1812:00 +CPU= 36.634
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001812
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001812
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001812
  05:44:09 STEP 1813 H=1813:00 +CPU= 23.432
  05:44:34 STEP 1814 H=1814:00 +CPU= 24.416
  05:45:10 STEP 1815 H=1815:00 +CPU= 36.503
  05:45:35 STEP 1816 H=1816:00 +CPU= 25.234
  05:46:01 STEP 1817 H=1817:00 +CPU= 25.055
  05:46:33 STEP 1818 H=1818:00 +CPU= 32.729
  05:46:57 STEP 1819 H=1819:00 +CPU= 23.807
  05:47:22 STEP 1820 H=1820:00 +CPU= 24.825
  05:48:00 STEP 1821 H=1821:00 +CPU= 38.280
  05:48:25 STEP 1822 H=1822:00 +CPU= 24.347
  05:48:50 STEP 1823 H=1823:00 +CPU= 25.281
  05:49:31 STEP 1824 H=1824:00 +CPU= 40.525
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001824
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001824
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001824
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001800
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001800
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001800
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001812
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001812
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001812
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_75.zip
Uploading the intermediate file: upload_file_75.zip
  05:49:53 STEP 1825 H=1825:00 +CPU= 22.695
  05:50:15 STEP 1826 H=1826:00 +CPU= 22.085
  05:50:48 STEP 1827 H=1827:00 +CPU= 32.639
  05:51:12 STEP 1828 H=1828:00 +CPU= 23.928
  05:51:34 STEP 1829 H=1829:00 +CPU= 21.967
  05:52:07 STEP 1830 H=1830:00 +CPU= 33.111
  05:52:31 STEP 1831 H=1831:00 +CPU= 23.460
  05:52:52 STEP 1832 H=1832:00 +CPU= 21.024
  05:53:28 STEP 1833 H=1833:00 +CPU= 36.077
  05:53:51 STEP 1834 H=1834:00 +CPU= 23.427
  05:54:15 STEP 1835 H=1835:00 +CPU= 23.894
  05:54:56 STEP 1836 H=1836:00 +CPU= 40.495
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001836
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001836
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001836
  05:55:20 STEP 1837 H=1837:00 +CPU= 24.182
  05:55:43 STEP 1838 H=1838:00 +CPU= 23.573
  05:56:18 STEP 1839 H=1839:00 +CPU= 34.979
  05:56:42 STEP 1840 H=1840:00 +CPU= 23.931
  05:57:06 STEP 1841 H=1841:00 +CPU= 23.659
  05:57:42 STEP 1842 H=1842:00 +CPU= 35.563
  05:58:03 STEP 1843 H=1843:00 +CPU= 21.495
  05:58:29 STEP 1844 H=1844:00 +CPU= 25.324
  05:59:05 STEP 1845 H=1845:00 +CPU= 36.090
  05:59:29 STEP 1846 H=1846:00 +CPU= 24.314
  05:59:54 STEP 1847 H=1847:00 +CPU= 25.103
  06:00:34 STEP 1848 H=1848:00 +CPU= 39.315
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001848
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001848
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001848
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001824
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001824
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001824
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001836
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001836
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001836
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_76.zip
Uploading the intermediate file: upload_file_76.zip
  06:00:58 STEP 1849 H=1849:00 +CPU= 24.420
  06:01:20 STEP 1850 H=1850:00 +CPU= 22.489
  06:01:55 STEP 1851 H=1851:00 +CPU= 34.868
  06:02:16 STEP 1852 H=1852:00 +CPU= 20.327
  06:02:40 STEP 1853 H=1853:00 +CPU= 24.372
  06:03:16 STEP 1854 H=1854:00 +CPU= 36.334
  06:03:40 STEP 1855 H=1855:00 +CPU= 23.149
  06:04:03 STEP 1856 H=1856:00 +CPU= 22.888
  06:04:32 STEP 1857 H=1857:00 +CPU= 29.587
  06:04:53 STEP 1858 H=1858:00 +CPU= 20.974
  06:05:15 STEP 1859 H=1859:00 +CPU= 21.422
  06:05:51 STEP 1860 H=1860:00 +CPU= 36.737
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001860
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001860
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001860
  06:06:13 STEP 1861 H=1861:00 +CPU= 21.690
  06:06:39 STEP 1862 H=1862:00 +CPU= 25.657
  06:07:14 STEP 1863 H=1863:00 +CPU= 35.298
  06:07:38 STEP 1864 H=1864:00 +CPU= 24.308
  06:08:05 STEP 1865 H=1865:00 +CPU= 26.740
  06:08:37 STEP 1866 H=1866:00 +CPU= 31.418
  06:09:00 STEP 1867 H=1867:00 +CPU= 23.373
  06:09:25 STEP 1868 H=1868:00 +CPU= 25.043
  06:09:56 STEP 1869 H=1869:00 +CPU= 30.727
  06:10:18 STEP 1870 H=1870:00 +CPU= 21.919
  06:10:42 STEP 1871 H=1871:00 +CPU= 24.082
  06:11:29 STEP 1872 H=1872:00 +CPU= 37.322
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001872
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001872
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001872
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001848
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001848
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001848
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMGGhq0f+001860
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMSHhq0f+001860
Adding to the zip: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_12167514/ICMUAhq0f+001860
Zipping up the intermediate file: /home/hangar/boinc/projects/climateprediction.net/oifs_43r3_ps_0870_1981050100_123_950_12167514_2_r952953254_77.zip
Uploading the intermediate file: upload_file_77.zip
  06:11:52 STEP 1873 H=1873:00 +CPU= 22.840
  06:12:16 STEP 1874 H=1874:00 +CPU= 23.953
  06:12:49 STEP 1875 H=1875:00 +CPU= 32.759
  06:13:14 STEP 1876 H=1876:00 +CPU= 25.122
  06:13:34 STEP 1877 H=1877:00 +CPU= 20.091
  06:14:08 STEP 1878 H=1878:00 +CPU= 34.204
  06:14:28 STEP 1879 H=1879:00 +CPU= 20.219
  06:14:49 STEP 1880 H=1880:00 +CPU= 20.168
  06:15:19 STEP 1881 H=1881:00 +CPU= 30.348
  06:15:41 STEP 1882 H=1882:00 +CPU= 22.453
  06:16:01 STEP 1883 H=1883:00 +CPU= 19.206
  06:16:31 STEP 1884 H=1884:00 +CPU= 30.551
Moving to projects directory: /home/hangar/boinc/slots/14/ICMGGhq0f+001884
Moving to projects directory: /home/hangar/boinc/slots/14/ICMSHhq0f+001884
Moving to projects directory: /home/hangar/boinc/slots/14/ICMUAhq0f+001884
  06:16:54 STEP 1885 H=1885:00 +CPU= 22.844
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:16:22 1535225 22295314 oifs_43r3_ps_0870_1981050100_123_950_12167514_2 6,048,000 39,534 0.0065
09 May 2023 16:16:15 1535225 22295314 oifs_43r3_ps_0870_1981050100_123_950_12167514_2 5,184,000 33,965 0.0066
09 May 2023 16:16:09 1535225 22295314 oifs_43r3_ps_0870_1981050100_123_950_12167514_2 4,320,000 28,383 0.0066
09 May 2023 16:16:04 1535225 22295314 oifs_43r3_ps_0870_1981050100_123_950_12167514_2 3,456,000 22,707 0.0066
09 May 2023 16:16:01 1535225 22295314 oifs_43r3_ps_0870_1981050100_123_950_12167514_2 2,592,000 17,431 0.0067
09 May 2023 16:15:55 1535225 22295314 oifs_43r3_ps_0870_1981050100_123_950_12167514_2 1,728,000 12,043 0.0070
09 May 2023 16:15:52 1535225 22295314 oifs_43r3_ps_0870_1981050100_123_950_12167514_2 864,000 6,576 0.0076


©2024 climateprediction.net