climateprediction.net home page
Task 22285089

Task 22285089

Name oifs_43r3_ps_0309_2013050100_123_982_12198953_0
Workunit 12198953
Created 24 Dec 2022, 7:14:26 UTC
Sent 24 Dec 2022, 19:29:57 UTC
Report deadline 23 Jan 2023, 19:29:57 UTC
Received 28 Dec 2022, 2:50:03 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1353495
Run time 2 days 8 hours 47 min 10 sec
CPU time 1 days 22 hours 21 min 4 sec
Validate state Invalid
Credit 8,709.12
Device peak FLOPS 2.50 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,418.82 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,971.03 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
diction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_55.zip
Uploading the intermediate file: upload_file_55.zip
  23:19:19 STEP 1345 H=1345:00 +CPU= 68.389
  23:20:35 STEP 1346 H=1346:00 +CPU= 71.529
  23:22:34 STEP 1347 H=1347:00 +CPU=112.938
  23:23:48 STEP 1348 H=1348:00 +CPU= 70.988
  23:24:59 STEP 1349 H=1349:00 +CPU= 68.111
  23:26:57 STEP 1350 H=1350:00 +CPU=112.894
  23:28:08 STEP 1351 H=1351:00 +CPU= 69.338
  23:29:25 STEP 1352 H=1352:00 +CPU= 72.693
  23:31:20 STEP 1353 H=1353:00 +CPU=111.385
  23:32:34 STEP 1354 H=1354:00 +CPU= 70.852
  23:33:44 STEP 1355 H=1355:00 +CPU= 68.401
  23:35:53 STEP 1356 H=1356:00 +CPU=123.332
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001356
  23:37:06 STEP 1357 H=1357:00 +CPU= 70.546
  23:38:28 STEP 1358 H=1358:00 +CPU= 78.457
  23:40:40 STEP 1359 H=1359:00 +CPU=126.496
  23:42:07 STEP 1360 H=1360:00 +CPU= 83.200
  23:43:25 STEP 1361 H=1361:00 +CPU= 76.530
  23:45:28 STEP 1362 H=1362:00 +CPU=115.434
  23:46:41 STEP 1363 H=1363:00 +CPU= 69.900
  23:47:54 STEP 1364 H=1364:00 +CPU= 70.425
  23:49:50 STEP 1365 H=1365:00 +CPU=110.466
  23:51:06 STEP 1366 H=1366:00 +CPU= 71.116
  23:52:19 STEP 1367 H=1367:00 +CPU= 70.725
  23:54:35 STEP 1368 H=1368:00 +CPU=128.896
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001356
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_56.zip
Uploading the intermediate file: upload_file_56.zip
  23:55:47 STEP 1369 H=1369:00 +CPU= 68.772
  23:56:59 STEP 1370 H=1370:00 +CPU= 70.345
  23:58:54 STEP 1371 H=1371:00 +CPU=111.914
  00:00:17 STEP 1372 H=1372:00 +CPU= 71.303
  00:01:43 STEP 1373 H=1373:00 +CPU= 76.066
  00:03:52 STEP 1374 H=1374:00 +CPU=117.602
  00:05:08 STEP 1375 H=1375:00 +CPU= 70.509
  00:06:29 STEP 1376 H=1376:00 +CPU= 75.605
  00:08:29 STEP 1377 H=1377:00 +CPU=112.378
  00:09:46 STEP 1378 H=1378:00 +CPU= 72.588
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:11:48 STEP 1379 H=1379:00 +CPU= 69.558
  00:14:02 STEP 1380 H=1380:00 +CPU=124.147
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001380
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001380
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001380
  00:15:18 STEP 1381 H=1381:00 +CPU= 69.899
  00:16:33 STEP 1382 H=1382:00 +CPU= 71.318
  00:18:37 STEP 1383 H=1383:00 +CPU=111.039
  00:19:57 STEP 1384 H=1384:00 +CPU= 71.902
  00:21:13 STEP 1385 H=1385:00 +CPU= 69.699
  00:23:16 STEP 1386 H=1386:00 +CPU=114.098
  00:24:31 STEP 1387 H=1387:00 +CPU= 70.054
  00:25:50 STEP 1388 H=1388:00 +CPU= 71.911
  00:27:50 STEP 1389 H=1389:00 +CPU=112.525
  00:29:07 STEP 1390 H=1390:00 +CPU= 72.246
  00:30:26 STEP 1391 H=1391:00 +CPU= 71.120
  00:32:43 STEP 1392 H=1392:00 +CPU=128.212
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001392
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001392
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001380
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_57.zip
Uploading the intermediate file: upload_file_57.zip
  00:33:58 STEP 1393 H=1393:00 +CPU= 70.364
  00:35:14 STEP 1394 H=1394:00 +CPU= 71.824
  00:37:11 STEP 1395 H=1395:00 +CPU=111.101
  00:38:29 STEP 1396 H=1396:00 +CPU= 71.587
  00:39:44 STEP 1397 H=1397:00 +CPU= 69.748
  00:41:45 STEP 1398 H=1398:00 +CPU=113.058
  00:43:06 STEP 1399 H=1399:00 +CPU= 73.420
  00:44:33 STEP 1400 H=1400:00 +CPU= 82.266
  00:46:45 STEP 1401 H=1401:00 +CPU=121.360
  00:48:11 STEP 1402 H=1402:00 +CPU= 77.410
  00:49:27 STEP 1403 H=1403:00 +CPU= 69.779
  00:51:51 STEP 1404 H=1404:00 +CPU=121.958
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001404
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:53:32 STEP 1405 H=1405:00 +CPU= 68.042
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:55:39 STEP 1406 H=1406:00 +CPU= 69.930
  00:57:37 STEP 1407 H=1407:00 +CPU=109.909
  00:58:53 STEP 1408 H=1408:00 +CPU= 71.523
  01:00:06 STEP 1409 H=1409:00 +CPU= 69.395
  01:02:10 STEP 1410 H=1410:00 +CPU=117.651
  01:03:25 STEP 1411 H=1411:00 +CPU= 72.296
  01:04:38 STEP 1412 H=1412:00 +CPU= 70.281
  01:06:38 STEP 1413 H=1413:00 +CPU=112.683
  01:07:54 STEP 1414 H=1414:00 +CPU= 73.156
  01:09:10 STEP 1415 H=1415:00 +CPU= 72.019
  01:11:27 STEP 1416 H=1416:00 +CPU=129.826
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001404
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_58.zip
Uploading the intermediate file: upload_file_58.zip
  01:12:40 STEP 1417 H=1417:00 +CPU= 70.130
  01:13:56 STEP 1418 H=1418:00 +CPU= 71.111
  01:15:53 STEP 1419 H=1419:00 +CPU=111.376
  01:17:09 STEP 1420 H=1420:00 +CPU= 72.437
  01:18:23 STEP 1421 H=1421:00 +CPU= 71.746
  01:20:26 STEP 1422 H=1422:00 +CPU=113.496
  01:21:39 STEP 1423 H=1423:00 +CPU= 70.203
  01:22:52 STEP 1424 H=1424:00 +CPU= 70.965
  01:24:52 STEP 1425 H=1425:00 +CPU=111.061
  01:26:07 STEP 1426 H=1426:00 +CPU= 70.930
  01:27:18 STEP 1427 H=1427:00 +CPU= 69.046
  01:29:26 STEP 1428 H=1428:00 +CPU=120.730
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001428
  01:30:40 STEP 1429 H=1429:00 +CPU= 69.836
  01:31:54 STEP 1430 H=1430:00 +CPU= 71.826
  01:33:49 STEP 1431 H=1431:00 +CPU=110.059
  01:35:07 STEP 1432 H=1432:00 +CPU= 71.252
  01:36:20 STEP 1433 H=1433:00 +CPU= 69.730
  01:38:17 STEP 1434 H=1434:00 +CPU=111.225
  01:39:33 STEP 1435 H=1435:00 +CPU= 69.448
  01:40:49 STEP 1436 H=1436:00 +CPU= 72.478
  01:42:47 STEP 1437 H=1437:00 +CPU=113.400
  01:44:04 STEP 1438 H=1438:00 +CPU= 72.524
  01:45:18 STEP 1439 H=1439:00 +CPU= 71.996
  01:47:36 STEP 1440 H=1440:00 +CPU=129.136
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_59.zip
Uploading the intermediate file: upload_file_59.zip
  01:48:55 STEP 1441 H=1441:00 +CPU= 73.119
  01:50:19 STEP 1442 H=1442:00 +CPU= 78.646
  01:52:29 STEP 1443 H=1443:00 +CPU=124.633
  01:53:44 STEP 1444 H=1444:00 +CPU= 72.031
  01:54:54 STEP 1445 H=1445:00 +CPU= 68.119
  01:56:54 STEP 1446 H=1446:00 +CPU=112.696
  01:58:07 STEP 1447 H=1447:00 +CPU= 69.561
  01:59:22 STEP 1448 H=1448:00 +CPU= 71.791
  02:01:24 STEP 1449 H=1449:00 +CPU=114.356
  02:02:40 STEP 1450 H=1450:00 +CPU= 73.327
  02:03:55 STEP 1451 H=1451:00 +CPU= 69.626
  02:06:03 STEP 1452 H=1452:00 +CPU=122.819
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001452
  02:07:15 STEP 1453 H=1453:00 +CPU= 69.907
  02:08:29 STEP 1454 H=1454:00 +CPU= 71.106
  02:10:25 STEP 1455 H=1455:00 +CPU=110.761
  02:11:42 STEP 1456 H=1456:00 +CPU= 72.691
  02:12:56 STEP 1457 H=1457:00 +CPU= 69.501
  02:14:56 STEP 1458 H=1458:00 +CPU=113.249
  02:15:39 STEP 1459 H=1459:00 +CPU= 41.289
  02:16:56 STEP 1460 H=1460:00 +CPU= 71.003
  02:18:56 STEP 1461 H=1461:00 +CPU=114.098
  02:20:12 STEP 1462 H=1462:00 +CPU= 69.752
  02:21:31 STEP 1463 H=1463:00 +CPU= 74.302
  02:23:46 STEP 1464 H=1464:00 +CPU=126.318
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001452
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_60.zip
Uploading the intermediate file: upload_file_60.zip
  02:24:57 STEP 1465 H=1465:00 +CPU= 68.098
  02:26:13 STEP 1466 H=1466:00 +CPU= 71.406
  02:28:08 STEP 1467 H=1467:00 +CPU=109.100
  02:29:23 STEP 1468 H=1468:00 +CPU= 70.535
  02:30:35 STEP 1469 H=1469:00 +CPU= 68.209
  02:32:32 STEP 1470 H=1470:00 +CPU=111.395
  02:33:42 STEP 1471 H=1471:00 +CPU= 68.189
  02:34:56 STEP 1472 H=1472:00 +CPU= 70.862
  02:36:51 STEP 1473 H=1473:00 +CPU=109.529
  02:38:05 STEP 1474 H=1474:00 +CPU= 69.782
  02:39:18 STEP 1475 H=1475:00 +CPU= 69.436
  02:41:25 STEP 1476 H=1476:00 +CPU=121.032
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001476
  02:42:36 STEP 1477 H=1477:00 +CPU= 69.053
  02:43:52 STEP 1478 H=1478:00 +CPU= 71.709
  02:45:47 STEP 1479 H=1479:00 +CPU=110.025
  02:47:01 STEP 1480 H=1480:00 +CPU= 71.510
  02:48:13 STEP 1481 H=1481:00 +CPU= 68.986
  02:50:10 STEP 1482 H=1482:00 +CPU=112.971
  02:51:22 STEP 1483 H=1483:00 +CPU= 69.338
  02:52:35 STEP 1484 H=1484:00 +CPU= 71.700
  02:54:43 STEP 1485 H=1485:00 +CPU=123.737
  02:56:05 STEP 1486 H=1486:00 +CPU= 77.246
  02:57:28 STEP 1487 H=1487:00 +CPU= 76.575
  02:59:43 STEP 1488 H=1488:00 +CPU=128.556
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001476
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_61.zip
Uploading the intermediate file: upload_file_61.zip
Uploading trickle at timestep: 5356800
  03:01:00 STEP 1489 H=1489:00 +CPU= 69.470
  03:02:17 STEP 1490 H=1490:00 +CPU= 73.870
  03:04:13 STEP 1491 H=1491:00 +CPU=109.965
  03:05:27 STEP 1492 H=1492:00 +CPU= 70.650
  03:06:40 STEP 1493 H=1493:00 +CPU= 69.623
  03:08:37 STEP 1494 H=1494:00 +CPU=113.116
  03:09:54 STEP 1495 H=1495:00 +CPU= 69.809
  03:11:09 STEP 1496 H=1496:00 +CPU= 72.188
  03:13:05 STEP 1497 H=1497:00 +CPU=110.847
  03:14:19 STEP 1498 H=1498:00 +CPU= 71.774
  03:15:31 STEP 1499 H=1499:00 +CPU= 68.961
  03:17:40 STEP 1500 H=1500:00 +CPU=124.977
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001500
  03:18:57 STEP 1501 H=1501:00 +CPU= 69.914
  03:20:12 STEP 1502 H=1502:00 +CPU= 71.999
  03:22:08 STEP 1503 H=1503:00 +CPU=110.742
  03:23:25 STEP 1504 H=1504:00 +CPU= 72.080
  03:24:36 STEP 1505 H=1505:00 +CPU= 68.559
  03:26:35 STEP 1506 H=1506:00 +CPU=113.409
  03:27:47 STEP 1507 H=1507:00 +CPU= 68.814
  03:28:59 STEP 1508 H=1508:00 +CPU= 69.351
  03:30:54 STEP 1509 H=1509:00 +CPU=110.237
  03:32:08 STEP 1510 H=1510:00 +CPU= 71.312
  03:33:23 STEP 1511 H=1511:00 +CPU= 72.281
  03:35:40 STEP 1512 H=1512:00 +CPU=127.650
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001500
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_62.zip
Uploading the intermediate file: upload_file_62.zip
  03:36:53 STEP 1513 H=1513:00 +CPU= 69.195
  03:38:06 STEP 1514 H=1514:00 +CPU= 69.573
  03:40:00 STEP 1515 H=1515:00 +CPU=109.873
  03:41:19 STEP 1516 H=1516:00 +CPU= 69.394
  03:42:31 STEP 1517 H=1517:00 +CPU= 69.161
  03:44:29 STEP 1518 H=1518:00 +CPU=113.493
  03:45:43 STEP 1519 H=1519:00 +CPU= 69.175
  03:46:55 STEP 1520 H=1520:00 +CPU= 70.502
  03:48:49 STEP 1521 H=1521:00 +CPU=109.729
  03:50:03 STEP 1522 H=1522:00 +CPU= 70.799
  03:51:16 STEP 1523 H=1523:00 +CPU= 70.125
  03:53:23 STEP 1524 H=1524:00 +CPU=123.084
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001524
  03:54:34 STEP 1525 H=1525:00 +CPU= 69.163
  03:55:48 STEP 1526 H=1526:00 +CPU= 70.802
  03:57:48 STEP 1527 H=1527:00 +CPU=112.399
  03:59:12 STEP 1528 H=1528:00 +CPU= 79.939
  04:00:38 STEP 1529 H=1529:00 +CPU= 77.575
  04:02:48 STEP 1530 H=1530:00 +CPU=123.024
  04:04:01 STEP 1531 H=1531:00 +CPU= 70.129
  04:05:17 STEP 1532 H=1532:00 +CPU= 72.984
  04:07:15 STEP 1533 H=1533:00 +CPU=112.265
  04:08:33 STEP 1534 H=1534:00 +CPU= 71.030
  04:09:47 STEP 1535 H=1535:00 +CPU= 71.504
  04:12:07 STEP 1536 H=1536:00 +CPU=130.654
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_63.zip
Uploading the intermediate file: upload_file_63.zip
  04:13:20 STEP 1537 H=1537:00 +CPU= 69.570
  04:14:34 STEP 1538 H=1538:00 +CPU= 71.543
  04:16:29 STEP 1539 H=1539:00 +CPU=111.304
  04:17:47 STEP 1540 H=1540:00 +CPU= 75.190
  04:19:00 STEP 1541 H=1541:00 +CPU= 71.030
  04:21:00 STEP 1542 H=1542:00 +CPU=113.068
  04:22:14 STEP 1543 H=1543:00 +CPU= 69.223
  04:23:28 STEP 1544 H=1544:00 +CPU= 71.495
  04:25:21 STEP 1545 H=1545:00 +CPU=110.895
  04:26:36 STEP 1546 H=1546:00 +CPU= 71.405
  04:27:47 STEP 1547 H=1547:00 +CPU= 68.824
  04:29:54 STEP 1548 H=1548:00 +CPU=123.245
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001548
  04:31:05 STEP 1549 H=1549:00 +CPU= 68.870
  04:32:18 STEP 1550 H=1550:00 +CPU= 71.188
  04:34:10 STEP 1551 H=1551:00 +CPU=109.149
  04:35:24 STEP 1552 H=1552:00 +CPU= 72.135
  04:36:37 STEP 1553 H=1553:00 +CPU= 68.721
  04:38:37 STEP 1554 H=1554:00 +CPU=116.853
  04:39:49 STEP 1555 H=1555:00 +CPU= 69.439
  04:41:03 STEP 1556 H=1556:00 +CPU= 72.063
  04:42:56 STEP 1557 H=1557:00 +CPU=110.703
  04:44:09 STEP 1558 H=1558:00 +CPU= 71.453
  04:45:25 STEP 1559 H=1559:00 +CPU= 72.022
  04:47:40 STEP 1560 H=1560:00 +CPU=129.259
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001548
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_64.zip
Uploading the intermediate file: upload_file_64.zip
  04:48:53 STEP 1561 H=1561:00 +CPU= 69.981
  04:50:07 STEP 1562 H=1562:00 +CPU= 71.195
  04:52:01 STEP 1563 H=1563:00 +CPU=110.460
  04:53:14 STEP 1564 H=1564:00 +CPU= 70.616
  04:54:23 STEP 1565 H=1565:00 +CPU= 68.390
  04:56:20 STEP 1566 H=1566:00 +CPU=113.050
  04:57:30 STEP 1567 H=1567:00 +CPU= 68.879
  04:58:43 STEP 1568 H=1568:00 +CPU= 71.711
  05:00:41 STEP 1569 H=1569:00 +CPU=111.999
  05:01:56 STEP 1570 H=1570:00 +CPU= 72.742
  05:03:11 STEP 1571 H=1571:00 +CPU= 72.466
  05:05:29 STEP 1572 H=1572:00 +CPU=132.545
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001572
  05:06:47 STEP 1573 H=1573:00 +CPU= 76.250
  05:08:07 STEP 1574 H=1574:00 +CPU= 77.673
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:10:21 STEP 1575 H=1575:00 +CPU=112.188
  05:11:34 STEP 1576 H=1576:00 +CPU= 71.055
  05:12:46 STEP 1577 H=1577:00 +CPU= 70.083
  05:14:42 STEP 1578 H=1578:00 +CPU=112.435
  05:15:54 STEP 1579 H=1579:00 +CPU= 69.570
  05:17:12 STEP 1580 H=1580:00 +CPU= 73.423
  05:19:09 STEP 1581 H=1581:00 +CPU=112.528
  05:20:23 STEP 1582 H=1582:00 +CPU= 70.633
  05:21:41 STEP 1583 H=1583:00 +CPU= 72.416
  05:23:56 STEP 1584 H=1584:00 +CPU=127.162
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001572
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_65.zip
Uploading the intermediate file: upload_file_65.zip
  05:25:08 STEP 1585 H=1585:00 +CPU= 68.837
  05:26:24 STEP 1586 H=1586:00 +CPU= 71.289
  05:28:18 STEP 1587 H=1587:00 +CPU=110.437
  05:29:31 STEP 1588 H=1588:00 +CPU= 71.228
  05:30:41 STEP 1589 H=1589:00 +CPU= 68.672
  05:32:39 STEP 1590 H=1590:00 +CPU=113.432
  05:33:54 STEP 1591 H=1591:00 +CPU= 70.688
  05:35:09 STEP 1592 H=1592:00 +CPU= 72.996
  05:37:04 STEP 1593 H=1593:00 +CPU=108.776
  05:38:17 STEP 1594 H=1594:00 +CPU= 71.556
  05:39:29 STEP 1595 H=1595:00 +CPU= 69.141
  05:41:33 STEP 1596 H=1596:00 +CPU=120.289
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001596
  05:42:47 STEP 1597 H=1597:00 +CPU= 69.462
  05:44:01 STEP 1598 H=1598:00 +CPU= 72.368
  05:45:54 STEP 1599 H=1599:00 +CPU=108.878
  05:47:08 STEP 1600 H=1600:00 +CPU= 71.645
  05:48:19 STEP 1601 H=1601:00 +CPU= 69.669
  05:50:14 STEP 1602 H=1602:00 +CPU=112.494
  05:51:25 STEP 1603 H=1603:00 +CPU= 68.729
  05:52:36 STEP 1604 H=1604:00 +CPU= 70.096
  05:54:37 STEP 1605 H=1605:00 +CPU=112.320
  05:55:50 STEP 1606 H=1606:00 +CPU= 69.528
  05:57:09 STEP 1607 H=1607:00 +CPU= 71.150
  05:59:32 STEP 1608 H=1608:00 +CPU=127.253
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001596
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_66.zip
Uploading the intermediate file: upload_file_66.zip
  06:00:50 STEP 1609 H=1609:00 +CPU= 68.605
  06:02:07 STEP 1610 H=1610:00 +CPU= 71.659
  06:04:04 STEP 1611 H=1611:00 +CPU=109.787
  06:05:23 STEP 1612 H=1612:00 +CPU= 73.093
  06:06:40 STEP 1613 H=1613:00 +CPU= 70.031
  06:08:49 STEP 1614 H=1614:00 +CPU=116.859
  06:10:15 STEP 1615 H=1615:00 +CPU= 79.141
  06:11:41 STEP 1616 H=1616:00 +CPU= 81.041
  06:13:48 STEP 1617 H=1617:00 +CPU=117.947
  06:15:05 STEP 1618 H=1618:00 +CPU= 72.607
  06:16:18 STEP 1619 H=1619:00 +CPU= 68.893
  06:18:35 STEP 1620 H=1620:00 +CPU=123.060
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001620
  06:19:49 STEP 1621 H=1621:00 +CPU= 69.482
  06:21:09 STEP 1622 H=1622:00 +CPU= 72.780
  06:23:08 STEP 1623 H=1623:00 +CPU=109.286
  06:24:24 STEP 1624 H=1624:00 +CPU= 70.085
  06:25:58 STEP 1625 H=1625:00 +CPU= 69.915
  06:28:06 STEP 1626 H=1626:00 +CPU=112.604
  06:29:22 STEP 1627 H=1627:00 +CPU= 69.340
  06:30:45 STEP 1628 H=1628:00 +CPU= 70.480
  06:32:51 STEP 1629 H=1629:00 +CPU=110.690
  06:34:12 STEP 1630 H=1630:00 +CPU= 70.410
  06:35:33 STEP 1631 H=1631:00 +CPU= 71.055
  06:38:00 STEP 1632 H=1632:00 +CPU=127.115
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_67.zip
Uploading the intermediate file: upload_file_67.zip
  06:39:23 STEP 1633 H=1633:00 +CPU= 70.179
  06:40:42 STEP 1634 H=1634:00 +CPU= 70.908
  06:42:43 STEP 1635 H=1635:00 +CPU=109.015
  06:44:01 STEP 1636 H=1636:00 +CPU= 69.988
  06:45:21 STEP 1637 H=1637:00 +CPU= 69.293
  06:47:30 STEP 1638 H=1638:00 +CPU=114.048
  06:48:49 STEP 1639 H=1639:00 +CPU= 68.418
  06:50:10 STEP 1640 H=1640:00 +CPU= 70.382
  06:52:21 STEP 1641 H=1641:00 +CPU=111.139
  06:53:42 STEP 1642 H=1642:00 +CPU= 71.156
  06:54:59 STEP 1643 H=1643:00 +CPU= 69.196
  06:57:25 STEP 1644 H=1644:00 +CPU=124.610
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001644
  06:58:49 STEP 1645 H=1645:00 +CPU= 70.004
  07:00:22 STEP 1646 H=1646:00 +CPU= 70.312
  07:02:38 STEP 1647 H=1647:00 +CPU=107.381
  07:04:03 STEP 1648 H=1648:00 +CPU= 69.569
  07:05:24 STEP 1649 H=1649:00 +CPU= 70.334
  07:07:35 STEP 1650 H=1650:00 +CPU=112.517
  07:09:01 STEP 1651 H=1651:00 +CPU= 71.068
  07:10:24 STEP 1652 H=1652:00 +CPU= 72.069
  07:12:35 STEP 1653 H=1653:00 +CPU=111.626
  07:14:07 STEP 1654 H=1654:00 +CPU= 77.029
  07:15:48 STEP 1655 H=1655:00 +CPU= 76.057
  07:18:28 STEP 1656 H=1656:00 +CPU=139.813
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001644
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_68.zip
Uploading the intermediate file: upload_file_68.zip
  07:19:46 STEP 1657 H=1657:00 +CPU= 71.065
  07:21:05 STEP 1658 H=1658:00 +CPU= 70.493
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:23:22 STEP 1659 H=1659:00 +CPU=108.818
  07:24:43 STEP 1660 H=1660:00 +CPU= 71.441
  07:26:02 STEP 1661 H=1661:00 +CPU= 69.732
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  07:28:36 STEP 1662 H=1662:00 +CPU=111.583
  07:29:52 STEP 1663 H=1663:00 +CPU= 69.598
  07:31:10 STEP 1664 H=1664:00 +CPU= 71.756
  07:33:10 STEP 1665 H=1665:00 +CPU=110.203
  07:34:25 STEP 1666 H=1666:00 +CPU= 70.806
  07:35:41 STEP 1667 H=1667:00 +CPU= 69.071
  07:37:54 STEP 1668 H=1668:00 +CPU=122.340
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001668
  07:39:10 STEP 1669 H=1669:00 +CPU= 68.521
  07:40:25 STEP 1670 H=1670:00 +CPU= 71.163
  07:42:23 STEP 1671 H=1671:00 +CPU=110.600
  07:43:39 STEP 1672 H=1672:00 +CPU= 72.212
  07:44:53 STEP 1673 H=1673:00 +CPU= 69.628
  07:46:56 STEP 1674 H=1674:00 +CPU=114.126
  07:48:10 STEP 1675 H=1675:00 +CPU= 68.345
  07:49:27 STEP 1676 H=1676:00 +CPU= 70.696
  07:51:24 STEP 1677 H=1677:00 +CPU=110.049
  07:52:40 STEP 1678 H=1678:00 +CPU= 70.885
  07:53:55 STEP 1679 H=1679:00 +CPU= 70.885
  07:56:16 STEP 1680 H=1680:00 +CPU=128.371
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_69.zip
Uploading the intermediate file: upload_file_69.zip
  07:57:29 STEP 1681 H=1681:00 +CPU= 68.078
  07:58:43 STEP 1682 H=1682:00 +CPU= 70.543
  08:00:45 STEP 1683 H=1683:00 +CPU=111.683
  08:02:03 STEP 1684 H=1684:00 +CPU= 72.317
  08:03:18 STEP 1685 H=1685:00 +CPU= 69.725
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:05:42 STEP 1686 H=1686:00 +CPU=111.135
  08:06:56 STEP 1687 H=1687:00 +CPU= 69.217
  08:08:11 STEP 1688 H=1688:00 +CPU= 71.079
  08:10:12 STEP 1689 H=1689:00 +CPU=111.214
  08:11:31 STEP 1690 H=1690:00 +CPU= 72.783
  08:12:45 STEP 1691 H=1691:00 +CPU= 68.652
  08:14:59 STEP 1692 H=1692:00 +CPU=123.035
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001692
  08:16:15 STEP 1693 H=1693:00 +CPU= 70.037
  08:17:35 STEP 1694 H=1694:00 +CPU= 74.623
  08:19:50 STEP 1695 H=1695:00 +CPU=124.035
  08:21:22 STEP 1696 H=1696:00 +CPU= 80.462
  08:22:43 STEP 1697 H=1697:00 +CPU= 75.925
  08:24:45 STEP 1698 H=1698:00 +CPU=114.000
  08:25:59 STEP 1699 H=1699:00 +CPU= 70.367
  08:27:16 STEP 1700 H=1700:00 +CPU= 70.740
  08:29:13 STEP 1701 H=1701:00 +CPU=109.959
  08:30:29 STEP 1702 H=1702:00 +CPU= 70.890
  08:31:45 STEP 1703 H=1703:00 +CPU= 70.843
  08:34:07 STEP 1704 H=1704:00 +CPU=131.329
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_70.zip
Uploading the intermediate file: upload_file_70.zip
  08:35:24 STEP 1705 H=1705:00 +CPU= 70.147
  08:36:40 STEP 1706 H=1706:00 +CPU= 71.601
  08:38:40 STEP 1707 H=1707:00 +CPU=112.735
  08:39:57 STEP 1708 H=1708:00 +CPU= 70.816
  08:41:11 STEP 1709 H=1709:00 +CPU= 69.221
  08:43:10 STEP 1710 H=1710:00 +CPU=113.401
  08:44:24 STEP 1711 H=1711:00 +CPU= 69.882
  08:45:41 STEP 1712 H=1712:00 +CPU= 71.388
  08:47:38 STEP 1713 H=1713:00 +CPU=109.804
  08:48:54 STEP 1714 H=1714:00 +CPU= 70.516
  08:50:10 STEP 1715 H=1715:00 +CPU= 69.976
  08:52:21 STEP 1716 H=1716:00 +CPU=120.759
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001716
  08:53:35 STEP 1717 H=1717:00 +CPU= 70.087
  08:54:48 STEP 1718 H=1718:00 +CPU= 70.480
  08:56:46 STEP 1719 H=1719:00 +CPU=109.622
  08:58:03 STEP 1720 H=1720:00 +CPU= 72.252
  08:59:17 STEP 1721 H=1721:00 +CPU= 67.655
  09:01:20 STEP 1722 H=1722:00 +CPU=114.947
  09:02:32 STEP 1723 H=1723:00 +CPU= 70.651
  09:03:47 STEP 1724 H=1724:00 +CPU= 73.048
  09:05:40 STEP 1725 H=1725:00 +CPU=110.148
  09:06:53 STEP 1726 H=1726:00 +CPU= 71.535
  09:08:07 STEP 1727 H=1727:00 +CPU= 71.771
  09:10:21 STEP 1728 H=1728:00 +CPU=130.893
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_71.zip
Uploading the intermediate file: upload_file_71.zip
Uploading trickle at timestep: 6220800
  09:11:35 STEP 1729 H=1729:00 +CPU= 70.753
  09:12:51 STEP 1730 H=1730:00 +CPU= 73.722
  09:14:45 STEP 1731 H=1731:00 +CPU=111.699
  09:15:57 STEP 1732 H=1732:00 +CPU= 71.131
  09:17:08 STEP 1733 H=1733:00 +CPU= 69.348
  09:19:10 STEP 1734 H=1734:00 +CPU=115.198
  09:20:21 STEP 1735 H=1735:00 +CPU= 68.813
  09:21:34 STEP 1736 H=1736:00 +CPU= 71.116
  09:23:38 STEP 1737 H=1737:00 +CPU=118.140
  09:24:58 STEP 1738 H=1738:00 +CPU= 77.419
  09:26:17 STEP 1739 H=1739:00 +CPU= 76.511
  09:28:36 STEP 1740 H=1740:00 +CPU=133.793
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001740
  09:29:46 STEP 1741 H=1741:00 +CPU= 69.128
  09:30:58 STEP 1742 H=1742:00 +CPU= 70.647
  09:32:53 STEP 1743 H=1743:00 +CPU=111.383
  09:34:07 STEP 1744 H=1744:00 +CPU= 71.799
  09:35:18 STEP 1745 H=1745:00 +CPU= 69.503
  09:37:14 STEP 1746 H=1746:00 +CPU=112.578
  09:38:25 STEP 1747 H=1747:00 +CPU= 69.283
  09:39:39 STEP 1748 H=1748:00 +CPU= 71.208
  09:41:34 STEP 1749 H=1749:00 +CPU=112.803
  09:42:54 STEP 1750 H=1750:00 +CPU= 71.780
  09:44:09 STEP 1751 H=1751:00 +CPU= 72.648
  09:46:28 STEP 1752 H=1752:00 +CPU=132.353
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_72.zip
Uploading the intermediate file: upload_file_72.zip
  09:47:38 STEP 1753 H=1753:00 +CPU= 67.277
  09:48:51 STEP 1754 H=1754:00 +CPU= 70.762
  09:50:32 STEP 1755 H=1755:00 +CPU= 98.893
  09:51:26 STEP 1756 H=1756:00 +CPU= 52.847
  09:52:38 STEP 1757 H=1757:00 +CPU= 69.873
  09:54:33 STEP 1758 H=1758:00 +CPU=112.801
  09:55:43 STEP 1759 H=1759:00 +CPU= 68.285
  09:56:57 STEP 1760 H=1760:00 +CPU= 71.066
  09:58:50 STEP 1761 H=1761:00 +CPU=110.719
  10:00:04 STEP 1762 H=1762:00 +CPU= 71.500
  10:01:20 STEP 1763 H=1763:00 +CPU= 69.847
  10:03:29 STEP 1764 H=1764:00 +CPU=126.440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001764
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:05:00 STEP 1765 H=1765:00 +CPU= 69.361
  10:06:12 STEP 1766 H=1766:00 +CPU= 69.567
  10:08:08 STEP 1767 H=1767:00 +CPU=111.759
  10:09:21 STEP 1768 H=1768:00 +CPU= 70.614
  10:10:32 STEP 1769 H=1769:00 +CPU= 68.363
  10:12:29 STEP 1770 H=1770:00 +CPU=113.610
  10:13:41 STEP 1771 H=1771:00 +CPU= 70.371
  10:14:55 STEP 1772 H=1772:00 +CPU= 71.894
  10:16:52 STEP 1773 H=1773:00 +CPU=112.645
  10:18:09 STEP 1774 H=1774:00 +CPU= 75.514
  10:19:23 STEP 1775 H=1775:00 +CPU= 71.335
  10:21:41 STEP 1776 H=1776:00 +CPU=132.401
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_73.zip
Uploading the intermediate file: upload_file_73.zip
  10:22:55 STEP 1777 H=1777:00 +CPU= 69.276
  10:24:11 STEP 1778 H=1778:00 +CPU= 73.024
  10:26:07 STEP 1779 H=1779:00 +CPU=113.209
  10:27:23 STEP 1780 H=1780:00 +CPU= 72.250
  10:28:38 STEP 1781 H=1781:00 +CPU= 73.717
  10:30:49 STEP 1782 H=1782:00 +CPU=126.396
  10:32:09 STEP 1783 H=1783:00 +CPU= 77.121
  10:33:28 STEP 1784 H=1784:00 +CPU= 76.363
  10:35:23 STEP 1785 H=1785:00 +CPU=110.961
  10:36:38 STEP 1786 H=1786:00 +CPU= 72.324
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:38:21 STEP 1787 H=1787:00 +CPU= 68.063
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  10:40:43 STEP 1788 H=1788:00 +CPU=119.757
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001788
  10:41:52 STEP 1789 H=1789:00 +CPU= 67.029
  10:43:07 STEP 1790 H=1790:00 +CPU= 70.972
  10:45:00 STEP 1791 H=1791:00 +CPU=109.920
  10:46:14 STEP 1792 H=1792:00 +CPU= 70.920
  10:47:26 STEP 1793 H=1793:00 +CPU= 68.296
  10:49:24 STEP 1794 H=1794:00 +CPU=113.317
  10:50:36 STEP 1795 H=1795:00 +CPU= 70.149
  10:51:49 STEP 1796 H=1796:00 +CPU= 71.022
  10:53:45 STEP 1797 H=1797:00 +CPU=110.660
  10:55:02 STEP 1798 H=1798:00 +CPU= 72.366
  10:56:21 STEP 1799 H=1799:00 +CPU= 72.108
  10:58:39 STEP 1800 H=1800:00 +CPU=128.922
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_74.zip
Uploading the intermediate file: upload_file_74.zip
  10:59:51 STEP 1801 H=1801:00 +CPU= 68.686
  11:01:08 STEP 1802 H=1802:00 +CPU= 72.005
  11:03:03 STEP 1803 H=1803:00 +CPU=109.893
  11:04:20 STEP 1804 H=1804:00 +CPU= 72.979
  11:05:36 STEP 1805 H=1805:00 +CPU= 73.266
  11:07:34 STEP 1806 H=1806:00 +CPU=113.335
  11:08:45 STEP 1807 H=1807:00 +CPU= 69.967
  11:10:01 STEP 1808 H=1808:00 +CPU= 72.899
  11:11:56 STEP 1809 H=1809:00 +CPU=112.320
  11:13:12 STEP 1810 H=1810:00 +CPU= 71.027
  11:14:24 STEP 1811 H=1811:00 +CPU= 70.420
  11:16:34 STEP 1812 H=1812:00 +CPU=125.221
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001812
  11:17:49 STEP 1813 H=1813:00 +CPU= 72.905
  11:19:05 STEP 1814 H=1814:00 +CPU= 73.227
  11:21:01 STEP 1815 H=1815:00 +CPU=110.373
  11:22:15 STEP 1816 H=1816:00 +CPU= 70.382
  11:23:29 STEP 1817 H=1817:00 +CPU= 69.405
  11:25:28 STEP 1818 H=1818:00 +CPU=113.432
  11:26:41 STEP 1819 H=1819:00 +CPU= 68.481
  11:27:56 STEP 1820 H=1820:00 +CPU= 70.671
  11:29:51 STEP 1821 H=1821:00 +CPU=112.131
  11:31:05 STEP 1822 H=1822:00 +CPU= 72.032
  11:32:19 STEP 1823 H=1823:00 +CPU= 71.497
  11:34:49 STEP 1824 H=1824:00 +CPU=140.008
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_75.zip
Uploading the intermediate file: upload_file_75.zip
  11:36:07 STEP 1825 H=1825:00 +CPU= 75.357
  11:37:30 STEP 1826 H=1826:00 +CPU= 80.521
  11:39:27 STEP 1827 H=1827:00 +CPU=112.248
  11:40:40 STEP 1828 H=1828:00 +CPU= 71.308
  11:41:55 STEP 1829 H=1829:00 +CPU= 68.525
  11:43:54 STEP 1830 H=1830:00 +CPU=113.577
  11:45:09 STEP 1831 H=1831:00 +CPU= 70.038
  11:46:21 STEP 1832 H=1832:00 +CPU= 70.733
  11:48:15 STEP 1833 H=1833:00 +CPU=111.261
  11:49:28 STEP 1834 H=1834:00 +CPU= 71.829
  11:50:43 STEP 1835 H=1835:00 +CPU= 69.821
  11:52:50 STEP 1836 H=1836:00 +CPU=122.887
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001836
  11:54:03 STEP 1837 H=1837:00 +CPU= 69.811
  11:55:16 STEP 1838 H=1838:00 +CPU= 70.405
  11:57:14 STEP 1839 H=1839:00 +CPU=109.751
  11:58:31 STEP 1840 H=1840:00 +CPU= 70.243
  11:59:44 STEP 1841 H=1841:00 +CPU= 69.649
  12:01:45 STEP 1842 H=1842:00 +CPU=113.444
  12:02:57 STEP 1843 H=1843:00 +CPU= 70.440
  12:04:13 STEP 1844 H=1844:00 +CPU= 72.906
  12:06:07 STEP 1845 H=1845:00 +CPU=111.712
  12:07:24 STEP 1846 H=1846:00 +CPU= 72.382
  12:08:39 STEP 1847 H=1847:00 +CPU= 71.370
  12:11:01 STEP 1848 H=1848:00 +CPU=131.516
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801_76.zip
Uploading the intermediate file: upload_file_76.zip
  12:12:17 STEP 1849 H=1849:00 +CPU= 70.948
  12:13:34 STEP 1850 H=1850:00 +CPU= 71.923
  12:15:30 STEP 1851 H=1851:00 +CPU=111.067
  12:16:46 STEP 1852 H=1852:00 +CPU= 72.741
  12:18:02 STEP 1853 H=1853:00 +CPU= 72.861
  12:20:01 STEP 1854 H=1854:00 +CPU=114.321
  12:21:16 STEP 1855 H=1855:00 +CPU= 69.147
  12:22:31 STEP 1856 H=1856:00 +CPU= 71.307
  12:24:31 STEP 1857 H=1857:00 +CPU=110.477
  12:25:45 STEP 1858 H=1858:00 +CPU= 71.567
  12:26:58 STEP 1859 H=1859:00 +CPU= 69.423
  12:29:10 STEP 1860 H=1860:00 +CPU=123.311
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001860
  12:30:22 STEP 1861 H=1861:00 +CPU= 69.798
  12:31:36 STEP 1862 H=1862:00 +CPU= 71.806
  12:33:36 STEP 1863 H=1863:00 +CPU=110.793
  12:34:49 STEP 1864 H=1864:00 +CPU= 71.854
  12:36:00 STEP 1865 H=1865:00 +CPU= 67.924
  12:38:03 STEP 1866 H=1866:00 +CPU=115.730
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2013050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0309
(argv4) batchid: 982
(argv5) wuid: 12198953
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12198953
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_3261953f48f1c5f503657efd68619e54 to: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0309_2013050100_123_982_12198953.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_ps_0309_2013050100_123_982_12198953.zip
ic_ancil_file: ic_ancil_12198953
ifsdata_file: ifsdata_12198953
climate_data_file: clim_data_12198953
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_95b6bb318d0177826e27220e2840d810 to: /var/lib/boinc-client/slots/2/ic_ancil_12198953.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12198953.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0e2a4740589b5f3b29c2e73f40d9d81b to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12198953.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12198953.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12198953.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12198953.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12198953.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12198953.xml
-- Model is restarting --
Adjusting last_iter, 1867, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12198953.xml
last_cpu_time: 164822
upload_file_number: 77
last_iter: 1847
last_upload: 6652800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0309_2013050100_123_982_12198953_0_r437559801
The child process has been launched with process id: 984256
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:hal.godelia.org:1:1:984256:984256] [20221228:021328:1672190008:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  02:16:13 STEP 1848 H=1848:00 +CPU=123.345
  02:17:23 STEP 1849 H=1849:00 +CPU= 67.247
  02:18:37 STEP 1850 H=1850:00 +CPU= 69.238
  02:20:32 STEP 1851 H=1851:00 +CPU=106.719
  02:21:43 STEP 1852 H=1852:00 +CPU= 68.433
  02:22:52 STEP 1853 H=1853:00 +CPU= 66.126
  02:24:47 STEP 1854 H=1854:00 +CPU=109.806
  02:25:57 STEP 1855 H=1855:00 +CPU= 65.915
  02:27:11 STEP 1856 H=1856:00 +CPU= 69.539
  02:29:02 STEP 1857 H=1857:00 +CPU=106.627
  02:30:12 STEP 1858 H=1858:00 +CPU= 67.989
  02:31:26 STEP 1859 H=1859:00 +CPU= 67.049
  02:33:27 STEP 1860 H=1860:00 +CPU=116.858
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAhq0f+001860
  02:34:36 STEP 1861 H=1861:00 +CPU= 67.660
  02:35:50 STEP 1862 H=1862:00 +CPU= 69.296
  02:37:39 STEP 1863 H=1863:00 +CPU=105.946
  02:38:50 STEP 1864 H=1864:00 +CPU= 68.825
  02:40:01 STEP 1865 H=1865:00 +CPU= 66.795
  02:41:57 STEP 1866 H=1866:00 +CPU=108.416
  02:43:09 STEP 1867 H=1867:00 +CPU= 69.548
  02:44:31 STEP 1868 H=1868:00 +CPU= 78.761
  02:46:36 STEP 1869 H=1869:00 +CPU=119.107
  02:47:53 STEP 1870 H=1870:00 +CPU= 74.690
  02:49:03 STEP 1871 H=1871:00 +CPU= 68.007
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:58:23 1353495 22285089 oifs_43r3_ps_0309_2013050100_123_982_12198953_0 6,220,800 152,939 0.0246
09 May 2023 15:57:58 1353495 22285089 oifs_43r3_ps_0309_2013050100_123_982_12198953_0 5,356,800 132,312 0.0247
09 May 2023 15:57:17 1353495 22285089 oifs_43r3_ps_0309_2013050100_123_982_12198953_0 4,320,000 107,388 0.0249
09 May 2023 15:54:51 1353495 22285089 oifs_43r3_ps_0309_2013050100_123_982_12198953_0 1,728,000 39,906 0.0231
09 May 2023 15:53:55 1353495 22285089 oifs_43r3_ps_0309_2013050100_123_982_12198953_0 864,000 19,882 0.0230


©2024 climateprediction.net