climateprediction.net home page
Task 22260381

Task 22260381

Name oifs_43r3_ps_0030_1990050100_123_959_12175674_0
Workunit 12175674
Created 21 Dec 2022, 18:07:14 UTC
Sent 4 Jan 2023, 4:48:01 UTC
Report deadline 3 Feb 2023, 4:48:01 UTC
Received 7 Jan 2023, 19:35:52 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1513103
Run time 15 hours 57 min 23 sec
CPU time 12 hours 32 min 18 sec
Validate state Invalid
Credit 9,313.92
Device peak FLOPS 7.83 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,419.54 MB
Peak swap size 4,978.07 MB
Peak disk usage 7,840.82 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
 36.225
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001476
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_45.zip
Uploading the intermediate file: upload_file_45.zip
  08:13:35 STEP 1489 H=1489:00 +CPU= 18.241
  08:13:58 STEP 1490 H=1490:00 +CPU= 22.998
  08:14:32 STEP 1491 H=1491:00 +CPU= 33.829
  08:14:56 STEP 1492 H=1492:00 +CPU= 23.476
  08:15:18 STEP 1493 H=1493:00 +CPU= 22.085
  08:15:54 STEP 1494 H=1494:00 +CPU= 35.859
  08:16:15 STEP 1495 H=1495:00 +CPU= 21.293
  08:16:36 STEP 1496 H=1496:00 +CPU= 21.153
  08:17:08 STEP 1497 H=1497:00 +CPU= 32.320
  08:17:29 STEP 1498 H=1498:00 +CPU= 20.123
  08:17:49 STEP 1499 H=1499:00 +CPU= 20.063
  08:18:21 STEP 1500 H=1500:00 +CPU= 32.555
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001500
  08:18:42 STEP 1501 H=1501:00 +CPU= 20.320
  08:19:03 STEP 1502 H=1502:00 +CPU= 21.378
  08:19:35 STEP 1503 H=1503:00 +CPU= 31.871
  08:19:58 STEP 1504 H=1504:00 +CPU= 23.127
  08:20:18 STEP 1505 H=1505:00 +CPU= 19.612
  08:20:51 STEP 1506 H=1506:00 +CPU= 33.770
  08:21:11 STEP 1507 H=1507:00 +CPU= 19.904
  08:21:32 STEP 1508 H=1508:00 +CPU= 21.070
  08:22:04 STEP 1509 H=1509:00 +CPU= 31.744
  08:22:27 STEP 1510 H=1510:00 +CPU= 22.936
  08:22:50 STEP 1511 H=1511:00 +CPU= 22.506
  08:23:27 STEP 1512 H=1512:00 +CPU= 37.378
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001500
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_46.zip
Uploading the intermediate file: upload_file_46.zip
  08:23:50 STEP 1513 H=1513:00 +CPU= 22.682
  08:24:13 STEP 1514 H=1514:00 +CPU= 22.848
  08:24:44 STEP 1515 H=1515:00 +CPU= 31.120
  08:25:03 STEP 1516 H=1516:00 +CPU= 19.739
  08:25:24 STEP 1517 H=1517:00 +CPU= 20.683
  08:25:58 STEP 1518 H=1518:00 +CPU= 33.802
  08:26:18 STEP 1519 H=1519:00 +CPU= 20.122
  08:26:40 STEP 1520 H=1520:00 +CPU= 22.092
  08:27:12 STEP 1521 H=1521:00 +CPU= 31.903
  08:27:33 STEP 1522 H=1522:00 +CPU= 20.796
  08:27:53 STEP 1523 H=1523:00 +CPU= 20.605
  08:28:30 STEP 1524 H=1524:00 +CPU= 36.201
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001524
  08:28:51 STEP 1525 H=1525:00 +CPU= 21.026
  08:29:12 STEP 1526 H=1526:00 +CPU= 21.096
  08:29:43 STEP 1527 H=1527:00 +CPU= 30.827
  08:30:05 STEP 1528 H=1528:00 +CPU= 22.068
  08:30:25 STEP 1529 H=1529:00 +CPU= 20.696
  08:30:58 STEP 1530 H=1530:00 +CPU= 32.218
  08:31:18 STEP 1531 H=1531:00 +CPU= 20.672
  08:31:40 STEP 1532 H=1532:00 +CPU= 21.304
  08:32:11 STEP 1533 H=1533:00 +CPU= 31.802
  08:32:32 STEP 1534 H=1534:00 +CPU= 20.787
  08:32:51 STEP 1535 H=1535:00 +CPU= 18.622
  08:33:28 STEP 1536 H=1536:00 +CPU= 37.047
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_47.zip
Uploading the intermediate file: upload_file_47.zip
  08:33:48 STEP 1537 H=1537:00 +CPU= 20.018
  08:34:10 STEP 1538 H=1538:00 +CPU= 22.451
  08:34:43 STEP 1539 H=1539:00 +CPU= 32.912
  08:35:02 STEP 1540 H=1540:00 +CPU= 18.684
  08:35:24 STEP 1541 H=1541:00 +CPU= 21.807
  08:35:56 STEP 1542 H=1542:00 +CPU= 31.779
  08:36:16 STEP 1543 H=1543:00 +CPU= 20.713
  08:36:39 STEP 1544 H=1544:00 +CPU= 22.354
  08:37:09 STEP 1545 H=1545:00 +CPU= 30.597
  08:37:31 STEP 1546 H=1546:00 +CPU= 21.375
  08:37:52 STEP 1547 H=1547:00 +CPU= 21.502
  08:38:27 STEP 1548 H=1548:00 +CPU= 34.298
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001548
  08:38:48 STEP 1549 H=1549:00 +CPU= 20.905
  08:39:10 STEP 1550 H=1550:00 +CPU= 22.128
  08:39:43 STEP 1551 H=1551:00 +CPU= 33.012
  08:40:05 STEP 1552 H=1552:00 +CPU= 22.513
  08:40:25 STEP 1553 H=1553:00 +CPU= 19.435
  08:40:59 STEP 1554 H=1554:00 +CPU= 33.969
  08:41:20 STEP 1555 H=1555:00 +CPU= 21.720
  08:41:42 STEP 1556 H=1556:00 +CPU= 21.317
  08:42:16 STEP 1557 H=1557:00 +CPU= 34.064
  08:42:37 STEP 1558 H=1558:00 +CPU= 20.798
  08:42:58 STEP 1559 H=1559:00 +CPU= 21.842
  08:43:36 STEP 1560 H=1560:00 +CPU= 37.909
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001548
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_48.zip
Uploading the intermediate file: upload_file_48.zip
  08:43:57 STEP 1561 H=1561:00 +CPU= 21.045
  08:44:19 STEP 1562 H=1562:00 +CPU= 21.564
  08:44:49 STEP 1563 H=1563:00 +CPU= 30.191
  08:45:10 STEP 1564 H=1564:00 +CPU= 20.802
  08:45:31 STEP 1565 H=1565:00 +CPU= 20.990
  08:46:04 STEP 1566 H=1566:00 +CPU= 33.463
  08:46:26 STEP 1567 H=1567:00 +CPU= 21.765
  08:46:48 STEP 1568 H=1568:00 +CPU= 22.176
  08:47:18 STEP 1569 H=1569:00 +CPU= 29.362
  08:47:38 STEP 1570 H=1570:00 +CPU= 19.860
  08:48:00 STEP 1571 H=1571:00 +CPU= 22.214
  08:48:38 STEP 1572 H=1572:00 +CPU= 37.720
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001572
  08:48:59 STEP 1573 H=1573:00 +CPU= 21.754
  08:49:23 STEP 1574 H=1574:00 +CPU= 23.264
  08:49:56 STEP 1575 H=1575:00 +CPU= 33.069
  08:50:17 STEP 1576 H=1576:00 +CPU= 20.825
  08:50:39 STEP 1577 H=1577:00 +CPU= 22.432
  08:51:10 STEP 1578 H=1578:00 +CPU= 31.366
  08:51:33 STEP 1579 H=1579:00 +CPU= 22.055
  08:51:54 STEP 1580 H=1580:00 +CPU= 21.330
  08:52:26 STEP 1581 H=1581:00 +CPU= 31.852
  08:52:47 STEP 1582 H=1582:00 +CPU= 20.815
  08:53:09 STEP 1583 H=1583:00 +CPU= 22.791
  08:53:47 STEP 1584 H=1584:00 +CPU= 38.085
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001572
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_49.zip
Uploading the intermediate file: upload_file_49.zip
  08:54:09 STEP 1585 H=1585:00 +CPU= 21.661
  08:54:32 STEP 1586 H=1586:00 +CPU= 22.580
  08:55:06 STEP 1587 H=1587:00 +CPU= 34.129
  08:55:29 STEP 1588 H=1588:00 +CPU= 22.747
  08:55:48 STEP 1589 H=1589:00 +CPU= 19.722
  08:56:22 STEP 1590 H=1590:00 +CPU= 33.721
  08:56:43 STEP 1591 H=1591:00 +CPU= 20.582
  08:57:02 STEP 1592 H=1592:00 +CPU= 19.842
  08:57:36 STEP 1593 H=1593:00 +CPU= 33.358
  08:57:55 STEP 1594 H=1594:00 +CPU= 19.382
  08:58:16 STEP 1595 H=1595:00 +CPU= 20.547
  08:58:52 STEP 1596 H=1596:00 +CPU= 36.449
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001596
  08:59:14 STEP 1597 H=1597:00 +CPU= 21.361
  08:59:37 STEP 1598 H=1598:00 +CPU= 23.133
  09:00:08 STEP 1599 H=1599:00 +CPU= 31.242
  09:00:30 STEP 1600 H=1600:00 +CPU= 21.681
  09:00:49 STEP 1601 H=1601:00 +CPU= 19.301
  09:01:22 STEP 1602 H=1602:00 +CPU= 33.151
  09:01:44 STEP 1603 H=1603:00 +CPU= 21.311
  09:02:06 STEP 1604 H=1604:00 +CPU= 22.298
  09:02:37 STEP 1605 H=1605:00 +CPU= 30.649
  09:02:57 STEP 1606 H=1606:00 +CPU= 20.383
  09:03:18 STEP 1607 H=1607:00 +CPU= 21.156
  09:03:55 STEP 1608 H=1608:00 +CPU= 37.283
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001596
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_50.zip
Uploading the intermediate file: upload_file_50.zip
  09:04:18 STEP 1609 H=1609:00 +CPU= 22.292
Uploading trickle at timestep: 5788800
  09:04:40 STEP 1610 H=1610:00 +CPU= 22.474
  09:05:12 STEP 1611 H=1611:00 +CPU= 31.438
  09:05:34 STEP 1612 H=1612:00 +CPU= 22.106
  09:05:55 STEP 1613 H=1613:00 +CPU= 21.258
  09:06:27 STEP 1614 H=1614:00 +CPU= 31.774
  09:06:47 STEP 1615 H=1615:00 +CPU= 19.773
  09:07:06 STEP 1616 H=1616:00 +CPU= 19.884
  09:07:37 STEP 1617 H=1617:00 +CPU= 30.133
  09:07:58 STEP 1618 H=1618:00 +CPU= 21.016
  09:08:18 STEP 1619 H=1619:00 +CPU= 20.105
  09:08:55 STEP 1620 H=1620:00 +CPU= 37.013
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001620
  09:09:15 STEP 1621 H=1621:00 +CPU= 20.378
  09:09:36 STEP 1622 H=1622:00 +CPU= 20.419
  09:10:08 STEP 1623 H=1623:00 +CPU= 32.772
  09:10:29 STEP 1624 H=1624:00 +CPU= 20.327
  09:10:48 STEP 1625 H=1625:00 +CPU= 19.208
  09:11:20 STEP 1626 H=1626:00 +CPU= 32.199
  09:11:39 STEP 1627 H=1627:00 +CPU= 19.078
  09:11:59 STEP 1628 H=1628:00 +CPU= 20.030
  09:12:34 STEP 1629 H=1629:00 +CPU= 34.556
  09:12:57 STEP 1630 H=1630:00 +CPU= 23.247
  09:13:19 STEP 1631 H=1631:00 +CPU= 21.989
  09:13:57 STEP 1632 H=1632:00 +CPU= 38.312
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_51.zip
Uploading the intermediate file: upload_file_51.zip
  09:14:18 STEP 1633 H=1633:00 +CPU= 20.482
  09:14:38 STEP 1634 H=1634:00 +CPU= 20.012
  09:15:11 STEP 1635 H=1635:00 +CPU= 33.035
  09:15:32 STEP 1636 H=1636:00 +CPU= 21.193
  09:15:53 STEP 1637 H=1637:00 +CPU= 20.937
  09:16:27 STEP 1638 H=1638:00 +CPU= 34.251
  09:16:47 STEP 1639 H=1639:00 +CPU= 19.362
  09:17:08 STEP 1640 H=1640:00 +CPU= 20.915
  09:17:42 STEP 1641 H=1641:00 +CPU= 34.594
  09:18:04 STEP 1642 H=1642:00 +CPU= 22.179
  09:18:26 STEP 1643 H=1643:00 +CPU= 21.595
  09:19:03 STEP 1644 H=1644:00 +CPU= 37.302
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001644
  09:19:24 STEP 1645 H=1645:00 +CPU= 20.669
  09:19:47 STEP 1646 H=1646:00 +CPU= 22.400
  09:20:21 STEP 1647 H=1647:00 +CPU= 34.322
  09:20:42 STEP 1648 H=1648:00 +CPU= 21.590
  09:21:02 STEP 1649 H=1649:00 +CPU= 19.976
  09:21:34 STEP 1650 H=1650:00 +CPU= 31.485
  09:21:54 STEP 1651 H=1651:00 +CPU= 20.200
  09:22:16 STEP 1652 H=1652:00 +CPU= 21.553
  09:22:46 STEP 1653 H=1653:00 +CPU= 30.617
  09:23:07 STEP 1654 H=1654:00 +CPU= 20.295
  09:23:30 STEP 1655 H=1655:00 +CPU= 23.152
  09:24:07 STEP 1656 H=1656:00 +CPU= 37.031
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001644
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_52.zip
Uploading the intermediate file: upload_file_52.zip
  09:24:29 STEP 1657 H=1657:00 +CPU= 22.370
  09:24:50 STEP 1658 H=1658:00 +CPU= 21.075
  09:25:22 STEP 1659 H=1659:00 +CPU= 31.939
  09:25:43 STEP 1660 H=1660:00 +CPU= 20.821
  09:26:03 STEP 1661 H=1661:00 +CPU= 19.805
  09:26:39 STEP 1662 H=1662:00 +CPU= 35.896
  09:27:00 STEP 1663 H=1663:00 +CPU= 21.144
  09:27:21 STEP 1664 H=1664:00 +CPU= 20.842
  09:27:54 STEP 1665 H=1665:00 +CPU= 33.075
  09:28:14 STEP 1666 H=1666:00 +CPU= 19.705
  09:28:33 STEP 1667 H=1667:00 +CPU= 19.089
  09:29:09 STEP 1668 H=1668:00 +CPU= 35.854
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001668
  09:29:31 STEP 1669 H=1669:00 +CPU= 22.509
  09:29:54 STEP 1670 H=1670:00 +CPU= 23.345
  09:30:26 STEP 1671 H=1671:00 +CPU= 31.106
  09:30:47 STEP 1672 H=1672:00 +CPU= 21.422
  09:31:08 STEP 1673 H=1673:00 +CPU= 21.458
  09:31:43 STEP 1674 H=1674:00 +CPU= 34.872
  09:32:03 STEP 1675 H=1675:00 +CPU= 19.589
  09:32:26 STEP 1676 H=1676:00 +CPU= 23.025
  09:32:59 STEP 1677 H=1677:00 +CPU= 33.332
  09:33:22 STEP 1678 H=1678:00 +CPU= 22.609
  09:33:46 STEP 1679 H=1679:00 +CPU= 23.742
  09:34:25 STEP 1680 H=1680:00 +CPU= 38.918
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_53.zip
Uploading the intermediate file: upload_file_53.zip
  09:34:45 STEP 1681 H=1681:00 +CPU= 20.857
  09:35:05 STEP 1682 H=1682:00 +CPU= 19.654
  09:35:37 STEP 1683 H=1683:00 +CPU= 32.159
  09:35:59 STEP 1684 H=1684:00 +CPU= 22.150
  09:36:20 STEP 1685 H=1685:00 +CPU= 20.848
  09:36:53 STEP 1686 H=1686:00 +CPU= 32.236
  09:37:14 STEP 1687 H=1687:00 +CPU= 21.248
  09:37:37 STEP 1688 H=1688:00 +CPU= 22.743
  09:38:10 STEP 1689 H=1689:00 +CPU= 33.897
  09:38:33 STEP 1690 H=1690:00 +CPU= 22.740
  09:38:51 STEP 1691 H=1691:00 +CPU= 18.179
  09:39:28 STEP 1692 H=1692:00 +CPU= 36.418
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001692
  09:39:49 STEP 1693 H=1693:00 +CPU= 21.439
  09:40:11 STEP 1694 H=1694:00 +CPU= 21.867
  09:40:44 STEP 1695 H=1695:00 +CPU= 32.424
  09:41:04 STEP 1696 H=1696:00 +CPU= 20.488
  09:41:24 STEP 1697 H=1697:00 +CPU= 20.050
  09:41:58 STEP 1698 H=1698:00 +CPU= 33.688
  09:42:19 STEP 1699 H=1699:00 +CPU= 21.114
  09:42:40 STEP 1700 H=1700:00 +CPU= 21.246
  09:43:14 STEP 1701 H=1701:00 +CPU= 33.968
  09:43:35 STEP 1702 H=1702:00 +CPU= 20.816
  09:43:55 STEP 1703 H=1703:00 +CPU= 19.542
  09:44:35 STEP 1704 H=1704:00 +CPU= 40.488
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_54.zip
Uploading the intermediate file: upload_file_54.zip
  09:44:53 STEP 1705 H=1705:00 +CPU= 18.075
  09:45:15 STEP 1706 H=1706:00 +CPU= 21.859
  09:45:48 STEP 1707 H=1707:00 +CPU= 33.232
  09:46:10 STEP 1708 H=1708:00 +CPU= 21.433
  09:46:29 STEP 1709 H=1709:00 +CPU= 19.550
  09:47:00 STEP 1710 H=1710:00 +CPU= 31.045
  09:47:21 STEP 1711 H=1711:00 +CPU= 20.527
  09:47:39 STEP 1712 H=1712:00 +CPU= 17.808
  09:48:08 STEP 1713 H=1713:00 +CPU= 29.653
  09:48:32 STEP 1714 H=1714:00 +CPU= 23.223
  09:48:52 STEP 1715 H=1715:00 +CPU= 20.220
  09:49:28 STEP 1716 H=1716:00 +CPU= 36.319
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001716
  09:49:48 STEP 1717 H=1717:00 +CPU= 19.418
  09:50:10 STEP 1718 H=1718:00 +CPU= 22.748
  09:50:45 STEP 1719 H=1719:00 +CPU= 34.832
  09:51:07 STEP 1720 H=1720:00 +CPU= 22.223
  09:51:26 STEP 1721 H=1721:00 +CPU= 18.824
  09:52:01 STEP 1722 H=1722:00 +CPU= 34.648
  09:52:22 STEP 1723 H=1723:00 +CPU= 21.078
  09:52:43 STEP 1724 H=1724:00 +CPU= 20.719
  09:53:19 STEP 1725 H=1725:00 +CPU= 36.054
  09:53:41 STEP 1726 H=1726:00 +CPU= 21.925
  09:54:02 STEP 1727 H=1727:00 +CPU= 21.091
  09:54:42 STEP 1728 H=1728:00 +CPU= 40.493
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_55.zip
Uploading the intermediate file: upload_file_55.zip
  09:55:05 STEP 1729 H=1729:00 +CPU= 22.783
  09:55:29 STEP 1730 H=1730:00 +CPU= 24.318
  09:56:07 STEP 1731 H=1731:00 +CPU= 37.035
  09:56:29 STEP 1732 H=1732:00 +CPU= 22.940
  09:56:55 STEP 1733 H=1733:00 +CPU= 25.181
  09:57:32 STEP 1734 H=1734:00 +CPU= 37.127
  09:57:57 STEP 1735 H=1735:00 +CPU= 24.714
  09:58:21 STEP 1736 H=1736:00 +CPU= 24.830
  09:58:59 STEP 1737 H=1737:00 +CPU= 37.119
  09:59:24 STEP 1738 H=1738:00 +CPU= 25.711
  09:59:48 STEP 1739 H=1739:00 +CPU= 23.364
  10:00:26 STEP 1740 H=1740:00 +CPU= 38.507
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001740
  10:00:49 STEP 1741 H=1741:00 +CPU= 22.608
  10:01:14 STEP 1742 H=1742:00 +CPU= 25.470
  10:01:50 STEP 1743 H=1743:00 +CPU= 35.302
  10:02:15 STEP 1744 H=1744:00 +CPU= 25.394
  10:02:39 STEP 1745 H=1745:00 +CPU= 23.975
  10:03:17 STEP 1746 H=1746:00 +CPU= 38.464
  10:03:43 STEP 1747 H=1747:00 +CPU= 25.420
  10:04:10 STEP 1748 H=1748:00 +CPU= 26.641
  10:04:46 STEP 1749 H=1749:00 +CPU= 36.138
  10:05:12 STEP 1750 H=1750:00 +CPU= 26.019
  10:05:38 STEP 1751 H=1751:00 +CPU= 26.102
  10:06:21 STEP 1752 H=1752:00 +CPU= 43.037
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_56.zip
Uploading the intermediate file: upload_file_56.zip
  10:06:43 STEP 1753 H=1753:00 +CPU= 21.803
  10:07:05 STEP 1754 H=1754:00 +CPU= 22.480
  10:07:40 STEP 1755 H=1755:00 +CPU= 35.198
  10:08:04 STEP 1756 H=1756:00 +CPU= 24.023
  10:08:30 STEP 1757 H=1757:00 +CPU= 25.112
  10:09:09 STEP 1758 H=1758:00 +CPU= 39.098
  10:09:32 STEP 1759 H=1759:00 +CPU= 22.827
  10:09:54 STEP 1760 H=1760:00 +CPU= 22.605
  10:10:27 STEP 1761 H=1761:00 +CPU= 32.348
  10:10:48 STEP 1762 H=1762:00 +CPU= 21.622
  10:11:13 STEP 1763 H=1763:00 +CPU= 25.019
  10:11:51 STEP 1764 H=1764:00 +CPU= 37.584
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001764
  10:12:15 STEP 1765 H=1765:00 +CPU= 23.784
  10:12:41 STEP 1766 H=1766:00 +CPU= 26.347
  10:13:18 STEP 1767 H=1767:00 +CPU= 37.168
  10:13:43 STEP 1768 H=1768:00 +CPU= 24.513
  10:14:03 STEP 1769 H=1769:00 +CPU= 20.577
  10:14:39 STEP 1770 H=1770:00 +CPU= 35.597
  10:15:04 STEP 1771 H=1771:00 +CPU= 25.341
  10:15:31 STEP 1772 H=1772:00 +CPU= 26.386
  10:16:11 STEP 1773 H=1773:00 +CPU= 40.268
  10:16:36 STEP 1774 H=1774:00 +CPU= 25.034
  10:17:02 STEP 1775 H=1775:00 +CPU= 26.297
  10:17:46 STEP 1776 H=1776:00 +CPU= 43.299
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_57.zip
Uploading the intermediate file: upload_file_57.zip
  10:18:11 STEP 1777 H=1777:00 +CPU= 25.191
  10:18:34 STEP 1778 H=1778:00 +CPU= 23.075
  10:19:10 STEP 1779 H=1779:00 +CPU= 36.259
  10:19:34 STEP 1780 H=1780:00 +CPU= 23.927
  10:19:56 STEP 1781 H=1781:00 +CPU= 22.349
  10:20:34 STEP 1782 H=1782:00 +CPU= 38.065
  10:20:56 STEP 1783 H=1783:00 +CPU= 21.555
  10:21:18 STEP 1784 H=1784:00 +CPU= 21.917
  10:21:54 STEP 1785 H=1785:00 +CPU= 35.715
  10:22:16 STEP 1786 H=1786:00 +CPU= 22.400
  10:22:40 STEP 1787 H=1787:00 +CPU= 23.924
  10:23:15 STEP 1788 H=1788:00 +CPU= 35.264
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001788
  10:23:36 STEP 1789 H=1789:00 +CPU= 20.921
  10:23:58 STEP 1790 H=1790:00 +CPU= 22.113
  10:24:33 STEP 1791 H=1791:00 +CPU= 34.782
  10:24:55 STEP 1792 H=1792:00 +CPU= 21.689
  10:25:15 STEP 1793 H=1793:00 +CPU= 20.555
  10:25:50 STEP 1794 H=1794:00 +CPU= 34.114
  10:26:10 STEP 1795 H=1795:00 +CPU= 20.706
  10:26:31 STEP 1796 H=1796:00 +CPU= 20.405
  10:27:10 STEP 1797 H=1797:00 +CPU= 39.015
  10:27:34 STEP 1798 H=1798:00 +CPU= 24.718
  10:27:55 STEP 1799 H=1799:00 +CPU= 20.924
  10:28:35 STEP 1800 H=1800:00 +CPU= 40.049
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_58.zip
Uploading the intermediate file: upload_file_58.zip
  10:28:58 STEP 1801 H=1801:00 +CPU= 22.690
  10:29:19 STEP 1802 H=1802:00 +CPU= 20.347
  10:29:50 STEP 1803 H=1803:00 +CPU= 31.602
  10:30:12 STEP 1804 H=1804:00 +CPU= 21.840
  10:30:31 STEP 1805 H=1805:00 +CPU= 19.482
  10:31:05 STEP 1806 H=1806:00 +CPU= 33.281
  10:31:25 STEP 1807 H=1807:00 +CPU= 20.559
  10:31:47 STEP 1808 H=1808:00 +CPU= 22.061
  10:32:19 STEP 1809 H=1809:00 +CPU= 31.711
  10:32:40 STEP 1810 H=1810:00 +CPU= 21.239
  10:33:00 STEP 1811 H=1811:00 +CPU= 19.534
  10:33:36 STEP 1812 H=1812:00 +CPU= 36.504
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001812
  10:33:58 STEP 1813 H=1813:00 +CPU= 21.499
  10:34:24 STEP 1814 H=1814:00 +CPU= 23.598
  10:34:59 STEP 1815 H=1815:00 +CPU= 34.118
  10:35:21 STEP 1816 H=1816:00 +CPU= 22.056
  10:35:43 STEP 1817 H=1817:00 +CPU= 21.746
  10:36:17 STEP 1818 H=1818:00 +CPU= 34.013
  10:36:41 STEP 1819 H=1819:00 +CPU= 22.397
  10:37:04 STEP 1820 H=1820:00 +CPU= 22.364
  10:37:39 STEP 1821 H=1821:00 +CPU= 34.003
  10:38:02 STEP 1822 H=1822:00 +CPU= 22.373
  10:38:25 STEP 1823 H=1823:00 +CPU= 22.681
  10:39:06 STEP 1824 H=1824:00 +CPU= 39.553
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_59.zip
Uploading the intermediate file: upload_file_59.zip
  10:39:27 STEP 1825 H=1825:00 +CPU= 21.271
  10:39:50 STEP 1826 H=1826:00 +CPU= 22.203
  10:40:26 STEP 1827 H=1827:00 +CPU= 34.217
  10:40:49 STEP 1828 H=1828:00 +CPU= 22.226
  10:41:13 STEP 1829 H=1829:00 +CPU= 23.136
  10:41:51 STEP 1830 H=1830:00 +CPU= 36.625
  10:42:15 STEP 1831 H=1831:00 +CPU= 23.123
  10:42:40 STEP 1832 H=1832:00 +CPU= 23.927
  10:43:17 STEP 1833 H=1833:00 +CPU= 35.626
  10:43:40 STEP 1834 H=1834:00 +CPU= 22.404
  10:44:01 STEP 1835 H=1835:00 +CPU= 21.068
  10:44:41 STEP 1836 H=1836:00 +CPU= 38.337
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001836
  10:45:05 STEP 1837 H=1837:00 +CPU= 22.701
  10:45:29 STEP 1838 H=1838:00 +CPU= 23.116
  10:46:06 STEP 1839 H=1839:00 +CPU= 35.578
  10:46:30 STEP 1840 H=1840:00 +CPU= 23.411
  10:46:54 STEP 1841 H=1841:00 +CPU= 22.513
  10:47:30 STEP 1842 H=1842:00 +CPU= 35.378
  10:47:54 STEP 1843 H=1843:00 +CPU= 22.202
  10:48:16 STEP 1844 H=1844:00 +CPU= 21.789
  10:48:52 STEP 1845 H=1845:00 +CPU= 35.065
  10:49:15 STEP 1846 H=1846:00 +CPU= 22.048
  10:49:39 STEP 1847 H=1847:00 +CPU= 23.154
  10:50:20 STEP 1848 H=1848:00 +CPU= 39.702
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_60.zip
Uploading the intermediate file: upload_file_60.zip
  10:50:43 STEP 1849 H=1849:00 +CPU= 22.597
Uploading trickle at timestep: 6652800
  10:51:07 STEP 1850 H=1850:00 +CPU= 22.700
  10:51:43 STEP 1851 H=1851:00 +CPU= 34.504
  10:52:06 STEP 1852 H=1852:00 +CPU= 22.313
  10:52:28 STEP 1853 H=1853:00 +CPU= 22.142
  10:53:03 STEP 1854 H=1854:00 +CPU= 33.524
  10:53:24 STEP 1855 H=1855:00 +CPU= 21.043
  10:53:46 STEP 1856 H=1856:00 +CPU= 21.662
  10:54:19 STEP 1857 H=1857:00 +CPU= 33.014
  10:54:41 STEP 1858 H=1858:00 +CPU= 21.865
  10:55:03 STEP 1859 H=1859:00 +CPU= 21.348
  10:55:40 STEP 1860 H=1860:00 +CPU= 36.648
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001860
  10:56:02 STEP 1861 H=1861:00 +CPU= 21.219
  10:56:24 STEP 1862 H=1862:00 +CPU= 21.750
  10:56:58 STEP 1863 H=1863:00 +CPU= 33.454
  10:57:20 STEP 1864 H=1864:00 +CPU= 21.935
  10:57:43 STEP 1865 H=1865:00 +CPU= 22.465
  10:58:18 STEP 1866 H=1866:00 +CPU= 34.133
  10:58:40 STEP 1867 H=1867:00 +CPU= 21.675
  10:59:03 STEP 1868 H=1868:00 +CPU= 22.484
  10:59:38 STEP 1869 H=1869:00 +CPU= 33.786
  11:00:01 STEP 1870 H=1870:00 +CPU= 22.355
  11:00:24 STEP 1871 H=1871:00 +CPU= 21.911
  11:01:04 STEP 1872 H=1872:00 +CPU= 39.292
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_61.zip
Uploading the intermediate file: upload_file_61.zip
  11:01:27 STEP 1873 H=1873:00 +CPU= 21.891
  11:01:49 STEP 1874 H=1874:00 +CPU= 21.928
  11:02:24 STEP 1875 H=1875:00 +CPU= 33.716
  11:02:47 STEP 1876 H=1876:00 +CPU= 22.214
  11:03:09 STEP 1877 H=1877:00 +CPU= 21.897
  11:03:45 STEP 1878 H=1878:00 +CPU= 34.641
  11:04:07 STEP 1879 H=1879:00 +CPU= 21.832
  11:04:30 STEP 1880 H=1880:00 +CPU= 22.168
  11:05:05 STEP 1881 H=1881:00 +CPU= 33.373
  11:05:27 STEP 1882 H=1882:00 +CPU= 22.124
  11:05:49 STEP 1883 H=1883:00 +CPU= 21.495
  11:06:27 STEP 1884 H=1884:00 +CPU= 37.286
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001884
  11:06:49 STEP 1885 H=1885:00 +CPU= 21.684
  11:07:11 STEP 1886 H=1886:00 +CPU= 21.196
  11:07:42 STEP 1887 H=1887:00 +CPU= 30.906
  11:08:03 STEP 1888 H=1888:00 +CPU= 20.516
  11:08:23 STEP 1889 H=1889:00 +CPU= 20.550
  11:08:55 STEP 1890 H=1890:00 +CPU= 32.120
  11:09:17 STEP 1891 H=1891:00 +CPU= 21.548
  11:09:37 STEP 1892 H=1892:00 +CPU= 20.466
  11:10:09 STEP 1893 H=1893:00 +CPU= 31.913
  11:10:30 STEP 1894 H=1894:00 +CPU= 20.437
  11:10:51 STEP 1895 H=1895:00 +CPU= 21.263
  11:11:28 STEP 1896 H=1896:00 +CPU= 36.609
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_62.zip
Uploading the intermediate file: upload_file_62.zip
  11:11:49 STEP 1897 H=1897:00 +CPU= 20.950
  11:12:10 STEP 1898 H=1898:00 +CPU= 20.538
  11:12:41 STEP 1899 H=1899:00 +CPU= 31.769
  11:13:02 STEP 1900 H=1900:00 +CPU= 20.919
  11:13:22 STEP 1901 H=1901:00 +CPU= 19.707
  11:13:55 STEP 1902 H=1902:00 +CPU= 32.604
  11:14:16 STEP 1903 H=1903:00 +CPU= 21.369
  11:14:38 STEP 1904 H=1904:00 +CPU= 21.959
  11:15:10 STEP 1905 H=1905:00 +CPU= 31.758
  11:15:31 STEP 1906 H=1906:00 +CPU= 21.081
  11:15:51 STEP 1907 H=1907:00 +CPU= 20.062
  11:16:28 STEP 1908 H=1908:00 +CPU= 36.401
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001908
  11:16:49 STEP 1909 H=1909:00 +CPU= 21.245
  11:17:10 STEP 1910 H=1910:00 +CPU= 20.888
  11:17:42 STEP 1911 H=1911:00 +CPU= 32.061
  11:18:03 STEP 1912 H=1912:00 +CPU= 21.266
  11:18:25 STEP 1913 H=1913:00 +CPU= 21.520
  11:18:58 STEP 1914 H=1914:00 +CPU= 33.279
  11:19:20 STEP 1915 H=1915:00 +CPU= 21.628
  11:19:43 STEP 1916 H=1916:00 +CPU= 23.102
  11:20:18 STEP 1917 H=1917:00 +CPU= 34.520
  11:20:42 STEP 1918 H=1918:00 +CPU= 23.697
  11:21:05 STEP 1919 H=1919:00 +CPU= 23.020
  11:21:46 STEP 1920 H=1920:00 +CPU= 41.619
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_63.zip
Uploading the intermediate file: upload_file_63.zip
  11:22:08 STEP 1921 H=1921:00 +CPU= 21.772
  11:22:30 STEP 1922 H=1922:00 +CPU= 21.752
  11:23:02 STEP 1923 H=1923:00 +CPU= 31.939
  11:23:23 STEP 1924 H=1924:00 +CPU= 21.113
  11:23:44 STEP 1925 H=1925:00 +CPU= 20.442
  11:24:17 STEP 1926 H=1926:00 +CPU= 32.702
  11:24:40 STEP 1927 H=1927:00 +CPU= 22.890
  11:25:02 STEP 1928 H=1928:00 +CPU= 22.768
  11:25:38 STEP 1929 H=1929:00 +CPU= 35.315
  11:26:00 STEP 1930 H=1930:00 +CPU= 21.717
  11:26:20 STEP 1931 H=1931:00 +CPU= 20.074
  11:26:55 STEP 1932 H=1932:00 +CPU= 35.268
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001932
  11:27:16 STEP 1933 H=1933:00 +CPU= 20.989
  11:27:37 STEP 1934 H=1934:00 +CPU= 20.562
  11:28:10 STEP 1935 H=1935:00 +CPU= 33.582
  11:28:33 STEP 1936 H=1936:00 +CPU= 22.558
  11:28:56 STEP 1937 H=1937:00 +CPU= 22.877
  11:29:34 STEP 1938 H=1938:00 +CPU= 37.575
  11:29:59 STEP 1939 H=1939:00 +CPU= 25.041
  11:30:24 STEP 1940 H=1940:00 +CPU= 25.608
  11:31:03 STEP 1941 H=1941:00 +CPU= 39.078
  11:31:29 STEP 1942 H=1942:00 +CPU= 25.195
  11:31:53 STEP 1943 H=1943:00 +CPU= 23.728
  11:32:38 STEP 1944 H=1944:00 +CPU= 44.990
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_64.zip
Uploading the intermediate file: upload_file_64.zip
  11:33:00 STEP 1945 H=1945:00 +CPU= 22.756
  11:33:25 STEP 1946 H=1946:00 +CPU= 24.994
  11:34:05 STEP 1947 H=1947:00 +CPU= 39.167
  11:34:32 STEP 1948 H=1948:00 +CPU= 27.067
  11:34:58 STEP 1949 H=1949:00 +CPU= 25.931
  11:35:44 STEP 1950 H=1950:00 +CPU= 45.871
  11:36:13 STEP 1951 H=1951:00 +CPU= 28.701
  11:36:40 STEP 1952 H=1952:00 +CPU= 26.549
  11:37:20 STEP 1953 H=1953:00 +CPU= 40.559
  11:37:48 STEP 1954 H=1954:00 +CPU= 27.284
  11:38:12 STEP 1955 H=1955:00 +CPU= 24.266
  11:38:56 STEP 1956 H=1956:00 +CPU= 43.697
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001956
  11:39:22 STEP 1957 H=1957:00 +CPU= 26.445
  11:39:49 STEP 1958 H=1958:00 +CPU= 26.778
  11:40:28 STEP 1959 H=1959:00 +CPU= 38.737
  11:40:53 STEP 1960 H=1960:00 +CPU= 24.717
  11:41:18 STEP 1961 H=1961:00 +CPU= 25.117
  11:42:02 STEP 1962 H=1962:00 +CPU= 43.689
  11:42:29 STEP 1963 H=1963:00 +CPU= 26.778
  11:42:56 STEP 1964 H=1964:00 +CPU= 27.268
  11:43:38 STEP 1965 H=1965:00 +CPU= 42.145
  11:44:07 STEP 1966 H=1966:00 +CPU= 28.163
  11:44:34 STEP 1967 H=1967:00 +CPU= 27.559
  11:45:25 STEP 1968 H=1968:00 +CPU= 50.362
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_65.zip
Uploading the intermediate file: upload_file_65.zip
  11:45:51 STEP 1969 H=1969:00 +CPU= 26.238
  11:46:17 STEP 1970 H=1970:00 +CPU= 26.252
  11:46:56 STEP 1971 H=1971:00 +CPU= 38.718
  11:47:23 STEP 1972 H=1972:00 +CPU= 26.807
  11:47:46 STEP 1973 H=1973:00 +CPU= 22.748
  11:48:28 STEP 1974 H=1974:00 +CPU= 42.581
  11:48:54 STEP 1975 H=1975:00 +CPU= 25.725
  11:49:21 STEP 1976 H=1976:00 +CPU= 26.490
  11:50:05 STEP 1977 H=1977:00 +CPU= 43.570
  11:50:32 STEP 1978 H=1978:00 +CPU= 27.193
  11:50:57 STEP 1979 H=1979:00 +CPU= 25.050
  11:51:43 STEP 1980 H=1980:00 +CPU= 45.609
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001980
  11:52:08 STEP 1981 H=1981:00 +CPU= 25.145
  11:52:35 STEP 1982 H=1982:00 +CPU= 27.398
  11:53:14 STEP 1983 H=1983:00 +CPU= 38.676
  11:53:39 STEP 1984 H=1984:00 +CPU= 24.512
  11:54:03 STEP 1985 H=1985:00 +CPU= 23.967
  11:54:43 STEP 1986 H=1986:00 +CPU= 40.193
  11:55:07 STEP 1987 H=1987:00 +CPU= 23.478
  11:55:33 STEP 1988 H=1988:00 +CPU= 26.676
  11:56:15 STEP 1989 H=1989:00 +CPU= 41.926
  11:56:43 STEP 1990 H=1990:00 +CPU= 27.166
  11:57:11 STEP 1991 H=1991:00 +CPU= 28.042
  11:58:02 STEP 1992 H=1992:00 +CPU= 50.663
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_66.zip
Uploading the intermediate file: upload_file_66.zip
  11:58:27 STEP 1993 H=1993:00 +CPU= 25.159
  11:58:54 STEP 1994 H=1994:00 +CPU= 27.674
  11:59:33 STEP 1995 H=1995:00 +CPU= 38.832
  11:59:57 STEP 1996 H=1996:00 +CPU= 23.943
  12:00:23 STEP 1997 H=1997:00 +CPU= 25.626
  12:01:05 STEP 1998 H=1998:00 +CPU= 42.046
  12:01:30 STEP 1999 H=1999:00 +CPU= 24.798
  12:01:56 STEP 2000 H=2000:00 +CPU= 25.682
  12:02:36 STEP 2001 H=2001:00 +CPU= 39.508
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0030
(argv4) batchid: 959
(argv5) wuid: 12175674
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/6
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d09e6374a156f51ae89170b6f6e74880 to: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0030_1990050100_123_959_12175674.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/6/oifs_43r3_ps_0030_1990050100_123_959_12175674.zip
ic_ancil_file: ic_ancil_12175674
ifsdata_file: ifsdata_12175674
climate_data_file: clim_data_12175674
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_d15b95fcad437d6468e0d4dc669d37a6 to: /var/lib/boinc-client/slots/6/ic_ancil_12175674.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/6/ic_ancil_12175674.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_79c216ef70984f70eeddaab5961e146a to: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12175674.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/6/ifsdata/ifsdata_12175674.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/6/159l_2/clim_data_12175674.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/6/159l_2/clim_data_12175674.zip
Checking for progress XML file: /var/lib/boinc-client/slots/6/progress_file_12175674.xml
Opened progress file ok : /var/lib/boinc-client/slots/6/progress_file_12175674.xml
-- Model is restarting --
Adjusting last_iter, 2002, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/6/progress_file_12175674.xml
last_cpu_time: 44390
upload_file_number: 67
last_iter: 1991
last_upload: 7171200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342
The child process has been launched with process id: 188357
Executing the command: /var/lib/boinc-client/slots/6/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:johann:1:1:188357:188357] [20230107:202138:1673119298:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  20:22:26 STEP 1992 H=1992:00 +CPU= 26.894
  20:22:41 STEP 1993 H=1993:00 +CPU= 14.991
  20:22:56 STEP 1994 H=1994:00 +CPU= 15.801
  20:23:20 STEP 1995 H=1995:00 +CPU= 23.532
  20:23:36 STEP 1996 H=1996:00 +CPU= 15.910
  20:23:51 STEP 1997 H=1997:00 +CPU= 15.480
  20:24:16 STEP 1998 H=1998:00 +CPU= 24.634
  20:24:32 STEP 1999 H=1999:00 +CPU= 16.270
  20:24:49 STEP 2000 H=2000:00 +CPU= 16.815
  20:25:14 STEP 2001 H=2001:00 +CPU= 24.592
  20:25:31 STEP 2002 H=2002:00 +CPU= 16.667
  20:25:47 STEP 2003 H=2003:00 +CPU= 15.947
  20:26:16 STEP 2004 H=2004:00 +CPU= 28.965
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002004
  20:26:32 STEP 2005 H=2005:00 +CPU= 16.693
  20:26:50 STEP 2006 H=2006:00 +CPU= 17.334
  20:27:16 STEP 2007 H=2007:00 +CPU= 26.598
  20:27:33 STEP 2008 H=2008:00 +CPU= 16.850
  20:27:50 STEP 2009 H=2009:00 +CPU= 16.474
  20:28:18 STEP 2010 H=2010:00 +CPU= 28.218
  20:28:36 STEP 2011 H=2011:00 +CPU= 17.942
  20:28:54 STEP 2012 H=2012:00 +CPU= 17.992
  20:29:24 STEP 2013 H=2013:00 +CPU= 29.599
  20:29:42 STEP 2014 H=2014:00 +CPU= 18.534
  20:30:00 STEP 2015 H=2015:00 +CPU= 17.591
  20:30:31 STEP 2016 H=2016:00 +CPU= 30.468
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/6/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175674/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0030_1990050100_123_959_12175674_0_r497180342_67.zip
Uploading the intermediate file: upload_file_67.zip
  20:30:48 STEP 2017 H=2017:00 +CPU= 17.024
  20:31:06 STEP 2018 H=2018:00 +CPU= 18.028
  20:31:32 STEP 2019 H=2019:00 +CPU= 26.588
  20:31:50 STEP 2020 H=2020:00 +CPU= 17.463
  20:32:08 STEP 2021 H=2021:00 +CPU= 17.793
  20:32:35 STEP 2022 H=2022:00 +CPU= 27.731
  20:32:54 STEP 2023 H=2023:00 +CPU= 18.947
  20:33:13 STEP 2024 H=2024:00 +CPU= 19.076
  20:33:39 STEP 2025 H=2025:00 +CPU= 25.438
  20:33:57 STEP 2026 H=2026:00 +CPU= 17.642
  20:34:14 STEP 2027 H=2027:00 +CPU= 17.703
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:11:34 1513103 22260381 oifs_43r3_ps_0030_1990050100_123_959_12175674_0 6,652,800 40,086 0.0060
09 May 2023 16:11:34 1513103 22260381 oifs_43r3_ps_0030_1990050100_123_959_12175674_0 6,652,800 40,086 0.0060
09 May 2023 16:11:29 1513103 22260381 oifs_43r3_ps_0030_1990050100_123_959_12175674_0 5,788,800 33,729 0.0058
09 May 2023 16:11:23 1513103 22260381 oifs_43r3_ps_0030_1990050100_123_959_12175674_0 4,924,800 27,622 0.0056
09 May 2023 16:11:16 1513103 22260381 oifs_43r3_ps_0030_1990050100_123_959_12175674_0 4,060,800 18,898 0.0047
09 May 2023 16:11:11 1513103 22260381 oifs_43r3_ps_0030_1990050100_123_959_12175674_0 3,196,800 13,113 0.0041
09 May 2023 16:11:05 1513103 22260381 oifs_43r3_ps_0030_1990050100_123_959_12175674_0 2,332,800 7,376 0.0032
09 May 2023 16:11:05 1513103 22260381 oifs_43r3_ps_0030_1990050100_123_959_12175674_0 2,332,800 7,376 0.0032


©2024 climateprediction.net