climateprediction.net home page
Task 22275041

Task 22275041

Name oifs_43r3_ps_0850_2003050100_123_972_12189494_0
Workunit 12189494
Created 23 Dec 2022, 6:25:21 UTC
Sent 3 Jan 2023, 18:06:33 UTC
Report deadline 2 Feb 2023, 18:06:33 UTC
Received 8 Jan 2023, 19:34:38 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1534746
Run time 12 hours 1 min 8 sec
CPU time 10 hours 39 min 22 sec
Validate state Invalid
Credit 9,676.80
Device peak FLOPS 5.61 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,636.44 MB
Peak swap size 4,974.80 MB
Peak disk usage 4,507.78 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
620 H=1620:00 +CPU= 25.158
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:43:08 STEP 1672 H=1672:00 +CPU= 14.970
  22:43:11 STEP 1621 H=1621:00 +CPU= 13.814
  22:43:23 STEP 1673 H=1673:00 +CPU= 14.499
  22:43:26 STEP 1622 H=1622:00 +CPU= 14.558
Suspend request received from the BOINC client, suspending the child process
  22:43:49 STEP 1674 H=1674:00 +CPU= 24.968
Resuming the child process
  22:43:52 STEP 1623 H=1623:00 +CPU= 23.321
  22:44:05 STEP 1675 H=1675:00 +CPU= 14.926
  22:44:07 STEP 1624 H=1624:00 +CPU= 14.227
  22:44:21 STEP 1676 H=1676:00 +CPU= 15.314
  22:44:22 STEP 1625 H=1625:00 +CPU= 14.482
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:44:46 STEP 1677 H=1677:00 +CPU= 24.356
  22:44:47 STEP 1626 H=1626:00 +CPU= 22.407
  22:45:02 STEP 1627 H=1627:00 +CPU= 14.084
  22:45:03 STEP 1678 H=1678:00 +CPU= 15.291
  22:45:17 STEP 1628 H=1628:00 +CPU= 14.077
  22:45:22 STEP 1679 H=1679:00 +CPU= 15.088
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:45:44 STEP 1629 H=1629:00 +CPU= 23.360
  22:45:54 STEP 1680 H=1680:00 +CPU= 29.274
  22:45:59 STEP 1630 H=1630:00 +CPU= 14.594
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_69.zip
Uploading the intermediate file: upload_file_69.zip
  22:46:10 STEP 1681 H=1681:00 +CPU= 14.363
  22:46:14 STEP 1631 H=1631:00 +CPU= 14.159
Uploading trickle at timestep: 6048000
  22:46:27 STEP 1682 H=1682:00 +CPU= 16.589
  22:46:42 STEP 1632 H=1632:00 +CPU= 26.428
  22:46:54 STEP 1683 H=1683:00 +CPU= 24.061
  22:46:57 STEP 1633 H=1633:00 +CPU= 14.263
Suspend request received from the BOINC client, suspending the child process
  22:47:09 STEP 1684 H=1684:00 +CPU= 15.101
Resuming the child process
  22:47:13 STEP 1634 H=1634:00 +CPU= 14.003
  22:47:25 STEP 1685 H=1685:00 +CPU= 14.806
  22:47:41 STEP 1635 H=1635:00 +CPU= 22.752
  22:47:52 STEP 1686 H=1686:00 +CPU= 25.026
  22:47:56 STEP 1636 H=1636:00 +CPU= 14.346
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:48:07 STEP 1687 H=1687:00 +CPU= 14.993
  22:48:13 STEP 1637 H=1637:00 +CPU= 13.670
  22:48:23 STEP 1688 H=1688:00 +CPU= 15.047
  22:48:36 STEP 1638 H=1638:00 +CPU= 22.534
  22:48:47 STEP 1689 H=1689:00 +CPU= 23.233
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:48:53 STEP 1639 H=1639:00 +CPU= 14.559
  22:49:04 STEP 1690 H=1690:00 +CPU= 16.201
  22:49:09 STEP 1640 H=1640:00 +CPU= 14.618
  22:49:19 STEP 1691 H=1691:00 +CPU= 14.509
  22:49:32 STEP 1641 H=1641:00 +CPU= 22.761
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:49:47 STEP 1692 H=1692:00 +CPU= 26.614
  22:49:50 STEP 1642 H=1642:00 +CPU= 14.873
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001692
  22:50:03 STEP 1693 H=1693:00 +CPU= 15.179
  22:50:07 STEP 1643 H=1643:00 +CPU= 14.247
  22:50:19 STEP 1694 H=1694:00 +CPU= 15.098
  22:50:33 STEP 1644 H=1644:00 +CPU= 25.048
  22:50:45 STEP 1695 H=1695:00 +CPU= 24.639
  22:50:48 STEP 1645 H=1645:00 +CPU= 14.436
  22:51:01 STEP 1696 H=1696:00 +CPU= 15.152
  22:51:03 STEP 1646 H=1646:00 +CPU= 14.550
  22:51:16 STEP 1697 H=1697:00 +CPU= 14.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:51:30 STEP 1647 H=1647:00 +CPU= 23.033
  22:51:41 STEP 1698 H=1698:00 +CPU= 24.423
  22:51:45 STEP 1648 H=1648:00 +CPU= 14.427
  22:51:57 STEP 1699 H=1699:00 +CPU= 14.676
  22:52:00 STEP 1649 H=1649:00 +CPU= 14.719
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:52:13 STEP 1700 H=1700:00 +CPU= 15.187
  22:52:26 STEP 1650 H=1650:00 +CPU= 23.075
  22:52:38 STEP 1701 H=1701:00 +CPU= 23.768
  22:52:40 STEP 1651 H=1651:00 +CPU= 13.594
  22:52:54 STEP 1702 H=1702:00 +CPU= 15.398
  22:52:55 STEP 1652 H=1652:00 +CPU= 14.385
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:53:09 STEP 1703 H=1703:00 +CPU= 14.611
  22:53:21 STEP 1653 H=1653:00 +CPU= 22.712
  22:53:36 STEP 1654 H=1654:00 +CPU= 13.742
  22:53:39 STEP 1704 H=1704:00 +CPU= 28.299
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_70.zip
Uploading the intermediate file: upload_file_70.zip
  22:53:52 STEP 1655 H=1655:00 +CPU= 15.529
  22:53:55 STEP 1705 H=1705:00 +CPU= 16.166
  22:54:11 STEP 1706 H=1706:00 +CPU= 15.115
  22:54:21 STEP 1656 H=1656:00 +CPU= 26.694
  22:54:35 STEP 1657 H=1657:00 +CPU= 13.763
  22:54:36 STEP 1707 H=1707:00 +CPU= 24.158
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:54:53 STEP 1658 H=1658:00 +CPU= 14.896
  22:54:53 STEP 1708 H=1708:00 +CPU= 16.332
  22:55:09 STEP 1709 H=1709:00 +CPU= 14.776
  22:55:17 STEP 1659 H=1659:00 +CPU= 22.568
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:55:33 STEP 1710 H=1710:00 +CPU= 23.894
  22:55:34 STEP 1660 H=1660:00 +CPU= 14.893
  22:55:48 STEP 1711 H=1711:00 +CPU= 14.530
  22:55:49 STEP 1661 H=1661:00 +CPU= 13.893
  22:56:03 STEP 1712 H=1712:00 +CPU= 14.948
  22:56:13 STEP 1662 H=1662:00 +CPU= 22.823
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:56:29 STEP 1713 H=1713:00 +CPU= 24.171
  22:56:31 STEP 1663 H=1663:00 +CPU= 14.438
  22:56:44 STEP 1714 H=1714:00 +CPU= 14.869
  22:56:46 STEP 1664 H=1664:00 +CPU= 14.209
  22:57:00 STEP 1715 H=1715:00 +CPU= 15.361
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:57:12 STEP 1665 H=1665:00 +CPU= 22.882
  22:57:27 STEP 1666 H=1666:00 +CPU= 14.579
  22:57:29 STEP 1716 H=1716:00 +CPU= 27.237
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001716
  22:57:41 STEP 1667 H=1667:00 +CPU= 13.732
  22:57:44 STEP 1717 H=1717:00 +CPU= 14.537
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:58:01 STEP 1718 H=1718:00 +CPU= 16.682
  22:58:11 STEP 1668 H=1668:00 +CPU= 26.378
  22:58:27 STEP 1669 H=1669:00 +CPU= 14.322
  22:58:27 STEP 1719 H=1719:00 +CPU= 24.492
  22:58:41 STEP 1670 H=1670:00 +CPU= 14.285
  22:58:43 STEP 1720 H=1720:00 +CPU= 15.119
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:59:00 STEP 1721 H=1721:00 +CPU= 16.296
  22:59:07 STEP 1671 H=1671:00 +CPU= 22.916
  22:59:23 STEP 1672 H=1672:00 +CPU= 15.006
  22:59:26 STEP 1722 H=1722:00 +CPU= 24.785
  22:59:37 STEP 1673 H=1673:00 +CPU= 13.589
Suspend request received from the BOINC client, suspending the child process
  22:59:41 STEP 1723 H=1723:00 +CPU= 14.755
Resuming the child process
  22:59:58 STEP 1724 H=1724:00 +CPU= 15.913
  23:00:03 STEP 1674 H=1674:00 +CPU= 23.070
  23:00:18 STEP 1675 H=1675:00 +CPU= 14.270
  23:00:23 STEP 1725 H=1725:00 +CPU= 24.411
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:00:36 STEP 1676 H=1676:00 +CPU= 14.504
  23:00:39 STEP 1726 H=1726:00 +CPU= 14.829
  23:00:59 STEP 1727 H=1727:00 +CPU= 16.122
  23:00:59 STEP 1677 H=1677:00 +CPU= 22.641
  23:01:14 STEP 1678 H=1678:00 +CPU= 14.042
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:01:31 STEP 1728 H=1728:00 +CPU= 27.524
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_71.zip
  23:01:32 STEP 1679 H=1679:00 +CPU= 14.355
Uploading the intermediate file: upload_file_71.zip
  23:01:46 STEP 1729 H=1729:00 +CPU= 14.356
  23:02:02 STEP 1680 H=1680:00 +CPU= 26.467
  23:02:02 STEP 1730 H=1730:00 +CPU= 15.518
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:02:19 STEP 1681 H=1681:00 +CPU= 14.319
  23:02:27 STEP 1731 H=1731:00 +CPU= 23.990
  23:02:34 STEP 1682 H=1682:00 +CPU= 14.061
  23:02:43 STEP 1732 H=1732:00 +CPU= 14.878
  23:02:58 STEP 1683 H=1683:00 +CPU= 23.032
  23:02:59 STEP 1733 H=1733:00 +CPU= 15.117
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:03:15 STEP 1684 H=1684:00 +CPU= 14.566
  23:03:25 STEP 1734 H=1734:00 +CPU= 25.101
  23:03:30 STEP 1685 H=1685:00 +CPU= 14.207
  23:03:40 STEP 1735 H=1735:00 +CPU= 14.820
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:03:57 STEP 1686 H=1686:00 +CPU= 23.288
  23:03:57 STEP 1736 H=1736:00 +CPU= 16.514
  23:04:11 STEP 1687 H=1687:00 +CPU= 13.902
  23:04:22 STEP 1737 H=1737:00 +CPU= 23.898
  23:04:26 STEP 1688 H=1688:00 +CPU= 14.531
  23:04:38 STEP 1738 H=1738:00 +CPU= 15.319
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:04:52 STEP 1689 H=1689:00 +CPU= 22.503
  23:04:55 STEP 1739 H=1739:00 +CPU= 15.366
  23:05:07 STEP 1690 H=1690:00 +CPU= 13.883
  23:05:22 STEP 1691 H=1691:00 +CPU= 14.200
  23:05:24 STEP 1740 H=1740:00 +CPU= 28.262
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001740
  23:05:40 STEP 1741 H=1741:00 +CPU= 15.184
  23:05:51 STEP 1692 H=1692:00 +CPU= 24.694
  23:05:57 STEP 1742 H=1742:00 +CPU= 16.242
  23:06:04 STEP 1693 H=1693:00 +CPU= 13.141
  23:06:19 STEP 1694 H=1694:00 +CPU= 13.882
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:06:23 STEP 1743 H=1743:00 +CPU= 24.861
  23:06:39 STEP 1744 H=1744:00 +CPU= 15.564
  23:06:44 STEP 1695 H=1695:00 +CPU= 21.745
  23:06:56 STEP 1745 H=1745:00 +CPU= 15.352
  23:06:58 STEP 1696 H=1696:00 +CPU= 14.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:07:14 STEP 1697 H=1697:00 +CPU= 13.608
  23:07:22 STEP 1746 H=1746:00 +CPU= 25.469
  23:07:37 STEP 1698 H=1698:00 +CPU= 22.307
  23:07:38 STEP 1747 H=1747:00 +CPU= 15.119
  23:07:52 STEP 1699 H=1699:00 +CPU= 13.664
  23:07:55 STEP 1748 H=1748:00 +CPU= 16.148
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:08:08 STEP 1700 H=1700:00 +CPU= 13.503
  23:08:20 STEP 1749 H=1749:00 +CPU= 23.939
  23:08:32 STEP 1701 H=1701:00 +CPU= 22.678
  23:08:36 STEP 1750 H=1750:00 +CPU= 14.637
  23:08:47 STEP 1702 H=1702:00 +CPU= 14.135
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:08:52 STEP 1751 H=1751:00 +CPU= 15.580
  23:09:05 STEP 1703 H=1703:00 +CPU= 15.003
  23:09:22 STEP 1752 H=1752:00 +CPU= 29.028
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_72.zip
Uploading the intermediate file: upload_file_72.zip
  23:09:32 STEP 1704 H=1704:00 +CPU= 26.309
  23:09:37 STEP 1753 H=1753:00 +CPU= 14.595
  23:09:48 STEP 1705 H=1705:00 +CPU= 15.311
  23:09:54 STEP 1754 H=1754:00 +CPU= 15.813
  23:10:03 STEP 1706 H=1706:00 +CPU= 13.972
  23:10:19 STEP 1755 H=1755:00 +CPU= 23.930
  23:10:26 STEP 1707 H=1707:00 +CPU= 22.914
  23:10:34 STEP 1756 H=1756:00 +CPU= 14.734
  23:10:41 STEP 1708 H=1708:00 +CPU= 14.217
  23:10:50 STEP 1757 H=1757:00 +CPU= 14.681
  23:10:56 STEP 1709 H=1709:00 +CPU= 14.176
  23:11:15 STEP 1758 H=1758:00 +CPU= 24.206
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:11:22 STEP 1710 H=1710:00 +CPU= 23.161
  23:11:31 STEP 1759 H=1759:00 +CPU= 15.014
  23:11:36 STEP 1711 H=1711:00 +CPU= 13.707
  23:11:47 STEP 1760 H=1760:00 +CPU= 15.246
  23:11:51 STEP 1712 H=1712:00 +CPU= 14.430
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:12:14 STEP 1761 H=1761:00 +CPU= 25.453
  23:12:18 STEP 1713 H=1713:00 +CPU= 23.198
  23:12:30 STEP 1762 H=1762:00 +CPU= 15.036
  23:12:32 STEP 1714 H=1714:00 +CPU= 14.106
  23:12:46 STEP 1763 H=1763:00 +CPU= 14.375
  23:12:47 STEP 1715 H=1715:00 +CPU= 13.775
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:13:14 STEP 1764 H=1764:00 +CPU= 27.135
  23:13:15 STEP 1716 H=1716:00 +CPU= 25.242
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001764
  23:13:29 STEP 1717 H=1717:00 +CPU= 14.005
  23:13:30 STEP 1765 H=1765:00 +CPU= 14.852
  23:13:44 STEP 1718 H=1718:00 +CPU= 14.248
  23:13:45 STEP 1766 H=1766:00 +CPU= 14.854
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:14:10 STEP 1719 H=1719:00 +CPU= 22.939
  23:14:11 STEP 1767 H=1767:00 +CPU= 24.466
  23:14:26 STEP 1720 H=1720:00 +CPU= 14.664
  23:14:27 STEP 1768 H=1768:00 +CPU= 15.628
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:14:42 STEP 1721 H=1721:00 +CPU= 13.538
  23:14:43 STEP 1769 H=1769:00 +CPU= 15.407
  23:15:06 STEP 1722 H=1722:00 +CPU= 23.182
  23:15:10 STEP 1770 H=1770:00 +CPU= 24.974
  23:15:21 STEP 1723 H=1723:00 +CPU= 14.293
  23:15:26 STEP 1771 H=1771:00 +CPU= 15.621
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:15:38 STEP 1724 H=1724:00 +CPU= 14.262
  23:15:42 STEP 1772 H=1772:00 +CPU= 15.559
  23:16:03 STEP 1725 H=1725:00 +CPU= 23.441
  23:16:08 STEP 1773 H=1773:00 +CPU= 23.745
  23:16:17 STEP 1726 H=1726:00 +CPU= 13.928
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:16:24 STEP 1774 H=1774:00 +CPU= 15.797
  23:16:34 STEP 1727 H=1727:00 +CPU= 14.514
  23:16:40 STEP 1775 H=1775:00 +CPU= 14.633
  23:17:03 STEP 1728 H=1728:00 +CPU= 26.458
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:17:16 STEP 1776 H=1776:00 +CPU= 28.809
  23:17:20 STEP 1729 H=1729:00 +CPU= 14.278
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_73.zip
Uploading the intermediate file: upload_file_73.zip
  23:17:31 STEP 1777 H=1777:00 +CPU= 14.941
  23:17:34 STEP 1730 H=1730:00 +CPU= 13.976
  23:17:48 STEP 1778 H=1778:00 +CPU= 15.559
  23:17:59 STEP 1731 H=1731:00 +CPU= 23.400
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:18:13 STEP 1779 H=1779:00 +CPU= 24.736
  23:18:16 STEP 1732 H=1732:00 +CPU= 14.130
  23:18:30 STEP 1780 H=1780:00 +CPU= 15.447
  23:18:31 STEP 1733 H=1733:00 +CPU= 14.403
  23:18:45 STEP 1781 H=1781:00 +CPU= 14.558
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:18:57 STEP 1734 H=1734:00 +CPU= 23.968
  23:19:10 STEP 1782 H=1782:00 +CPU= 24.197
  23:19:12 STEP 1735 H=1735:00 +CPU= 13.961
  23:19:27 STEP 1783 H=1783:00 +CPU= 15.729
  23:19:27 STEP 1736 H=1736:00 +CPU= 14.682
Suspend request received from the BOINC client, suspending the child process
  23:19:42 STEP 1784 H=1784:00 +CPU= 14.989
Resuming the child process
  23:19:54 STEP 1737 H=1737:00 +CPU= 23.313
  23:20:08 STEP 1785 H=1785:00 +CPU= 24.905
  23:20:08 STEP 1738 H=1738:00 +CPU= 14.204
  23:20:23 STEP 1739 H=1739:00 +CPU= 14.157
  23:20:25 STEP 1786 H=1786:00 +CPU= 15.982
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:20:41 STEP 1787 H=1787:00 +CPU= 15.658
  23:20:52 STEP 1740 H=1740:00 +CPU= 25.134
  23:21:07 STEP 1741 H=1741:00 +CPU= 13.815
  23:21:09 STEP 1788 H=1788:00 +CPU= 26.348
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001788
  23:21:22 STEP 1742 H=1742:00 +CPU= 14.530
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:21:26 STEP 1789 H=1789:00 +CPU= 16.811
  23:21:42 STEP 1790 H=1790:00 +CPU= 15.199
  23:21:47 STEP 1743 H=1743:00 +CPU= 22.395
  23:22:02 STEP 1744 H=1744:00 +CPU= 14.745
  23:22:08 STEP 1791 H=1791:00 +CPU= 24.725
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:22:20 STEP 1745 H=1745:00 +CPU= 14.107
  23:22:25 STEP 1792 H=1792:00 +CPU= 16.469
  23:22:40 STEP 1793 H=1793:00 +CPU= 14.682
  23:22:44 STEP 1746 H=1746:00 +CPU= 22.695
  23:22:59 STEP 1747 H=1747:00 +CPU= 14.122
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:23:07 STEP 1794 H=1794:00 +CPU= 25.236
  23:23:16 STEP 1748 H=1748:00 +CPU= 14.065
  23:23:23 STEP 1795 H=1795:00 +CPU= 15.464
  23:23:39 STEP 1796 H=1796:00 +CPU= 14.544
  23:23:40 STEP 1749 H=1749:00 +CPU= 22.830
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:23:57 STEP 1750 H=1750:00 +CPU= 14.593
  23:24:05 STEP 1797 H=1797:00 +CPU= 25.205
  23:24:14 STEP 1751 H=1751:00 +CPU= 14.100
  23:24:21 STEP 1798 H=1798:00 +CPU= 15.975
  23:24:37 STEP 1799 H=1799:00 +CPU= 14.881
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:24:46 STEP 1752 H=1752:00 +CPU= 26.700
  23:25:01 STEP 1753 H=1753:00 +CPU= 13.962
  23:25:07 STEP 1800 H=1800:00 +CPU= 29.210
  23:25:16 STEP 1754 H=1754:00 +CPU= 13.749
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_74.zip
Uploading the intermediate file: upload_file_74.zip
  23:25:23 STEP 1801 H=1801:00 +CPU= 15.269
  23:25:39 STEP 1755 H=1755:00 +CPU= 22.340
  23:25:40 STEP 1802 H=1802:00 +CPU= 15.753
  23:25:55 STEP 1756 H=1756:00 +CPU= 14.895
  23:26:05 STEP 1803 H=1803:00 +CPU= 24.126
  23:26:10 STEP 1757 H=1757:00 +CPU= 13.672
Suspend request received from the BOINC client, suspending the child process
  23:26:21 STEP 1804 H=1804:00 +CPU= 16.079
Resuming the child process
  23:26:36 STEP 1758 H=1758:00 +CPU= 23.499
  23:26:36 STEP 1805 H=1805:00 +CPU= 14.567
  23:26:51 STEP 1759 H=1759:00 +CPU= 14.341
  23:27:02 STEP 1806 H=1806:00 +CPU= 24.221
  23:27:05 STEP 1760 H=1760:00 +CPU= 13.856
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:27:19 STEP 1807 H=1807:00 +CPU= 16.090
  23:27:31 STEP 1761 H=1761:00 +CPU= 22.566
  23:27:34 STEP 1808 H=1808:00 +CPU= 14.951
  23:27:45 STEP 1762 H=1762:00 +CPU= 13.717
  23:27:59 STEP 1763 H=1763:00 +CPU= 14.095
  23:28:00 STEP 1809 H=1809:00 +CPU= 23.742
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:28:16 STEP 1810 H=1810:00 +CPU= 15.202
  23:28:28 STEP 1764 H=1764:00 +CPU= 25.701
  23:28:32 STEP 1811 H=1811:00 +CPU= 15.115
  23:28:42 STEP 1765 H=1765:00 +CPU= 13.317
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:28:59 STEP 1812 H=1812:00 +CPU= 26.241
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001812
  23:29:00 STEP 1766 H=1766:00 +CPU= 14.805
  23:29:14 STEP 1813 H=1813:00 +CPU= 14.719
  23:29:23 STEP 1767 H=1767:00 +CPU= 22.573
  23:29:30 STEP 1814 H=1814:00 +CPU= 15.618
  23:29:38 STEP 1768 H=1768:00 +CPU= 13.829
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:29:55 STEP 1769 H=1769:00 +CPU= 14.192
  23:29:56 STEP 1815 H=1815:00 +CPU= 24.570
  23:30:11 STEP 1816 H=1816:00 +CPU= 14.729
  23:30:19 STEP 1770 H=1770:00 +CPU= 22.828
  23:30:27 STEP 1817 H=1817:00 +CPU= 15.429
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:30:35 STEP 1771 H=1771:00 +CPU= 13.762
  23:30:50 STEP 1772 H=1772:00 +CPU= 14.185
  23:30:53 STEP 1818 H=1818:00 +CPU= 24.277
  23:31:08 STEP 1819 H=1819:00 +CPU= 14.470
  23:31:13 STEP 1773 H=1773:00 +CPU= 21.838
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:31:24 STEP 1820 H=1820:00 +CPU= 15.713
  23:31:30 STEP 1774 H=1774:00 +CPU= 14.641
  23:31:45 STEP 1775 H=1775:00 +CPU= 14.134
  23:31:50 STEP 1821 H=1821:00 +CPU= 24.945
  23:32:06 STEP 1822 H=1822:00 +CPU= 15.256
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:32:15 STEP 1776 H=1776:00 +CPU= 26.402
  23:32:22 STEP 1823 H=1823:00 +CPU= 15.564
  23:32:30 STEP 1777 H=1777:00 +CPU= 13.804
  23:32:44 STEP 1778 H=1778:00 +CPU= 14.076
  23:32:53 STEP 1824 H=1824:00 +CPU= 29.074
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_75.zip
Uploading the intermediate file: upload_file_75.zip
  23:33:09 STEP 1779 H=1779:00 +CPU= 23.088
  23:33:09 STEP 1825 H=1825:00 +CPU= 15.304
  23:33:24 STEP 1780 H=1780:00 +CPU= 14.473
  23:33:25 STEP 1826 H=1826:00 +CPU= 15.517
  23:33:38 STEP 1781 H=1781:00 +CPU= 13.617
  23:33:51 STEP 1827 H=1827:00 +CPU= 24.538
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:34:04 STEP 1782 H=1782:00 +CPU= 23.290
  23:34:07 STEP 1828 H=1828:00 +CPU= 15.731
  23:34:19 STEP 1783 H=1783:00 +CPU= 13.751
  23:34:23 STEP 1829 H=1829:00 +CPU= 15.180
  23:34:33 STEP 1784 H=1784:00 +CPU= 13.958
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:34:50 STEP 1830 H=1830:00 +CPU= 25.886
  23:34:59 STEP 1785 H=1785:00 +CPU= 22.722
  23:35:05 STEP 1831 H=1831:00 +CPU= 14.790
  23:35:14 STEP 1786 H=1786:00 +CPU= 13.969
  23:35:22 STEP 1832 H=1832:00 +CPU= 16.136
  23:35:29 STEP 1787 H=1787:00 +CPU= 14.188
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:35:47 STEP 1833 H=1833:00 +CPU= 23.351
  23:35:57 STEP 1788 H=1788:00 +CPU= 25.357
  23:36:03 STEP 1834 H=1834:00 +CPU= 15.576
  23:36:11 STEP 1789 H=1789:00 +CPU= 13.884
  23:36:19 STEP 1835 H=1835:00 +CPU= 15.076
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:36:29 STEP 1790 H=1790:00 +CPU= 15.105
  23:36:47 STEP 1836 H=1836:00 +CPU= 26.594
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001836
  23:36:52 STEP 1791 H=1791:00 +CPU= 22.427
  23:37:03 STEP 1837 H=1837:00 +CPU= 15.154
  23:37:07 STEP 1792 H=1792:00 +CPU= 14.210
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:37:21 STEP 1838 H=1838:00 +CPU= 17.029
  23:37:24 STEP 1793 H=1793:00 +CPU= 14.201
  23:37:45 STEP 1839 H=1839:00 +CPU= 22.883
  23:37:48 STEP 1794 H=1794:00 +CPU= 23.035
Suspend request received from the BOINC client, suspending the child process
  23:38:02 STEP 1840 H=1840:00 +CPU= 16.188
Resuming the child process
  23:38:05 STEP 1795 H=1795:00 +CPU= 13.933
  23:38:18 STEP 1841 H=1841:00 +CPU= 15.447
  23:38:20 STEP 1796 H=1796:00 +CPU= 14.585
  23:38:43 STEP 1797 H=1797:00 +CPU= 22.383
  23:38:45 STEP 1842 H=1842:00 +CPU= 24.494
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:39:00 STEP 1798 H=1798:00 +CPU= 14.855
  23:39:02 STEP 1843 H=1843:00 +CPU= 16.260
  23:39:15 STEP 1799 H=1799:00 +CPU= 13.746
  23:39:19 STEP 1844 H=1844:00 +CPU= 15.017
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:39:45 STEP 1800 H=1800:00 +CPU= 26.097
  23:39:45 STEP 1845 H=1845:00 +CPU= 24.459
  23:39:59 STEP 1801 H=1801:00 +CPU= 13.878
  23:40:03 STEP 1846 H=1846:00 +CPU= 15.113
  23:40:14 STEP 1802 H=1802:00 +CPU= 14.143
  23:40:18 STEP 1847 H=1847:00 +CPU= 14.702
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:40:40 STEP 1803 H=1803:00 +CPU= 22.650
  23:40:45 STEP 1848 H=1848:00 +CPU= 26.886
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_76.zip
  23:40:55 STEP 1804 H=1804:00 +CPU= 14.341
  23:41:01 STEP 1849 H=1849:00 +CPU= 15.082
Uploading the intermediate file: upload_file_76.zip
  23:41:09 STEP 1805 H=1805:00 +CPU= 13.503
  23:41:17 STEP 1850 H=1850:00 +CPU= 14.529
  23:41:33 STEP 1806 H=1806:00 +CPU= 23.476
  23:41:41 STEP 1851 H=1851:00 +CPU= 24.006
  23:41:48 STEP 1807 H=1807:00 +CPU= 13.855
  23:41:58 STEP 1852 H=1852:00 +CPU= 15.525
  23:42:03 STEP 1808 H=1808:00 +CPU= 14.105
Suspend request received from the BOINC client, suspending the child process
  23:42:14 STEP 1853 H=1853:00 +CPU= 15.135
Resuming the child process
  23:42:28 STEP 1809 H=1809:00 +CPU= 22.536
  23:42:39 STEP 1854 H=1854:00 +CPU= 24.215
  23:42:43 STEP 1810 H=1810:00 +CPU= 13.630
  23:42:55 STEP 1855 H=1855:00 +CPU= 15.037
  23:42:57 STEP 1811 H=1811:00 +CPU= 14.026
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:43:11 STEP 1856 H=1856:00 +CPU= 15.332
  23:43:26 STEP 1812 H=1812:00 +CPU= 25.674
  23:43:36 STEP 1857 H=1857:00 +CPU= 23.946
  23:43:40 STEP 1813 H=1813:00 +CPU= 13.289
Suspend request received from the BOINC client, suspending the child process
  23:43:52 STEP 1858 H=1858:00 +CPU= 15.236
Resuming the child process
  23:43:58 STEP 1814 H=1814:00 +CPU= 14.698
  23:44:08 STEP 1859 H=1859:00 +CPU= 15.306
  23:44:22 STEP 1815 H=1815:00 +CPU= 22.692
  23:44:36 STEP 1860 H=1860:00 +CPU= 27.301
  23:44:36 STEP 1816 H=1816:00 +CPU= 13.766
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001860
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:44:52 STEP 1861 H=1861:00 +CPU= 15.139
  23:44:53 STEP 1817 H=1817:00 +CPU= 14.035
  23:45:07 STEP 1862 H=1862:00 +CPU= 15.164
  23:45:16 STEP 1818 H=1818:00 +CPU= 22.093
  23:45:32 STEP 1819 H=1819:00 +CPU= 14.063
  23:45:32 STEP 1863 H=1863:00 +CPU= 24.320
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:45:49 STEP 1820 H=1820:00 +CPU= 14.425
  23:45:49 STEP 1864 H=1864:00 +CPU= 16.306
  23:46:05 STEP 1865 H=1865:00 +CPU= 14.829
  23:46:13 STEP 1821 H=1821:00 +CPU= 22.355
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:46:30 STEP 1822 H=1822:00 +CPU= 14.983
  23:46:31 STEP 1866 H=1866:00 +CPU= 25.094
  23:46:45 STEP 1823 H=1823:00 +CPU= 14.038
  23:46:46 STEP 1867 H=1867:00 +CPU= 14.163
  23:47:03 STEP 1868 H=1868:00 +CPU= 15.023
  23:47:13 STEP 1824 H=1824:00 +CPU= 26.067
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:47:28 STEP 1869 H=1869:00 +CPU= 24.056
  23:47:30 STEP 1825 H=1825:00 +CPU= 13.856
  23:47:44 STEP 1826 H=1826:00 +CPU= 13.824
  23:47:44 STEP 1870 H=1870:00 +CPU= 14.950
  23:48:00 STEP 1871 H=1871:00 +CPU= 15.621
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:48:10 STEP 1827 H=1827:00 +CPU= 23.109
  23:48:25 STEP 1828 H=1828:00 +CPU= 14.363
  23:48:30 STEP 1872 H=1872:00 +CPU= 28.621
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_77.zip
Uploading the intermediate file: upload_file_77.zip
  23:48:39 STEP 1829 H=1829:00 +CPU= 13.347
  23:48:45 STEP 1873 H=1873:00 +CPU= 14.422
  23:49:01 STEP 1874 H=1874:00 +CPU= 15.532
  23:49:04 STEP 1830 H=1830:00 +CPU= 23.996
  23:49:19 STEP 1831 H=1831:00 +CPU= 13.855
  23:49:27 STEP 1875 H=1875:00 +CPU= 23.849
  23:49:33 STEP 1832 H=1832:00 +CPU= 14.012
  23:49:42 STEP 1876 H=1876:00 +CPU= 14.920
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:49:59 STEP 1877 H=1877:00 +CPU= 15.976
  23:49:59 STEP 1833 H=1833:00 +CPU= 22.842
  23:50:14 STEP 1834 H=1834:00 +CPU= 13.891
  23:50:25 STEP 1878 H=1878:00 +CPU= 25.056
  23:50:31 STEP 1835 H=1835:00 +CPU= 14.145
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:50:43 STEP 1879 H=1879:00 +CPU= 15.844
  23:51:00 STEP 1880 H=1880:00 +CPU= 15.999
  23:51:00 STEP 1836 H=1836:00 +CPU= 25.790
  23:51:14 STEP 1837 H=1837:00 +CPU= 13.261
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:51:26 STEP 1881 H=1881:00 +CPU= 24.743
  23:51:31 STEP 1838 H=1838:00 +CPU= 14.726
  23:51:41 STEP 1882 H=1882:00 +CPU= 15.053
  23:51:55 STEP 1839 H=1839:00 +CPU= 22.736
  23:51:57 STEP 1883 H=1883:00 +CPU= 15.083
  23:52:10 STEP 1840 H=1840:00 +CPU= 13.891
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:52:26 STEP 1884 H=1884:00 +CPU= 28.213
  23:52:27 STEP 1841 H=1841:00 +CPU= 14.169
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001884
  23:52:41 STEP 1885 H=1885:00 +CPU= 14.861
  23:52:52 STEP 1842 H=1842:00 +CPU= 23.468
  23:52:58 STEP 1886 H=1886:00 +CPU= 16.078
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:53:09 STEP 1843 H=1843:00 +CPU= 13.605
  23:53:24 STEP 1887 H=1887:00 +CPU= 24.713
  23:53:24 STEP 1844 H=1844:00 +CPU= 14.624
  23:53:40 STEP 1888 H=1888:00 +CPU= 15.271
  23:53:47 STEP 1845 H=1845:00 +CPU= 22.051
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:53:55 STEP 1889 H=1889:00 +CPU= 14.356
  23:54:04 STEP 1846 H=1846:00 +CPU= 14.403
  23:54:19 STEP 1847 H=1847:00 +CPU= 14.355
  23:54:20 STEP 1890 H=1890:00 +CPU= 24.561
  23:54:36 STEP 1891 H=1891:00 +CPU= 14.900
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:54:48 STEP 1848 H=1848:00 +CPU= 25.844
  23:54:53 STEP 1892 H=1892:00 +CPU= 15.890
  23:55:02 STEP 1849 H=1849:00 +CPU= 13.113
  23:55:16 STEP 1850 H=1850:00 +CPU= 13.814
  23:55:18 STEP 1893 H=1893:00 +CPU= 24.060
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:55:35 STEP 1894 H=1894:00 +CPU= 16.114
  23:55:42 STEP 1851 H=1851:00 +CPU= 23.069
  23:55:52 STEP 1895 H=1895:00 +CPU= 15.879
  23:55:58 STEP 1852 H=1852:00 +CPU= 14.568
  23:56:12 STEP 1853 H=1853:00 +CPU= 13.660
  23:56:21 STEP 1896 H=1896:00 +CPU= 27.665
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_78.zip
Uploading the intermediate file: upload_file_78.zip
  23:56:36 STEP 1897 H=1897:00 +CPU= 14.528
  23:56:38 STEP 1854 H=1854:00 +CPU= 22.942
  23:56:53 STEP 1898 H=1898:00 +CPU= 15.717
  23:56:54 STEP 1855 H=1855:00 +CPU= 14.284
  23:57:08 STEP 1856 H=1856:00 +CPU= 14.158
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:57:19 STEP 1899 H=1899:00 +CPU= 24.437
  23:57:34 STEP 1900 H=1900:00 +CPU= 15.120
  23:57:34 STEP 1857 H=1857:00 +CPU= 22.633
  23:57:50 STEP 1858 H=1858:00 +CPU= 14.762
  23:57:50 STEP 1901 H=1901:00 +CPU= 14.852
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:58:06 STEP 1859 H=1859:00 +CPU= 13.887
  23:58:15 STEP 1902 H=1902:00 +CPU= 24.357
  23:58:31 STEP 1903 H=1903:00 +CPU= 14.977
  23:58:33 STEP 1860 H=1860:00 +CPU= 25.415
  23:58:47 STEP 1904 H=1904:00 +CPU= 14.939
  23:58:47 STEP 1861 H=1861:00 +CPU= 13.407
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:59:04 STEP 1862 H=1862:00 +CPU= 14.503
  23:59:13 STEP 1905 H=1905:00 +CPU= 25.211
  23:59:27 STEP 1863 H=1863:00 +CPU= 22.359
  23:59:30 STEP 1906 H=1906:00 +CPU= 15.870
  23:59:42 STEP 1864 H=1864:00 +CPU= 14.123
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:59:47 STEP 1907 H=1907:00 +CPU= 15.302
  23:59:59 STEP 1865 H=1865:00 +CPU= 14.539
  00:00:16 STEP 1908 H=1908:00 +CPU= 27.258
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001908
  00:00:23 STEP 1866 H=1866:00 +CPU= 22.977
  00:00:32 STEP 1909 H=1909:00 +CPU= 14.897
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:00:39 STEP 1867 H=1867:00 +CPU= 13.773
  00:00:49 STEP 1910 H=1910:00 +CPU= 17.376
  00:00:54 STEP 1868 H=1868:00 +CPU= 14.228
  00:01:14 STEP 1911 H=1911:00 +CPU= 23.567
  00:01:18 STEP 1869 H=1869:00 +CPU= 22.253
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:01:30 STEP 1912 H=1912:00 +CPU= 15.136
  00:01:35 STEP 1870 H=1870:00 +CPU= 14.426
  00:01:46 STEP 1913 H=1913:00 +CPU= 14.919
  00:01:50 STEP 1871 H=1871:00 +CPU= 14.455
  00:02:12 STEP 1914 H=1914:00 +CPU= 24.692
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:02:21 STEP 1872 H=1872:00 +CPU= 26.646
  00:02:28 STEP 1915 H=1915:00 +CPU= 15.853
  00:02:34 STEP 1873 H=1873:00 +CPU= 13.186
  00:02:44 STEP 1916 H=1916:00 +CPU= 14.708
  00:02:49 STEP 1874 H=1874:00 +CPU= 14.473
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:03:08 STEP 1917 H=1917:00 +CPU= 23.679
  00:03:14 STEP 1875 H=1875:00 +CPU= 22.155
  00:03:25 STEP 1918 H=1918:00 +CPU= 15.468
  00:03:29 STEP 1876 H=1876:00 +CPU= 14.384
  00:03:41 STEP 1919 H=1919:00 +CPU= 14.950
  00:03:43 STEP 1877 H=1877:00 +CPU= 13.478
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:04:09 STEP 1878 H=1878:00 +CPU= 22.963
  00:04:11 STEP 1920 H=1920:00 +CPU= 28.436
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_79.zip
Uploading the intermediate file: upload_file_79.zip
  00:04:24 STEP 1879 H=1879:00 +CPU= 14.191
  00:04:26 STEP 1921 H=1921:00 +CPU= 14.980
  00:04:38 STEP 1880 H=1880:00 +CPU= 13.711
  00:04:41 STEP 1922 H=1922:00 +CPU= 14.507
Uploading trickle at timestep: 6912000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:05:05 STEP 1881 H=1881:00 +CPU= 23.381
  00:05:07 STEP 1923 H=1923:00 +CPU= 24.293
  00:05:20 STEP 1882 H=1882:00 +CPU= 14.337
  00:05:22 STEP 1924 H=1924:00 +CPU= 14.752
  00:05:34 STEP 1883 H=1883:00 +CPU= 13.689
  00:05:38 STEP 1925 H=1925:00 +CPU= 15.585
  00:06:01 STEP 1884 H=1884:00 +CPU= 25.596
  00:06:03 STEP 1926 H=1926:00 +CPU= 24.393
  00:06:15 STEP 1885 H=1885:00 +CPU= 13.409
  00:06:19 STEP 1927 H=1927:00 +CPU= 14.640
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:06:32 STEP 1886 H=1886:00 +CPU= 14.382
  00:06:34 STEP 1928 H=1928:00 +CPU= 14.464
  00:06:56 STEP 1887 H=1887:00 +CPU= 22.686
  00:06:59 STEP 1929 H=1929:00 +CPU= 23.814
  00:07:11 STEP 1888 H=1888:00 +CPU= 14.302
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:07:15 STEP 1930 H=1930:00 +CPU= 15.086
  00:07:28 STEP 1889 H=1889:00 +CPU= 14.467
  00:07:31 STEP 1931 H=1931:00 +CPU= 15.268
  00:07:52 STEP 1890 H=1890:00 +CPU= 23.202
  00:07:59 STEP 1932 H=1932:00 +CPU= 26.674
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:08:09 STEP 1891 H=1891:00 +CPU= 13.722
  00:08:15 STEP 1933 H=1933:00 +CPU= 15.433
  00:08:25 STEP 1892 H=1892:00 +CPU= 14.616
  00:08:31 STEP 1934 H=1934:00 +CPU= 15.039
  00:08:49 STEP 1893 H=1893:00 +CPU= 22.953
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:08:57 STEP 1935 H=1935:00 +CPU= 24.884
  00:09:06 STEP 1894 H=1894:00 +CPU= 14.640
  00:09:12 STEP 1936 H=1936:00 +CPU= 14.894
  00:09:21 STEP 1895 H=1895:00 +CPU= 14.706
  00:09:28 STEP 1937 H=1937:00 +CPU= 15.061
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:09:51 STEP 1896 H=1896:00 +CPU= 26.164
  00:09:54 STEP 1938 H=1938:00 +CPU= 25.042
  00:10:05 STEP 1897 H=1897:00 +CPU= 13.572
  00:10:09 STEP 1939 H=1939:00 +CPU= 14.231
  00:10:20 STEP 1898 H=1898:00 +CPU= 14.471
  00:10:25 STEP 1940 H=1940:00 +CPU= 15.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:10:46 STEP 1899 H=1899:00 +CPU= 22.709
  00:10:50 STEP 1941 H=1941:00 +CPU= 23.723
  00:11:01 STEP 1900 H=1900:00 +CPU= 14.890
  00:11:05 STEP 1942 H=1942:00 +CPU= 14.782
  00:11:16 STEP 1901 H=1901:00 +CPU= 13.594
  00:11:22 STEP 1943 H=1943:00 +CPU= 15.608
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:11:42 STEP 1902 H=1902:00 +CPU= 23.613
  00:11:52 STEP 1944 H=1944:00 +CPU= 28.397
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_80.zip
Uploading the intermediate file: upload_file_80.zip
  00:11:59 STEP 1903 H=1903:00 +CPU= 14.521
  00:12:07 STEP 1945 H=1945:00 +CPU= 14.643
  00:12:13 STEP 1904 H=1904:00 +CPU= 14.054
  00:12:22 STEP 1946 H=1946:00 +CPU= 15.282
  00:12:37 STEP 1905 H=1905:00 +CPU= 22.955
  00:12:47 STEP 1947 H=1947:00 +CPU= 23.621
  00:12:53 STEP 1906 H=1906:00 +CPU= 14.778
Suspend request received from the BOINC client, suspending the child process
  00:13:03 STEP 1948 H=1948:00 +CPU= 15.309
Resuming the child process
  00:13:10 STEP 1907 H=1907:00 +CPU= 13.933
  00:13:19 STEP 1949 H=1949:00 +CPU= 15.568
  00:13:36 STEP 1908 H=1908:00 +CPU= 25.471
  00:13:45 STEP 1950 H=1950:00 +CPU= 24.175
  00:13:51 STEP 1909 H=1909:00 +CPU= 14.512
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:14:01 STEP 1951 H=1951:00 +CPU= 15.286
  00:14:09 STEP 1910 H=1910:00 +CPU= 14.293
  00:14:16 STEP 1952 H=1952:00 +CPU= 14.940
  00:14:33 STEP 1911 H=1911:00 +CPU= 23.370
  00:14:41 STEP 1953 H=1953:00 +CPU= 24.232
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:14:51 STEP 1912 H=1912:00 +CPU= 14.950
  00:15:00 STEP 1954 H=1954:00 +CPU= 16.613
  00:15:06 STEP 1913 H=1913:00 +CPU= 14.550
  00:15:15 STEP 1955 H=1955:00 +CPU= 14.149
  00:15:32 STEP 1914 H=1914:00 +CPU= 23.768
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:15:46 STEP 1956 H=1956:00 +CPU= 27.712
Moving to projects directory: /var/lib/boinc/slots/40/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc/slots/40/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc/slots/40/ICMUAhq0f+001956
  00:15:49 STEP 1915 H=1915:00 +CPU= 14.404
  00:16:02 STEP 1957 H=1957:00 +CPU= 15.182
  00:16:04 STEP 1916 H=1916:00 +CPU= 14.918
  00:16:19 STEP 1958 H=1958:00 +CPU= 15.707
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:16:32 STEP 1917 H=1917:00 +CPU= 24.695
  00:16:44 STEP 1959 H=1959:00 +CPU= 23.952
  00:16:48 STEP 1918 H=1918:00 +CPU= 14.712
  00:16:59 STEP 1960 H=1960:00 +CPU= 15.263
  00:17:05 STEP 1919 H=1919:00 +CPU= 14.424
Suspend request received from the BOINC client, suspending the child process
  00:17:14 STEP 1961 H=1961:00 +CPU= 14.457
Resuming the child process
  00:17:38 STEP 1920 H=1920:00 +CPU= 27.199
  00:17:40 STEP 1962 H=1962:00 +CPU= 25.119
  00:17:54 STEP 1921 H=1921:00 +CPU= 14.798
  00:17:57 STEP 1963 H=1963:00 +CPU= 15.445
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:18:11 STEP 1922 H=1922:00 +CPU= 14.378
  00:18:13 STEP 1964 H=1964:00 +CPU= 14.772
  00:18:36 STEP 1923 H=1923:00 +CPU= 23.110
  00:18:39 STEP 1965 H=1965:00 +CPU= 24.453
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:20:02 STEP 1924 H=1924:00 +CPU= 15.652
  00:20:06 STEP 1966 H=1966:00 +CPU= 15.956
  00:20:17 STEP 1925 H=1925:00 +CPU= 14.017
  00:20:23 STEP 1967 H=1967:00 +CPU= 15.922
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2003050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0850
(argv4) batchid: 972
(argv5) wuid: 12189494
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/40
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/40/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/40/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_259a4fd57631791124bd4446b1c50fe7 to: /var/lib/boinc/slots/40/oifs_43r3_ps_0850_2003050100_123_972_12189494.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/40/oifs_43r3_ps_0850_2003050100_123_972_12189494.zip
ic_ancil_file: ic_ancil_12189494
ifsdata_file: ifsdata_12189494
climate_data_file: clim_data_12189494
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_644e52450266e903c13a8a1f34675835 to: /var/lib/boinc/slots/40/ic_ancil_12189494.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/40/ic_ancil_12189494.zip
  01:22:58 STEP 1926 H=1926:00 +CPU=169.324
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_736d68a7d3bd493bbf05e57ec33f6d2a to: /var/lib/boinc/slots/40/ifsdata/ifsdata_12189494.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/40/ifsdata/ifsdata_12189494.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/40/159l_2/clim_data_12189494.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/40/159l_2/clim_data_12189494.zip
Checking for progress XML file: /var/lib/boinc/slots/40/progress_file_12189494.xml
Opened progress file ok : /var/lib/boinc/slots/40/progress_file_12189494.xml
-- Model is restarting --
Adjusting last_iter, 1968, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/40/progress_file_12189494.xml
last_cpu_time: 38188
upload_file_number: 81
last_iter: 1967
last_upload: 6998400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812
The child process has been launched with process id: 12374
Executing the command: /var/lib/boinc/slots/40/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:12374:12374] [20230109:012303:1673202183:0.004] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:23:18 STEP 1927 H=1927:00 +CPU= 18.525
  01:23:19 STEP 1968 H=1968:00 +CPU=206.661
Invalid characters in stoi string: STEPO
Unable to update iter, resetting to last_iter.
ifs_line = 
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:29:08 STEP 1969 H=1969:00 +CPU= 94.605
Suspend request received from the BOINC client, suspending the child process
  01:30:20 STEP 1970 H=1970:00 +CPU= 20.212
Resuming the child process
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12189494/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0850_2003050100_123_972_12189494_0_r403070812_81.zip
  01:30:27 STEP 1968 H=1968:00 +CPU=103.286
Uploading the intermediate file: upload_file_81.zip
  01:30:42 STEP 1969 H=1969:00 +CPU= 14.110
  01:30:44 STEP 1971 H=1971:00 +CPU= 23.411
  01:30:57 STEP 1970 H=1970:00 +CPU= 14.649
  01:31:00 STEP 1972 H=1972:00 +CPU= 15.496
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:31:14 STEP 1973 H=1973:00 +CPU= 14.280
  01:31:23 STEP 1971 H=1971:00 +CPU= 23.469
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
The child process terminated with status: 0
  01:32:17 STEP 1974 H=1974:00 +CPU= 37.180
  01:32:31 STEP 1975 H=1975:00 +CPU= 14.038
  01:32:45 STEP 1976 H=1976:00 +CPU= 13.864
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:12:55 1534746 22275041 oifs_43r3_ps_0850_2003050100_123_972_12189494_0 6,912,000 37,342 0.0054
09 May 2023 16:12:52 1534746 22275041 oifs_43r3_ps_0850_2003050100_123_972_12189494_0 6,048,000 33,041 0.0055
09 May 2023 16:12:50 1534746 22275041 oifs_43r3_ps_0850_2003050100_123_972_12189494_0 5,184,000 28,742 0.0055
09 May 2023 16:12:48 1534746 22275041 oifs_43r3_ps_0850_2003050100_123_972_12189494_0 4,320,000 24,621 0.0057
09 May 2023 16:12:43 1534746 22275041 oifs_43r3_ps_0850_2003050100_123_972_12189494_0 3,456,000 20,528 0.0059
09 May 2023 16:12:40 1534746 22275041 oifs_43r3_ps_0850_2003050100_123_972_12189494_0 2,592,000 16,418 0.0063
09 May 2023 16:12:37 1534746 22275041 oifs_43r3_ps_0850_2003050100_123_972_12189494_0 1,728,000 12,205 0.0071
09 May 2023 16:12:35 1534746 22275041 oifs_43r3_ps_0850_2003050100_123_972_12189494_0 864,000 7,987 0.0092
09 May 2023 16:12:35 1534746 22275041 oifs_43r3_ps_0850_2003050100_123_972_12189494_0 864,000 7,987 0.0092


©2024 climateprediction.net