climateprediction.net home page
Task 22255377

Task 22255377

Name oifs_43r3_ps_0400_1985050100_123_954_12171044_0
Workunit 12171044
Created 21 Dec 2022, 5:55:08 UTC
Sent 2 Jan 2023, 16:55:02 UTC
Report deadline 1 Feb 2023, 16:55:02 UTC
Received 3 Jan 2023, 18:13:58 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1510819
Run time 1 days 0 hours 16 min 40 sec
CPU time 22 hours 33 min 13 sec
Validate state Invalid
Credit 12,096.00
Device peak FLOPS 3.55 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,401.58 MB
Peak swap size 4,974.12 MB
Peak disk usage 3,141.43 MB
Stderr
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_73.zip
Uploading the intermediate file: upload_file_73.zip
  05:53:00 STEP 1777 H=1777:00 +CPU= 26.985
  05:53:28 STEP 1778 H=1778:00 +CPU= 27.985
  05:54:12 STEP 1779 H=1779:00 +CPU= 43.672
  05:54:40 STEP 1780 H=1780:00 +CPU= 27.209
  05:55:07 STEP 1781 H=1781:00 +CPU= 27.220
  05:55:50 STEP 1782 H=1782:00 +CPU= 42.983
  05:56:17 STEP 1783 H=1783:00 +CPU= 26.368
  05:56:44 STEP 1784 H=1784:00 +CPU= 27.509
  05:57:28 STEP 1785 H=1785:00 +CPU= 43.286
  05:57:55 STEP 1786 H=1786:00 +CPU= 27.355
  05:58:22 STEP 1787 H=1787:00 +CPU= 27.035
  05:59:11 STEP 1788 H=1788:00 +CPU= 47.908
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001788
  05:59:38 STEP 1789 H=1789:00 +CPU= 27.139
  06:00:07 STEP 1790 H=1790:00 +CPU= 28.858
  06:00:54 STEP 1791 H=1791:00 +CPU= 46.610
  06:01:23 STEP 1792 H=1792:00 +CPU= 29.470
  06:01:52 STEP 1793 H=1793:00 +CPU= 28.082
  06:02:36 STEP 1794 H=1794:00 +CPU= 43.863
  06:03:03 STEP 1795 H=1795:00 +CPU= 26.806
  06:03:31 STEP 1796 H=1796:00 +CPU= 27.643
  06:04:15 STEP 1797 H=1797:00 +CPU= 44.302
  06:04:44 STEP 1798 H=1798:00 +CPU= 28.486
  06:05:13 STEP 1799 H=1799:00 +CPU= 28.995
  06:06:41 STEP 1800 H=1800:00 +CPU= 51.712
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_74.zip
Uploading the intermediate file: upload_file_74.zip
  06:07:08 STEP 1801 H=1801:00 +CPU= 27.036
  06:07:36 STEP 1802 H=1802:00 +CPU= 27.686
  06:08:20 STEP 1803 H=1803:00 +CPU= 44.019
  06:08:48 STEP 1804 H=1804:00 +CPU= 27.705
  06:09:15 STEP 1805 H=1805:00 +CPU= 26.826
  06:09:58 STEP 1806 H=1806:00 +CPU= 43.548
  06:10:26 STEP 1807 H=1807:00 +CPU= 27.848
  06:10:54 STEP 1808 H=1808:00 +CPU= 27.797
  06:11:37 STEP 1809 H=1809:00 +CPU= 42.962
  06:12:05 STEP 1810 H=1810:00 +CPU= 27.986
  06:12:33 STEP 1811 H=1811:00 +CPU= 27.438
  06:13:20 STEP 1812 H=1812:00 +CPU= 47.479
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001812
  06:13:47 STEP 1813 H=1813:00 +CPU= 26.815
  06:14:15 STEP 1814 H=1814:00 +CPU= 27.870
  06:14:59 STEP 1815 H=1815:00 +CPU= 43.787
  06:15:28 STEP 1816 H=1816:00 +CPU= 28.822
  06:15:55 STEP 1817 H=1817:00 +CPU= 27.183
  06:16:40 STEP 1818 H=1818:00 +CPU= 44.592
  06:17:08 STEP 1819 H=1819:00 +CPU= 27.065
  06:17:35 STEP 1820 H=1820:00 +CPU= 27.677
  06:18:19 STEP 1821 H=1821:00 +CPU= 43.066
  06:18:46 STEP 1822 H=1822:00 +CPU= 27.837
  06:19:15 STEP 1823 H=1823:00 +CPU= 28.026
  06:20:37 STEP 1824 H=1824:00 +CPU= 53.055
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_75.zip
Uploading the intermediate file: upload_file_75.zip
  06:21:04 STEP 1825 H=1825:00 +CPU= 26.529
  06:21:32 STEP 1826 H=1826:00 +CPU= 27.007
  06:22:15 STEP 1827 H=1827:00 +CPU= 43.114
  06:22:43 STEP 1828 H=1828:00 +CPU= 27.830
  06:23:10 STEP 1829 H=1829:00 +CPU= 27.052
  06:23:55 STEP 1830 H=1830:00 +CPU= 45.106
  06:24:23 STEP 1831 H=1831:00 +CPU= 27.399
  06:24:50 STEP 1832 H=1832:00 +CPU= 27.586
  06:25:36 STEP 1833 H=1833:00 +CPU= 45.050
  06:26:04 STEP 1834 H=1834:00 +CPU= 28.111
  06:26:32 STEP 1835 H=1835:00 +CPU= 27.568
  06:27:22 STEP 1836 H=1836:00 +CPU= 48.724
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001836
  06:27:49 STEP 1837 H=1837:00 +CPU= 27.127
  06:28:16 STEP 1838 H=1838:00 +CPU= 27.202
  06:29:00 STEP 1839 H=1839:00 +CPU= 43.089
  06:29:28 STEP 1840 H=1840:00 +CPU= 28.322
  06:29:57 STEP 1841 H=1841:00 +CPU= 28.055
  06:30:44 STEP 1842 H=1842:00 +CPU= 46.669
  06:31:12 STEP 1843 H=1843:00 +CPU= 27.531
  06:31:40 STEP 1844 H=1844:00 +CPU= 28.291
  06:32:25 STEP 1845 H=1845:00 +CPU= 43.678
  06:32:52 STEP 1846 H=1846:00 +CPU= 27.039
  06:33:19 STEP 1847 H=1847:00 +CPU= 26.865
  06:34:11 STEP 1848 H=1848:00 +CPU= 49.510
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_76.zip
Uploading the intermediate file: upload_file_76.zip
  06:34:38 STEP 1849 H=1849:00 +CPU= 26.681
  06:35:07 STEP 1850 H=1850:00 +CPU= 28.468
  06:35:51 STEP 1851 H=1851:00 +CPU= 43.959
  06:36:20 STEP 1852 H=1852:00 +CPU= 28.347
  06:36:47 STEP 1853 H=1853:00 +CPU= 26.814
  06:37:31 STEP 1854 H=1854:00 +CPU= 44.171
  06:37:59 STEP 1855 H=1855:00 +CPU= 27.378
  06:38:27 STEP 1856 H=1856:00 +CPU= 27.745
  06:39:10 STEP 1857 H=1857:00 +CPU= 43.282
  06:39:38 STEP 1858 H=1858:00 +CPU= 27.135
  06:40:05 STEP 1859 H=1859:00 +CPU= 27.317
  06:40:54 STEP 1860 H=1860:00 +CPU= 49.024
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001860
  06:41:22 STEP 1861 H=1861:00 +CPU= 27.735
  06:41:51 STEP 1862 H=1862:00 +CPU= 28.555
  06:42:36 STEP 1863 H=1863:00 +CPU= 44.521
  06:43:03 STEP 1864 H=1864:00 +CPU= 27.789
  06:43:30 STEP 1865 H=1865:00 +CPU= 26.600
  06:44:14 STEP 1866 H=1866:00 +CPU= 43.629
  06:44:41 STEP 1867 H=1867:00 +CPU= 26.686
  06:45:09 STEP 1868 H=1868:00 +CPU= 28.260
  06:45:53 STEP 1869 H=1869:00 +CPU= 44.274
  06:46:22 STEP 1870 H=1870:00 +CPU= 28.688
  06:46:50 STEP 1871 H=1871:00 +CPU= 28.121
  06:48:10 STEP 1872 H=1872:00 +CPU= 51.322
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_77.zip
Uploading the intermediate file: upload_file_77.zip
  06:48:37 STEP 1873 H=1873:00 +CPU= 27.227
  06:49:06 STEP 1874 H=1874:00 +CPU= 28.222
  06:49:49 STEP 1875 H=1875:00 +CPU= 43.279
  06:50:18 STEP 1876 H=1876:00 +CPU= 28.379
  06:50:45 STEP 1877 H=1877:00 +CPU= 27.084
  06:51:28 STEP 1878 H=1878:00 +CPU= 43.529
  06:51:55 STEP 1879 H=1879:00 +CPU= 26.635
  06:52:23 STEP 1880 H=1880:00 +CPU= 28.177
  06:53:07 STEP 1881 H=1881:00 +CPU= 43.883
  06:53:35 STEP 1882 H=1882:00 +CPU= 27.660
  06:54:02 STEP 1883 H=1883:00 +CPU= 27.511
  06:54:51 STEP 1884 H=1884:00 +CPU= 48.952
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001884
  06:55:19 STEP 1885 H=1885:00 +CPU= 27.731
  06:55:47 STEP 1886 H=1886:00 +CPU= 27.899
  06:56:31 STEP 1887 H=1887:00 +CPU= 43.253
  06:56:58 STEP 1888 H=1888:00 +CPU= 27.527
  06:57:25 STEP 1889 H=1889:00 +CPU= 26.869
  06:58:09 STEP 1890 H=1890:00 +CPU= 43.669
  06:58:36 STEP 1891 H=1891:00 +CPU= 26.887
  06:59:04 STEP 1892 H=1892:00 +CPU= 27.553
  06:59:46 STEP 1893 H=1893:00 +CPU= 42.321
  07:00:15 STEP 1894 H=1894:00 +CPU= 28.620
  07:00:44 STEP 1895 H=1895:00 +CPU= 28.653
  07:01:41 STEP 1896 H=1896:00 +CPU= 50.975
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_78.zip
Uploading the intermediate file: upload_file_78.zip
  07:02:09 STEP 1897 H=1897:00 +CPU= 27.102
  07:02:37 STEP 1898 H=1898:00 +CPU= 27.853
  07:03:20 STEP 1899 H=1899:00 +CPU= 43.515
  07:03:48 STEP 1900 H=1900:00 +CPU= 28.046
  07:04:15 STEP 1901 H=1901:00 +CPU= 27.150
  07:04:59 STEP 1902 H=1902:00 +CPU= 43.106
  07:05:25 STEP 1903 H=1903:00 +CPU= 26.738
  07:05:53 STEP 1904 H=1904:00 +CPU= 27.401
  07:06:36 STEP 1905 H=1905:00 +CPU= 42.612
  07:07:03 STEP 1906 H=1906:00 +CPU= 27.480
  07:07:30 STEP 1907 H=1907:00 +CPU= 26.557
  07:08:17 STEP 1908 H=1908:00 +CPU= 47.006
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001908
  07:08:44 STEP 1909 H=1909:00 +CPU= 27.076
  07:09:12 STEP 1910 H=1910:00 +CPU= 27.834
  07:09:56 STEP 1911 H=1911:00 +CPU= 43.465
  07:10:25 STEP 1912 H=1912:00 +CPU= 29.129
  07:10:53 STEP 1913 H=1913:00 +CPU= 27.762
  07:11:37 STEP 1914 H=1914:00 +CPU= 44.285
  07:12:04 STEP 1915 H=1915:00 +CPU= 27.249
  07:12:32 STEP 1916 H=1916:00 +CPU= 27.568
  07:13:16 STEP 1917 H=1917:00 +CPU= 43.589
  07:13:43 STEP 1918 H=1918:00 +CPU= 27.403
  07:14:11 STEP 1919 H=1919:00 +CPU= 27.616
  07:15:05 STEP 1920 H=1920:00 +CPU= 50.320
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_79.zip
Uploading the intermediate file: upload_file_79.zip
  07:15:33 STEP 1921 H=1921:00 +CPU= 26.592
Uploading trickle at timestep: 6912000
  07:16:00 STEP 1922 H=1922:00 +CPU= 27.511
  07:16:43 STEP 1923 H=1923:00 +CPU= 42.690
  07:17:11 STEP 1924 H=1924:00 +CPU= 27.353
  07:17:37 STEP 1925 H=1925:00 +CPU= 26.242
  07:18:21 STEP 1926 H=1926:00 +CPU= 44.045
  07:18:48 STEP 1927 H=1927:00 +CPU= 26.408
  07:19:15 STEP 1928 H=1928:00 +CPU= 27.394
  07:19:58 STEP 1929 H=1929:00 +CPU= 42.635
  07:20:27 STEP 1930 H=1930:00 +CPU= 28.684
  07:20:54 STEP 1931 H=1931:00 +CPU= 27.042
  07:21:41 STEP 1932 H=1932:00 +CPU= 47.027
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001932
  07:22:09 STEP 1933 H=1933:00 +CPU= 27.178
  07:22:36 STEP 1934 H=1934:00 +CPU= 27.280
  07:23:19 STEP 1935 H=1935:00 +CPU= 42.391
  07:23:46 STEP 1936 H=1936:00 +CPU= 27.147
  07:24:13 STEP 1937 H=1937:00 +CPU= 26.625
  07:24:56 STEP 1938 H=1938:00 +CPU= 43.507
  07:25:24 STEP 1939 H=1939:00 +CPU= 27.630
  07:25:51 STEP 1940 H=1940:00 +CPU= 27.205
  07:26:34 STEP 1941 H=1941:00 +CPU= 42.407
  07:27:01 STEP 1942 H=1942:00 +CPU= 27.272
  07:27:29 STEP 1943 H=1943:00 +CPU= 27.392
  07:28:24 STEP 1944 H=1944:00 +CPU= 50.765
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_80.zip
Uploading the intermediate file: upload_file_80.zip
  07:28:52 STEP 1945 H=1945:00 +CPU= 27.035
  07:29:20 STEP 1946 H=1946:00 +CPU= 27.814
  07:30:03 STEP 1947 H=1947:00 +CPU= 42.798
  07:30:32 STEP 1948 H=1948:00 +CPU= 28.827
  07:30:59 STEP 1949 H=1949:00 +CPU= 26.778
  07:31:44 STEP 1950 H=1950:00 +CPU= 44.603
  07:32:11 STEP 1951 H=1951:00 +CPU= 26.966
  07:32:38 STEP 1952 H=1952:00 +CPU= 27.282
  07:33:22 STEP 1953 H=1953:00 +CPU= 43.490
  07:33:50 STEP 1954 H=1954:00 +CPU= 27.639
  07:34:18 STEP 1955 H=1955:00 +CPU= 27.296
  07:35:06 STEP 1956 H=1956:00 +CPU= 47.771
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001956
  07:35:33 STEP 1957 H=1957:00 +CPU= 27.126
  07:36:01 STEP 1958 H=1958:00 +CPU= 27.102
  07:36:43 STEP 1959 H=1959:00 +CPU= 42.583
  07:37:11 STEP 1960 H=1960:00 +CPU= 27.132
  07:37:37 STEP 1961 H=1961:00 +CPU= 26.209
  07:38:21 STEP 1962 H=1962:00 +CPU= 43.874
  07:38:49 STEP 1963 H=1963:00 +CPU= 26.815
  07:39:17 STEP 1964 H=1964:00 +CPU= 28.057
  07:40:01 STEP 1965 H=1965:00 +CPU= 43.419
  07:40:31 STEP 1966 H=1966:00 +CPU= 29.711
  07:41:00 STEP 1967 H=1967:00 +CPU= 28.396
  07:43:00 STEP 1968 H=1968:00 +CPU= 51.712
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_81.zip
Uploading the intermediate file: upload_file_81.zip
  07:43:30 STEP 1969 H=1969:00 +CPU= 27.454
  07:43:58 STEP 1970 H=1970:00 +CPU= 27.783
  07:44:41 STEP 1971 H=1971:00 +CPU= 42.293
  07:45:09 STEP 1972 H=1972:00 +CPU= 27.444
  07:45:36 STEP 1973 H=1973:00 +CPU= 26.445
  07:46:20 STEP 1974 H=1974:00 +CPU= 43.314
  07:46:46 STEP 1975 H=1975:00 +CPU= 26.508
  07:47:14 STEP 1976 H=1976:00 +CPU= 27.988
  07:47:59 STEP 1977 H=1977:00 +CPU= 43.918
  07:48:27 STEP 1978 H=1978:00 +CPU= 28.455
  07:48:55 STEP 1979 H=1979:00 +CPU= 27.346
  07:49:43 STEP 1980 H=1980:00 +CPU= 47.688
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001980
  07:50:11 STEP 1981 H=1981:00 +CPU= 27.512
  07:50:40 STEP 1982 H=1982:00 +CPU= 28.412
  07:51:23 STEP 1983 H=1983:00 +CPU= 43.298
  07:51:51 STEP 1984 H=1984:00 +CPU= 27.703
  07:52:18 STEP 1985 H=1985:00 +CPU= 26.891
  07:53:03 STEP 1986 H=1986:00 +CPU= 44.390
  07:53:30 STEP 1987 H=1987:00 +CPU= 27.200
  07:53:58 STEP 1988 H=1988:00 +CPU= 27.831
  07:54:42 STEP 1989 H=1989:00 +CPU= 44.064
  07:55:10 STEP 1990 H=1990:00 +CPU= 27.613
  07:55:38 STEP 1991 H=1991:00 +CPU= 27.367
  08:04:33 STEP 1992 H=1992:00 +CPU= 95.179
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_82.zip
Uploading the intermediate file: upload_file_82.zip
  08:05:01 STEP 1993 H=1993:00 +CPU= 26.962
  08:05:30 STEP 1994 H=1994:00 +CPU= 28.786
  08:06:15 STEP 1995 H=1995:00 +CPU= 44.160
  08:06:43 STEP 1996 H=1996:00 +CPU= 27.686
  08:07:09 STEP 1997 H=1997:00 +CPU= 26.661
  08:07:53 STEP 1998 H=1998:00 +CPU= 43.641
  08:08:20 STEP 1999 H=1999:00 +CPU= 26.980
  08:08:48 STEP 2000 H=2000:00 +CPU= 27.422
  08:09:31 STEP 2001 H=2001:00 +CPU= 42.756
  08:09:58 STEP 2002 H=2002:00 +CPU= 27.169
  08:10:26 STEP 2003 H=2003:00 +CPU= 27.727
  08:11:15 STEP 2004 H=2004:00 +CPU= 47.654
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002004
  08:11:41 STEP 2005 H=2005:00 +CPU= 26.427
  08:12:09 STEP 2006 H=2006:00 +CPU= 27.630
  08:12:52 STEP 2007 H=2007:00 +CPU= 42.994
  08:13:20 STEP 2008 H=2008:00 +CPU= 27.483
  08:13:47 STEP 2009 H=2009:00 +CPU= 26.687
  08:14:32 STEP 2010 H=2010:00 +CPU= 44.264
  08:14:58 STEP 2011 H=2011:00 +CPU= 26.702
  08:15:26 STEP 2012 H=2012:00 +CPU= 27.535
  08:16:09 STEP 2013 H=2013:00 +CPU= 43.032
  08:16:37 STEP 2014 H=2014:00 +CPU= 27.583
  08:17:05 STEP 2015 H=2015:00 +CPU= 27.384
  08:17:57 STEP 2016 H=2016:00 +CPU= 49.513
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_83.zip
Uploading the intermediate file: upload_file_83.zip
  08:18:23 STEP 2017 H=2017:00 +CPU= 26.424
  08:18:51 STEP 2018 H=2018:00 +CPU= 27.161
  08:19:34 STEP 2019 H=2019:00 +CPU= 42.632
  08:20:01 STEP 2020 H=2020:00 +CPU= 27.199
  08:20:29 STEP 2021 H=2021:00 +CPU= 28.466
  08:21:14 STEP 2022 H=2022:00 +CPU= 44.347
  08:21:41 STEP 2023 H=2023:00 +CPU= 26.508
  08:22:08 STEP 2024 H=2024:00 +CPU= 26.960
  08:22:51 STEP 2025 H=2025:00 +CPU= 42.613
  08:23:18 STEP 2026 H=2026:00 +CPU= 27.390
  08:23:45 STEP 2027 H=2027:00 +CPU= 26.673
  08:24:32 STEP 2028 H=2028:00 +CPU= 46.988
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002028
  08:24:59 STEP 2029 H=2029:00 +CPU= 26.311
  08:25:26 STEP 2030 H=2030:00 +CPU= 27.644
  08:26:09 STEP 2031 H=2031:00 +CPU= 42.349
  08:26:36 STEP 2032 H=2032:00 +CPU= 27.418
  08:27:04 STEP 2033 H=2033:00 +CPU= 27.215
  08:27:48 STEP 2034 H=2034:00 +CPU= 44.351
  08:28:15 STEP 2035 H=2035:00 +CPU= 26.886
  08:28:43 STEP 2036 H=2036:00 +CPU= 27.711
  08:29:25 STEP 2037 H=2037:00 +CPU= 42.517
  08:29:53 STEP 2038 H=2038:00 +CPU= 27.084
  08:30:21 STEP 2039 H=2039:00 +CPU= 28.547
  08:32:12 STEP 2040 H=2040:00 +CPU= 51.117
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_84.zip
Uploading the intermediate file: upload_file_84.zip
  08:32:42 STEP 2041 H=2041:00 +CPU= 26.934
  08:33:13 STEP 2042 H=2042:00 +CPU= 28.046
  08:33:59 STEP 2043 H=2043:00 +CPU= 42.993
  08:34:27 STEP 2044 H=2044:00 +CPU= 27.989
  08:34:55 STEP 2045 H=2045:00 +CPU= 27.287
  08:35:40 STEP 2046 H=2046:00 +CPU= 44.350
  08:36:07 STEP 2047 H=2047:00 +CPU= 26.499
  08:36:34 STEP 2048 H=2048:00 +CPU= 27.089
  08:37:17 STEP 2049 H=2049:00 +CPU= 42.965
  08:37:45 STEP 2050 H=2050:00 +CPU= 27.468
  08:38:12 STEP 2051 H=2051:00 +CPU= 27.068
  08:39:02 STEP 2052 H=2052:00 +CPU= 48.329
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002052
  08:39:29 STEP 2053 H=2053:00 +CPU= 27.475
  08:39:57 STEP 2054 H=2054:00 +CPU= 27.697
  08:40:42 STEP 2055 H=2055:00 +CPU= 44.859
  08:41:10 STEP 2056 H=2056:00 +CPU= 27.458
  08:41:37 STEP 2057 H=2057:00 +CPU= 26.327
  08:42:21 STEP 2058 H=2058:00 +CPU= 43.712
  08:42:47 STEP 2059 H=2059:00 +CPU= 26.319
  08:43:15 STEP 2060 H=2060:00 +CPU= 27.898
  08:43:59 STEP 2061 H=2061:00 +CPU= 43.164
  08:44:26 STEP 2062 H=2062:00 +CPU= 27.758
  08:44:55 STEP 2063 H=2063:00 +CPU= 27.812
  08:45:54 STEP 2064 H=2064:00 +CPU= 50.695
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_85.zip
Uploading the intermediate file: upload_file_85.zip
  08:46:21 STEP 2065 H=2065:00 +CPU= 26.635
  08:46:48 STEP 2066 H=2066:00 +CPU= 27.364
  08:47:30 STEP 2067 H=2067:00 +CPU= 42.197
  08:47:57 STEP 2068 H=2068:00 +CPU= 26.836
  08:48:24 STEP 2069 H=2069:00 +CPU= 26.731
  08:49:07 STEP 2070 H=2070:00 +CPU= 43.312
  08:49:34 STEP 2071 H=2071:00 +CPU= 26.486
  08:50:02 STEP 2072 H=2072:00 +CPU= 27.779
  08:50:48 STEP 2073 H=2073:00 +CPU= 45.489
  08:51:16 STEP 2074 H=2074:00 +CPU= 28.029
  08:51:42 STEP 2075 H=2075:00 +CPU= 26.829
  08:52:30 STEP 2076 H=2076:00 +CPU= 47.715
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002076
  08:52:57 STEP 2077 H=2077:00 +CPU= 26.671
  08:53:24 STEP 2078 H=2078:00 +CPU= 26.882
  08:54:06 STEP 2079 H=2079:00 +CPU= 41.899
  08:54:33 STEP 2080 H=2080:00 +CPU= 26.842
  08:54:59 STEP 2081 H=2081:00 +CPU= 26.031
  08:55:43 STEP 2082 H=2082:00 +CPU= 44.173
  08:56:10 STEP 2083 H=2083:00 +CPU= 26.882
  08:56:38 STEP 2084 H=2084:00 +CPU= 27.531
  08:57:21 STEP 2085 H=2085:00 +CPU= 42.800
  08:57:49 STEP 2086 H=2086:00 +CPU= 27.244
  08:58:16 STEP 2087 H=2087:00 +CPU= 27.726
  08:59:37 STEP 2088 H=2088:00 +CPU= 51.386
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_86.zip
Uploading the intermediate file: upload_file_86.zip
  09:00:04 STEP 2089 H=2089:00 +CPU= 27.660
  09:00:34 STEP 2090 H=2090:00 +CPU= 29.808
  09:01:19 STEP 2091 H=2091:00 +CPU= 44.132
  09:01:46 STEP 2092 H=2092:00 +CPU= 27.508
  09:02:13 STEP 2093 H=2093:00 +CPU= 26.896
  09:02:59 STEP 2094 H=2094:00 +CPU= 45.424
  09:03:27 STEP 2095 H=2095:00 +CPU= 28.049
  09:03:56 STEP 2096 H=2096:00 +CPU= 28.500
  09:04:40 STEP 2097 H=2097:00 +CPU= 44.118
  09:05:10 STEP 2098 H=2098:00 +CPU= 29.005
  09:05:37 STEP 2099 H=2099:00 +CPU= 27.411
  09:06:26 STEP 2100 H=2100:00 +CPU= 48.197
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002100
  09:06:53 STEP 2101 H=2101:00 +CPU= 27.281
  09:07:21 STEP 2102 H=2102:00 +CPU= 27.841
  09:08:06 STEP 2103 H=2103:00 +CPU= 44.198
  09:08:35 STEP 2104 H=2104:00 +CPU= 28.668
  09:09:03 STEP 2105 H=2105:00 +CPU= 27.880
  09:09:49 STEP 2106 H=2106:00 +CPU= 45.852
  09:10:17 STEP 2107 H=2107:00 +CPU= 28.428
  09:10:47 STEP 2108 H=2108:00 +CPU= 29.170
  09:11:31 STEP 2109 H=2109:00 +CPU= 44.482
  09:12:01 STEP 2110 H=2110:00 +CPU= 29.340
  09:12:30 STEP 2111 H=2111:00 +CPU= 28.961
  09:14:24 STEP 2112 H=2112:00 +CPU= 50.803
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_87.zip
Uploading the intermediate file: upload_file_87.zip
  09:14:51 STEP 2113 H=2113:00 +CPU= 26.376
  09:15:21 STEP 2114 H=2114:00 +CPU= 29.519
  09:16:07 STEP 2115 H=2115:00 +CPU= 45.829
  09:16:36 STEP 2116 H=2116:00 +CPU= 28.505
  09:17:04 STEP 2117 H=2117:00 +CPU= 27.774
  09:17:51 STEP 2118 H=2118:00 +CPU= 46.392
  09:18:19 STEP 2119 H=2119:00 +CPU= 28.265
  09:18:48 STEP 2120 H=2120:00 +CPU= 28.268
  09:19:33 STEP 2121 H=2121:00 +CPU= 45.221
  09:20:02 STEP 2122 H=2122:00 +CPU= 28.200
  09:20:31 STEP 2123 H=2123:00 +CPU= 29.180
  09:21:20 STEP 2124 H=2124:00 +CPU= 48.790
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002124
  09:21:47 STEP 2125 H=2125:00 +CPU= 26.736
  09:22:15 STEP 2126 H=2126:00 +CPU= 28.148
  09:22:59 STEP 2127 H=2127:00 +CPU= 43.613
  09:23:27 STEP 2128 H=2128:00 +CPU= 28.428
  09:23:55 STEP 2129 H=2129:00 +CPU= 27.701
  09:24:41 STEP 2130 H=2130:00 +CPU= 45.936
  09:25:10 STEP 2131 H=2131:00 +CPU= 28.422
  09:25:38 STEP 2132 H=2132:00 +CPU= 28.340
  09:26:23 STEP 2133 H=2133:00 +CPU= 44.614
  09:26:51 STEP 2134 H=2134:00 +CPU= 27.940
  09:27:19 STEP 2135 H=2135:00 +CPU= 28.571
  09:28:39 STEP 2136 H=2136:00 +CPU= 52.402
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_88.zip
Uploading the intermediate file: upload_file_88.zip
  09:29:07 STEP 2137 H=2137:00 +CPU= 27.401
  09:29:35 STEP 2138 H=2138:00 +CPU= 27.976
  09:30:22 STEP 2139 H=2139:00 +CPU= 46.090
  09:30:51 STEP 2140 H=2140:00 +CPU= 29.280
  09:31:19 STEP 2141 H=2141:00 +CPU= 27.935
  09:32:06 STEP 2142 H=2142:00 +CPU= 46.602
  09:32:34 STEP 2143 H=2143:00 +CPU= 28.006
  09:33:03 STEP 2144 H=2144:00 +CPU= 28.551
  09:33:48 STEP 2145 H=2145:00 +CPU= 44.108
  09:34:17 STEP 2146 H=2146:00 +CPU= 28.858
  09:34:45 STEP 2147 H=2147:00 +CPU= 27.741
  09:35:35 STEP 2148 H=2148:00 +CPU= 49.460
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002148
  09:36:02 STEP 2149 H=2149:00 +CPU= 27.274
  09:36:31 STEP 2150 H=2150:00 +CPU= 28.169
  09:37:15 STEP 2151 H=2151:00 +CPU= 43.965
  09:37:42 STEP 2152 H=2152:00 +CPU= 27.536
  09:38:10 STEP 2153 H=2153:00 +CPU= 27.546
  09:38:55 STEP 2154 H=2154:00 +CPU= 45.355
  09:39:23 STEP 2155 H=2155:00 +CPU= 28.021
  09:39:52 STEP 2156 H=2156:00 +CPU= 28.228
  09:40:37 STEP 2157 H=2157:00 +CPU= 45.362
  09:41:06 STEP 2158 H=2158:00 +CPU= 28.390
  09:41:34 STEP 2159 H=2159:00 +CPU= 27.709
  09:44:13 STEP 2160 H=2160:00 +CPU= 52.689
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_89.zip
Uploading the intermediate file: upload_file_89.zip
Uploading trickle at timestep: 7776000
  09:44:42 STEP 2161 H=2161:00 +CPU= 27.755
  09:45:11 STEP 2162 H=2162:00 +CPU= 28.553
  09:45:56 STEP 2163 H=2163:00 +CPU= 44.410
  09:46:26 STEP 2164 H=2164:00 +CPU= 29.014
  09:46:54 STEP 2165 H=2165:00 +CPU= 28.414
  09:47:41 STEP 2166 H=2166:00 +CPU= 46.655
  09:48:09 STEP 2167 H=2167:00 +CPU= 27.613
  09:48:38 STEP 2168 H=2168:00 +CPU= 28.647
  09:49:23 STEP 2169 H=2169:00 +CPU= 44.881
  09:49:52 STEP 2170 H=2170:00 +CPU= 29.385
  09:50:22 STEP 2171 H=2171:00 +CPU= 30.011
  09:51:14 STEP 2172 H=2172:00 +CPU= 51.617
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002172
  09:51:43 STEP 2173 H=2173:00 +CPU= 28.763
  09:52:13 STEP 2174 H=2174:00 +CPU= 29.108
  09:52:58 STEP 2175 H=2175:00 +CPU= 45.395
  09:53:27 STEP 2176 H=2176:00 +CPU= 28.468
  09:53:56 STEP 2177 H=2177:00 +CPU= 28.421
  09:54:44 STEP 2178 H=2178:00 +CPU= 46.936
  09:55:13 STEP 2179 H=2179:00 +CPU= 29.138
  09:55:43 STEP 2180 H=2180:00 +CPU= 29.593
  09:56:30 STEP 2181 H=2181:00 +CPU= 47.008
  09:57:01 STEP 2182 H=2182:00 +CPU= 30.239
  09:57:32 STEP 2183 H=2183:00 +CPU= 30.381
  10:00:23 STEP 2184 H=2184:00 +CPU= 54.891
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_90.zip
Uploading the intermediate file: upload_file_90.zip
  10:00:55 STEP 2185 H=2185:00 +CPU= 29.362
  10:01:26 STEP 2186 H=2186:00 +CPU= 30.430
  10:02:14 STEP 2187 H=2187:00 +CPU= 47.567
  10:02:44 STEP 2188 H=2188:00 +CPU= 30.080
  10:03:14 STEP 2189 H=2189:00 +CPU= 29.523
  10:04:01 STEP 2190 H=2190:00 +CPU= 46.699
  10:04:30 STEP 2191 H=2191:00 +CPU= 29.337
  10:05:00 STEP 2192 H=2192:00 +CPU= 29.652
  10:05:47 STEP 2193 H=2193:00 +CPU= 47.351
  10:06:17 STEP 2194 H=2194:00 +CPU= 29.753
  10:06:46 STEP 2195 H=2195:00 +CPU= 28.699
  10:07:37 STEP 2196 H=2196:00 +CPU= 50.952
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002196
  10:08:06 STEP 2197 H=2197:00 +CPU= 28.631
  10:08:36 STEP 2198 H=2198:00 +CPU= 29.399
  10:09:22 STEP 2199 H=2199:00 +CPU= 45.771
  10:09:52 STEP 2200 H=2200:00 +CPU= 29.652
  10:10:23 STEP 2201 H=2201:00 +CPU= 30.846
  10:11:13 STEP 2202 H=2202:00 +CPU= 49.402
  10:11:43 STEP 2203 H=2203:00 +CPU= 29.447
  10:12:13 STEP 2204 H=2204:00 +CPU= 30.221
  10:13:00 STEP 2205 H=2205:00 +CPU= 46.673
  10:13:30 STEP 2206 H=2206:00 +CPU= 29.409
  10:14:00 STEP 2207 H=2207:00 +CPU= 30.073
  10:14:59 STEP 2208 H=2208:00 +CPU= 53.248
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_91.zip
Uploading the intermediate file: upload_file_91.zip
  10:15:28 STEP 2209 H=2209:00 +CPU= 28.835
  10:15:57 STEP 2210 H=2210:00 +CPU= 29.298
  10:16:44 STEP 2211 H=2211:00 +CPU= 46.521
  10:17:14 STEP 2212 H=2212:00 +CPU= 29.213
  10:17:42 STEP 2213 H=2213:00 +CPU= 28.139
  10:18:28 STEP 2214 H=2214:00 +CPU= 46.257
  10:18:56 STEP 2215 H=2215:00 +CPU= 28.153
  10:19:26 STEP 2216 H=2216:00 +CPU= 29.568
  10:20:12 STEP 2217 H=2217:00 +CPU= 45.868
  10:20:42 STEP 2218 H=2218:00 +CPU= 29.990
  10:21:11 STEP 2219 H=2219:00 +CPU= 28.445
  10:22:01 STEP 2220 H=2220:00 +CPU= 50.186
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002220
  10:22:29 STEP 2221 H=2221:00 +CPU= 27.946
  10:22:58 STEP 2222 H=2222:00 +CPU= 28.459
  10:23:43 STEP 2223 H=2223:00 +CPU= 44.591
  10:24:11 STEP 2224 H=2224:00 +CPU= 28.706
  10:24:39 STEP 2225 H=2225:00 +CPU= 27.780
  10:25:27 STEP 2226 H=2226:00 +CPU= 46.773
  10:25:55 STEP 2227 H=2227:00 +CPU= 28.349
  10:26:25 STEP 2228 H=2228:00 +CPU= 30.217
  10:27:12 STEP 2229 H=2229:00 +CPU= 46.581
  10:27:42 STEP 2230 H=2230:00 +CPU= 29.735
  10:28:11 STEP 2231 H=2231:00 +CPU= 29.119
  10:29:13 STEP 2232 H=2232:00 +CPU= 52.559
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_92.zip
Uploading the intermediate file: upload_file_92.zip
  10:29:41 STEP 2233 H=2233:00 +CPU= 27.545
  10:30:12 STEP 2234 H=2234:00 +CPU= 30.295
  10:30:59 STEP 2235 H=2235:00 +CPU= 46.952
  10:31:28 STEP 2236 H=2236:00 +CPU= 28.722
  10:31:57 STEP 2237 H=2237:00 +CPU= 28.224
  10:32:43 STEP 2238 H=2238:00 +CPU= 46.194
  10:33:11 STEP 2239 H=2239:00 +CPU= 28.347
  10:33:40 STEP 2240 H=2240:00 +CPU= 28.691
  10:34:25 STEP 2241 H=2241:00 +CPU= 45.259
  10:34:54 STEP 2242 H=2242:00 +CPU= 28.680
  10:35:23 STEP 2243 H=2243:00 +CPU= 28.405
  10:36:13 STEP 2244 H=2244:00 +CPU= 50.141
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002244
  10:36:42 STEP 2245 H=2245:00 +CPU= 28.743
  10:37:12 STEP 2246 H=2246:00 +CPU= 29.372
  10:37:58 STEP 2247 H=2247:00 +CPU= 45.416
  10:38:28 STEP 2248 H=2248:00 +CPU= 29.344
  10:38:56 STEP 2249 H=2249:00 +CPU= 28.283
  10:39:43 STEP 2250 H=2250:00 +CPU= 46.416
  10:40:12 STEP 2251 H=2251:00 +CPU= 28.659
  10:40:41 STEP 2252 H=2252:00 +CPU= 29.516
  10:41:27 STEP 2253 H=2253:00 +CPU= 45.472
  10:41:56 STEP 2254 H=2254:00 +CPU= 29.039
  10:42:26 STEP 2255 H=2255:00 +CPU= 29.029
  10:43:49 STEP 2256 H=2256:00 +CPU= 52.678
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_93.zip
Uploading the intermediate file: upload_file_93.zip
  10:44:17 STEP 2257 H=2257:00 +CPU= 28.141
  10:44:46 STEP 2258 H=2258:00 +CPU= 28.668
  10:45:32 STEP 2259 H=2259:00 +CPU= 46.116
  10:46:02 STEP 2260 H=2260:00 +CPU= 29.363
  10:46:30 STEP 2261 H=2261:00 +CPU= 28.435
  10:47:17 STEP 2262 H=2262:00 +CPU= 46.766
  10:47:45 STEP 2263 H=2263:00 +CPU= 28.106
  10:48:15 STEP 2264 H=2264:00 +CPU= 29.679
  10:49:01 STEP 2265 H=2265:00 +CPU= 45.725
  10:49:31 STEP 2266 H=2266:00 +CPU= 29.146
  10:49:59 STEP 2267 H=2267:00 +CPU= 28.235
  10:50:52 STEP 2268 H=2268:00 +CPU= 52.085
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002268
  10:51:20 STEP 2269 H=2269:00 +CPU= 28.065
  10:51:48 STEP 2270 H=2270:00 +CPU= 28.389
  10:52:35 STEP 2271 H=2271:00 +CPU= 46.294
  10:53:04 STEP 2272 H=2272:00 +CPU= 29.557
  10:53:33 STEP 2273 H=2273:00 +CPU= 28.505
  10:54:21 STEP 2274 H=2274:00 +CPU= 47.251
  10:54:49 STEP 2275 H=2275:00 +CPU= 28.253
  10:55:19 STEP 2276 H=2276:00 +CPU= 29.602
  10:56:05 STEP 2277 H=2277:00 +CPU= 46.172
  10:56:35 STEP 2278 H=2278:00 +CPU= 29.204
  10:57:05 STEP 2279 H=2279:00 +CPU= 29.206
  10:58:04 STEP 2280 H=2280:00 +CPU= 52.419
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_94.zip
Uploading the intermediate file: upload_file_94.zip
  10:58:32 STEP 2281 H=2281:00 +CPU= 28.070
  10:59:02 STEP 2282 H=2282:00 +CPU= 29.394
  10:59:49 STEP 2283 H=2283:00 +CPU= 46.632
  11:00:22 STEP 2284 H=2284:00 +CPU= 31.710
  11:00:52 STEP 2285 H=2285:00 +CPU= 30.234
  11:01:42 STEP 2286 H=2286:00 +CPU= 48.710
  11:02:11 STEP 2287 H=2287:00 +CPU= 29.719
  11:02:42 STEP 2288 H=2288:00 +CPU= 30.184
  11:03:29 STEP 2289 H=2289:00 +CPU= 45.665
  11:03:59 STEP 2290 H=2290:00 +CPU= 29.228
  11:04:28 STEP 2291 H=2291:00 +CPU= 28.447
  11:05:20 STEP 2292 H=2292:00 +CPU= 51.436
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002292
  11:05:49 STEP 2293 H=2293:00 +CPU= 28.822
  11:06:20 STEP 2294 H=2294:00 +CPU= 30.466
  11:07:06 STEP 2295 H=2295:00 +CPU= 46.331
  11:07:36 STEP 2296 H=2296:00 +CPU= 29.682
  11:08:05 STEP 2297 H=2297:00 +CPU= 28.848
  11:08:53 STEP 2298 H=2298:00 +CPU= 47.497
  11:09:21 STEP 2299 H=2299:00 +CPU= 28.222
  11:09:50 STEP 2300 H=2300:00 +CPU= 29.018
  11:10:38 STEP 2301 H=2301:00 +CPU= 48.093
  11:11:08 STEP 2302 H=2302:00 +CPU= 29.474
  11:11:38 STEP 2303 H=2303:00 +CPU= 29.772
  11:12:35 STEP 2304 H=2304:00 +CPU= 54.648
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_95.zip
Uploading the intermediate file: upload_file_95.zip
  11:13:04 STEP 2305 H=2305:00 +CPU= 29.218
  11:13:35 STEP 2306 H=2306:00 +CPU= 30.254
  11:14:22 STEP 2307 H=2307:00 +CPU= 47.222
  11:14:52 STEP 2308 H=2308:00 +CPU= 29.237
  11:15:20 STEP 2309 H=2309:00 +CPU= 28.360
  11:16:06 STEP 2310 H=2310:00 +CPU= 45.983
  11:16:35 STEP 2311 H=2311:00 +CPU= 28.435
  11:17:04 STEP 2312 H=2312:00 +CPU= 29.375
  11:17:51 STEP 2313 H=2313:00 +CPU= 46.213
  11:18:20 STEP 2314 H=2314:00 +CPU= 29.358
  11:18:48 STEP 2315 H=2315:00 +CPU= 28.024
  11:19:37 STEP 2316 H=2316:00 +CPU= 49.162
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002316
  11:20:06 STEP 2317 H=2317:00 +CPU= 29.152
  11:20:38 STEP 2318 H=2318:00 +CPU= 31.607
  11:21:25 STEP 2319 H=2319:00 +CPU= 46.545
  11:21:54 STEP 2320 H=2320:00 +CPU= 29.403
  11:22:23 STEP 2321 H=2321:00 +CPU= 29.230
  11:23:11 STEP 2322 H=2322:00 +CPU= 47.184
  11:23:39 STEP 2323 H=2323:00 +CPU= 28.241
  11:24:08 STEP 2324 H=2324:00 +CPU= 29.395
  11:24:55 STEP 2325 H=2325:00 +CPU= 46.676
  11:25:25 STEP 2326 H=2326:00 +CPU= 29.553
  11:25:54 STEP 2327 H=2327:00 +CPU= 29.056
  11:26:54 STEP 2328 H=2328:00 +CPU= 53.021
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_96.zip
Uploading the intermediate file: upload_file_96.zip
  11:27:23 STEP 2329 H=2329:00 +CPU= 28.506
  11:27:52 STEP 2330 H=2330:00 +CPU= 29.078
  11:28:38 STEP 2331 H=2331:00 +CPU= 45.940
  11:29:08 STEP 2332 H=2332:00 +CPU= 29.302
  11:29:36 STEP 2333 H=2333:00 +CPU= 28.149
  11:30:24 STEP 2334 H=2334:00 +CPU= 47.478
  11:30:55 STEP 2335 H=2335:00 +CPU= 29.683
  11:31:24 STEP 2336 H=2336:00 +CPU= 29.436
  11:32:09 STEP 2337 H=2337:00 +CPU= 44.930
  11:32:38 STEP 2338 H=2338:00 +CPU= 28.959
  11:33:07 STEP 2339 H=2339:00 +CPU= 28.747
  11:33:57 STEP 2340 H=2340:00 +CPU= 50.113
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002340
  11:34:26 STEP 2341 H=2341:00 +CPU= 28.633
  11:34:55 STEP 2342 H=2342:00 +CPU= 28.723
  11:35:42 STEP 2343 H=2343:00 +CPU= 46.267
  11:36:12 STEP 2344 H=2344:00 +CPU= 29.652
  11:36:40 STEP 2345 H=2345:00 +CPU= 28.456
  11:37:27 STEP 2346 H=2346:00 +CPU= 46.533
  11:37:56 STEP 2347 H=2347:00 +CPU= 28.590
  11:38:25 STEP 2348 H=2348:00 +CPU= 29.568
  11:39:11 STEP 2349 H=2349:00 +CPU= 45.257
  11:39:39 STEP 2350 H=2350:00 +CPU= 28.589
  11:40:09 STEP 2351 H=2351:00 +CPU= 29.406
  11:41:10 STEP 2352 H=2352:00 +CPU= 54.946
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_97.zip
Uploading the intermediate file: upload_file_97.zip
  11:41:39 STEP 2353 H=2353:00 +CPU= 28.540
  11:42:08 STEP 2354 H=2354:00 +CPU= 29.571
  11:42:54 STEP 2355 H=2355:00 +CPU= 45.710
  11:43:23 STEP 2356 H=2356:00 +CPU= 29.344
  11:43:52 STEP 2357 H=2357:00 +CPU= 28.449
  11:44:38 STEP 2358 H=2358:00 +CPU= 46.235
  11:45:07 STEP 2359 H=2359:00 +CPU= 28.767
  11:45:37 STEP 2360 H=2360:00 +CPU= 29.636
  11:46:23 STEP 2361 H=2361:00 +CPU= 46.324
  11:46:53 STEP 2362 H=2362:00 +CPU= 29.149
  11:47:21 STEP 2363 H=2363:00 +CPU= 28.664
  11:48:13 STEP 2364 H=2364:00 +CPU= 50.759
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002364
  11:48:41 STEP 2365 H=2365:00 +CPU= 28.405
  11:49:10 STEP 2366 H=2366:00 +CPU= 28.622
  11:49:55 STEP 2367 H=2367:00 +CPU= 44.715
  11:50:25 STEP 2368 H=2368:00 +CPU= 29.582
  11:50:54 STEP 2369 H=2369:00 +CPU= 28.816
  11:51:41 STEP 2370 H=2370:00 +CPU= 47.307
  11:52:10 STEP 2371 H=2371:00 +CPU= 28.622
  11:52:40 STEP 2372 H=2372:00 +CPU= 29.968
  11:53:28 STEP 2373 H=2373:00 +CPU= 48.152
  11:53:58 STEP 2374 H=2374:00 +CPU= 30.009
  11:54:28 STEP 2375 H=2375:00 +CPU= 29.663
  11:56:47 STEP 2376 H=2376:00 +CPU= 53.034
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_98.zip
Uploading the intermediate file: upload_file_98.zip
  11:57:16 STEP 2377 H=2377:00 +CPU= 28.771
  11:57:46 STEP 2378 H=2378:00 +CPU= 29.378
  11:58:32 STEP 2379 H=2379:00 +CPU= 45.951
  11:59:02 STEP 2380 H=2380:00 +CPU= 29.372
  11:59:30 STEP 2381 H=2381:00 +CPU= 28.670
  12:00:19 STEP 2382 H=2382:00 +CPU= 48.628
  12:00:49 STEP 2383 H=2383:00 +CPU= 29.378
  12:01:19 STEP 2384 H=2384:00 +CPU= 29.932
  12:02:06 STEP 2385 H=2385:00 +CPU= 46.906
  12:02:34 STEP 2386 H=2386:00 +CPU= 28.554
  12:03:02 STEP 2387 H=2387:00 +CPU= 27.930
  12:03:53 STEP 2388 H=2388:00 +CPU= 50.610
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002388
  12:04:22 STEP 2389 H=2389:00 +CPU= 28.788
  12:04:52 STEP 2390 H=2390:00 +CPU= 29.176
  12:05:38 STEP 2391 H=2391:00 +CPU= 46.554
  12:06:09 STEP 2392 H=2392:00 +CPU= 30.366
  12:06:38 STEP 2393 H=2393:00 +CPU= 28.917
  12:07:26 STEP 2394 H=2394:00 +CPU= 47.342
  12:07:54 STEP 2395 H=2395:00 +CPU= 28.250
  12:08:24 STEP 2396 H=2396:00 +CPU= 29.267
  12:09:10 STEP 2397 H=2397:00 +CPU= 45.753
  12:09:39 STEP 2398 H=2398:00 +CPU= 29.342
  12:10:09 STEP 2399 H=2399:00 +CPU= 30.051
  12:12:15 STEP 2400 H=2400:00 +CPU= 55.205
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12171044/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0400_1985050100_123_954_12171044_0_r466890581_99.zip
Uploading the intermediate file: upload_file_99.zip
  12:12:46 STEP 2401 H=2401:00 +CPU= 29.148
Uploading trickle at timestep: 8640000
  12:13:16 STEP 2402 H=2402:00 +CPU= 29.304
  12:14:04 STEP 2403 H=2403:00 +CPU= 46.855
  12:14:34 STEP 2404 H=2404:00 +CPU= 29.087
  12:15:03 STEP 2405 H=2405:00 +CPU= 28.310
  12:15:53 STEP 2406 H=2406:00 +CPU= 47.315
  12:16:27 STEP 2407 H=2407:00 +CPU= 29.288
  12:17:01 STEP 2408 H=2408:00 +CPU= 29.730
  12:17:51 STEP 2409 H=2409:00 +CPU= 46.089
  12:18:23 STEP 2410 H=2410:00 +CPU= 30.112
  12:18:53 STEP 2411 H=2411:00 +CPU= 29.039
forrtl: severe (41): insufficient virtual memory
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001D2B9CB  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000D78293  call_sl_heap_              92  call_sl_heap.F90
oifs_43r3_model.e  0000000000BF9958  gp_model_                 533  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:07:06 1510819 22255377 oifs_43r3_ps_0400_1985050100_123_954_12171044_0 8,640,000 80,798 0.0094
09 May 2023 16:06:59 1510819 22255377 oifs_43r3_ps_0400_1985050100_123_954_12171044_0 7,776,000 72,303 0.0093
09 May 2023 16:06:54 1510819 22255377 oifs_43r3_ps_0400_1985050100_123_954_12171044_0 6,912,000 64,233 0.0093
09 May 2023 16:06:50 1510819 22255377 oifs_43r3_ps_0400_1985050100_123_954_12171044_0 6,048,000 56,234 0.0093
09 May 2023 16:06:43 1510819 22255377 oifs_43r3_ps_0400_1985050100_123_954_12171044_0 5,184,000 48,189 0.0093
09 May 2023 16:06:38 1510819 22255377 oifs_43r3_ps_0400_1985050100_123_954_12171044_0 4,320,000 40,048 0.0093
09 May 2023 16:06:33 1510819 22255377 oifs_43r3_ps_0400_1985050100_123_954_12171044_0 3,456,000 32,034 0.0093
09 May 2023 16:06:29 1510819 22255377 oifs_43r3_ps_0400_1985050100_123_954_12171044_0 2,592,000 23,983 0.0093
09 May 2023 16:06:22 1510819 22255377 oifs_43r3_ps_0400_1985050100_123_954_12171044_0 1,728,000 16,040 0.0093
09 May 2023 16:06:17 1510819 22255377 oifs_43r3_ps_0400_1985050100_123_954_12171044_0 864,000 8,103 0.0094


©2024 climateprediction.net