climateprediction.net home page
Task 22250305

Task 22250305

Name oifs_43r3_bl_a003_2016092300_15_949_12166397_0
Workunit 12166397
Created 14 Dec 2022, 13:58:16 UTC
Sent 14 Dec 2022, 13:58:23 UTC
Report deadline 13 Jan 2023, 13:58:23 UTC
Received 15 Dec 2022, 10:15:58 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1536300
Run time 11 hours 24 min 42 sec
CPU time 11 hours 15 min 15 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 6.12 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.07
x86_64-pc-linux-gnu
Peak working set size 4,896.54 MB
Peak swap size 5,625.84 MB
Peak disk usage 4,333.03 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
lib/boinc-client/slots/2/ICMUAh7zg+000888
  01:52:54 STEP  889 H= 222:15 +CPU= 20.032
  01:53:13 STEP  890 H= 222:30 +CPU= 19.438
  01:53:33 STEP  891 H= 222:45 +CPU= 20.102
  01:53:54 STEP  892 H= 223:00 +CPU= 20.204
  01:54:14 STEP  893 H= 223:15 +CPU= 19.763
  01:54:34 STEP  894 H= 223:30 +CPU= 19.618
  01:54:54 STEP  895 H= 223:45 +CPU= 19.958
  01:55:14 STEP  896 H= 224:00 +CPU= 20.189
  01:55:34 STEP  897 H= 224:15 +CPU= 19.353
  01:55:53 STEP  898 H= 224:30 +CPU= 19.846
  01:56:13 STEP  899 H= 224:45 +CPU= 19.781
  01:56:37 STEP  900 H= 225:00 +CPU= 23.850
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000900
  01:56:57 STEP  901 H= 225:15 +CPU= 19.807
  01:57:18 STEP  902 H= 225:30 +CPU= 19.862
  01:57:37 STEP  903 H= 225:45 +CPU= 19.660
  01:57:58 STEP  904 H= 226:00 +CPU= 20.052
  01:58:18 STEP  905 H= 226:15 +CPU= 19.770
  01:58:37 STEP  906 H= 226:30 +CPU= 19.684
  01:58:57 STEP  907 H= 226:45 +CPU= 19.363
  01:59:17 STEP  908 H= 227:00 +CPU= 20.067
  01:59:37 STEP  909 H= 227:15 +CPU= 19.803
  01:59:57 STEP  910 H= 227:30 +CPU= 19.424
  02:00:16 STEP  911 H= 227:45 +CPU= 19.705
  02:00:43 STEP  912 H= 228:00 +CPU= 26.551
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000912
  02:01:03 STEP  913 H= 228:15 +CPU= 19.492
  02:01:23 STEP  914 H= 228:30 +CPU= 19.674
  02:01:43 STEP  915 H= 228:45 +CPU= 19.760
  02:02:03 STEP  916 H= 229:00 +CPU= 20.068
  02:02:23 STEP  917 H= 229:15 +CPU= 19.551
  02:02:43 STEP  918 H= 229:30 +CPU= 19.807
  02:03:03 STEP  919 H= 229:45 +CPU= 19.975
  02:03:22 STEP  920 H= 230:00 +CPU= 19.583
  02:03:42 STEP  921 H= 230:15 +CPU= 19.834
  02:04:02 STEP  922 H= 230:30 +CPU= 19.717
  02:04:22 STEP  923 H= 230:45 +CPU= 19.264
  02:04:46 STEP  924 H= 231:00 +CPU= 24.177
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000924
  02:05:06 STEP  925 H= 231:15 +CPU= 19.954
  02:05:26 STEP  926 H= 231:30 +CPU= 19.409
  02:05:46 STEP  927 H= 231:45 +CPU= 19.753
  02:06:06 STEP  928 H= 232:00 +CPU= 20.117
  02:06:26 STEP  929 H= 232:15 +CPU= 19.803
  02:06:45 STEP  930 H= 232:30 +CPU= 19.358
  02:07:05 STEP  931 H= 232:45 +CPU= 19.781
  02:07:26 STEP  932 H= 233:00 +CPU= 20.018
  02:07:45 STEP  933 H= 233:15 +CPU= 19.422
  02:08:05 STEP  934 H= 233:30 +CPU= 19.547
  02:08:25 STEP  935 H= 233:45 +CPU= 19.580
  02:08:49 STEP  936 H= 234:00 +CPU= 24.070
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000936
  02:09:09 STEP  937 H= 234:15 +CPU= 19.907
  02:09:29 STEP  938 H= 234:30 +CPU= 19.843
  02:09:49 STEP  939 H= 234:45 +CPU= 19.660
  02:10:09 STEP  940 H= 235:00 +CPU= 20.115
  02:10:29 STEP  941 H= 235:15 +CPU= 19.810
  02:10:49 STEP  942 H= 235:30 +CPU= 19.948
  02:11:09 STEP  943 H= 235:45 +CPU= 19.426
  02:11:29 STEP  944 H= 236:00 +CPU= 20.199
  02:11:49 STEP  945 H= 236:15 +CPU= 20.058
  02:12:09 STEP  946 H= 236:30 +CPU= 19.682
  02:12:29 STEP  947 H= 236:45 +CPU= 19.921
  02:12:54 STEP  948 H= 237:00 +CPU= 24.386
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000948
  02:13:14 STEP  949 H= 237:15 +CPU= 19.666
  02:13:32 STEP  950 H= 237:30 +CPU= 18.216
  02:13:50 STEP  951 H= 237:45 +CPU= 17.491
  02:14:08 STEP  952 H= 238:00 +CPU= 17.846
  02:14:26 STEP  953 H= 238:15 +CPU= 17.778
  02:14:45 STEP  954 H= 238:30 +CPU= 19.497
  02:15:05 STEP  955 H= 238:45 +CPU= 19.705
  02:15:25 STEP  956 H= 239:00 +CPU= 19.856
  02:15:44 STEP  957 H= 239:15 +CPU= 18.222
  02:16:01 STEP  958 H= 239:30 +CPU= 17.418
  02:16:19 STEP  959 H= 239:45 +CPU= 17.379
  02:16:43 STEP  960 H= 240:00 +CPU= 24.453
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a003_2016092300_15_949_12166397_0_r1581120742_9.zip
Uploading the intermediate file: upload_file_9.zip
  02:17:03 STEP  961 H= 240:15 +CPU= 19.549
  02:17:23 STEP  962 H= 240:30 +CPU= 19.989
  02:17:44 STEP  963 H= 240:45 +CPU= 20.179
  02:18:04 STEP  964 H= 241:00 +CPU= 20.085
  02:18:24 STEP  965 H= 241:15 +CPU= 19.855
  02:18:44 STEP  966 H= 241:30 +CPU= 19.940
  02:19:04 STEP  967 H= 241:45 +CPU= 19.866
  02:19:24 STEP  968 H= 242:00 +CPU= 20.025
  02:19:44 STEP  969 H= 242:15 +CPU= 19.889
  02:20:04 STEP  970 H= 242:30 +CPU= 19.899
  02:20:24 STEP  971 H= 242:45 +CPU= 19.428
  02:20:49 STEP  972 H= 243:00 +CPU= 24.472
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000972
  02:21:09 STEP  973 H= 243:15 +CPU= 19.903
  02:21:28 STEP  974 H= 243:30 +CPU= 19.581
  02:21:49 STEP  975 H= 243:45 +CPU= 19.937
  02:22:09 STEP  976 H= 244:00 +CPU= 20.271
  02:22:29 STEP  977 H= 244:15 +CPU= 19.675
  02:22:49 STEP  978 H= 244:30 +CPU= 19.802
  02:23:09 STEP  979 H= 244:45 +CPU= 19.833
  02:23:29 STEP  980 H= 245:00 +CPU= 20.194
  02:23:49 STEP  981 H= 245:15 +CPU= 19.645
  02:24:09 STEP  982 H= 245:30 +CPU= 19.930
  02:24:29 STEP  983 H= 245:45 +CPU= 19.667
  02:24:53 STEP  984 H= 246:00 +CPU= 23.928
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000984
  02:25:13 STEP  985 H= 246:15 +CPU= 20.046
  02:25:34 STEP  986 H= 246:30 +CPU= 20.073
  02:25:53 STEP  987 H= 246:45 +CPU= 19.790
  02:26:14 STEP  988 H= 247:00 +CPU= 20.486
  02:26:34 STEP  989 H= 247:15 +CPU= 20.033
  02:26:55 STEP  990 H= 247:30 +CPU= 20.087
  02:27:15 STEP  991 H= 247:45 +CPU= 19.950
  02:27:35 STEP  992 H= 248:00 +CPU= 20.361
  02:27:55 STEP  993 H= 248:15 +CPU= 20.036
  02:28:15 STEP  994 H= 248:30 +CPU= 19.532
  02:28:35 STEP  995 H= 248:45 +CPU= 19.944
  02:29:00 STEP  996 H= 249:00 +CPU= 24.506
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+000996
  02:29:20 STEP  997 H= 249:15 +CPU= 19.450
  02:29:40 STEP  998 H= 249:30 +CPU= 20.094
  02:30:00 STEP  999 H= 249:45 +CPU= 20.020
  02:30:20 STEP 1000 H= 250:00 +CPU= 19.976
  02:30:40 STEP 1001 H= 250:15 +CPU= 19.887
  02:31:01 STEP 1002 H= 250:30 +CPU= 19.984
  02:31:20 STEP 1003 H= 250:45 +CPU= 19.817
  02:31:41 STEP 1004 H= 251:00 +CPU= 19.979
  02:32:01 STEP 1005 H= 251:15 +CPU= 19.797
  02:32:21 STEP 1006 H= 251:30 +CPU= 20.106
  02:32:40 STEP 1007 H= 251:45 +CPU= 19.439
  02:33:07 STEP 1008 H= 252:00 +CPU= 26.788
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001008
  02:33:28 STEP 1009 H= 252:15 +CPU= 19.965
  02:33:47 STEP 1010 H= 252:30 +CPU= 19.351
  02:34:07 STEP 1011 H= 252:45 +CPU= 19.981
  02:34:28 STEP 1012 H= 253:00 +CPU= 20.220
  02:34:47 STEP 1013 H= 253:15 +CPU= 19.600
  02:35:07 STEP 1014 H= 253:30 +CPU= 19.884
  02:35:28 STEP 1015 H= 253:45 +CPU= 19.957
  02:35:48 STEP 1016 H= 254:00 +CPU= 20.232
  02:36:08 STEP 1017 H= 254:15 +CPU= 19.863
  02:36:28 STEP 1018 H= 254:30 +CPU= 19.959
  02:36:48 STEP 1019 H= 254:45 +CPU= 19.781
  02:37:12 STEP 1020 H= 255:00 +CPU= 24.064
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001020
  02:37:33 STEP 1021 H= 255:15 +CPU= 20.045
  02:37:53 STEP 1022 H= 255:30 +CPU= 19.922
  02:38:12 STEP 1023 H= 255:45 +CPU= 19.598
  02:38:33 STEP 1024 H= 256:00 +CPU= 20.150
  02:38:53 STEP 1025 H= 256:15 +CPU= 20.008
  02:39:13 STEP 1026 H= 256:30 +CPU= 19.642
  02:39:33 STEP 1027 H= 256:45 +CPU= 19.822
  02:39:53 STEP 1028 H= 257:00 +CPU= 20.070
  02:40:13 STEP 1029 H= 257:15 +CPU= 19.944
  02:40:33 STEP 1030 H= 257:30 +CPU= 19.397
  02:40:52 STEP 1031 H= 257:45 +CPU= 19.659
  02:41:17 STEP 1032 H= 258:00 +CPU= 24.431
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001032
  02:41:37 STEP 1033 H= 258:15 +CPU= 19.512
  02:41:57 STEP 1034 H= 258:30 +CPU= 20.031
  02:42:15 STEP 1035 H= 258:45 +CPU= 18.368
  02:42:33 STEP 1036 H= 259:00 +CPU= 17.907
  02:42:51 STEP 1037 H= 259:15 +CPU= 17.567
  02:43:09 STEP 1038 H= 259:30 +CPU= 17.966
  02:43:29 STEP 1039 H= 259:45 +CPU= 19.703
  02:43:50 STEP 1040 H= 260:00 +CPU= 20.279
  02:44:10 STEP 1041 H= 260:15 +CPU= 19.935
  02:44:30 STEP 1042 H= 260:30 +CPU= 19.782
  02:44:50 STEP 1043 H= 260:45 +CPU= 19.989
  02:45:14 STEP 1044 H= 261:00 +CPU= 24.283
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001044
  02:45:34 STEP 1045 H= 261:15 +CPU= 19.858
  02:45:54 STEP 1046 H= 261:30 +CPU= 19.884
  02:46:15 STEP 1047 H= 261:45 +CPU= 20.117
  02:46:35 STEP 1048 H= 262:00 +CPU= 20.257
  02:46:55 STEP 1049 H= 262:15 +CPU= 19.576
  02:47:15 STEP 1050 H= 262:30 +CPU= 19.894
  02:47:35 STEP 1051 H= 262:45 +CPU= 20.024
  02:47:55 STEP 1052 H= 263:00 +CPU= 19.785
  02:48:15 STEP 1053 H= 263:15 +CPU= 19.768
  02:48:35 STEP 1054 H= 263:30 +CPU= 19.810
  02:48:55 STEP 1055 H= 263:45 +CPU= 19.741
  02:49:21 STEP 1056 H= 264:00 +CPU= 26.241
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a003_2016092300_15_949_12166397_0_r1581120742_10.zip
Uploading the intermediate file: upload_file_10.zip
  02:49:39 STEP 1057 H= 264:15 +CPU= 18.272
  02:49:57 STEP 1058 H= 264:30 +CPU= 17.493
  02:50:15 STEP 1059 H= 264:45 +CPU= 17.847
  02:50:34 STEP 1060 H= 265:00 +CPU= 18.515
  02:50:54 STEP 1061 H= 265:15 +CPU= 19.660
  02:51:14 STEP 1062 H= 265:30 +CPU= 19.878
  02:51:34 STEP 1063 H= 265:45 +CPU= 19.884
  02:51:52 STEP 1064 H= 266:00 +CPU= 18.554
  02:52:10 STEP 1065 H= 266:15 +CPU= 17.512
  02:52:28 STEP 1066 H= 266:30 +CPU= 17.510
  02:52:46 STEP 1067 H= 266:45 +CPU= 17.905
  02:53:09 STEP 1068 H= 267:00 +CPU= 23.616
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001068
  02:53:29 STEP 1069 H= 267:15 +CPU= 19.877
  02:53:49 STEP 1070 H= 267:30 +CPU= 19.637
  02:54:09 STEP 1071 H= 267:45 +CPU= 19.430
  02:54:29 STEP 1072 H= 268:00 +CPU= 19.917
  02:54:49 STEP 1073 H= 268:15 +CPU= 19.728
  02:55:08 STEP 1074 H= 268:30 +CPU= 19.501
  02:55:28 STEP 1075 H= 268:45 +CPU= 19.608
  02:55:48 STEP 1076 H= 269:00 +CPU= 19.869
  02:56:08 STEP 1077 H= 269:15 +CPU= 19.840
  02:56:28 STEP 1078 H= 269:30 +CPU= 19.183
  02:56:47 STEP 1079 H= 269:45 +CPU= 19.676
  02:57:12 STEP 1080 H= 270:00 +CPU= 24.164
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001080
  02:57:31 STEP 1081 H= 270:15 +CPU= 19.445
  02:57:51 STEP 1082 H= 270:30 +CPU= 19.768
  02:58:12 STEP 1083 H= 270:45 +CPU= 20.124
  02:58:32 STEP 1084 H= 271:00 +CPU= 20.212
  02:58:52 STEP 1085 H= 271:15 +CPU= 19.806
  02:59:12 STEP 1086 H= 271:30 +CPU= 19.826
  02:59:32 STEP 1087 H= 271:45 +CPU= 19.803
  02:59:52 STEP 1088 H= 272:00 +CPU= 19.948
  03:00:12 STEP 1089 H= 272:15 +CPU= 19.893
  03:00:32 STEP 1090 H= 272:30 +CPU= 19.806
  03:00:51 STEP 1091 H= 272:45 +CPU= 19.288
  03:01:16 STEP 1092 H= 273:00 +CPU= 24.394
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001092
  03:01:34 STEP 1093 H= 273:15 +CPU= 18.346
  03:01:52 STEP 1094 H= 273:30 +CPU= 17.565
  03:02:10 STEP 1095 H= 273:45 +CPU= 17.596
  03:02:28 STEP 1096 H= 274:00 +CPU= 18.082
  03:02:48 STEP 1097 H= 274:15 +CPU= 19.357
  03:03:08 STEP 1098 H= 274:30 +CPU= 19.929
  03:03:28 STEP 1099 H= 274:45 +CPU= 19.861
  03:03:46 STEP 1100 H= 275:00 +CPU= 18.622
  03:04:04 STEP 1101 H= 275:15 +CPU= 17.599
  03:04:22 STEP 1102 H= 275:30 +CPU= 17.554
  03:04:40 STEP 1103 H= 275:45 +CPU= 17.832
  03:05:06 STEP 1104 H= 276:00 +CPU= 26.372
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001104
  03:05:27 STEP 1105 H= 276:15 +CPU= 19.937
  03:05:47 STEP 1106 H= 276:30 +CPU= 19.932
  03:06:06 STEP 1107 H= 276:45 +CPU= 19.648
  03:06:27 STEP 1108 H= 277:00 +CPU= 20.373
  03:06:47 STEP 1109 H= 277:15 +CPU= 20.053
  03:07:07 STEP 1110 H= 277:30 +CPU= 19.873
  03:07:27 STEP 1111 H= 277:45 +CPU= 20.039
  03:07:48 STEP 1112 H= 278:00 +CPU= 20.250
  03:08:08 STEP 1113 H= 278:15 +CPU= 20.088
  03:08:28 STEP 1114 H= 278:30 +CPU= 19.900
  03:08:48 STEP 1115 H= 278:45 +CPU= 20.128
  03:09:13 STEP 1116 H= 279:00 +CPU= 24.548
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001116
  03:09:33 STEP 1117 H= 279:15 +CPU= 19.697
  03:09:53 STEP 1118 H= 279:30 +CPU= 19.960
  03:10:13 STEP 1119 H= 279:45 +CPU= 20.038
  03:10:33 STEP 1120 H= 280:00 +CPU= 20.011
  03:10:54 STEP 1121 H= 280:15 +CPU= 20.051
  03:11:14 STEP 1122 H= 280:30 +CPU= 20.005
  03:11:34 STEP 1123 H= 280:45 +CPU= 19.900
  03:11:54 STEP 1124 H= 281:00 +CPU= 20.339
  03:12:15 STEP 1125 H= 281:15 +CPU= 20.206
  03:12:35 STEP 1126 H= 281:30 +CPU= 20.080
  03:12:55 STEP 1127 H= 281:45 +CPU= 19.911
  03:13:19 STEP 1128 H= 282:00 +CPU= 24.246
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001128
  03:13:40 STEP 1129 H= 282:15 +CPU= 20.046
  03:13:59 STEP 1130 H= 282:30 +CPU= 19.559
  03:14:20 STEP 1131 H= 282:45 +CPU= 20.058
  03:14:40 STEP 1132 H= 283:00 +CPU= 20.362
  03:15:00 STEP 1133 H= 283:15 +CPU= 19.724
  03:15:20 STEP 1134 H= 283:30 +CPU= 20.044
  03:15:40 STEP 1135 H= 283:45 +CPU= 19.980
  03:16:01 STEP 1136 H= 284:00 +CPU= 20.154
  03:16:21 STEP 1137 H= 284:15 +CPU= 19.966
  03:16:41 STEP 1138 H= 284:30 +CPU= 19.874
  03:17:01 STEP 1139 H= 284:45 +CPU= 20.109
  03:17:26 STEP 1140 H= 285:00 +CPU= 24.235
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001140
  03:17:46 STEP 1141 H= 285:15 +CPU= 19.993
  03:18:06 STEP 1142 H= 285:30 +CPU= 20.077
  03:18:26 STEP 1143 H= 285:45 +CPU= 19.647
  03:18:46 STEP 1144 H= 286:00 +CPU= 20.311
  03:19:07 STEP 1145 H= 286:15 +CPU= 20.115
  03:19:27 STEP 1146 H= 286:30 +CPU= 19.696
  03:19:47 STEP 1147 H= 286:45 +CPU= 20.073
  03:20:07 STEP 1148 H= 287:00 +CPU= 20.323
  03:20:27 STEP 1149 H= 287:15 +CPU= 19.861
  03:20:47 STEP 1150 H= 287:30 +CPU= 19.928
  03:21:08 STEP 1151 H= 287:45 +CPU= 19.983
  03:21:35 STEP 1152 H= 288:00 +CPU= 26.682
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a003_2016092300_15_949_12166397_0_r1581120742_11.zip
Uploading the intermediate file: upload_file_11.zip
  03:21:54 STEP 1153 H= 288:15 +CPU= 18.974
Uploading trickle at timestep: 1036800
  03:22:12 STEP 1154 H= 288:30 +CPU= 17.691
  03:22:30 STEP 1155 H= 288:45 +CPU= 18.047
  03:22:49 STEP 1156 H= 289:00 +CPU= 18.638
  03:23:09 STEP 1157 H= 289:15 +CPU= 19.856
  03:23:29 STEP 1158 H= 289:30 +CPU= 19.875
  03:23:49 STEP 1159 H= 289:45 +CPU= 19.808
  03:24:09 STEP 1160 H= 290:00 +CPU= 20.175
  03:24:29 STEP 1161 H= 290:15 +CPU= 19.797
  03:24:49 STEP 1162 H= 290:30 +CPU= 19.958
  03:25:09 STEP 1163 H= 290:45 +CPU= 19.911
  03:25:33 STEP 1164 H= 291:00 +CPU= 24.182
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001164
  03:25:53 STEP 1165 H= 291:15 +CPU= 19.715
  03:26:13 STEP 1166 H= 291:30 +CPU= 19.845
  03:26:33 STEP 1167 H= 291:45 +CPU= 19.552
  03:26:53 STEP 1168 H= 292:00 +CPU= 20.323
  03:27:13 STEP 1169 H= 292:15 +CPU= 19.745
  03:27:33 STEP 1170 H= 292:30 +CPU= 19.558
  03:27:53 STEP 1171 H= 292:45 +CPU= 19.729
  03:28:13 STEP 1172 H= 293:00 +CPU= 20.160
  03:28:33 STEP 1173 H= 293:15 +CPU= 19.844
  03:28:53 STEP 1174 H= 293:30 +CPU= 19.454
  03:29:13 STEP 1175 H= 293:45 +CPU= 19.716
  03:29:37 STEP 1176 H= 294:00 +CPU= 23.927
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001176
  03:29:57 STEP 1177 H= 294:15 +CPU= 19.611
  03:30:16 STEP 1178 H= 294:30 +CPU= 19.688
  03:30:37 STEP 1179 H= 294:45 +CPU= 19.925
  03:30:57 STEP 1180 H= 295:00 +CPU= 20.014
  03:31:16 STEP 1181 H= 295:15 +CPU= 19.636
  03:31:36 STEP 1182 H= 295:30 +CPU= 19.601
  03:31:56 STEP 1183 H= 295:45 +CPU= 19.718
  03:32:16 STEP 1184 H= 296:00 +CPU= 20.110
  03:32:36 STEP 1185 H= 296:15 +CPU= 19.653
  03:32:56 STEP 1186 H= 296:30 +CPU= 19.916
  03:33:16 STEP 1187 H= 296:45 +CPU= 19.445
  03:33:40 STEP 1188 H= 297:00 +CPU= 24.396
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001188
  03:34:00 STEP 1189 H= 297:15 +CPU= 19.685
  03:34:20 STEP 1190 H= 297:30 +CPU= 19.466
  03:34:40 STEP 1191 H= 297:45 +CPU= 19.794
  03:35:00 STEP 1192 H= 298:00 +CPU= 20.156
  03:35:20 STEP 1193 H= 298:15 +CPU= 19.580
  03:35:40 STEP 1194 H= 298:30 +CPU= 19.741
  03:36:00 STEP 1195 H= 298:45 +CPU= 19.755
  03:36:20 STEP 1196 H= 299:00 +CPU= 20.093
  03:36:40 STEP 1197 H= 299:15 +CPU= 19.572
  03:37:00 STEP 1198 H= 299:30 +CPU= 19.859
  03:37:20 STEP 1199 H= 299:45 +CPU= 19.702
  03:37:46 STEP 1200 H= 300:00 +CPU= 26.607
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001200
  03:38:06 STEP 1201 H= 300:15 +CPU= 19.860
  03:38:26 STEP 1202 H= 300:30 +CPU= 19.726
  03:38:46 STEP 1203 H= 300:45 +CPU= 19.503
  03:39:06 STEP 1204 H= 301:00 +CPU= 20.117
  03:39:26 STEP 1205 H= 301:15 +CPU= 19.678
  03:39:46 STEP 1206 H= 301:30 +CPU= 19.807
  03:40:06 STEP 1207 H= 301:45 +CPU= 19.831
  03:40:26 STEP 1208 H= 302:00 +CPU= 20.190
  03:40:46 STEP 1209 H= 302:15 +CPU= 19.982
  03:41:06 STEP 1210 H= 302:30 +CPU= 19.606
  03:41:26 STEP 1211 H= 302:45 +CPU= 19.936
  03:41:51 STEP 1212 H= 303:00 +CPU= 24.310
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001212
  03:42:11 STEP 1213 H= 303:15 +CPU= 19.799
  03:42:31 STEP 1214 H= 303:30 +CPU= 19.939
  03:42:51 STEP 1215 H= 303:45 +CPU= 20.085
  03:43:11 STEP 1216 H= 304:00 +CPU= 20.095
  03:43:32 STEP 1217 H= 304:15 +CPU= 20.027
  03:43:52 STEP 1218 H= 304:30 +CPU= 19.909
  03:44:11 STEP 1219 H= 304:45 +CPU= 19.660
  03:44:32 STEP 1220 H= 305:00 +CPU= 20.238
  03:44:52 STEP 1221 H= 305:15 +CPU= 19.910
  03:45:12 STEP 1222 H= 305:30 +CPU= 19.890
  03:45:32 STEP 1223 H= 305:45 +CPU= 19.856
  03:45:56 STEP 1224 H= 306:00 +CPU= 24.105
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001224
  03:46:16 STEP 1225 H= 306:15 +CPU= 19.821
  03:46:35 STEP 1226 H= 306:30 +CPU= 18.466
  03:46:52 STEP 1227 H= 306:45 +CPU= 17.573
  03:47:10 STEP 1228 H= 307:00 +CPU= 17.944
  03:47:28 STEP 1229 H= 307:15 +CPU= 17.709
  03:47:47 STEP 1230 H= 307:30 +CPU= 18.874
  03:48:07 STEP 1231 H= 307:45 +CPU= 19.830
  03:48:28 STEP 1232 H= 308:00 +CPU= 20.324
  03:48:48 STEP 1233 H= 308:15 +CPU= 20.189
  03:49:08 STEP 1234 H= 308:30 +CPU= 19.685
  03:49:29 STEP 1235 H= 308:45 +CPU= 20.206
  03:49:53 STEP 1236 H= 309:00 +CPU= 24.517
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001236
  03:50:13 STEP 1237 H= 309:15 +CPU= 19.684
  03:50:33 STEP 1238 H= 309:30 +CPU= 20.090
  03:50:54 STEP 1239 H= 309:45 +CPU= 20.169
  03:51:14 STEP 1240 H= 310:00 +CPU= 20.020
  03:51:34 STEP 1241 H= 310:15 +CPU= 20.133
  03:51:55 STEP 1242 H= 310:30 +CPU= 20.195
  03:52:15 STEP 1243 H= 310:45 +CPU= 19.979
  03:52:35 STEP 1244 H= 311:00 +CPU= 20.116
  03:52:55 STEP 1245 H= 311:15 +CPU= 20.186
  03:53:16 STEP 1246 H= 311:30 +CPU= 20.188
  03:53:36 STEP 1247 H= 311:45 +CPU= 19.607
  03:54:03 STEP 1248 H= 312:00 +CPU= 27.237
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a003_2016092300_15_949_12166397_0_r1581120742_12.zip
Uploading the intermediate file: upload_file_12.zip
  03:54:24 STEP 1249 H= 312:15 +CPU= 20.441
  03:54:44 STEP 1250 H= 312:30 +CPU= 20.066
  03:55:05 STEP 1251 H= 312:45 +CPU= 20.560
  03:55:25 STEP 1252 H= 313:00 +CPU= 20.596
  03:55:46 STEP 1253 H= 313:15 +CPU= 19.978
  03:56:06 STEP 1254 H= 313:30 +CPU= 20.207
  03:56:26 STEP 1255 H= 313:45 +CPU= 20.240
  03:56:47 STEP 1256 H= 314:00 +CPU= 20.396
  03:57:07 STEP 1257 H= 314:15 +CPU= 20.107
  03:57:28 STEP 1258 H= 314:30 +CPU= 20.455
  03:57:48 STEP 1259 H= 314:45 +CPU= 20.342
  03:58:13 STEP 1260 H= 315:00 +CPU= 24.318
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001260
  03:58:34 STEP 1261 H= 315:15 +CPU= 20.358
  03:58:54 STEP 1262 H= 315:30 +CPU= 20.163
  03:59:14 STEP 1263 H= 315:45 +CPU= 19.642
  03:59:34 STEP 1264 H= 316:00 +CPU= 20.640
  03:59:55 STEP 1265 H= 316:15 +CPU= 20.209
  04:00:15 STEP 1266 H= 316:30 +CPU= 19.901
  04:00:35 STEP 1267 H= 316:45 +CPU= 20.235
  04:00:56 STEP 1268 H= 317:00 +CPU= 20.478
  04:01:16 STEP 1269 H= 317:15 +CPU= 20.143
  04:01:36 STEP 1270 H= 317:30 +CPU= 20.235
  04:01:57 STEP 1271 H= 317:45 +CPU= 20.269
  04:02:21 STEP 1272 H= 318:00 +CPU= 24.213
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001272
  04:02:42 STEP 1273 H= 318:15 +CPU= 20.195
  04:03:02 STEP 1274 H= 318:30 +CPU= 20.158
  04:03:22 STEP 1275 H= 318:45 +CPU= 20.341
  04:03:43 STEP 1276 H= 319:00 +CPU= 20.257
  04:04:03 STEP 1277 H= 319:15 +CPU= 20.060
  04:04:23 STEP 1278 H= 319:30 +CPU= 20.087
  04:04:43 STEP 1279 H= 319:45 +CPU= 19.844
  04:05:04 STEP 1280 H= 320:00 +CPU= 20.442
  04:05:24 STEP 1281 H= 320:15 +CPU= 20.267
  04:05:44 STEP 1282 H= 320:30 +CPU= 19.792
  04:06:03 STEP 1283 H= 320:45 +CPU= 18.462
  04:06:25 STEP 1284 H= 321:00 +CPU= 21.555
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001284
  04:06:42 STEP 1285 H= 321:15 +CPU= 17.635
  04:07:00 STEP 1286 H= 321:30 +CPU= 17.800
  04:07:19 STEP 1287 H= 321:45 +CPU= 18.755
  04:07:39 STEP 1288 H= 322:00 +CPU= 19.925
  04:08:00 STEP 1289 H= 322:15 +CPU= 20.080
  04:08:20 STEP 1290 H= 322:30 +CPU= 20.052
  04:08:39 STEP 1291 H= 322:45 +CPU= 19.255
  04:09:00 STEP 1292 H= 323:00 +CPU= 20.312
  04:09:20 STEP 1293 H= 323:15 +CPU= 19.948
  04:09:39 STEP 1294 H= 323:30 +CPU= 19.287
  04:09:59 STEP 1295 H= 323:45 +CPU= 19.975
  04:10:27 STEP 1296 H= 324:00 +CPU= 26.835
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001296
  04:10:46 STEP 1297 H= 324:15 +CPU= 19.606
  04:11:07 STEP 1298 H= 324:30 +CPU= 20.108
  04:11:27 STEP 1299 H= 324:45 +CPU= 20.147
  04:11:47 STEP 1300 H= 325:00 +CPU= 20.174
  04:12:08 STEP 1301 H= 325:15 +CPU= 20.078
  04:12:28 STEP 1302 H= 325:30 +CPU= 20.052
  04:12:47 STEP 1303 H= 325:45 +CPU= 18.788
  04:13:05 STEP 1304 H= 326:00 +CPU= 17.991
  04:13:23 STEP 1305 H= 326:15 +CPU= 17.679
  04:13:40 STEP 1306 H= 326:30 +CPU= 17.792
  04:14:00 STEP 1307 H= 326:45 +CPU= 19.468
  04:14:24 STEP 1308 H= 327:00 +CPU= 24.051
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001308
  04:14:45 STEP 1309 H= 327:15 +CPU= 20.209
  04:15:05 STEP 1310 H= 327:30 +CPU= 20.368
  04:15:26 STEP 1311 H= 327:45 +CPU= 20.073
  04:15:46 STEP 1312 H= 328:00 +CPU= 20.514
  04:16:07 STEP 1313 H= 328:15 +CPU= 20.296
  04:16:27 STEP 1314 H= 328:30 +CPU= 19.767
  04:16:47 STEP 1315 H= 328:45 +CPU= 20.167
  04:17:07 STEP 1316 H= 329:00 +CPU= 20.387
  04:17:27 STEP 1317 H= 329:15 +CPU= 19.789
  04:17:48 STEP 1318 H= 329:30 +CPU= 20.169
  04:18:08 STEP 1319 H= 329:45 +CPU= 20.209
  04:18:32 STEP 1320 H= 330:00 +CPU= 23.974
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001320
  04:18:53 STEP 1321 H= 330:15 +CPU= 20.178
  04:19:13 STEP 1322 H= 330:30 +CPU= 20.058
  04:19:33 STEP 1323 H= 330:45 +CPU= 20.004
  04:19:53 STEP 1324 H= 331:00 +CPU= 20.320
  04:20:14 STEP 1325 H= 331:15 +CPU= 20.234
  04:20:34 STEP 1326 H= 331:30 +CPU= 20.034
  04:20:54 STEP 1327 H= 331:45 +CPU= 19.784
  04:21:15 STEP 1328 H= 332:00 +CPU= 20.486
  04:21:35 STEP 1329 H= 332:15 +CPU= 20.123
  04:21:55 STEP 1330 H= 332:30 +CPU= 19.887
  04:22:15 STEP 1331 H= 332:45 +CPU= 19.932
  04:22:40 STEP 1332 H= 333:00 +CPU= 24.515
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001332
  04:23:00 STEP 1333 H= 333:15 +CPU= 19.689
  04:23:20 STEP 1334 H= 333:30 +CPU= 20.097
  04:23:40 STEP 1335 H= 333:45 +CPU= 20.169
  04:24:01 STEP 1336 H= 334:00 +CPU= 20.530
  04:24:21 STEP 1337 H= 334:15 +CPU= 19.906
  04:24:41 STEP 1338 H= 334:30 +CPU= 20.224
  04:25:02 STEP 1339 H= 334:45 +CPU= 20.086
  04:25:22 STEP 1340 H= 335:00 +CPU= 20.078
  04:25:42 STEP 1341 H= 335:15 +CPU= 20.120
  04:26:02 STEP 1342 H= 335:30 +CPU= 20.141
  04:26:22 STEP 1343 H= 335:45 +CPU= 19.830
  04:26:49 STEP 1344 H= 336:00 +CPU= 26.775
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a003_2016092300_15_949_12166397_0_r1581120742_13.zip
Uploading the intermediate file: upload_file_13.zip
  04:27:10 STEP 1345 H= 336:15 +CPU= 20.553
  04:27:30 STEP 1346 H= 336:30 +CPU= 19.918
  04:27:51 STEP 1347 H= 336:45 +CPU= 20.439
  04:28:12 STEP 1348 H= 337:00 +CPU= 20.671
  04:28:32 STEP 1349 H= 337:15 +CPU= 19.944
  04:28:52 STEP 1350 H= 337:30 +CPU= 20.048
  04:29:13 STEP 1351 H= 337:45 +CPU= 20.193
  04:29:33 STEP 1352 H= 338:00 +CPU= 20.478
  04:29:53 STEP 1353 H= 338:15 +CPU= 19.898
  04:30:14 STEP 1354 H= 338:30 +CPU= 20.280
  04:30:34 STEP 1355 H= 338:45 +CPU= 20.215
  04:30:59 STEP 1356 H= 339:00 +CPU= 24.391
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001356
  04:31:19 STEP 1357 H= 339:15 +CPU= 20.314
  04:31:39 STEP 1358 H= 339:30 +CPU= 20.075
  04:31:59 STEP 1359 H= 339:45 +CPU= 19.877
  04:32:20 STEP 1360 H= 340:00 +CPU= 20.530
  04:32:40 STEP 1361 H= 340:15 +CPU= 20.076
  04:33:01 STEP 1362 H= 340:30 +CPU= 19.977
  04:33:21 STEP 1363 H= 340:45 +CPU= 20.114
  04:33:41 STEP 1364 H= 341:00 +CPU= 20.446
  04:34:02 STEP 1365 H= 341:15 +CPU= 20.182
  04:34:22 STEP 1366 H= 341:30 +CPU= 19.997
  04:34:42 STEP 1367 H= 341:45 +CPU= 20.345
  04:35:07 STEP 1368 H= 342:00 +CPU= 24.411
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001368
  04:35:28 STEP 1369 H= 342:15 +CPU= 20.239
  04:35:48 STEP 1370 H= 342:30 +CPU= 20.290
  04:36:09 STEP 1371 H= 342:45 +CPU= 20.405
  04:36:29 STEP 1372 H= 343:00 +CPU= 20.280
  04:36:49 STEP 1373 H= 343:15 +CPU= 20.053
  04:37:10 STEP 1374 H= 343:30 +CPU= 20.198
  04:37:29 STEP 1375 H= 343:45 +CPU= 18.727
  04:37:47 STEP 1376 H= 344:00 +CPU= 17.941
  04:38:04 STEP 1377 H= 344:15 +CPU= 17.678
  04:38:22 STEP 1378 H= 344:30 +CPU= 17.780
  04:38:42 STEP 1379 H= 344:45 +CPU= 19.688
  04:39:07 STEP 1380 H= 345:00 +CPU= 24.322
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001380
  04:39:27 STEP 1381 H= 345:15 +CPU= 19.862
  04:39:47 STEP 1382 H= 345:30 +CPU= 19.727
  04:40:07 STEP 1383 H= 345:45 +CPU= 19.656
  04:40:27 STEP 1384 H= 346:00 +CPU= 20.057
  04:40:47 STEP 1385 H= 346:15 +CPU= 19.762
  04:41:06 STEP 1386 H= 346:30 +CPU= 19.488
  04:41:26 STEP 1387 H= 346:45 +CPU= 19.713
  04:41:46 STEP 1388 H= 347:00 +CPU= 19.963
  04:42:06 STEP 1389 H= 347:15 +CPU= 19.394
  04:42:26 STEP 1390 H= 347:30 +CPU= 19.633
  04:42:45 STEP 1391 H= 347:45 +CPU= 19.580
  04:43:12 STEP 1392 H= 348:00 +CPU= 26.563
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001392
  04:43:32 STEP 1393 H= 348:15 +CPU= 19.941
  04:43:51 STEP 1394 H= 348:30 +CPU= 18.847
  04:44:09 STEP 1395 H= 348:45 +CPU= 17.745
  04:44:27 STEP 1396 H= 349:00 +CPU= 18.069
  04:44:45 STEP 1397 H= 349:15 +CPU= 17.911
  04:45:05 STEP 1398 H= 349:30 +CPU= 19.664
  04:45:25 STEP 1399 H= 349:45 +CPU= 19.499
  04:45:46 STEP 1400 H= 350:00 +CPU= 20.786
  04:46:06 STEP 1401 H= 350:15 +CPU= 20.324
  04:46:26 STEP 1402 H= 350:30 +CPU= 19.677
  04:46:46 STEP 1403 H= 350:45 +CPU= 20.276
  04:47:12 STEP 1404 H= 351:00 +CPU= 24.881
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001404
  04:47:31 STEP 1405 H= 351:15 +CPU= 19.668
  04:47:52 STEP 1406 H= 351:30 +CPU= 20.300
  04:48:12 STEP 1407 H= 351:45 +CPU= 20.265
  04:48:33 STEP 1408 H= 352:00 +CPU= 20.111
  04:48:53 STEP 1409 H= 352:15 +CPU= 20.484
  04:49:14 STEP 1410 H= 352:30 +CPU= 20.194
  04:49:34 STEP 1411 H= 352:45 +CPU= 20.211
  04:49:55 STEP 1412 H= 353:00 +CPU= 20.484
  04:50:15 STEP 1413 H= 353:15 +CPU= 20.237
  04:50:35 STEP 1414 H= 353:30 +CPU= 20.185
  04:50:55 STEP 1415 H= 353:45 +CPU= 19.785
  04:51:20 STEP 1416 H= 354:00 +CPU= 24.679
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001416
  04:51:41 STEP 1417 H= 354:15 +CPU= 20.265
  04:52:01 STEP 1418 H= 354:30 +CPU= 19.725
  04:52:21 STEP 1419 H= 354:45 +CPU= 20.267
  04:52:42 STEP 1420 H= 355:00 +CPU= 20.545
  04:53:02 STEP 1421 H= 355:15 +CPU= 19.801
  04:53:22 STEP 1422 H= 355:30 +CPU= 20.184
  04:53:43 STEP 1423 H= 355:45 +CPU= 20.389
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.07_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a003
(argv4) batchid: 949
(argv5) wuid: 12166397
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/2
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.07
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/2/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/2/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d85c7163981ab4d8b5cae45d7c882cca to: /var/lib/boinc-client/slots/2/oifs_43r3_bl_a003_2016092300_15_949_12166397.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/2/oifs_43r3_bl_a003_2016092300_15_949_12166397.zip
ic_ancil_file: ic_ancil_12166397
ifsdata_file: ifsdata_12166397
climate_data_file: clim_data_12166397
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/2/ic_ancil_12166397.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/2/ic_ancil_12166397.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_2d8981f82bc0dbce78e5fa94968a6a38 to: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12166397.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/2/ifsdata/ifsdata_12166397.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/2/159l_2/clim_data_12166397.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/2/159l_2/clim_data_12166397.zip
Checking for progress XML file: /var/lib/boinc-client/slots/2/progress_file_12166397.xml
Opened progress file ok : /var/lib/boinc-client/slots/2/progress_file_12166397.xml
-- Model is restarting --
Adjusting last_iter, 1424, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/2/progress_file_12166397.xml
last_cpu_time: 39553
upload_file_number: 14
last_iter: 1391
last_upload: 1209600
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a003_2016092300_15_949_12166397_0_r1581120742
The child process has been launched with process id: 1235
Executing the command: /var/lib/boinc-client/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x30eaa80
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:ubuntu:1:1:1235:1235] [20221215:085645:1671094605:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  08:57:55 STEP 1392 H= 348:00 +CPU= 17.503
  08:58:13 STEP 1393 H= 348:15 +CPU= 17.419
  08:58:30 STEP 1394 H= 348:30 +CPU= 17.271
  08:58:48 STEP 1395 H= 348:45 +CPU= 17.743
  08:59:08 STEP 1396 H= 349:00 +CPU= 19.649
  08:59:28 STEP 1397 H= 349:15 +CPU= 19.428
  08:59:47 STEP 1398 H= 349:30 +CPU= 19.278
  09:00:07 STEP 1399 H= 349:45 +CPU= 19.481
  09:00:27 STEP 1400 H= 350:00 +CPU= 19.721
  09:00:46 STEP 1401 H= 350:15 +CPU= 19.168
  09:01:06 STEP 1402 H= 350:30 +CPU= 19.267
  09:01:25 STEP 1403 H= 350:45 +CPU= 19.467
  09:01:49 STEP 1404 H= 351:00 +CPU= 23.680
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001404
  09:02:08 STEP 1405 H= 351:15 +CPU= 19.251
  09:02:28 STEP 1406 H= 351:30 +CPU= 19.348
  09:02:48 STEP 1407 H= 351:45 +CPU= 19.435
  09:03:07 STEP 1408 H= 352:00 +CPU= 19.462
  09:03:27 STEP 1409 H= 352:15 +CPU= 19.403
  09:03:46 STEP 1410 H= 352:30 +CPU= 19.472
  09:04:06 STEP 1411 H= 352:45 +CPU= 19.150
  09:04:26 STEP 1412 H= 353:00 +CPU= 19.763
  09:04:45 STEP 1413 H= 353:15 +CPU= 19.517
  09:05:04 STEP 1414 H= 353:30 +CPU= 19.151
  09:05:24 STEP 1415 H= 353:45 +CPU= 19.448
  09:05:48 STEP 1416 H= 354:00 +CPU= 23.857
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001416
  09:06:08 STEP 1417 H= 354:15 +CPU= 19.277
  09:06:27 STEP 1418 H= 354:30 +CPU= 19.421
  09:06:47 STEP 1419 H= 354:45 +CPU= 19.446
  09:07:07 STEP 1420 H= 355:00 +CPU= 19.748
  09:07:26 STEP 1421 H= 355:15 +CPU= 19.137
  09:07:46 STEP 1422 H= 355:30 +CPU= 19.489
  09:08:05 STEP 1423 H= 355:45 +CPU= 19.542
  09:08:25 STEP 1424 H= 356:00 +CPU= 19.387
  09:08:44 STEP 1425 H= 356:15 +CPU= 19.481
  09:09:04 STEP 1426 H= 356:30 +CPU= 19.490
  09:09:23 STEP 1427 H= 356:45 +CPU= 19.062
  09:09:47 STEP 1428 H= 357:00 +CPU= 23.657
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001428
  09:10:07 STEP 1429 H= 357:15 +CPU= 19.436
  09:10:26 STEP 1430 H= 357:30 +CPU= 19.165
  09:10:45 STEP 1431 H= 357:45 +CPU= 19.410
  09:11:05 STEP 1432 H= 358:00 +CPU= 19.691
  09:11:25 STEP 1433 H= 358:15 +CPU= 19.320
  09:11:44 STEP 1434 H= 358:30 +CPU= 19.135
  09:12:04 STEP 1435 H= 358:45 +CPU= 19.499
  09:12:23 STEP 1436 H= 359:00 +CPU= 19.630
  09:12:43 STEP 1437 H= 359:15 +CPU= 18.936
  09:13:02 STEP 1438 H= 359:30 +CPU= 19.433
  09:13:22 STEP 1439 H= 359:45 +CPU= 19.386
  09:13:45 STEP 1440 H= 360:00 +CPU= 23.629
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/2/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166397/ICMUAh7zg+001392
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a003_2016092300_15_949_12166397_0_r1581120742_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
09:17:15 (1104): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:43:07 1536300 22250305 oifs_43r3_bl_a003_2016092300_15_949_12166397_0 1,295,100 40,515 0.0313
09 May 2023 15:43:01 1536300 22250305 oifs_43r3_bl_a003_2016092300_15_949_12166397_0 1,036,800 34,062 0.0329


©2024 climateprediction.net