climateprediction.net home page
Task 22302408

Task 22302408

Name oifs_43r3_ps_0344_2016050100_123_985_12201988_1
Workunit 12201988
Created 23 Jan 2023, 15:22:01 UTC
Sent 23 Jan 2023, 15:29:58 UTC
Report deadline 24 Mar 2023, 15:29:58 UTC
Received 25 Jan 2023, 13:38:57 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1519626
Run time 13 hours 47 min 24 sec
CPU time 13 hours 32 min 15 sec
Validate state Invalid
Credit 3,628.80
Device peak FLOPS 3.03 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,747.04 MB
Peak swap size 4,974.12 MB
Peak disk usage 1,624.11 MB
Stderr
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
t/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000108
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000108
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_4.zip
Uploading the intermediate file: upload_file_4.zip
  22:01:55 STEP  121 H= 121:00 +CPU= 52.283
  22:02:49 STEP  122 H= 122:00 +CPU= 53.708
  22:04:15 STEP  123 H= 123:00 +CPU= 84.502
  22:05:09 STEP  124 H= 124:00 +CPU= 54.034
  22:06:02 STEP  125 H= 125:00 +CPU= 52.440
  22:07:30 STEP  126 H= 126:00 +CPU= 86.357
  22:08:23 STEP  127 H= 127:00 +CPU= 52.374
  22:09:18 STEP  128 H= 128:00 +CPU= 53.858
  22:10:43 STEP  129 H= 129:00 +CPU= 84.687
  22:11:37 STEP  130 H= 130:00 +CPU= 53.867
  22:12:31 STEP  131 H= 131:00 +CPU= 52.459
  22:14:06 STEP  132 H= 132:00 +CPU= 94.070
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000132
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000132
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000132
  22:15:00 STEP  133 H= 133:00 +CPU= 52.387
  22:15:55 STEP  134 H= 134:00 +CPU= 53.932
  22:17:21 STEP  135 H= 135:00 +CPU= 84.811
  22:18:15 STEP  136 H= 136:00 +CPU= 53.824
  22:19:09 STEP  137 H= 137:00 +CPU= 52.573
  22:20:37 STEP  138 H= 138:00 +CPU= 86.315
  22:21:31 STEP  139 H= 139:00 +CPU= 52.386
  22:22:26 STEP  140 H= 140:00 +CPU= 53.797
  22:23:52 STEP  141 H= 141:00 +CPU= 84.567
  22:24:46 STEP  142 H= 142:00 +CPU= 53.753
  22:25:41 STEP  143 H= 143:00 +CPU= 54.048
  22:27:20 STEP  144 H= 144:00 +CPU= 97.335
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000144
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000144
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000132
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_5.zip
Uploading the intermediate file: upload_file_5.zip
  22:28:13 STEP  145 H= 145:00 +CPU= 52.177
  22:29:08 STEP  146 H= 146:00 +CPU= 53.737
  22:30:34 STEP  147 H= 147:00 +CPU= 84.502
  22:31:29 STEP  148 H= 148:00 +CPU= 53.726
  22:32:22 STEP  149 H= 149:00 +CPU= 52.266
  22:33:49 STEP  150 H= 150:00 +CPU= 86.267
  22:34:42 STEP  151 H= 151:00 +CPU= 52.287
  22:35:37 STEP  152 H= 152:00 +CPU= 53.818
  22:37:03 STEP  153 H= 153:00 +CPU= 84.775
  22:37:57 STEP  154 H= 154:00 +CPU= 53.816
  22:38:50 STEP  155 H= 155:00 +CPU= 52.343
  22:40:26 STEP  156 H= 156:00 +CPU= 94.024
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000156
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000156
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000156
  22:41:19 STEP  157 H= 157:00 +CPU= 52.404
  22:42:14 STEP  158 H= 158:00 +CPU= 53.846
  22:43:40 STEP  159 H= 159:00 +CPU= 84.697
  22:44:35 STEP  160 H= 160:00 +CPU= 53.773
  22:45:28 STEP  161 H= 161:00 +CPU= 52.311
  22:46:55 STEP  162 H= 162:00 +CPU= 86.368
  22:47:48 STEP  163 H= 163:00 +CPU= 52.290
  22:48:42 STEP  164 H= 164:00 +CPU= 53.626
  22:50:07 STEP  165 H= 165:00 +CPU= 84.619
  22:51:02 STEP  166 H= 166:00 +CPU= 53.664
  22:51:57 STEP  167 H= 167:00 +CPU= 53.994
  22:53:37 STEP  168 H= 168:00 +CPU= 97.414
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000168
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000168
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000156
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000156
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000156
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_6.zip
Uploading the intermediate file: upload_file_6.zip
  22:54:31 STEP  169 H= 169:00 +CPU= 52.217
  22:55:25 STEP  170 H= 170:00 +CPU= 53.694
  22:56:50 STEP  171 H= 171:00 +CPU= 84.678
  22:57:45 STEP  172 H= 172:00 +CPU= 53.714
  22:58:38 STEP  173 H= 173:00 +CPU= 52.370
  23:00:07 STEP  174 H= 174:00 +CPU= 86.523
  23:01:00 STEP  175 H= 175:00 +CPU= 52.431
  23:01:54 STEP  176 H= 176:00 +CPU= 53.864
  23:03:20 STEP  177 H= 177:00 +CPU= 84.876
  23:04:14 STEP  178 H= 178:00 +CPU= 53.778
  23:05:07 STEP  179 H= 179:00 +CPU= 52.365
  23:06:43 STEP  180 H= 180:00 +CPU= 94.222
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000180
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000180
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000180
  23:07:36 STEP  181 H= 181:00 +CPU= 52.392
  23:08:31 STEP  182 H= 182:00 +CPU= 53.902
  23:09:57 STEP  183 H= 183:00 +CPU= 84.850
  23:10:52 STEP  184 H= 184:00 +CPU= 53.850
  23:11:46 STEP  185 H= 185:00 +CPU= 52.332
  23:13:14 STEP  186 H= 186:00 +CPU= 86.371
  23:14:07 STEP  187 H= 187:00 +CPU= 52.339
  23:15:01 STEP  188 H= 188:00 +CPU= 53.821
  23:16:27 STEP  189 H= 189:00 +CPU= 84.674
  23:17:21 STEP  190 H= 190:00 +CPU= 53.732
  23:18:16 STEP  191 H= 191:00 +CPU= 54.020
  23:19:55 STEP  192 H= 192:00 +CPU= 97.372
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000192
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000192
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000180
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000180
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000180
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_7.zip
Uploading the intermediate file: upload_file_7.zip
  23:20:48 STEP  193 H= 193:00 +CPU= 52.185
  23:21:42 STEP  194 H= 194:00 +CPU= 53.709
  23:23:08 STEP  195 H= 195:00 +CPU= 84.765
  23:24:03 STEP  196 H= 196:00 +CPU= 53.733
  23:24:56 STEP  197 H= 197:00 +CPU= 52.280
  23:26:24 STEP  198 H= 198:00 +CPU= 86.340
  23:27:16 STEP  199 H= 199:00 +CPU= 52.315
  23:28:11 STEP  200 H= 200:00 +CPU= 54.023
  23:29:36 STEP  201 H= 201:00 +CPU= 84.698
  23:30:31 STEP  202 H= 202:00 +CPU= 53.838
  23:31:24 STEP  203 H= 203:00 +CPU= 52.386
  23:33:00 STEP  204 H= 204:00 +CPU= 94.037
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000204
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000204
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000204
  23:33:52 STEP  205 H= 205:00 +CPU= 52.389
  23:34:47 STEP  206 H= 206:00 +CPU= 53.835
  23:36:13 STEP  207 H= 207:00 +CPU= 84.727
  23:37:08 STEP  208 H= 208:00 +CPU= 53.951
  23:38:01 STEP  209 H= 209:00 +CPU= 52.345
  23:39:28 STEP  210 H= 210:00 +CPU= 86.217
  23:40:21 STEP  211 H= 211:00 +CPU= 52.284
  23:41:15 STEP  212 H= 212:00 +CPU= 53.717
  23:42:40 STEP  213 H= 213:00 +CPU= 84.514
  23:43:34 STEP  214 H= 214:00 +CPU= 53.591
  23:44:29 STEP  215 H= 215:00 +CPU= 53.997
  23:46:07 STEP  216 H= 216:00 +CPU= 97.368
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000216
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000216
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000204
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000204
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000204
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_8.zip
Uploading the intermediate file: upload_file_8.zip
  23:47:01 STEP  217 H= 217:00 +CPU= 52.306
  23:47:56 STEP  218 H= 218:00 +CPU= 53.683
  23:49:22 STEP  219 H= 219:00 +CPU= 84.663
  23:50:16 STEP  220 H= 220:00 +CPU= 53.643
  23:51:09 STEP  221 H= 221:00 +CPU= 52.408
  23:52:36 STEP  222 H= 222:00 +CPU= 86.264
  23:53:30 STEP  223 H= 223:00 +CPU= 52.350
  23:54:25 STEP  224 H= 224:00 +CPU= 53.850
  23:55:50 STEP  225 H= 225:00 +CPU= 84.769
  23:56:45 STEP  226 H= 226:00 +CPU= 53.862
  23:57:39 STEP  227 H= 227:00 +CPU= 52.442
  23:59:14 STEP  228 H= 228:00 +CPU= 94.221
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000228
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000228
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000228
  00:00:08 STEP  229 H= 229:00 +CPU= 52.529
  00:01:03 STEP  230 H= 230:00 +CPU= 53.915
  00:02:28 STEP  231 H= 231:00 +CPU= 84.633
  00:03:23 STEP  232 H= 232:00 +CPU= 53.837
  00:04:15 STEP  233 H= 233:00 +CPU= 52.372
  00:05:42 STEP  234 H= 234:00 +CPU= 86.268
  00:06:35 STEP  235 H= 235:00 +CPU= 52.332
  00:07:30 STEP  236 H= 236:00 +CPU= 53.770
  00:08:56 STEP  237 H= 237:00 +CPU= 84.664
  00:09:50 STEP  238 H= 238:00 +CPU= 53.711
  00:10:45 STEP  239 H= 239:00 +CPU= 53.991
  00:12:23 STEP  240 H= 240:00 +CPU= 97.153
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000240
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000240
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000228
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000228
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000228
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_9.zip
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 864000
  00:13:16 STEP  241 H= 241:00 +CPU= 52.549
  00:14:12 STEP  242 H= 242:00 +CPU= 53.792
  00:15:38 STEP  243 H= 243:00 +CPU= 84.586
  00:16:33 STEP  244 H= 244:00 +CPU= 53.726
  00:17:25 STEP  245 H= 245:00 +CPU= 52.207
  00:18:53 STEP  246 H= 246:00 +CPU= 86.343
  00:19:46 STEP  247 H= 247:00 +CPU= 52.300
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  03:36:33 STEP  248 H= 248:00 +CPU= 52.979
  03:37:58 STEP  249 H= 249:00 +CPU= 84.180
  03:38:52 STEP  250 H= 250:00 +CPU= 53.181
  03:39:44 STEP  251 H= 251:00 +CPU= 51.847
  03:41:20 STEP  252 H= 252:00 +CPU= 93.334
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000252
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000252
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000252
  03:42:13 STEP  253 H= 253:00 +CPU= 51.792
  03:43:07 STEP  254 H= 254:00 +CPU= 53.223
  03:44:32 STEP  255 H= 255:00 +CPU= 84.124
  03:45:26 STEP  256 H= 256:00 +CPU= 53.110
  03:46:18 STEP  257 H= 257:00 +CPU= 51.646
  03:47:45 STEP  258 H= 258:00 +CPU= 85.722
  03:48:37 STEP  259 H= 259:00 +CPU= 51.596
  03:49:31 STEP  260 H= 260:00 +CPU= 53.019
  03:50:55 STEP  261 H= 261:00 +CPU= 84.080
  03:51:49 STEP  262 H= 262:00 +CPU= 53.064
  03:52:43 STEP  263 H= 263:00 +CPU= 53.404
  03:54:21 STEP  264 H= 264:00 +CPU= 95.798
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000264
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000264
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000252
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000252
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000252
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_10.zip
Uploading the intermediate file: upload_file_10.zip
  03:55:14 STEP  265 H= 265:00 +CPU= 51.559
  03:56:08 STEP  266 H= 266:00 +CPU= 53.076
  03:57:33 STEP  267 H= 267:00 +CPU= 83.291
  03:58:27 STEP  268 H= 268:00 +CPU= 52.973
  03:59:19 STEP  269 H= 269:00 +CPU= 51.480
  04:00:46 STEP  270 H= 270:00 +CPU= 84.941
  04:01:39 STEP  271 H= 271:00 +CPU= 51.563
  04:02:33 STEP  272 H= 272:00 +CPU= 53.064
  04:03:58 STEP  273 H= 273:00 +CPU= 83.410
  04:04:51 STEP  274 H= 274:00 +CPU= 53.082
  04:05:43 STEP  275 H= 275:00 +CPU= 51.599
  04:07:17 STEP  276 H= 276:00 +CPU= 92.490
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000276
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000276
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000276
  04:08:09 STEP  277 H= 277:00 +CPU= 51.865
  04:09:02 STEP  278 H= 278:00 +CPU= 53.002
  04:10:26 STEP  279 H= 279:00 +CPU= 83.245
  04:11:20 STEP  280 H= 280:00 +CPU= 53.081
  04:12:13 STEP  281 H= 281:00 +CPU= 51.517
  04:13:39 STEP  282 H= 282:00 +CPU= 84.898
  04:14:32 STEP  283 H= 283:00 +CPU= 51.508
  04:15:26 STEP  284 H= 284:00 +CPU= 52.896
  04:16:51 STEP  285 H= 285:00 +CPU= 83.226
  04:17:45 STEP  286 H= 286:00 +CPU= 52.909
  04:18:39 STEP  287 H= 287:00 +CPU= 53.244
  04:20:16 STEP  288 H= 288:00 +CPU= 95.790
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000288
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000288
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000276
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000276
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000276
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_11.zip
Uploading the intermediate file: upload_file_11.zip
  04:21:09 STEP  289 H= 289:00 +CPU= 51.690
  04:22:03 STEP  290 H= 290:00 +CPU= 52.950
  04:23:28 STEP  291 H= 291:00 +CPU= 83.166
  04:24:22 STEP  292 H= 292:00 +CPU= 52.996
  04:25:15 STEP  293 H= 293:00 +CPU= 51.593
  04:26:43 STEP  294 H= 294:00 +CPU= 85.109
  04:27:36 STEP  295 H= 295:00 +CPU= 51.669
  04:28:31 STEP  296 H= 296:00 +CPU= 53.108
  04:29:56 STEP  297 H= 297:00 +CPU= 83.518
  04:30:51 STEP  298 H= 298:00 +CPU= 53.093
  04:31:44 STEP  299 H= 299:00 +CPU= 51.755
  04:33:18 STEP  300 H= 300:00 +CPU= 92.622
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000300
  04:34:11 STEP  301 H= 301:00 +CPU= 51.899
  04:35:05 STEP  302 H= 302:00 +CPU= 53.104
  04:36:29 STEP  303 H= 303:00 +CPU= 83.419
  04:37:24 STEP  304 H= 304:00 +CPU= 53.043
  04:38:17 STEP  305 H= 305:00 +CPU= 51.580
  04:39:43 STEP  306 H= 306:00 +CPU= 84.921
  04:40:36 STEP  307 H= 307:00 +CPU= 51.486
  04:41:30 STEP  308 H= 308:00 +CPU= 52.890
  04:42:54 STEP  309 H= 309:00 +CPU= 83.270
  04:43:48 STEP  310 H= 310:00 +CPU= 52.921
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  05:31:53 STEP  311 H= 311:00 +CPU= 53.299
  05:33:32 STEP  312 H= 312:00 +CPU= 95.686
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000300
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_12.zip
Uploading the intermediate file: upload_file_12.zip
  05:34:25 STEP  313 H= 313:00 +CPU= 51.449
  05:35:18 STEP  314 H= 314:00 +CPU= 52.904
  05:36:43 STEP  315 H= 315:00 +CPU= 83.192
  05:37:37 STEP  316 H= 316:00 +CPU= 52.967
  05:38:29 STEP  317 H= 317:00 +CPU= 51.578
  05:39:56 STEP  318 H= 318:00 +CPU= 85.028
  05:40:49 STEP  319 H= 319:00 +CPU= 51.616
  05:41:43 STEP  320 H= 320:00 +CPU= 53.066
  05:43:08 STEP  321 H= 321:00 +CPU= 83.567
  05:44:02 STEP  322 H= 322:00 +CPU= 53.008
  05:44:54 STEP  323 H= 323:00 +CPU= 51.564
  05:46:28 STEP  324 H= 324:00 +CPU= 92.397
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000324
  05:47:20 STEP  325 H= 325:00 +CPU= 51.603
  05:48:15 STEP  326 H= 326:00 +CPU= 53.023
  05:49:40 STEP  327 H= 327:00 +CPU= 83.230
  05:50:34 STEP  328 H= 328:00 +CPU= 52.960
  05:51:27 STEP  329 H= 329:00 +CPU= 51.556
  05:52:54 STEP  330 H= 330:00 +CPU= 85.079
  05:53:46 STEP  331 H= 331:00 +CPU= 51.480
  05:54:40 STEP  332 H= 332:00 +CPU= 52.914
  05:56:05 STEP  333 H= 333:00 +CPU= 83.308
  05:56:59 STEP  334 H= 334:00 +CPU= 52.895
  05:57:53 STEP  335 H= 335:00 +CPU= 53.208
  05:59:31 STEP  336 H= 336:00 +CPU= 95.850
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000324
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_13.zip
Uploading the intermediate file: upload_file_13.zip
  06:00:23 STEP  337 H= 337:00 +CPU= 51.404
  06:01:17 STEP  338 H= 338:00 +CPU= 52.893
  06:02:42 STEP  339 H= 339:00 +CPU= 83.208
  06:03:36 STEP  340 H= 340:00 +CPU= 52.985
  06:04:28 STEP  341 H= 341:00 +CPU= 51.534
  06:05:56 STEP  342 H= 342:00 +CPU= 85.018
  06:06:48 STEP  343 H= 343:00 +CPU= 51.610
  06:07:43 STEP  344 H= 344:00 +CPU= 53.092
  06:09:08 STEP  345 H= 345:00 +CPU= 83.498
  06:10:02 STEP  346 H= 346:00 +CPU= 52.941
  06:10:55 STEP  347 H= 347:00 +CPU= 51.585
  06:12:28 STEP  348 H= 348:00 +CPU= 92.261
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000348
  06:13:20 STEP  349 H= 349:00 +CPU= 51.593
  06:14:14 STEP  350 H= 350:00 +CPU= 53.047
  06:15:39 STEP  351 H= 351:00 +CPU= 83.281
  06:16:32 STEP  352 H= 352:00 +CPU= 52.950
  06:17:25 STEP  353 H= 353:00 +CPU= 51.556
  06:18:52 STEP  354 H= 354:00 +CPU= 84.965
  06:19:45 STEP  355 H= 355:00 +CPU= 51.508
  06:20:39 STEP  356 H= 356:00 +CPU= 52.938
  06:22:03 STEP  357 H= 357:00 +CPU= 83.232
  06:22:57 STEP  358 H= 358:00 +CPU= 52.912
  06:23:51 STEP  359 H= 359:00 +CPU= 53.199
  06:25:30 STEP  360 H= 360:00 +CPU= 95.896
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000360
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000360
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000348
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_14.zip
Uploading the intermediate file: upload_file_14.zip
  06:26:23 STEP  361 H= 361:00 +CPU= 51.524
  06:27:16 STEP  362 H= 362:00 +CPU= 52.846
  06:28:40 STEP  363 H= 363:00 +CPU= 83.045
  06:29:34 STEP  364 H= 364:00 +CPU= 52.918
  06:30:27 STEP  365 H= 365:00 +CPU= 51.464
  06:31:54 STEP  366 H= 366:00 +CPU= 84.948
  06:32:47 STEP  367 H= 367:00 +CPU= 51.580
  06:33:41 STEP  368 H= 368:00 +CPU= 53.058
  06:35:05 STEP  369 H= 369:00 +CPU= 83.326
  06:35:59 STEP  370 H= 370:00 +CPU= 53.050
  06:36:51 STEP  371 H= 371:00 +CPU= 51.582
  06:38:26 STEP  372 H= 372:00 +CPU= 92.468
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000372
  06:39:19 STEP  373 H= 373:00 +CPU= 51.642
  06:40:12 STEP  374 H= 374:00 +CPU= 53.073
  06:41:38 STEP  375 H= 375:00 +CPU= 83.332
  06:42:31 STEP  376 H= 376:00 +CPU= 52.987
  06:43:23 STEP  377 H= 377:00 +CPU= 51.534
  06:44:49 STEP  378 H= 378:00 +CPU= 84.895
  06:45:42 STEP  379 H= 379:00 +CPU= 51.495
  06:46:35 STEP  380 H= 380:00 +CPU= 52.963
  06:48:00 STEP  381 H= 381:00 +CPU= 83.233
  06:48:54 STEP  382 H= 382:00 +CPU= 52.936
  06:49:48 STEP  383 H= 383:00 +CPU= 53.341
  06:51:27 STEP  384 H= 384:00 +CPU= 95.970
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_15.zip
Uploading the intermediate file: upload_file_15.zip
  06:52:21 STEP  385 H= 385:00 +CPU= 51.481
  06:53:15 STEP  386 H= 386:00 +CPU= 53.063
  06:54:41 STEP  387 H= 387:00 +CPU= 83.471
  06:55:35 STEP  388 H= 388:00 +CPU= 53.027
  06:56:28 STEP  389 H= 389:00 +CPU= 51.656
  06:57:55 STEP  390 H= 390:00 +CPU= 85.162
  06:58:48 STEP  391 H= 391:00 +CPU= 51.632
  06:59:41 STEP  392 H= 392:00 +CPU= 53.033
  07:01:05 STEP  393 H= 393:00 +CPU= 83.461
  07:02:00 STEP  394 H= 394:00 +CPU= 53.091
  07:02:52 STEP  395 H= 395:00 +CPU= 51.623
  07:04:27 STEP  396 H= 396:00 +CPU= 92.511
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000396
  07:05:20 STEP  397 H= 397:00 +CPU= 51.582
  07:06:15 STEP  398 H= 398:00 +CPU= 53.052
  07:07:39 STEP  399 H= 399:00 +CPU= 83.308
  07:08:33 STEP  400 H= 400:00 +CPU= 52.931
  07:09:25 STEP  401 H= 401:00 +CPU= 51.458
  07:10:51 STEP  402 H= 402:00 +CPU= 85.038
  07:11:44 STEP  403 H= 403:00 +CPU= 51.481
  07:12:38 STEP  404 H= 404:00 +CPU= 52.936
  07:14:02 STEP  405 H= 405:00 +CPU= 83.314
  07:14:55 STEP  406 H= 406:00 +CPU= 52.826
  07:15:50 STEP  407 H= 407:00 +CPU= 53.190
  07:17:28 STEP  408 H= 408:00 +CPU= 95.731
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_16.zip
Uploading the intermediate file: upload_file_16.zip
  07:18:21 STEP  409 H= 409:00 +CPU= 51.385
  07:19:15 STEP  410 H= 410:00 +CPU= 52.854
  07:20:40 STEP  411 H= 411:00 +CPU= 83.274
  07:21:34 STEP  412 H= 412:00 +CPU= 52.931
  07:22:26 STEP  413 H= 413:00 +CPU= 51.330
  07:23:51 STEP  414 H= 414:00 +CPU= 84.980
  07:24:45 STEP  415 H= 415:00 +CPU= 51.639
  07:25:39 STEP  416 H= 416:00 +CPU= 53.011
  07:27:04 STEP  417 H= 417:00 +CPU= 83.471
  07:27:58 STEP  418 H= 418:00 +CPU= 52.970
  07:28:51 STEP  419 H= 419:00 +CPU= 51.494
  07:30:24 STEP  420 H= 420:00 +CPU= 92.489
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000420
  07:31:16 STEP  421 H= 421:00 +CPU= 51.553
  07:32:09 STEP  422 H= 422:00 +CPU= 53.150
  07:33:34 STEP  423 H= 423:00 +CPU= 83.320
  07:34:29 STEP  424 H= 424:00 +CPU= 52.975
  07:35:21 STEP  425 H= 425:00 +CPU= 51.493
  07:36:47 STEP  426 H= 426:00 +CPU= 84.889
  07:37:40 STEP  427 H= 427:00 +CPU= 51.455
  07:38:33 STEP  428 H= 428:00 +CPU= 52.888
  07:39:58 STEP  429 H= 429:00 +CPU= 83.327
  07:40:52 STEP  430 H= 430:00 +CPU= 52.848
  07:41:47 STEP  431 H= 431:00 +CPU= 53.205
  07:43:26 STEP  432 H= 432:00 +CPU= 96.012
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_17.zip
Uploading the intermediate file: upload_file_17.zip
  07:44:19 STEP  433 H= 433:00 +CPU= 51.479
  07:45:12 STEP  434 H= 434:00 +CPU= 52.866
  07:46:37 STEP  435 H= 435:00 +CPU= 83.325
  07:47:32 STEP  436 H= 436:00 +CPU= 52.923
  07:48:24 STEP  437 H= 437:00 +CPU= 51.550
  07:49:51 STEP  438 H= 438:00 +CPU= 85.123
  07:50:43 STEP  439 H= 439:00 +CPU= 51.629
  07:51:38 STEP  440 H= 440:00 +CPU= 53.100
  07:53:02 STEP  441 H= 441:00 +CPU= 83.567
  07:53:56 STEP  442 H= 442:00 +CPU= 53.041
  07:54:49 STEP  443 H= 443:00 +CPU= 51.657
  07:56:23 STEP  444 H= 444:00 +CPU= 92.583
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000444
  07:57:15 STEP  445 H= 445:00 +CPU= 51.612
  07:58:09 STEP  446 H= 446:00 +CPU= 53.228
  07:59:34 STEP  447 H= 447:00 +CPU= 83.559
  08:00:28 STEP  448 H= 448:00 +CPU= 53.017
  08:01:21 STEP  449 H= 449:00 +CPU= 51.652
  08:02:47 STEP  450 H= 450:00 +CPU= 85.012
  08:03:39 STEP  451 H= 451:00 +CPU= 51.545
  08:04:34 STEP  452 H= 452:00 +CPU= 52.895
  08:05:58 STEP  453 H= 453:00 +CPU= 83.377
  08:06:52 STEP  454 H= 454:00 +CPU= 52.955
  08:07:47 STEP  455 H= 455:00 +CPU= 53.191
  08:09:26 STEP  456 H= 456:00 +CPU= 95.906
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_18.zip
Uploading the intermediate file: upload_file_18.zip
  08:10:18 STEP  457 H= 457:00 +CPU= 51.431
  08:11:12 STEP  458 H= 458:00 +CPU= 52.915
  08:12:39 STEP  459 H= 459:00 +CPU= 84.969
  08:13:33 STEP  460 H= 460:00 +CPU= 53.072
  08:14:26 STEP  461 H= 461:00 +CPU= 52.056
  08:15:53 STEP  462 H= 462:00 +CPU= 85.765
  08:16:46 STEP  463 H= 463:00 +CPU= 52.160
  08:17:41 STEP  464 H= 464:00 +CPU= 53.469
  08:19:08 STEP  465 H= 465:00 +CPU= 84.506
  08:20:02 STEP  466 H= 466:00 +CPU= 53.199
  08:20:54 STEP  467 H= 467:00 +CPU= 51.847
  08:22:29 STEP  468 H= 468:00 +CPU= 93.552
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000468
  08:23:23 STEP  469 H= 469:00 +CPU= 52.070
  08:24:18 STEP  470 H= 470:00 +CPU= 53.615
  08:25:43 STEP  471 H= 471:00 +CPU= 84.175
  08:26:37 STEP  472 H= 472:00 +CPU= 53.438
  08:27:30 STEP  473 H= 473:00 +CPU= 52.163
  08:28:58 STEP  474 H= 474:00 +CPU= 86.019
  08:29:51 STEP  475 H= 475:00 +CPU= 52.112
  08:30:46 STEP  476 H= 476:00 +CPU= 53.180
  08:32:11 STEP  477 H= 477:00 +CPU= 84.004
  08:33:05 STEP  478 H= 478:00 +CPU= 53.306
  08:33:59 STEP  479 H= 479:00 +CPU= 53.493
  08:35:38 STEP  480 H= 480:00 +CPU= 96.567
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_19.zip
Uploading the intermediate file: upload_file_19.zip
Uploading trickle at timestep: 1728000
  08:36:31 STEP  481 H= 481:00 +CPU= 52.201
  08:37:26 STEP  482 H= 482:00 +CPU= 53.713
  08:38:52 STEP  483 H= 483:00 +CPU= 84.850
  08:39:47 STEP  484 H= 484:00 +CPU= 53.007
  08:40:39 STEP  485 H= 485:00 +CPU= 51.649
  08:42:06 STEP  486 H= 486:00 +CPU= 85.953
  08:42:58 STEP  487 H= 487:00 +CPU= 51.642
  08:43:51 STEP  488 H= 488:00 +CPU= 52.881
  08:45:14 STEP  489 H= 489:00 +CPU= 83.644
  08:46:11 STEP  490 H= 490:00 +CPU= 54.573
  08:47:06 STEP  491 H= 491:00 +CPU= 53.992
  08:48:49 STEP  492 H= 492:00 +CPU= 99.889
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000492
  08:49:41 STEP  493 H= 493:00 +CPU= 51.379
  08:50:36 STEP  494 H= 494:00 +CPU= 55.189
  08:52:05 STEP  495 H= 495:00 +CPU= 87.744
  08:53:01 STEP  496 H= 496:00 +CPU= 56.243
  08:53:57 STEP  497 H= 497:00 +CPU= 54.937
  08:55:24 STEP  498 H= 498:00 +CPU= 85.835
  08:56:20 STEP  499 H= 499:00 +CPU= 55.202
  08:57:13 STEP  500 H= 500:00 +CPU= 52.937
  08:58:38 STEP  501 H= 501:00 +CPU= 83.800
  08:59:36 STEP  502 H= 502:00 +CPU= 56.685
  09:00:33 STEP  503 H= 503:00 +CPU= 55.248
  09:02:12 STEP  504 H= 504:00 +CPU= 97.312
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_20.zip
Uploading the intermediate file: upload_file_20.zip
  09:03:06 STEP  505 H= 505:00 +CPU= 52.666
  09:04:00 STEP  506 H= 506:00 +CPU= 52.948
  09:05:25 STEP  507 H= 507:00 +CPU= 82.795
  09:06:19 STEP  508 H= 508:00 +CPU= 53.113
  09:07:12 STEP  509 H= 509:00 +CPU= 52.343
  09:08:41 STEP  510 H= 510:00 +CPU= 86.931
  09:09:34 STEP  511 H= 511:00 +CPU= 52.055
  09:10:28 STEP  512 H= 512:00 +CPU= 53.381
  09:11:55 STEP  513 H= 513:00 +CPU= 85.562
  09:12:50 STEP  514 H= 514:00 +CPU= 54.462
  09:13:43 STEP  515 H= 515:00 +CPU= 52.186
  09:15:19 STEP  516 H= 516:00 +CPU= 95.516
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000516
  09:16:15 STEP  517 H= 517:00 +CPU= 54.665
  09:17:13 STEP  518 H= 518:00 +CPU= 56.381
  09:18:38 STEP  519 H= 519:00 +CPU= 84.399
  09:19:33 STEP  520 H= 520:00 +CPU= 54.500
  09:20:30 STEP  521 H= 521:00 +CPU= 55.343
  09:21:59 STEP  522 H= 522:00 +CPU= 86.898
  09:22:52 STEP  523 H= 523:00 +CPU= 51.835
  09:23:46 STEP  524 H= 524:00 +CPU= 53.457
  09:25:12 STEP  525 H= 525:00 +CPU= 84.487
  09:26:07 STEP  526 H= 526:00 +CPU= 54.842
  09:27:05 STEP  527 H= 527:00 +CPU= 57.139
  09:28:49 STEP  528 H= 528:00 +CPU=101.453
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_21.zip
Uploading the intermediate file: upload_file_21.zip
  09:29:42 STEP  529 H= 529:00 +CPU= 51.747
  09:30:38 STEP  530 H= 530:00 +CPU= 54.487
  09:32:06 STEP  531 H= 531:00 +CPU= 86.615
  09:33:03 STEP  532 H= 532:00 +CPU= 56.287
  09:33:56 STEP  533 H= 533:00 +CPU= 51.845
  09:35:22 STEP  534 H= 534:00 +CPU= 85.579
  09:36:16 STEP  535 H= 535:00 +CPU= 51.964
  09:37:11 STEP  536 H= 536:00 +CPU= 53.920
  09:38:38 STEP  537 H= 537:00 +CPU= 86.268
  09:39:34 STEP  538 H= 538:00 +CPU= 55.019
  09:40:27 STEP  539 H= 539:00 +CPU= 51.986
  09:42:02 STEP  540 H= 540:00 +CPU= 93.103
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000540
  09:42:55 STEP  541 H= 541:00 +CPU= 52.342
  09:43:50 STEP  542 H= 542:00 +CPU= 53.496
  09:45:18 STEP  543 H= 543:00 +CPU= 86.863
  09:46:14 STEP  544 H= 544:00 +CPU= 54.232
  09:47:09 STEP  545 H= 545:00 +CPU= 54.217
  09:48:38 STEP  546 H= 546:00 +CPU= 87.261
  09:49:30 STEP  547 H= 547:00 +CPU= 51.830
  09:50:26 STEP  548 H= 548:00 +CPU= 55.654
  09:51:53 STEP  549 H= 549:00 +CPU= 86.380
  09:52:46 STEP  550 H= 550:00 +CPU= 53.198
  09:53:40 STEP  551 H= 551:00 +CPU= 53.559
  09:55:23 STEP  552 H= 552:00 +CPU=101.398
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000540
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_22.zip
Uploading the intermediate file: upload_file_22.zip
  09:56:18 STEP  553 H= 553:00 +CPU= 53.261
  09:57:13 STEP  554 H= 554:00 +CPU= 54.002
  09:58:40 STEP  555 H= 555:00 +CPU= 86.039
  09:59:36 STEP  556 H= 556:00 +CPU= 55.061
  10:00:32 STEP  557 H= 557:00 +CPU= 55.741
  10:02:02 STEP  558 H= 558:00 +CPU= 87.718
  10:02:54 STEP  559 H= 559:00 +CPU= 52.169
  10:03:52 STEP  560 H= 560:00 +CPU= 56.269
  10:05:19 STEP  561 H= 561:00 +CPU= 85.429
  10:06:17 STEP  562 H= 562:00 +CPU= 56.579
  10:07:11 STEP  563 H= 563:00 +CPU= 53.045
  10:08:48 STEP  564 H= 564:00 +CPU= 96.198
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000564
  10:09:41 STEP  565 H= 565:00 +CPU= 51.946
  10:10:38 STEP  566 H= 566:00 +CPU= 55.013
  10:12:04 STEP  567 H= 567:00 +CPU= 85.538
  10:12:58 STEP  568 H= 568:00 +CPU= 53.654
  10:13:52 STEP  569 H= 569:00 +CPU= 53.366
  10:15:22 STEP  570 H= 570:00 +CPU= 87.386
  10:16:14 STEP  571 H= 571:00 +CPU= 51.751
  10:17:11 STEP  572 H= 572:00 +CPU= 56.449
  10:18:38 STEP  573 H= 573:00 +CPU= 86.002
  10:19:36 STEP  574 H= 574:00 +CPU= 56.295
  10:20:33 STEP  575 H= 575:00 +CPU= 56.075
  10:22:14 STEP  576 H= 576:00 +CPU= 98.475
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_23.zip
Uploading the intermediate file: upload_file_23.zip
  10:23:09 STEP  577 H= 577:00 +CPU= 53.575
  10:24:03 STEP  578 H= 578:00 +CPU= 53.233
  10:25:29 STEP  579 H= 579:00 +CPU= 85.762
  10:26:27 STEP  580 H= 580:00 +CPU= 56.573
  10:27:20 STEP  581 H= 581:00 +CPU= 53.268
  10:28:48 STEP  582 H= 582:00 +CPU= 87.214
  10:29:42 STEP  583 H= 583:00 +CPU= 52.980
  10:30:38 STEP  584 H= 584:00 +CPU= 55.193
  10:32:06 STEP  585 H= 585:00 +CPU= 86.316
  10:33:03 STEP  586 H= 586:00 +CPU= 55.477
  10:33:56 STEP  587 H= 587:00 +CPU= 52.612
  10:35:32 STEP  588 H= 588:00 +CPU= 94.135
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000588
  10:36:25 STEP  589 H= 589:00 +CPU= 51.896
  10:37:20 STEP  590 H= 590:00 +CPU= 54.633
  10:38:45 STEP  591 H= 591:00 +CPU= 83.704
  10:39:40 STEP  592 H= 592:00 +CPU= 54.407
  10:40:32 STEP  593 H= 593:00 +CPU= 51.852
  10:41:57 STEP  594 H= 594:00 +CPU= 85.347
  10:42:51 STEP  595 H= 595:00 +CPU= 53.444
  10:43:44 STEP  596 H= 596:00 +CPU= 53.393
  10:45:11 STEP  597 H= 597:00 +CPU= 86.473
  10:46:08 STEP  598 H= 598:00 +CPU= 55.981
  10:47:03 STEP  599 H= 599:00 +CPU= 54.686
  10:48:45 STEP  600 H= 600:00 +CPU=101.257
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000588
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_24.zip
Uploading the intermediate file: upload_file_24.zip
  10:49:42 STEP  601 H= 601:00 +CPU= 55.309
  10:50:38 STEP  602 H= 602:00 +CPU= 54.318
  10:52:05 STEP  603 H= 603:00 +CPU= 85.033
  10:53:01 STEP  604 H= 604:00 +CPU= 55.596
  10:53:56 STEP  605 H= 605:00 +CPU= 53.262
  10:55:24 STEP  606 H= 606:00 +CPU= 87.156
  10:56:18 STEP  607 H= 607:00 +CPU= 53.261
  10:57:15 STEP  608 H= 608:00 +CPU= 56.260
  10:58:45 STEP  609 H= 609:00 +CPU= 88.729
  10:59:42 STEP  610 H= 610:00 +CPU= 55.577
  11:00:36 STEP  611 H= 611:00 +CPU= 53.505
  11:02:16 STEP  612 H= 612:00 +CPU= 97.476
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000612
  11:03:11 STEP  613 H= 613:00 +CPU= 53.847
  11:04:06 STEP  614 H= 614:00 +CPU= 54.845
  11:05:34 STEP  615 H= 615:00 +CPU= 86.729
  11:06:29 STEP  616 H= 616:00 +CPU= 53.350
  11:07:22 STEP  617 H= 617:00 +CPU= 53.011
  11:08:52 STEP  618 H= 618:00 +CPU= 88.735
  11:09:47 STEP  619 H= 619:00 +CPU= 53.655
  11:10:44 STEP  620 H= 620:00 +CPU= 56.119
  11:12:12 STEP  621 H= 621:00 +CPU= 86.936
  11:13:10 STEP  622 H= 622:00 +CPU= 57.058
  11:14:07 STEP  623 H= 623:00 +CPU= 55.645
  11:15:50 STEP  624 H= 624:00 +CPU=100.929
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000612
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_25.zip
Uploading the intermediate file: upload_file_25.zip
  11:16:46 STEP  625 H= 625:00 +CPU= 54.876
  11:17:40 STEP  626 H= 626:00 +CPU= 53.304
  11:19:08 STEP  627 H= 627:00 +CPU= 85.893
  11:20:05 STEP  628 H= 628:00 +CPU= 56.243
  11:21:00 STEP  629 H= 629:00 +CPU= 52.946
  11:22:30 STEP  630 H= 630:00 +CPU= 88.923
  11:23:23 STEP  631 H= 631:00 +CPU= 52.189
  11:24:17 STEP  632 H= 632:00 +CPU= 53.715
  11:25:45 STEP  633 H= 633:00 +CPU= 85.960
  11:26:39 STEP  634 H= 634:00 +CPU= 54.170
  11:27:33 STEP  635 H= 635:00 +CPU= 52.534
  11:29:08 STEP  636 H= 636:00 +CPU= 93.807
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000636
  11:30:01 STEP  637 H= 637:00 +CPU= 52.448
  11:30:56 STEP  638 H= 638:00 +CPU= 53.734
  11:32:23 STEP  639 H= 639:00 +CPU= 85.507
  11:33:18 STEP  640 H= 640:00 +CPU= 55.306
  11:34:12 STEP  641 H= 641:00 +CPU= 51.973
  11:35:42 STEP  642 H= 642:00 +CPU= 89.128
  11:36:36 STEP  643 H= 643:00 +CPU= 52.778
  11:37:30 STEP  644 H= 644:00 +CPU= 53.245
  11:38:57 STEP  645 H= 645:00 +CPU= 84.220
  11:39:53 STEP  646 H= 646:00 +CPU= 54.955
  11:40:47 STEP  647 H= 647:00 +CPU= 53.534
  11:42:26 STEP  648 H= 648:00 +CPU= 96.834
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000636
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_26.zip
Uploading the intermediate file: upload_file_26.zip
  11:43:19 STEP  649 H= 649:00 +CPU= 52.350
  11:44:15 STEP  650 H= 650:00 +CPU= 54.801
  11:45:45 STEP  651 H= 651:00 +CPU= 89.369
  11:46:40 STEP  652 H= 652:00 +CPU= 53.589
  11:47:34 STEP  653 H= 653:00 +CPU= 53.251
  11:49:04 STEP  654 H= 654:00 +CPU= 88.382
  11:49:56 STEP  655 H= 655:00 +CPU= 51.899
  11:50:53 STEP  656 H= 656:00 +CPU= 55.473
  11:52:21 STEP  657 H= 657:00 +CPU= 87.666
  11:53:20 STEP  658 H= 658:00 +CPU= 58.058
  11:54:15 STEP  659 H= 659:00 +CPU= 53.920
  11:55:51 STEP  660 H= 660:00 +CPU= 93.796
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000660
  11:56:44 STEP  661 H= 661:00 +CPU= 52.824
  11:57:39 STEP  662 H= 662:00 +CPU= 54.188
  11:59:04 STEP  663 H= 663:00 +CPU= 83.835
  11:59:59 STEP  664 H= 664:00 +CPU= 54.046
  12:00:54 STEP  665 H= 665:00 +CPU= 54.548
  12:02:23 STEP  666 H= 666:00 +CPU= 87.003
  12:03:16 STEP  667 H= 667:00 +CPU= 52.857
  12:04:11 STEP  668 H= 668:00 +CPU= 53.866
  12:05:39 STEP  669 H= 669:00 +CPU= 86.336
  12:06:38 STEP  670 H= 670:00 +CPU= 58.250
  12:07:36 STEP  671 H= 671:00 +CPU= 57.981
  12:09:18 STEP  672 H= 672:00 +CPU= 98.768
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_27.zip
Uploading the intermediate file: upload_file_27.zip
  12:10:14 STEP  673 H= 673:00 +CPU= 54.030
  12:11:08 STEP  674 H= 674:00 +CPU= 53.344
  12:12:36 STEP  675 H= 675:00 +CPU= 86.891
  12:13:32 STEP  676 H= 676:00 +CPU= 55.275
  12:14:26 STEP  677 H= 677:00 +CPU= 52.458
  12:15:55 STEP  678 H= 678:00 +CPU= 87.441
  12:16:50 STEP  679 H= 679:00 +CPU= 54.310
  12:17:46 STEP  680 H= 680:00 +CPU= 54.857
  12:19:14 STEP  681 H= 681:00 +CPU= 86.762
  12:20:10 STEP  682 H= 682:00 +CPU= 55.139
  12:21:05 STEP  683 H= 683:00 +CPU= 53.457
  12:22:42 STEP  684 H= 684:00 +CPU= 94.774
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000684
  12:23:35 STEP  685 H= 685:00 +CPU= 52.033
  12:24:32 STEP  686 H= 686:00 +CPU= 56.447
  12:26:02 STEP  687 H= 687:00 +CPU= 89.051
  12:26:57 STEP  688 H= 688:00 +CPU= 54.763
  12:27:52 STEP  689 H= 689:00 +CPU= 54.649
  12:29:21 STEP  690 H= 690:00 +CPU= 86.792
  12:30:14 STEP  691 H= 691:00 +CPU= 52.779
  12:31:10 STEP  692 H= 692:00 +CPU= 54.751
  12:32:37 STEP  693 H= 693:00 +CPU= 85.718
  12:33:33 STEP  694 H= 694:00 +CPU= 55.450
  12:34:28 STEP  695 H= 695:00 +CPU= 54.545
  12:36:07 STEP  696 H= 696:00 +CPU= 97.840
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000696
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000684
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_28.zip
Uploading the intermediate file: upload_file_28.zip
  12:37:01 STEP  697 H= 697:00 +CPU= 51.876
  12:37:56 STEP  698 H= 698:00 +CPU= 53.936
  12:39:22 STEP  699 H= 699:00 +CPU= 84.648
  12:40:17 STEP  700 H= 700:00 +CPU= 53.774
  12:41:13 STEP  701 H= 701:00 +CPU= 54.301
  12:42:42 STEP  702 H= 702:00 +CPU= 87.920
  12:43:37 STEP  703 H= 703:00 +CPU= 54.071
  12:44:32 STEP  704 H= 704:00 +CPU= 54.532
  12:45:58 STEP  705 H= 705:00 +CPU= 84.262
  12:46:55 STEP  706 H= 706:00 +CPU= 56.531
  12:47:48 STEP  707 H= 707:00 +CPU= 51.915
  12:49:26 STEP  708 H= 708:00 +CPU= 97.067
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000708
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000708
  12:50:21 STEP  709 H= 709:00 +CPU= 53.253
  12:51:18 STEP  710 H= 710:00 +CPU= 56.583
  12:52:49 STEP  711 H= 711:00 +CPU= 89.869
  12:53:47 STEP  712 H= 712:00 +CPU= 57.489
  12:54:39 STEP  713 H= 713:00 +CPU= 51.831
  12:56:07 STEP  714 H= 714:00 +CPU= 87.229
  12:57:01 STEP  715 H= 715:00 +CPU= 53.338
  12:57:57 STEP  716 H= 716:00 +CPU= 55.278
  12:59:25 STEP  717 H= 717:00 +CPU= 86.970
  13:00:20 STEP  718 H= 718:00 +CPU= 54.308
  13:01:14 STEP  719 H= 719:00 +CPU= 53.604
  13:02:56 STEP  720 H= 720:00 +CPU= 99.077
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000720
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000708
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_29.zip
Uploading the intermediate file: upload_file_29.zip
Uploading trickle at timestep: 2592000
  13:03:50 STEP  721 H= 721:00 +CPU= 53.397
  13:04:46 STEP  722 H= 722:00 +CPU= 54.718
  13:06:15 STEP  723 H= 723:00 +CPU= 87.828
  13:07:12 STEP  724 H= 724:00 +CPU= 55.277
  13:08:08 STEP  725 H= 725:00 +CPU= 55.496
  13:09:38 STEP  726 H= 726:00 +CPU= 87.899
  13:10:32 STEP  727 H= 727:00 +CPU= 53.454
  13:11:32 STEP  728 H= 728:00 +CPU= 57.909
  13:13:02 STEP  729 H= 729:00 +CPU= 88.312
  13:13:58 STEP  730 H= 730:00 +CPU= 55.223
  13:14:51 STEP  731 H= 731:00 +CPU= 52.115
  13:16:28 STEP  732 H= 732:00 +CPU= 94.373
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000732
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000732
  13:17:23 STEP  733 H= 733:00 +CPU= 53.997
  13:18:20 STEP  734 H= 734:00 +CPU= 55.831
  13:19:46 STEP  735 H= 735:00 +CPU= 85.150
  13:20:41 STEP  736 H= 736:00 +CPU= 53.882
  13:21:38 STEP  737 H= 737:00 +CPU= 54.944
  13:23:11 STEP  738 H= 738:00 +CPU= 91.960
  13:24:05 STEP  739 H= 739:00 +CPU= 53.431
  13:25:03 STEP  740 H= 740:00 +CPU= 56.490
  13:26:31 STEP  741 H= 741:00 +CPU= 87.717
  13:27:27 STEP  742 H= 742:00 +CPU= 54.822
  13:28:22 STEP  743 H= 743:00 +CPU= 53.567
  13:30:03 STEP  744 H= 744:00 +CPU= 99.498
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHhq0f+000744
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAhq0f+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMGGhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMSHhq0f+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12201988/ICMUAhq0f+000732
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0344_2016050100_123_985_12201988_1_r686848174_30.zip
Uploading the intermediate file: upload_file_30.zip
  13:30:58 STEP  745 H= 745:00 +CPU= 53.275
  13:31:53 STEP  746 H= 746:00 +CPU= 54.583
  13:33:22 STEP  747 H= 747:00 +CPU= 86.829
  13:34:24 STEP  748 H= 748:00 +CPU= 59.326
  13:35:23 STEP  749 H= 749:00 +CPU= 57.338
forrtl: severe (41): insufficient virtual memory
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001D2B9CB  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000012BCFF6  radintg_                  935  radintg.F90
oifs_43r3_model.e  0000000001270124  raddrv_                   537  raddrv.F90
oifs_43r3_model.e  0000000000BFD839  gp_model_                 482  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:40:44 1519626 22302408 oifs_43r3_ps_0344_2016050100_123_985_12201988_1 2,592,000 46,818 0.0181
09 May 2023 16:40:25 1519626 22302408 oifs_43r3_ps_0344_2016050100_123_985_12201988_1 1,728,000 31,033 0.0180
09 May 2023 16:38:27 1519626 22302408 oifs_43r3_ps_0344_2016050100_123_985_12201988_1 864,000 15,717 0.0182


©2024 climateprediction.net