climateprediction.net home page
Task 22249959

Task 22249959

Name oifs_43r3_ps_1842_2021050100_123_946_12164931_1
Workunit 12164931
Created 10 Dec 2022, 14:12:37 UTC
Sent 10 Dec 2022, 14:12:44 UTC
Report deadline 9 Jan 2023, 14:12:44 UTC
Received 11 Dec 2022, 5:19:43 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 148 (0x00000094) Unknown error code
Computer ID 1459268
Run time 14 hours 1 min 50 sec
CPU time 11 hours 58 min 4 sec
Validate state Invalid
Credit 3,507.84
Device peak FLOPS 2.62 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.01
x86_64-pc-linux-gnu
Peak working set size 4,528.59 MB
Peak swap size 4,978.06 MB
Peak disk usage 2,391.14 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 148 (0x94, -108)</message>
<stderr_txt>
.842
  12:29:33 STEP  204 H= 204:00 +CPU= 94.508
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000204
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000204
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000204
  12:30:28 STEP  205 H= 205:00 +CPU= 54.017
  12:31:26 STEP  206 H= 206:00 +CPU= 56.509
  12:32:52 STEP  207 H= 207:00 +CPU= 85.458
  12:33:50 STEP  208 H= 208:00 +CPU= 56.811
  12:34:45 STEP  209 H= 209:00 +CPU= 54.703
  12:36:12 STEP  210 H= 210:00 +CPU= 85.610
  12:37:07 STEP  211 H= 211:00 +CPU= 54.795
  12:38:04 STEP  212 H= 212:00 +CPU= 55.551
  12:39:25 STEP  213 H= 213:00 +CPU= 80.860
  12:40:20 STEP  214 H= 214:00 +CPU= 53.977
  12:41:16 STEP  215 H= 215:00 +CPU= 55.490
  12:42:54 STEP  216 H= 216:00 +CPU= 97.423
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000216
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000216
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000204
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000204
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000204
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_5.zip
Uploading the intermediate file: upload_file_5.zip
Uploading trickle at timestep: 777600
  12:43:50 STEP  217 H= 217:00 +CPU= 55.013
  12:44:48 STEP  218 H= 218:00 +CPU= 56.223
  12:46:12 STEP  219 H= 219:00 +CPU= 83.191
  12:47:08 STEP  220 H= 220:00 +CPU= 55.560
  12:48:01 STEP  221 H= 221:00 +CPU= 52.435
  12:49:25 STEP  222 H= 222:00 +CPU= 83.997
  12:50:20 STEP  223 H= 223:00 +CPU= 53.983
  12:51:15 STEP  224 H= 224:00 +CPU= 54.256
  12:52:39 STEP  225 H= 225:00 +CPU= 83.198
  12:53:36 STEP  226 H= 226:00 +CPU= 55.499
  12:54:31 STEP  227 H= 227:00 +CPU= 54.465
  12:56:06 STEP  228 H= 228:00 +CPU= 92.642
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000228
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000228
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000228
  12:56:59 STEP  229 H= 229:00 +CPU= 53.184
  12:57:55 STEP  230 H= 230:00 +CPU= 54.950
  12:59:20 STEP  231 H= 231:00 +CPU= 84.820
  13:00:17 STEP  232 H= 232:00 +CPU= 56.346
  13:01:13 STEP  233 H= 233:00 +CPU= 55.209
  13:02:42 STEP  234 H= 234:00 +CPU= 86.478
  13:03:38 STEP  235 H= 235:00 +CPU= 55.610
  13:04:35 STEP  236 H= 236:00 +CPU= 55.939
  13:06:01 STEP  237 H= 237:00 +CPU= 85.298
  13:06:59 STEP  238 H= 238:00 +CPU= 57.130
  13:07:57 STEP  239 H= 239:00 +CPU= 57.133
  13:09:42 STEP  240 H= 240:00 +CPU=102.255
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000240
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000240
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000228
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000228
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000228
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_6.zip
Uploading the intermediate file: upload_file_6.zip
Uploading trickle at timestep: 864000
  13:10:39 STEP  241 H= 241:00 +CPU= 55.909
  13:11:37 STEP  242 H= 242:00 +CPU= 57.351
  13:13:06 STEP  243 H= 243:00 +CPU= 86.773
  13:14:03 STEP  244 H= 244:00 +CPU= 56.785
  13:15:01 STEP  245 H= 245:00 +CPU= 56.638
  13:16:31 STEP  246 H= 246:00 +CPU= 88.073
  13:17:28 STEP  247 H= 247:00 +CPU= 56.293
  13:18:26 STEP  248 H= 248:00 +CPU= 56.896
  13:19:54 STEP  249 H= 249:00 +CPU= 86.278
  13:20:52 STEP  250 H= 250:00 +CPU= 57.226
  13:21:49 STEP  251 H= 251:00 +CPU= 55.467
  13:23:27 STEP  252 H= 252:00 +CPU= 95.972
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000252
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000252
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000252
  13:24:25 STEP  253 H= 253:00 +CPU= 56.792
  13:25:24 STEP  254 H= 254:00 +CPU= 57.783
  13:26:53 STEP  255 H= 255:00 +CPU= 87.199
  13:27:51 STEP  256 H= 256:00 +CPU= 57.427
  13:28:48 STEP  257 H= 257:00 +CPU= 56.157
  13:30:18 STEP  258 H= 258:00 +CPU= 88.259
  13:31:15 STEP  259 H= 259:00 +CPU= 55.705
  13:32:12 STEP  260 H= 260:00 +CPU= 56.694
  13:33:39 STEP  261 H= 261:00 +CPU= 85.618
  13:34:35 STEP  262 H= 262:00 +CPU= 55.872
  13:35:32 STEP  263 H= 263:00 +CPU= 56.108
  13:37:14 STEP  264 H= 264:00 +CPU=100.889
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000264
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000264
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000252
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000252
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000252
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_7.zip
Uploading the intermediate file: upload_file_7.zip
Uploading trickle at timestep: 950400
  13:38:10 STEP  265 H= 265:00 +CPU= 55.511
  13:39:08 STEP  266 H= 266:00 +CPU= 57.006
  13:40:35 STEP  267 H= 267:00 +CPU= 85.957
  13:41:32 STEP  268 H= 268:00 +CPU= 56.442
  13:42:27 STEP  269 H= 269:00 +CPU= 54.656
  13:43:55 STEP  270 H= 270:00 +CPU= 87.048
  13:44:51 STEP  271 H= 271:00 +CPU= 55.357
  13:45:46 STEP  272 H= 272:00 +CPU= 55.066
  13:47:12 STEP  273 H= 273:00 +CPU= 85.036
  13:48:09 STEP  274 H= 274:00 +CPU= 56.790
  13:49:05 STEP  275 H= 275:00 +CPU= 54.590
  13:50:39 STEP  276 H= 276:00 +CPU= 92.811
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000276
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000276
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000276
  13:51:35 STEP  277 H= 277:00 +CPU= 54.629
  13:52:31 STEP  278 H= 278:00 +CPU= 55.218
  13:53:57 STEP  279 H= 279:00 +CPU= 84.065
  13:54:56 STEP  280 H= 280:00 +CPU= 57.270
  13:55:53 STEP  281 H= 281:00 +CPU= 54.488
  13:57:25 STEP  282 H= 282:00 +CPU= 86.427
  13:58:22 STEP  283 H= 283:00 +CPU= 55.564
  13:59:20 STEP  284 H= 284:00 +CPU= 57.569
  14:00:51 STEP  285 H= 285:00 +CPU= 88.034
  14:01:52 STEP  286 H= 286:00 +CPU= 58.069
  14:02:52 STEP  287 H= 287:00 +CPU= 58.306
  14:04:38 STEP  288 H= 288:00 +CPU=103.091
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000288
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000288
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000276
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000276
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000276
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_8.zip
Uploading the intermediate file: upload_file_8.zip
Uploading trickle at timestep: 1036800
  14:05:36 STEP  289 H= 289:00 +CPU= 56.522
  14:06:36 STEP  290 H= 290:00 +CPU= 58.263
  14:08:04 STEP  291 H= 291:00 +CPU= 86.332
  14:09:03 STEP  292 H= 292:00 +CPU= 56.615
  14:09:59 STEP  293 H= 293:00 +CPU= 55.882
  14:11:28 STEP  294 H= 294:00 +CPU= 87.228
  14:12:20 STEP  295 H= 295:00 +CPU= 51.396
  14:13:13 STEP  296 H= 296:00 +CPU= 52.623
  14:14:39 STEP  297 H= 297:00 +CPU= 84.599
  14:15:35 STEP  298 H= 298:00 +CPU= 55.128
  14:16:28 STEP  299 H= 299:00 +CPU= 52.543
  14:18:02 STEP  300 H= 300:00 +CPU= 93.362
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000300
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000300
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000300
  14:18:57 STEP  301 H= 301:00 +CPU= 54.457
  14:19:53 STEP  302 H= 302:00 +CPU= 55.544
  14:21:19 STEP  303 H= 303:00 +CPU= 84.626
  14:22:13 STEP  304 H= 304:00 +CPU= 54.061
  14:23:07 STEP  305 H= 305:00 +CPU= 53.111
  14:24:34 STEP  306 H= 306:00 +CPU= 85.538
  14:25:25 STEP  307 H= 307:00 +CPU= 51.056
  14:26:19 STEP  308 H= 308:00 +CPU= 53.978
  14:27:41 STEP  309 H= 309:00 +CPU= 80.693
  14:28:37 STEP  310 H= 310:00 +CPU= 55.968
  14:29:33 STEP  311 H= 311:00 +CPU= 54.785
  14:31:11 STEP  312 H= 312:00 +CPU= 97.166
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000312
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000312
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000300
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_9.zip
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 1123200
  14:32:02 STEP  313 H= 313:00 +CPU= 51.294
  14:32:58 STEP  314 H= 314:00 +CPU= 54.633
  14:34:22 STEP  315 H= 315:00 +CPU= 83.316
  14:35:18 STEP  316 H= 316:00 +CPU= 55.370
  14:36:13 STEP  317 H= 317:00 +CPU= 54.585
  14:37:38 STEP  318 H= 318:00 +CPU= 84.615
  14:38:30 STEP  319 H= 319:00 +CPU= 51.583
  14:39:25 STEP  320 H= 320:00 +CPU= 54.029
  14:40:48 STEP  321 H= 321:00 +CPU= 82.413
  14:41:43 STEP  322 H= 322:00 +CPU= 54.329
  14:42:37 STEP  323 H= 323:00 +CPU= 53.922
  14:44:08 STEP  324 H= 324:00 +CPU= 89.991
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000324
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000324
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000324
  14:45:00 STEP  325 H= 325:00 +CPU= 51.677
  14:45:56 STEP  326 H= 326:00 +CPU= 55.085
  14:47:20 STEP  327 H= 327:00 +CPU= 82.495
  14:48:17 STEP  328 H= 328:00 +CPU= 55.870
  14:49:11 STEP  329 H= 329:00 +CPU= 53.499
  14:50:38 STEP  330 H= 330:00 +CPU= 85.339
  14:51:33 STEP  331 H= 331:00 +CPU= 54.410
  14:52:30 STEP  332 H= 332:00 +CPU= 56.461
  14:53:56 STEP  333 H= 333:00 +CPU= 84.612
  14:54:51 STEP  334 H= 334:00 +CPU= 53.226
  14:55:47 STEP  335 H= 335:00 +CPU= 55.290
  14:57:29 STEP  336 H= 336:00 +CPU= 99.576
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000336
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000336
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000324
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_10.zip
Uploading the intermediate file: upload_file_10.zip
Uploading trickle at timestep: 1209600
  14:58:25 STEP  337 H= 337:00 +CPU= 55.134
  14:59:21 STEP  338 H= 338:00 +CPU= 54.878
  15:00:47 STEP  339 H= 339:00 +CPU= 84.462
  15:01:42 STEP  340 H= 340:00 +CPU= 54.374
  15:02:36 STEP  341 H= 341:00 +CPU= 53.256
  15:04:00 STEP  342 H= 342:00 +CPU= 82.997
  15:04:56 STEP  343 H= 343:00 +CPU= 54.900
  15:05:54 STEP  344 H= 344:00 +CPU= 56.412
  15:07:17 STEP  345 H= 345:00 +CPU= 81.671
  15:08:14 STEP  346 H= 346:00 +CPU= 55.528
  15:09:09 STEP  347 H= 347:00 +CPU= 54.581
  15:10:44 STEP  348 H= 348:00 +CPU= 93.761
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000348
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000348
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000348
  15:11:39 STEP  349 H= 349:00 +CPU= 54.875
  15:12:36 STEP  350 H= 350:00 +CPU= 55.078
  15:14:00 STEP  351 H= 351:00 +CPU= 83.244
  15:14:55 STEP  352 H= 352:00 +CPU= 55.068
  15:15:50 STEP  353 H= 353:00 +CPU= 54.237
  15:17:18 STEP  354 H= 354:00 +CPU= 86.569
  15:18:13 STEP  355 H= 355:00 +CPU= 53.540
  15:19:09 STEP  356 H= 356:00 +CPU= 55.640
  15:20:34 STEP  357 H= 357:00 +CPU= 83.959
  15:21:30 STEP  358 H= 358:00 +CPU= 54.811
  15:22:25 STEP  359 H= 359:00 +CPU= 54.968
  15:24:06 STEP  360 H= 360:00 +CPU= 99.221
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000360
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000360
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000348
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_11.zip
Uploading the intermediate file: upload_file_11.zip
Uploading trickle at timestep: 1296000
  15:25:01 STEP  361 H= 361:00 +CPU= 54.836
  15:25:58 STEP  362 H= 362:00 +CPU= 55.975
  15:27:23 STEP  363 H= 363:00 +CPU= 83.979
  15:28:20 STEP  364 H= 364:00 +CPU= 56.046
  15:29:15 STEP  365 H= 365:00 +CPU= 53.984
  15:30:42 STEP  366 H= 366:00 +CPU= 84.793
  15:31:38 STEP  367 H= 367:00 +CPU= 54.994
  15:32:34 STEP  368 H= 368:00 +CPU= 55.678
  15:33:59 STEP  369 H= 369:00 +CPU= 83.661
  15:34:56 STEP  370 H= 370:00 +CPU= 55.932
  15:35:50 STEP  371 H= 371:00 +CPU= 53.826
  15:37:24 STEP  372 H= 372:00 +CPU= 92.546
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000372
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000372
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000372
  15:38:17 STEP  373 H= 373:00 +CPU= 52.404
  15:39:14 STEP  374 H= 374:00 +CPU= 55.883
  15:40:39 STEP  375 H= 375:00 +CPU= 84.310
  15:41:35 STEP  376 H= 376:00 +CPU= 55.172
  15:42:30 STEP  377 H= 377:00 +CPU= 54.178
  15:43:55 STEP  378 H= 378:00 +CPU= 84.298
  15:44:49 STEP  379 H= 379:00 +CPU= 54.298
  15:45:46 STEP  380 H= 380:00 +CPU= 55.777
  15:47:11 STEP  381 H= 381:00 +CPU= 83.746
  15:48:08 STEP  382 H= 382:00 +CPU= 55.765
  15:49:04 STEP  383 H= 383:00 +CPU= 54.538
  15:50:43 STEP  384 H= 384:00 +CPU= 97.459
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000384
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000384
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_12.zip
Uploading the intermediate file: upload_file_12.zip
Uploading trickle at timestep: 1382400
  15:51:39 STEP  385 H= 385:00 +CPU= 54.298
  15:52:34 STEP  386 H= 386:00 +CPU= 54.032
  15:53:55 STEP  387 H= 387:00 +CPU= 79.924
  15:54:51 STEP  388 H= 388:00 +CPU= 54.885
  15:55:44 STEP  389 H= 389:00 +CPU= 52.334
  15:57:09 STEP  390 H= 390:00 +CPU= 83.033
  15:58:01 STEP  391 H= 391:00 +CPU= 51.055
  15:58:57 STEP  392 H= 392:00 +CPU= 54.803
  16:00:22 STEP  393 H= 393:00 +CPU= 83.510
  16:01:16 STEP  394 H= 394:00 +CPU= 54.052
  16:02:10 STEP  395 H= 395:00 +CPU= 53.422
  16:03:45 STEP  396 H= 396:00 +CPU= 93.619
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000396
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000396
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000396
  16:04:40 STEP  397 H= 397:00 +CPU= 53.702
  16:05:35 STEP  398 H= 398:00 +CPU= 54.719
  16:07:00 STEP  399 H= 399:00 +CPU= 84.247
  16:07:57 STEP  400 H= 400:00 +CPU= 55.768
  16:08:51 STEP  401 H= 401:00 +CPU= 54.022
  16:10:19 STEP  402 H= 402:00 +CPU= 85.702
  16:11:12 STEP  403 H= 403:00 +CPU= 52.917
  16:12:09 STEP  404 H= 404:00 +CPU= 55.823
  16:13:35 STEP  405 H= 405:00 +CPU= 84.780
  16:14:32 STEP  406 H= 406:00 +CPU= 56.026
  16:15:28 STEP  407 H= 407:00 +CPU= 55.324
  16:17:08 STEP  408 H= 408:00 +CPU= 99.411
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000408
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000408
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_13.zip
Uploading the intermediate file: upload_file_13.zip
Uploading trickle at timestep: 1468800
  16:18:04 STEP  409 H= 409:00 +CPU= 55.015
  16:19:01 STEP  410 H= 410:00 +CPU= 55.842
  16:20:27 STEP  411 H= 411:00 +CPU= 85.456
  16:21:25 STEP  412 H= 412:00 +CPU= 56.663
  16:22:20 STEP  413 H= 413:00 +CPU= 53.991
  16:23:47 STEP  414 H= 414:00 +CPU= 86.086
  16:24:42 STEP  415 H= 415:00 +CPU= 54.445
  16:25:39 STEP  416 H= 416:00 +CPU= 56.480
  16:27:05 STEP  417 H= 417:00 +CPU= 85.351
  16:28:02 STEP  418 H= 418:00 +CPU= 55.852
  16:28:56 STEP  419 H= 419:00 +CPU= 53.510
  16:30:30 STEP  420 H= 420:00 +CPU= 92.163
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000420
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000420
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000420
  16:31:24 STEP  421 H= 421:00 +CPU= 54.118
  16:32:20 STEP  422 H= 422:00 +CPU= 55.018
  16:33:45 STEP  423 H= 423:00 +CPU= 83.666
  16:34:40 STEP  424 H= 424:00 +CPU= 55.227
  16:35:35 STEP  425 H= 425:00 +CPU= 54.276
  16:37:02 STEP  426 H= 426:00 +CPU= 86.196
  16:37:58 STEP  427 H= 427:00 +CPU= 54.986
  16:38:55 STEP  428 H= 428:00 +CPU= 56.362
  16:40:21 STEP  429 H= 429:00 +CPU= 83.845
  16:41:18 STEP  430 H= 430:00 +CPU= 55.695
  16:42:14 STEP  431 H= 431:00 +CPU= 55.383
  16:43:54 STEP  432 H= 432:00 +CPU= 99.035
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000432
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000432
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_14.zip
Uploading the intermediate file: upload_file_14.zip
Uploading trickle at timestep: 1555200
  16:44:50 STEP  433 H= 433:00 +CPU= 55.083
  16:45:46 STEP  434 H= 434:00 +CPU= 55.331
  16:47:13 STEP  435 H= 435:00 +CPU= 85.359
  16:48:10 STEP  436 H= 436:00 +CPU= 56.240
  16:49:05 STEP  437 H= 437:00 +CPU= 54.588
  16:50:32 STEP  438 H= 438:00 +CPU= 86.489
  16:51:28 STEP  439 H= 439:00 +CPU= 54.601
  16:52:24 STEP  440 H= 440:00 +CPU= 55.474
  16:53:49 STEP  441 H= 441:00 +CPU= 83.512
  16:54:45 STEP  442 H= 442:00 +CPU= 54.695
  16:55:38 STEP  443 H= 443:00 +CPU= 52.707
  16:57:14 STEP  444 H= 444:00 +CPU= 91.410
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000444
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000444
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000444
  16:58:09 STEP  445 H= 445:00 +CPU= 52.780
  16:59:03 STEP  446 H= 446:00 +CPU= 53.344
  17:00:28 STEP  447 H= 447:00 +CPU= 84.788
  17:01:25 STEP  448 H= 448:00 +CPU= 55.787
  17:02:20 STEP  449 H= 449:00 +CPU= 54.639
  17:03:47 STEP  450 H= 450:00 +CPU= 85.855
  17:04:42 STEP  451 H= 451:00 +CPU= 54.497
  17:05:39 STEP  452 H= 452:00 +CPU= 56.011
  17:07:05 STEP  453 H= 453:00 +CPU= 84.910
  17:08:02 STEP  454 H= 454:00 +CPU= 56.053
  17:08:59 STEP  455 H= 455:00 +CPU= 56.223
  17:10:40 STEP  456 H= 456:00 +CPU=100.191
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000456
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000456
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_15.zip
Uploading the intermediate file: upload_file_15.zip
Uploading trickle at timestep: 1641600
  17:11:36 STEP  457 H= 457:00 +CPU= 55.162
  17:12:33 STEP  458 H= 458:00 +CPU= 56.624
  17:14:00 STEP  459 H= 459:00 +CPU= 85.688
  17:14:56 STEP  460 H= 460:00 +CPU= 55.560
  17:15:50 STEP  461 H= 461:00 +CPU= 54.108
  17:17:17 STEP  462 H= 462:00 +CPU= 86.436
  17:18:12 STEP  463 H= 463:00 +CPU= 54.527
  17:19:08 STEP  464 H= 464:00 +CPU= 55.241
  17:20:35 STEP  465 H= 465:00 +CPU= 85.024
  17:21:30 STEP  466 H= 466:00 +CPU= 54.680
  17:22:25 STEP  467 H= 467:00 +CPU= 54.522
  17:24:00 STEP  468 H= 468:00 +CPU= 94.106
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000468
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000468
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000468
  17:24:55 STEP  469 H= 469:00 +CPU= 53.704
  17:25:51 STEP  470 H= 470:00 +CPU= 55.733
  17:27:16 STEP  471 H= 471:00 +CPU= 84.081
  17:28:12 STEP  472 H= 472:00 +CPU= 55.392
  17:29:06 STEP  473 H= 473:00 +CPU= 52.880
  17:30:33 STEP  474 H= 474:00 +CPU= 85.834
  17:31:28 STEP  475 H= 475:00 +CPU= 54.633
  17:32:26 STEP  476 H= 476:00 +CPU= 56.236
  17:33:52 STEP  477 H= 477:00 +CPU= 84.816
  17:34:50 STEP  478 H= 478:00 +CPU= 57.298
  17:35:47 STEP  479 H= 479:00 +CPU= 56.157
  17:37:25 STEP  480 H= 480:00 +CPU= 97.597
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000480
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000480
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_16.zip
Uploading the intermediate file: upload_file_16.zip
Uploading trickle at timestep: 1728000
  17:38:17 STEP  481 H= 481:00 +CPU= 51.235
  17:39:12 STEP  482 H= 482:00 +CPU= 53.663
  17:40:38 STEP  483 H= 483:00 +CPU= 84.839
  17:41:35 STEP  484 H= 484:00 +CPU= 56.220
  17:42:31 STEP  485 H= 485:00 +CPU= 55.673
  17:44:01 STEP  486 H= 486:00 +CPU= 86.898
  17:44:57 STEP  487 H= 487:00 +CPU= 55.788
  17:45:54 STEP  488 H= 488:00 +CPU= 56.044
  17:47:20 STEP  489 H= 489:00 +CPU= 84.517
  17:48:17 STEP  490 H= 490:00 +CPU= 56.146
  17:49:12 STEP  491 H= 491:00 +CPU= 54.962
  17:50:48 STEP  492 H= 492:00 +CPU= 94.619
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000492
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000492
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000492
  17:51:44 STEP  493 H= 493:00 +CPU= 54.662
  17:52:41 STEP  494 H= 494:00 +CPU= 56.594
  17:54:07 STEP  495 H= 495:00 +CPU= 84.411
  17:55:03 STEP  496 H= 496:00 +CPU= 55.854
  17:56:00 STEP  497 H= 497:00 +CPU= 55.284
  17:57:29 STEP  498 H= 498:00 +CPU= 87.050
  17:58:26 STEP  499 H= 499:00 +CPU= 55.056
  17:59:22 STEP  500 H= 500:00 +CPU= 56.291
  18:00:56 STEP  501 H= 501:00 +CPU= 86.664
  18:01:57 STEP  502 H= 502:00 +CPU= 57.432
  18:02:57 STEP  503 H= 503:00 +CPU= 57.944
  18:04:42 STEP  504 H= 504:00 +CPU=102.333
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000504
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000504
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_17.zip
Uploading the intermediate file: upload_file_17.zip
Uploading trickle at timestep: 1814400
  18:05:42 STEP  505 H= 505:00 +CPU= 57.107
  18:06:41 STEP  506 H= 506:00 +CPU= 57.181
  18:08:11 STEP  507 H= 507:00 +CPU= 86.747
  18:09:11 STEP  508 H= 508:00 +CPU= 57.933
  18:10:10 STEP  509 H= 509:00 +CPU= 56.316
  18:11:41 STEP  510 H= 510:00 +CPU= 88.805
  18:12:39 STEP  511 H= 511:00 +CPU= 56.057
  18:13:38 STEP  512 H= 512:00 +CPU= 57.516
  18:15:09 STEP  513 H= 513:00 +CPU= 86.871
  18:16:09 STEP  514 H= 514:00 +CPU= 58.060
  18:17:07 STEP  515 H= 515:00 +CPU= 56.766
  18:18:46 STEP  516 H= 516:00 +CPU= 96.524
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000516
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000516
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000516
  18:19:42 STEP  517 H= 517:00 +CPU= 55.364
  18:20:39 STEP  518 H= 518:00 +CPU= 56.419
  18:22:04 STEP  519 H= 519:00 +CPU= 84.811
  18:23:01 STEP  520 H= 520:00 +CPU= 56.043
  18:23:57 STEP  521 H= 521:00 +CPU= 55.468
  18:25:25 STEP  522 H= 522:00 +CPU= 86.961
  18:26:21 STEP  523 H= 523:00 +CPU= 55.000
  18:27:20 STEP  524 H= 524:00 +CPU= 56.727
  18:28:46 STEP  525 H= 525:00 +CPU= 85.231
  18:29:42 STEP  526 H= 526:00 +CPU= 55.457
  18:30:41 STEP  527 H= 527:00 +CPU= 57.818
  18:32:27 STEP  528 H= 528:00 +CPU=103.273
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000528
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000528
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_18.zip
Uploading the intermediate file: upload_file_18.zip
Uploading trickle at timestep: 1900800
  18:33:24 STEP  529 H= 529:00 +CPU= 56.753
  18:34:24 STEP  530 H= 530:00 +CPU= 58.125
  18:35:53 STEP  531 H= 531:00 +CPU= 86.576
  18:36:53 STEP  532 H= 532:00 +CPU= 56.946
  18:37:49 STEP  533 H= 533:00 +CPU= 55.481
  18:39:20 STEP  534 H= 534:00 +CPU= 88.690
  18:40:18 STEP  535 H= 535:00 +CPU= 56.763
  18:41:18 STEP  536 H= 536:00 +CPU= 58.424
  18:42:44 STEP  537 H= 537:00 +CPU= 85.937
  18:43:42 STEP  538 H= 538:00 +CPU= 56.487
  18:44:37 STEP  539 H= 539:00 +CPU= 54.659
  18:46:12 STEP  540 H= 540:00 +CPU= 93.847
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000540
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000540
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000540
  18:47:07 STEP  541 H= 541:00 +CPU= 55.121
  18:48:03 STEP  542 H= 542:00 +CPU= 55.689
  18:49:29 STEP  543 H= 543:00 +CPU= 84.045
  18:50:24 STEP  544 H= 544:00 +CPU= 54.640
  18:51:20 STEP  545 H= 545:00 +CPU= 54.809
  18:52:47 STEP  546 H= 546:00 +CPU= 86.490
  18:53:42 STEP  547 H= 547:00 +CPU= 53.904
  18:54:36 STEP  548 H= 548:00 +CPU= 53.466
  18:55:57 STEP  549 H= 549:00 +CPU= 79.890
  18:56:52 STEP  550 H= 550:00 +CPU= 54.245
  18:57:48 STEP  551 H= 551:00 +CPU= 55.131
  18:59:24 STEP  552 H= 552:00 +CPU= 94.929
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000552
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000552
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000540
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_19.zip
Uploading the intermediate file: upload_file_19.zip
Uploading trickle at timestep: 1987200
  19:00:18 STEP  553 H= 553:00 +CPU= 52.847
  19:01:16 STEP  554 H= 554:00 +CPU= 56.791
  19:02:43 STEP  555 H= 555:00 +CPU= 84.399
  19:03:40 STEP  556 H= 556:00 +CPU= 56.365
  19:04:35 STEP  557 H= 557:00 +CPU= 54.465
  19:06:03 STEP  558 H= 558:00 +CPU= 86.462
  19:06:57 STEP  559 H= 559:00 +CPU= 53.264
  19:07:54 STEP  560 H= 560:00 +CPU= 55.715
  19:09:20 STEP  561 H= 561:00 +CPU= 84.264
  19:10:16 STEP  562 H= 562:00 +CPU= 55.601
  19:11:11 STEP  563 H= 563:00 +CPU= 54.534
  19:12:46 STEP  564 H= 564:00 +CPU= 93.946
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000564
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000564
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000564
  19:13:42 STEP  565 H= 565:00 +CPU= 54.891
  19:14:38 STEP  566 H= 566:00 +CPU= 56.080
  19:16:04 STEP  567 H= 567:00 +CPU= 84.741
  19:17:01 STEP  568 H= 568:00 +CPU= 56.175
  19:17:57 STEP  569 H= 569:00 +CPU= 55.366
  19:19:24 STEP  570 H= 570:00 +CPU= 86.792
  19:20:20 STEP  571 H= 571:00 +CPU= 54.688
  19:21:16 STEP  572 H= 572:00 +CPU= 55.808
  19:22:43 STEP  573 H= 573:00 +CPU= 85.508
  19:23:40 STEP  574 H= 574:00 +CPU= 56.315
  19:24:37 STEP  575 H= 575:00 +CPU= 56.208
  19:26:19 STEP  576 H= 576:00 +CPU=100.022
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000576
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000576
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_20.zip
Uploading the intermediate file: upload_file_20.zip
Uploading trickle at timestep: 2073600
  19:27:13 STEP  577 H= 577:00 +CPU= 54.038
  19:28:10 STEP  578 H= 578:00 +CPU= 55.872
  19:29:35 STEP  579 H= 579:00 +CPU= 84.102
  19:30:32 STEP  580 H= 580:00 +CPU= 56.292
  19:31:28 STEP  581 H= 581:00 +CPU= 55.462
  19:32:55 STEP  582 H= 582:00 +CPU= 86.557
  19:33:51 STEP  583 H= 583:00 +CPU= 55.181
  19:34:48 STEP  584 H= 584:00 +CPU= 56.384
  19:36:13 STEP  585 H= 585:00 +CPU= 84.816
  19:37:10 STEP  586 H= 586:00 +CPU= 56.494
  19:38:05 STEP  587 H= 587:00 +CPU= 53.876
  19:39:41 STEP  588 H= 588:00 +CPU= 94.668
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000588
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000588
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000588
  19:40:35 STEP  589 H= 589:00 +CPU= 53.738
  19:41:32 STEP  590 H= 590:00 +CPU= 56.811
  19:43:00 STEP  591 H= 591:00 +CPU= 86.442
  19:43:56 STEP  592 H= 592:00 +CPU= 55.675
  19:44:51 STEP  593 H= 593:00 +CPU= 55.309
  19:46:19 STEP  594 H= 594:00 +CPU= 86.925
  19:47:14 STEP  595 H= 595:00 +CPU= 54.580
  19:48:13 STEP  596 H= 596:00 +CPU= 57.067
  19:49:36 STEP  597 H= 597:00 +CPU= 82.819
  19:50:33 STEP  598 H= 598:00 +CPU= 55.864
  19:51:28 STEP  599 H= 599:00 +CPU= 54.561
  19:53:08 STEP  600 H= 600:00 +CPU= 97.767
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000600
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000600
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000588
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_21.zip
Uploading the intermediate file: upload_file_21.zip
Uploading trickle at timestep: 2160000
  19:54:00 STEP  601 H= 601:00 +CPU= 51.746
  19:54:53 STEP  602 H= 602:00 +CPU= 52.733
  19:56:15 STEP  603 H= 603:00 +CPU= 80.293
  19:57:05 STEP  604 H= 604:00 +CPU= 50.109
  19:58:00 STEP  605 H= 605:00 +CPU= 54.249
  19:59:28 STEP  606 H= 606:00 +CPU= 84.979
  20:00:23 STEP  607 H= 607:00 +CPU= 53.798
  20:01:21 STEP  608 H= 608:00 +CPU= 56.556
  20:02:48 STEP  609 H= 609:00 +CPU= 85.795
  20:03:44 STEP  610 H= 610:00 +CPU= 54.849
  20:04:41 STEP  611 H= 611:00 +CPU= 55.833
  20:06:17 STEP  612 H= 612:00 +CPU= 94.658
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000612
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000612
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000612
  20:07:12 STEP  613 H= 613:00 +CPU= 55.151
  20:08:09 STEP  614 H= 614:00 +CPU= 56.282
  20:09:35 STEP  615 H= 615:00 +CPU= 84.942
  20:10:32 STEP  616 H= 616:00 +CPU= 56.157
  20:11:28 STEP  617 H= 617:00 +CPU= 55.255
  20:12:55 STEP  618 H= 618:00 +CPU= 86.368
  20:13:50 STEP  619 H= 619:00 +CPU= 54.388
  20:14:47 STEP  620 H= 620:00 +CPU= 56.083
  20:16:12 STEP  621 H= 621:00 +CPU= 84.542
  20:17:08 STEP  622 H= 622:00 +CPU= 55.392
  20:18:05 STEP  623 H= 623:00 +CPU= 56.220
  20:19:45 STEP  624 H= 624:00 +CPU= 99.569
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000624
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000624
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000612
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_22.zip
Uploading the intermediate file: upload_file_22.zip
Uploading trickle at timestep: 2246400
  20:20:40 STEP  625 H= 625:00 +CPU= 54.209
  20:21:34 STEP  626 H= 626:00 +CPU= 53.939
  20:23:01 STEP  627 H= 627:00 +CPU= 85.080
  20:23:55 STEP  628 H= 628:00 +CPU= 54.005
  20:24:49 STEP  629 H= 629:00 +CPU= 52.998
  20:26:16 STEP  630 H= 630:00 +CPU= 86.614
  20:27:11 STEP  631 H= 631:00 +CPU= 54.228
  20:28:07 STEP  632 H= 632:00 +CPU= 55.542
  20:29:33 STEP  633 H= 633:00 +CPU= 85.275
  20:30:29 STEP  634 H= 634:00 +CPU= 56.148
  20:31:25 STEP  635 H= 635:00 +CPU= 54.933
  20:32:59 STEP  636 H= 636:00 +CPU= 93.639
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000636
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000636
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000636
  20:33:53 STEP  637 H= 637:00 +CPU= 53.111
  20:34:49 STEP  638 H= 638:00 +CPU= 56.084
  20:36:10 STEP  639 H= 639:00 +CPU= 80.706
  20:37:05 STEP  640 H= 640:00 +CPU= 53.846
  20:37:56 STEP  641 H= 641:00 +CPU= 50.841
  20:39:22 STEP  642 H= 642:00 +CPU= 84.237
  20:40:16 STEP  643 H= 643:00 +CPU= 53.484
  20:41:13 STEP  644 H= 644:00 +CPU= 55.546
  20:42:37 STEP  645 H= 645:00 +CPU= 83.356
  20:43:31 STEP  646 H= 646:00 +CPU= 53.638
  20:44:26 STEP  647 H= 647:00 +CPU= 54.463
  20:46:06 STEP  648 H= 648:00 +CPU= 97.005
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000648
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000648
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000636
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_23.zip
Uploading the intermediate file: upload_file_23.zip
Uploading trickle at timestep: 2332800
  20:47:01 STEP  649 H= 649:00 +CPU= 53.987
  20:47:56 STEP  650 H= 650:00 +CPU= 54.524
  20:49:23 STEP  651 H= 651:00 +CPU= 85.455
  20:50:21 STEP  652 H= 652:00 +CPU= 56.343
  20:51:16 STEP  653 H= 653:00 +CPU= 54.647
  20:52:46 STEP  654 H= 654:00 +CPU= 86.569
  20:53:40 STEP  655 H= 655:00 +CPU= 53.377
  20:54:37 STEP  656 H= 656:00 +CPU= 55.421
  20:56:03 STEP  657 H= 657:00 +CPU= 84.441
  20:57:00 STEP  658 H= 658:00 +CPU= 56.283
  20:57:55 STEP  659 H= 659:00 +CPU= 54.598
  20:59:32 STEP  660 H= 660:00 +CPU= 95.213
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000660
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000660
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000660
  21:00:28 STEP  661 H= 661:00 +CPU= 55.134
  21:01:25 STEP  662 H= 662:00 +CPU= 56.483
  21:02:52 STEP  663 H= 663:00 +CPU= 85.138
  21:03:49 STEP  664 H= 664:00 +CPU= 56.116
  21:04:45 STEP  665 H= 665:00 +CPU= 55.092
  21:06:13 STEP  666 H= 666:00 +CPU= 87.050
  21:07:09 STEP  667 H= 667:00 +CPU= 55.034
  21:08:05 STEP  668 H= 668:00 +CPU= 55.797
  21:09:31 STEP  669 H= 669:00 +CPU= 85.305
  21:10:28 STEP  670 H= 670:00 +CPU= 56.228
  21:11:24 STEP  671 H= 671:00 +CPU= 56.202
  21:13:06 STEP  672 H= 672:00 +CPU=100.287
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000672
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000672
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_24.zip
Uploading the intermediate file: upload_file_24.zip
Uploading trickle at timestep: 2419200
  21:14:01 STEP  673 H= 673:00 +CPU= 54.688
  21:14:57 STEP  674 H= 674:00 +CPU= 55.107
  21:16:23 STEP  675 H= 675:00 +CPU= 85.384
  21:17:20 STEP  676 H= 676:00 +CPU= 55.787
  21:18:15 STEP  677 H= 677:00 +CPU= 54.676
  21:19:43 STEP  678 H= 678:00 +CPU= 86.925
  21:20:39 STEP  679 H= 679:00 +CPU= 55.103
  21:21:37 STEP  680 H= 680:00 +CPU= 57.154
  21:23:04 STEP  681 H= 681:00 +CPU= 85.606
  21:24:01 STEP  682 H= 682:00 +CPU= 56.752
  21:24:57 STEP  683 H= 683:00 +CPU= 54.944
  21:26:32 STEP  684 H= 684:00 +CPU= 94.158
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000684
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000684
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000684
  21:27:28 STEP  685 H= 685:00 +CPU= 55.196
  21:28:26 STEP  686 H= 686:00 +CPU= 57.244
  21:29:53 STEP  687 H= 687:00 +CPU= 85.579
  21:30:51 STEP  688 H= 688:00 +CPU= 56.728
  21:31:46 STEP  689 H= 689:00 +CPU= 54.660
  21:33:14 STEP  690 H= 690:00 +CPU= 87.226
  21:34:11 STEP  691 H= 691:00 +CPU= 55.710
  21:35:09 STEP  692 H= 692:00 +CPU= 57.418
  21:36:35 STEP  693 H= 693:00 +CPU= 84.954
  21:37:33 STEP  694 H= 694:00 +CPU= 56.327
  21:38:31 STEP  695 H= 695:00 +CPU= 56.711
  21:40:14 STEP  696 H= 696:00 +CPU= 99.893
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000696
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000696
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000684
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_25.zip
Uploading the intermediate file: upload_file_25.zip
Uploading trickle at timestep: 2505600
  21:41:10 STEP  697 H= 697:00 +CPU= 53.592
  21:42:06 STEP  698 H= 698:00 +CPU= 55.503
  21:43:32 STEP  699 H= 699:00 +CPU= 83.878
  21:44:29 STEP  700 H= 700:00 +CPU= 56.451
  21:45:25 STEP  701 H= 701:00 +CPU= 55.497
  21:46:56 STEP  702 H= 702:00 +CPU= 87.423
  21:47:52 STEP  703 H= 703:00 +CPU= 55.171
  21:48:49 STEP  704 H= 704:00 +CPU= 55.139
  21:50:15 STEP  705 H= 705:00 +CPU= 83.313
  21:51:12 STEP  706 H= 706:00 +CPU= 55.025
  21:52:08 STEP  707 H= 707:00 +CPU= 54.448
  21:53:44 STEP  708 H= 708:00 +CPU= 94.638
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000708
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000708
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000708
  21:54:40 STEP  709 H= 709:00 +CPU= 55.059
  21:55:38 STEP  710 H= 710:00 +CPU= 56.468
  21:57:06 STEP  711 H= 711:00 +CPU= 86.841
  21:58:07 STEP  712 H= 712:00 +CPU= 56.177
  21:59:03 STEP  713 H= 713:00 +CPU= 54.829
  22:00:32 STEP  714 H= 714:00 +CPU= 87.625
  22:01:31 STEP  715 H= 715:00 +CPU= 55.782
  22:02:31 STEP  716 H= 716:00 +CPU= 57.933
  22:04:01 STEP  717 H= 717:00 +CPU= 87.833
  22:05:02 STEP  718 H= 718:00 +CPU= 58.523
  22:06:01 STEP  719 H= 719:00 +CPU= 57.602
  22:07:48 STEP  720 H= 720:00 +CPU=103.205
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000720
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000720
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMGGhpi1+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMSHhpi1+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931/ICMUAhpi1+000708
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1842_2021050100_123_946_12164931_1_r1727560846_26.zip
Uploading the intermediate file: upload_file_26.zip
Uploading trickle at timestep: 2592000
  22:08:44 STEP  721 H= 721:00 +CPU= 56.091
  22:09:45 STEP  722 H= 722:00 +CPU= 58.216
  22:11:15 STEP  723 H= 723:00 +CPU= 88.073
  22:12:14 STEP  724 H= 724:00 +CPU= 57.547
  22:13:13 STEP  725 H= 725:00 +CPU= 57.120
  22:14:43 STEP  726 H= 726:00 +CPU= 88.553
  22:15:40 STEP  727 H= 727:00 +CPU= 56.041
  22:16:40 STEP  728 H= 728:00 +CPU= 57.451
  22:18:10 STEP  729 H= 729:00 +CPU= 88.006
  22:19:08 STEP  730 H= 730:00 +CPU= 57.032
  22:20:04 STEP  731 H= 731:00 +CPU= 55.278
  22:21:43 STEP  732 H= 732:00 +CPU= 96.276
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGhpi1+000732
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHhpi1+000732
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAhpi1+000732
  22:22:41 STEP  733 H= 733:00 +CPU= 57.009
  22:23:40 STEP  734 H= 734:00 +CPU= 57.112
  22:25:10 STEP  735 H= 735:00 +CPU= 87.529
  22:26:10 STEP  736 H= 736:00 +CPU= 57.559
  22:27:07 STEP  737 H= 737:00 +CPU= 56.295
  22:28:38 STEP  738 H= 738:00 +CPU= 88.829
  22:29:36 STEP  739 H= 739:00 +CPU= 56.514
  22:30:35 STEP  740 H= 740:00 +CPU= 57.421
  22:32:04 STEP  741 H= 741:00 +CPU= 87.819
  22:33:04 STEP  742 H= 742:00 +CPU= 57.969
  22:34:03 STEP  743 H= 743:00 +CPU= 58.382
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3996MB (heap), 4585MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 3996 MB (maxheap), 4585 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS CLDPP T/S    (1002) 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                SLTEND_LAYER 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223534:1670733334:43767.950] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 SLTEND 
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223535:1670733335:43768.951] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:boinc-00.fullford.com:1:1:72460:72460] [20221210:223535:1670733335:43768.951] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
master.exe         0000000001CE916B  Unknown               Unknown  Unknown
master.exe         000000000081FFF1  Unknown               Unknown  Unknown
master.exe         0000000001DC9090  Unknown               Unknown  Unknown
master.exe         0000000001CC0A84  Unknown               Unknown  Unknown
master.exe         000000000103E737  sltend_                   315  sltend.F90
master.exe         000000000103CDC0  sltend_layer_              99  sltend_layer.F90
master.exe         0000000000F410DA  callpar_                 1613  callpar.F90
master.exe         0000000000E4940F  ec_phys_                  670  ec_phys.F90
master.exe         0000000000E3610C  ec_phys_drv_              599  ec_phys_drv.F90
master.exe         0000000000BFA3D3  gp_model_                 613  gp_model.F90
master.exe         00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
master.exe         0000000000BBC1CE  scan2m_                   535  scan2m.F90
master.exe         000000000057A664  stepo_                    327  stepo.F90
master.exe         000000000055DEEC  cnt4_                    1133  cnt4.F90
master.exe         00000000005471C9  cnt3_                     267  cnt3.F90
master.exe         0000000000546412  cnt2_                      88  cnt2.F90
master.exe         0000000000545E28  cnt1_                      92  cnt1.F90
master.exe         000000000040708D  cnt0_                     146  cnt0.F90
master.exe         000000000040220F  MAIN__                     96  master.F90
master.exe         00000000004021A2  Unknown               Unknown  Unknown
master.exe         0000000001DCA390  Unknown               Unknown  Unknown
master.exe         000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 1842
(argv4) batchid: 946
(argv5) wuid: 12164931
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/22
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.01
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/22/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/22/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ff4a0f014950a7ce8b7c102e9927569e to: /var/lib/boinc-client/slots/22/oifs_43r3_ps_1842_2021050100_123_946_12164931.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/22/oifs_43r3_ps_1842_2021050100_123_946_12164931.zip
ic_ancil_file: ic_ancil_12164931
ifsdata_file: ifsdata_12164931
climate_data_file: clim_data_12164931
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
Copying IC ancils from: ../../projects/climateprediction.net/jf_f6b249c1bbdd8b0b2d9b7cfe1d7f36ce to: /var/lib/boinc-client/slots/22/ic_ancil_12164931.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/22/ic_ancil_12164931.zip
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 1842
(argv4) batchid: 946
(argv5) wuid: 12164931
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/22
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.01
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164931
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/22/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/22/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ff4a0f014950a7ce8b7c102e9927569e to: /var/lib/boinc-client/slots/22/oifs_43r3_ps_1842_2021050100_123_946_12164931.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/22/oifs_43r3_ps_1842_2021050100_123_946_12164931.zip
ic_ancil_file: ic_ancil_12164931
ifsdata_file: ifsdata_12164931
climate_data_file: clim_data_12164931
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
Copying IC ancils from:  to: /var/lib/boinc-client/slots/22/ic_ancil_12164931.zip
..Copying the IC ancils to the working directory failed

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:39:35 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 2,592,000 41,463 0.0160
09 May 2023 15:39:35 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 2,505,600 39,854 0.0159
09 May 2023 15:39:35 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 2,505,600 39,854 0.0159
09 May 2023 15:39:33 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 2,419,200 38,254 0.0158
09 May 2023 15:39:33 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 2,419,200 38,254 0.0158
09 May 2023 15:39:33 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 2,332,800 36,655 0.0157
09 May 2023 15:39:32 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 2,246,400 35,098 0.0156
09 May 2023 15:39:32 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 2,160,000 33,516 0.0155
09 May 2023 15:39:30 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 2,073,600 31,929 0.0154
09 May 2023 15:39:30 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 1,987,200 30,338 0.0153
09 May 2023 15:39:30 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 1,900,800 28,741 0.0151
09 May 2023 15:39:29 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 1,814,400 27,115 0.0149
09 May 2023 15:39:29 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 1,728,000 25,518 0.0148
09 May 2023 15:39:27 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 1,641,600 23,933 0.0146
09 May 2023 15:39:27 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 1,555,200 22,355 0.0144
09 May 2023 15:39:26 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 1,468,800 20,771 0.0141
09 May 2023 15:39:26 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 1,382,400 19,211 0.0139
09 May 2023 15:39:24 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 1,296,000 17,630 0.0136
09 May 2023 15:39:24 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 1,209,600 16,060 0.0133
09 May 2023 15:39:24 1459268 22249959 oifs_43r3_ps_1842_2021050100_123_946_12164931_1 1,123,200 14,507 0.0129


©2024 climateprediction.net