climateprediction.net home page
Task 22316940

Task 22316940

Name oifs_43r3_00t7_2019110100_123_993_12214489_1
Workunit 12214489
Created 25 Feb 2023, 1:06:34 UTC
Sent 25 Feb 2023, 1:10:33 UTC
Report deadline 26 Apr 2023, 1:10:33 UTC
Received 26 Feb 2023, 7:03:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1484742
Run time 17 hours 25 min 32 sec
CPU time 17 hours 16 min 41 sec
Validate state Invalid
Credit 14,873.04
Device peak FLOPS 3.09 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,794.87 MB
Peak swap size 4,974.28 MB
Peak disk usage 1,267.83 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
00 +CPU= 19.435
  03:47:22 STEP 2345 H=2345:00 +CPU= 18.297
  03:47:53 STEP 2346 H=2346:00 +CPU= 30.175
  03:48:11 STEP 2347 H=2347:00 +CPU= 18.445
  03:48:30 STEP 2348 H=2348:00 +CPU= 19.015
  03:48:59 STEP 2349 H=2349:00 +CPU= 29.003
  03:49:19 STEP 2350 H=2350:00 +CPU= 19.495
  03:49:38 STEP 2351 H=2351:00 +CPU= 18.874
  03:50:12 STEP 2352 H=2352:00 +CPU= 34.034
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002352
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002352
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002340
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_97.zip
Uploading the intermediate file: upload_file_97.zip
  03:50:31 STEP 2353 H=2353:00 +CPU= 18.946
  03:50:51 STEP 2354 H=2354:00 +CPU= 19.167
  03:51:20 STEP 2355 H=2355:00 +CPU= 29.264
  03:51:39 STEP 2356 H=2356:00 +CPU= 18.810
  03:51:58 STEP 2357 H=2357:00 +CPU= 18.863
  03:52:28 STEP 2358 H=2358:00 +CPU= 30.052
  03:52:47 STEP 2359 H=2359:00 +CPU= 18.485
  03:53:06 STEP 2360 H=2360:00 +CPU= 18.850
  03:53:35 STEP 2361 H=2361:00 +CPU= 28.979
  03:53:54 STEP 2362 H=2362:00 +CPU= 19.046
  03:54:12 STEP 2363 H=2363:00 +CPU= 18.281
  03:54:44 STEP 2364 H=2364:00 +CPU= 31.931
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002364
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002364
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002364
  03:55:03 STEP 2365 H=2365:00 +CPU= 18.359
  03:55:23 STEP 2366 H=2366:00 +CPU= 20.182
  03:55:53 STEP 2367 H=2367:00 +CPU= 30.129
  03:56:13 STEP 2368 H=2368:00 +CPU= 19.514
  03:56:32 STEP 2369 H=2369:00 +CPU= 18.526
  03:57:01 STEP 2370 H=2370:00 +CPU= 29.504
  03:57:20 STEP 2371 H=2371:00 +CPU= 18.265
  03:57:39 STEP 2372 H=2372:00 +CPU= 18.801
  03:58:08 STEP 2373 H=2373:00 +CPU= 29.150
  03:58:27 STEP 2374 H=2374:00 +CPU= 19.342
  03:58:47 STEP 2375 H=2375:00 +CPU= 19.234
  03:59:21 STEP 2376 H=2376:00 +CPU= 34.368
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_98.zip
Uploading the intermediate file: upload_file_98.zip
  03:59:40 STEP 2377 H=2377:00 +CPU= 18.627
  03:59:59 STEP 2378 H=2378:00 +CPU= 19.399
  04:00:30 STEP 2379 H=2379:00 +CPU= 30.350
  04:00:49 STEP 2380 H=2380:00 +CPU= 19.137
  04:01:08 STEP 2381 H=2381:00 +CPU= 18.511
  04:01:37 STEP 2382 H=2382:00 +CPU= 29.184
  04:01:56 STEP 2383 H=2383:00 +CPU= 18.270
  04:02:15 STEP 2384 H=2384:00 +CPU= 19.150
  04:02:44 STEP 2385 H=2385:00 +CPU= 28.982
  04:03:03 STEP 2386 H=2386:00 +CPU= 19.395
  04:03:22 STEP 2387 H=2387:00 +CPU= 18.718
  04:03:55 STEP 2388 H=2388:00 +CPU= 32.186
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002388
  04:04:13 STEP 2389 H=2389:00 +CPU= 18.746
  04:04:33 STEP 2390 H=2390:00 +CPU= 19.219
  04:05:03 STEP 2391 H=2391:00 +CPU= 29.696
  04:05:23 STEP 2392 H=2392:00 +CPU= 20.112
  04:05:42 STEP 2393 H=2393:00 +CPU= 19.100
  04:06:12 STEP 2394 H=2394:00 +CPU= 29.551
  04:06:30 STEP 2395 H=2395:00 +CPU= 18.555
  04:06:50 STEP 2396 H=2396:00 +CPU= 19.361
  04:07:19 STEP 2397 H=2397:00 +CPU= 29.131
  04:07:38 STEP 2398 H=2398:00 +CPU= 18.918
  04:07:58 STEP 2399 H=2399:00 +CPU= 19.551
  04:08:32 STEP 2400 H=2400:00 +CPU= 33.639
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_99.zip
Uploading the intermediate file: upload_file_99.zip
  04:08:50 STEP 2401 H=2401:00 +CPU= 18.118
Uploading trickle at timestep: 8640000
  04:09:09 STEP 2402 H=2402:00 +CPU= 18.889
  04:09:39 STEP 2403 H=2403:00 +CPU= 29.576
  04:09:57 STEP 2404 H=2404:00 +CPU= 18.560
  04:10:16 STEP 2405 H=2405:00 +CPU= 18.703
  04:10:47 STEP 2406 H=2406:00 +CPU= 30.923
  04:11:06 STEP 2407 H=2407:00 +CPU= 18.828
  04:11:25 STEP 2408 H=2408:00 +CPU= 19.209
  04:11:55 STEP 2409 H=2409:00 +CPU= 29.636
  04:12:14 STEP 2410 H=2410:00 +CPU= 19.081
  04:12:33 STEP 2411 H=2411:00 +CPU= 18.485
  04:13:05 STEP 2412 H=2412:00 +CPU= 32.202
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002412
  04:13:24 STEP 2413 H=2413:00 +CPU= 18.289
  04:13:43 STEP 2414 H=2414:00 +CPU= 18.975
  04:14:12 STEP 2415 H=2415:00 +CPU= 29.152
  04:14:31 STEP 2416 H=2416:00 +CPU= 19.201
  04:14:50 STEP 2417 H=2417:00 +CPU= 18.571
  04:15:21 STEP 2418 H=2418:00 +CPU= 30.675
  04:15:40 STEP 2419 H=2419:00 +CPU= 18.796
  04:15:59 STEP 2420 H=2420:00 +CPU= 19.302
  04:16:29 STEP 2421 H=2421:00 +CPU= 29.233
  04:16:48 STEP 2422 H=2422:00 +CPU= 19.311
  04:17:08 STEP 2423 H=2423:00 +CPU= 19.365
  04:17:41 STEP 2424 H=2424:00 +CPU= 33.317
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_100.zip
Uploading the intermediate file: upload_file_100.zip
  04:17:59 STEP 2425 H=2425:00 +CPU= 17.866
  04:18:18 STEP 2426 H=2426:00 +CPU= 18.486
  04:18:47 STEP 2427 H=2427:00 +CPU= 29.560
  04:19:06 STEP 2428 H=2428:00 +CPU= 18.698
  04:19:24 STEP 2429 H=2429:00 +CPU= 18.188
  04:19:54 STEP 2430 H=2430:00 +CPU= 29.849
  04:20:13 STEP 2431 H=2431:00 +CPU= 18.867
  04:20:33 STEP 2432 H=2432:00 +CPU= 19.975
  04:21:03 STEP 2433 H=2433:00 +CPU= 29.627
  04:21:22 STEP 2434 H=2434:00 +CPU= 19.067
  04:21:41 STEP 2435 H=2435:00 +CPU= 18.816
  04:22:14 STEP 2436 H=2436:00 +CPU= 32.216
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002436
  04:22:32 STEP 2437 H=2437:00 +CPU= 18.144
  04:22:51 STEP 2438 H=2438:00 +CPU= 18.666
  04:23:19 STEP 2439 H=2439:00 +CPU= 28.636
  04:23:39 STEP 2440 H=2440:00 +CPU= 18.991
  04:23:57 STEP 2441 H=2441:00 +CPU= 18.126
  04:24:27 STEP 2442 H=2442:00 +CPU= 30.050
  04:24:46 STEP 2443 H=2443:00 +CPU= 18.660
  04:25:05 STEP 2444 H=2444:00 +CPU= 19.546
  04:25:36 STEP 2445 H=2445:00 +CPU= 30.018
  04:25:55 STEP 2446 H=2446:00 +CPU= 19.358
  04:26:14 STEP 2447 H=2447:00 +CPU= 19.232
  04:26:48 STEP 2448 H=2448:00 +CPU= 33.377
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_101.zip
Uploading the intermediate file: upload_file_101.zip
  04:27:06 STEP 2449 H=2449:00 +CPU= 17.733
  04:27:25 STEP 2450 H=2450:00 +CPU= 18.719
  04:27:54 STEP 2451 H=2451:00 +CPU= 29.067
  04:28:13 STEP 2452 H=2452:00 +CPU= 18.799
  04:28:31 STEP 2453 H=2453:00 +CPU= 18.279
  04:29:01 STEP 2454 H=2454:00 +CPU= 29.769
  04:29:20 STEP 2455 H=2455:00 +CPU= 18.743
  04:29:39 STEP 2456 H=2456:00 +CPU= 19.005
  04:30:08 STEP 2457 H=2457:00 +CPU= 28.984
  04:30:28 STEP 2458 H=2458:00 +CPU= 20.151
  04:30:47 STEP 2459 H=2459:00 +CPU= 18.925
  04:31:20 STEP 2460 H=2460:00 +CPU= 32.405
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002460
  04:31:39 STEP 2461 H=2461:00 +CPU= 18.534
  04:31:58 STEP 2462 H=2462:00 +CPU= 18.901
  04:32:27 STEP 2463 H=2463:00 +CPU= 28.853
  04:32:46 STEP 2464 H=2464:00 +CPU= 19.291
  04:33:05 STEP 2465 H=2465:00 +CPU= 18.504
  04:33:35 STEP 2466 H=2466:00 +CPU= 30.041
  04:33:54 STEP 2467 H=2467:00 +CPU= 18.644
  04:34:13 STEP 2468 H=2468:00 +CPU= 19.576
  04:34:43 STEP 2469 H=2469:00 +CPU= 29.882
  04:35:03 STEP 2470 H=2470:00 +CPU= 19.293
  04:35:23 STEP 2471 H=2471:00 +CPU= 20.377
  04:35:58 STEP 2472 H=2472:00 +CPU= 34.193
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_102.zip
Uploading the intermediate file: upload_file_102.zip
  04:36:16 STEP 2473 H=2473:00 +CPU= 17.991
  04:36:35 STEP 2474 H=2474:00 +CPU= 18.765
  04:37:04 STEP 2475 H=2475:00 +CPU= 29.397
  04:37:23 STEP 2476 H=2476:00 +CPU= 19.041
  04:37:42 STEP 2477 H=2477:00 +CPU= 18.387
  04:38:12 STEP 2478 H=2478:00 +CPU= 30.211
  04:38:31 STEP 2479 H=2479:00 +CPU= 18.661
  04:38:50 STEP 2480 H=2480:00 +CPU= 19.196
  04:39:20 STEP 2481 H=2481:00 +CPU= 29.397
  04:39:39 STEP 2482 H=2482:00 +CPU= 19.026
  04:39:58 STEP 2483 H=2483:00 +CPU= 18.968
  04:40:32 STEP 2484 H=2484:00 +CPU= 33.612
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002484
  04:40:50 STEP 2485 H=2485:00 +CPU= 18.115
  04:41:09 STEP 2486 H=2486:00 +CPU= 18.627
  04:41:38 STEP 2487 H=2487:00 +CPU= 29.048
  04:41:57 STEP 2488 H=2488:00 +CPU= 19.060
  04:42:16 STEP 2489 H=2489:00 +CPU= 18.256
  04:42:45 STEP 2490 H=2490:00 +CPU= 29.818
  04:43:04 STEP 2491 H=2491:00 +CPU= 18.381
  04:43:23 STEP 2492 H=2492:00 +CPU= 19.037
  04:43:52 STEP 2493 H=2493:00 +CPU= 29.054
  04:44:11 STEP 2494 H=2494:00 +CPU= 18.895
  04:44:31 STEP 2495 H=2495:00 +CPU= 19.302
  04:45:05 STEP 2496 H=2496:00 +CPU= 34.418
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_103.zip
Uploading the intermediate file: upload_file_103.zip
  04:45:24 STEP 2497 H=2497:00 +CPU= 18.795
  04:45:43 STEP 2498 H=2498:00 +CPU= 18.604
  04:46:12 STEP 2499 H=2499:00 +CPU= 29.355
  04:46:32 STEP 2500 H=2500:00 +CPU= 19.143
  04:46:50 STEP 2501 H=2501:00 +CPU= 18.453
  04:47:20 STEP 2502 H=2502:00 +CPU= 29.768
  04:47:39 STEP 2503 H=2503:00 +CPU= 18.824
  04:47:58 STEP 2504 H=2504:00 +CPU= 19.083
  04:48:27 STEP 2505 H=2505:00 +CPU= 28.775
  04:48:46 STEP 2506 H=2506:00 +CPU= 19.090
  04:49:05 STEP 2507 H=2507:00 +CPU= 18.777
  04:49:38 STEP 2508 H=2508:00 +CPU= 32.196
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002508
  04:49:56 STEP 2509 H=2509:00 +CPU= 18.511
  04:50:16 STEP 2510 H=2510:00 +CPU= 19.466
  04:50:45 STEP 2511 H=2511:00 +CPU= 29.478
  04:51:05 STEP 2512 H=2512:00 +CPU= 18.990
  04:51:23 STEP 2513 H=2513:00 +CPU= 18.143
  04:51:53 STEP 2514 H=2514:00 +CPU= 29.624
  04:52:11 STEP 2515 H=2515:00 +CPU= 18.552
  04:52:31 STEP 2516 H=2516:00 +CPU= 19.191
  04:53:00 STEP 2517 H=2517:00 +CPU= 29.304
  04:53:19 STEP 2518 H=2518:00 +CPU= 19.056
  04:53:39 STEP 2519 H=2519:00 +CPU= 19.277
  04:54:12 STEP 2520 H=2520:00 +CPU= 33.578
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_104.zip
Uploading the intermediate file: upload_file_104.zip
  04:54:30 STEP 2521 H=2521:00 +CPU= 17.909
  04:54:49 STEP 2522 H=2522:00 +CPU= 18.512
  04:55:20 STEP 2523 H=2523:00 +CPU= 30.499
  04:55:38 STEP 2524 H=2524:00 +CPU= 18.808
  04:55:57 STEP 2525 H=2525:00 +CPU= 18.234
  04:56:26 STEP 2526 H=2526:00 +CPU= 29.205
  04:56:45 STEP 2527 H=2527:00 +CPU= 18.640
  04:57:04 STEP 2528 H=2528:00 +CPU= 19.071
  04:57:33 STEP 2529 H=2529:00 +CPU= 28.975
  04:57:52 STEP 2530 H=2530:00 +CPU= 19.172
  04:58:12 STEP 2531 H=2531:00 +CPU= 19.024
  04:58:44 STEP 2532 H=2532:00 +CPU= 31.954
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002532
  04:59:02 STEP 2533 H=2533:00 +CPU= 18.374
  04:59:21 STEP 2534 H=2534:00 +CPU= 18.890
  04:59:50 STEP 2535 H=2535:00 +CPU= 28.732
  05:00:09 STEP 2536 H=2536:00 +CPU= 19.120
  05:00:28 STEP 2537 H=2537:00 +CPU= 18.954
  05:00:58 STEP 2538 H=2538:00 +CPU= 29.396
  05:01:17 STEP 2539 H=2539:00 +CPU= 18.689
  05:01:36 STEP 2540 H=2540:00 +CPU= 19.467
  05:02:06 STEP 2541 H=2541:00 +CPU= 29.888
  05:02:26 STEP 2542 H=2542:00 +CPU= 19.390
  05:02:45 STEP 2543 H=2543:00 +CPU= 19.300
  05:03:19 STEP 2544 H=2544:00 +CPU= 33.178
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_105.zip
Uploading the intermediate file: upload_file_105.zip
  05:03:36 STEP 2545 H=2545:00 +CPU= 17.668
  05:03:55 STEP 2546 H=2546:00 +CPU= 18.465
  05:04:24 STEP 2547 H=2547:00 +CPU= 29.006
  05:04:43 STEP 2548 H=2548:00 +CPU= 19.057
  05:05:02 STEP 2549 H=2549:00 +CPU= 18.413
  05:05:33 STEP 2550 H=2550:00 +CPU= 31.205
  05:05:52 STEP 2551 H=2551:00 +CPU= 18.899
  05:06:12 STEP 2552 H=2552:00 +CPU= 19.512
  05:06:42 STEP 2553 H=2553:00 +CPU= 29.702
  05:07:01 STEP 2554 H=2554:00 +CPU= 19.042
  05:07:19 STEP 2555 H=2555:00 +CPU= 18.635
  05:07:52 STEP 2556 H=2556:00 +CPU= 32.142
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002556
  05:08:10 STEP 2557 H=2557:00 +CPU= 18.298
  05:08:29 STEP 2558 H=2558:00 +CPU= 18.811
  05:08:58 STEP 2559 H=2559:00 +CPU= 29.041
  05:09:17 STEP 2560 H=2560:00 +CPU= 18.975
  05:09:36 STEP 2561 H=2561:00 +CPU= 18.358
  05:10:06 STEP 2562 H=2562:00 +CPU= 30.180
  05:10:26 STEP 2563 H=2563:00 +CPU= 19.691
  05:10:45 STEP 2564 H=2564:00 +CPU= 19.306
  05:11:15 STEP 2565 H=2565:00 +CPU= 29.206
  05:11:34 STEP 2566 H=2566:00 +CPU= 19.155
  05:11:53 STEP 2567 H=2567:00 +CPU= 19.287
  05:12:27 STEP 2568 H=2568:00 +CPU= 33.423
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_106.zip
Uploading the intermediate file: upload_file_106.zip
  05:12:45 STEP 2569 H=2569:00 +CPU= 17.901
  05:13:03 STEP 2570 H=2570:00 +CPU= 18.472
  05:13:33 STEP 2571 H=2571:00 +CPU= 28.990
  05:13:52 STEP 2572 H=2572:00 +CPU= 18.815
  05:14:10 STEP 2573 H=2573:00 +CPU= 18.040
  05:14:39 STEP 2574 H=2574:00 +CPU= 29.622
  05:14:58 STEP 2575 H=2575:00 +CPU= 18.963
  05:15:19 STEP 2576 H=2576:00 +CPU= 20.305
  05:15:48 STEP 2577 H=2577:00 +CPU= 29.073
  05:16:07 STEP 2578 H=2578:00 +CPU= 19.106
  05:16:26 STEP 2579 H=2579:00 +CPU= 18.628
  05:16:58 STEP 2580 H=2580:00 +CPU= 32.047
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002580
  05:17:17 STEP 2581 H=2581:00 +CPU= 18.437
  05:17:36 STEP 2582 H=2582:00 +CPU= 18.750
  05:18:05 STEP 2583 H=2583:00 +CPU= 29.053
  05:18:24 STEP 2584 H=2584:00 +CPU= 18.886
  05:18:42 STEP 2585 H=2585:00 +CPU= 18.297
  05:19:12 STEP 2586 H=2586:00 +CPU= 29.937
  05:19:31 STEP 2587 H=2587:00 +CPU= 18.741
  05:19:51 STEP 2588 H=2588:00 +CPU= 19.371
  05:20:21 STEP 2589 H=2589:00 +CPU= 30.325
  05:20:40 STEP 2590 H=2590:00 +CPU= 18.993
  05:21:00 STEP 2591 H=2591:00 +CPU= 19.322
  05:21:34 STEP 2592 H=2592:00 +CPU= 33.934
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_107.zip
Uploading the intermediate file: upload_file_107.zip
  05:21:52 STEP 2593 H=2593:00 +CPU= 18.211
  05:22:11 STEP 2594 H=2594:00 +CPU= 18.538
  05:22:39 STEP 2595 H=2595:00 +CPU= 28.512
  05:22:58 STEP 2596 H=2596:00 +CPU= 18.918
  05:23:17 STEP 2597 H=2597:00 +CPU= 18.340
  05:23:47 STEP 2598 H=2598:00 +CPU= 29.845
  05:24:06 STEP 2599 H=2599:00 +CPU= 18.577
  05:24:25 STEP 2600 H=2600:00 +CPU= 19.085
  05:24:54 STEP 2601 H=2601:00 +CPU= 28.798
  05:25:13 STEP 2602 H=2602:00 +CPU= 19.524
  05:25:33 STEP 2603 H=2603:00 +CPU= 19.183
  05:26:05 STEP 2604 H=2604:00 +CPU= 31.815
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002604
  05:26:23 STEP 2605 H=2605:00 +CPU= 18.171
  05:26:42 STEP 2606 H=2606:00 +CPU= 18.809
  05:27:11 STEP 2607 H=2607:00 +CPU= 29.121
  05:27:30 STEP 2608 H=2608:00 +CPU= 18.989
  05:27:49 STEP 2609 H=2609:00 +CPU= 18.299
  05:28:19 STEP 2610 H=2610:00 +CPU= 29.830
  05:28:38 STEP 2611 H=2611:00 +CPU= 18.839
  05:28:57 STEP 2612 H=2612:00 +CPU= 19.633
  05:29:27 STEP 2613 H=2613:00 +CPU= 29.948
  05:29:47 STEP 2614 H=2614:00 +CPU= 19.298
  05:30:07 STEP 2615 H=2615:00 +CPU= 19.650
  05:30:41 STEP 2616 H=2616:00 +CPU= 34.550
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_108.zip
Uploading the intermediate file: upload_file_108.zip
  05:30:59 STEP 2617 H=2617:00 +CPU= 17.986
  05:31:18 STEP 2618 H=2618:00 +CPU= 18.743
  05:31:47 STEP 2619 H=2619:00 +CPU= 29.078
  05:32:07 STEP 2620 H=2620:00 +CPU= 19.056
  05:32:25 STEP 2621 H=2621:00 +CPU= 18.392
  05:32:55 STEP 2622 H=2622:00 +CPU= 29.798
  05:33:14 STEP 2623 H=2623:00 +CPU= 18.636
  05:33:33 STEP 2624 H=2624:00 +CPU= 18.927
  05:34:02 STEP 2625 H=2625:00 +CPU= 28.992
  05:34:21 STEP 2626 H=2626:00 +CPU= 19.166
  05:34:40 STEP 2627 H=2627:00 +CPU= 18.616
  05:35:13 STEP 2628 H=2628:00 +CPU= 32.855
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002628
  05:35:32 STEP 2629 H=2629:00 +CPU= 19.046
  05:35:51 STEP 2630 H=2630:00 +CPU= 19.040
  05:36:20 STEP 2631 H=2631:00 +CPU= 28.999
  05:36:40 STEP 2632 H=2632:00 +CPU= 19.046
  05:36:58 STEP 2633 H=2633:00 +CPU= 18.204
  05:37:28 STEP 2634 H=2634:00 +CPU= 29.608
  05:37:46 STEP 2635 H=2635:00 +CPU= 18.669
  05:38:06 STEP 2636 H=2636:00 +CPU= 19.509
  05:38:36 STEP 2637 H=2637:00 +CPU= 29.997
  05:38:55 STEP 2638 H=2638:00 +CPU= 19.201
  05:39:15 STEP 2639 H=2639:00 +CPU= 19.311
  05:39:49 STEP 2640 H=2640:00 +CPU= 33.534
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_109.zip
Uploading the intermediate file: upload_file_109.zip
  05:40:07 STEP 2641 H=2641:00 +CPU= 18.167
Uploading trickle at timestep: 9504000
  05:40:26 STEP 2642 H=2642:00 +CPU= 19.510
  05:40:56 STEP 2643 H=2643:00 +CPU= 29.044
  05:41:15 STEP 2644 H=2644:00 +CPU= 19.083
  05:41:33 STEP 2645 H=2645:00 +CPU= 18.200
  05:42:03 STEP 2646 H=2646:00 +CPU= 29.911
  05:42:22 STEP 2647 H=2647:00 +CPU= 19.013
  05:42:41 STEP 2648 H=2648:00 +CPU= 19.082
  05:43:11 STEP 2649 H=2649:00 +CPU= 29.138
  05:43:30 STEP 2650 H=2650:00 +CPU= 19.190
  05:43:49 STEP 2651 H=2651:00 +CPU= 18.836
  05:44:21 STEP 2652 H=2652:00 +CPU= 32.294
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002652
  05:44:40 STEP 2653 H=2653:00 +CPU= 18.334
  05:44:59 STEP 2654 H=2654:00 +CPU= 18.785
  05:45:29 STEP 2655 H=2655:00 +CPU= 30.444
  05:45:48 STEP 2656 H=2656:00 +CPU= 18.916
  05:46:07 STEP 2657 H=2657:00 +CPU= 18.240
  05:46:37 STEP 2658 H=2658:00 +CPU= 29.694
  05:46:55 STEP 2659 H=2659:00 +CPU= 18.708
  05:47:15 STEP 2660 H=2660:00 +CPU= 19.352
  05:47:45 STEP 2661 H=2661:00 +CPU= 29.569
  05:48:04 STEP 2662 H=2662:00 +CPU= 19.158
  05:48:23 STEP 2663 H=2663:00 +CPU= 19.135
  05:48:57 STEP 2664 H=2664:00 +CPU= 33.588
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_110.zip
Uploading the intermediate file: upload_file_110.zip
  05:49:15 STEP 2665 H=2665:00 +CPU= 17.970
  05:49:33 STEP 2666 H=2666:00 +CPU= 18.347
  05:50:02 STEP 2667 H=2667:00 +CPU= 28.708
  05:50:22 STEP 2668 H=2668:00 +CPU= 19.939
  05:50:41 STEP 2669 H=2669:00 +CPU= 18.196
  05:51:10 STEP 2670 H=2670:00 +CPU= 29.832
  05:51:29 STEP 2671 H=2671:00 +CPU= 18.630
  05:51:48 STEP 2672 H=2672:00 +CPU= 18.925
  05:52:17 STEP 2673 H=2673:00 +CPU= 29.039
  05:52:37 STEP 2674 H=2674:00 +CPU= 19.187
  05:52:56 STEP 2675 H=2675:00 +CPU= 18.911
  05:53:28 STEP 2676 H=2676:00 +CPU= 32.601
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002676
  05:53:47 STEP 2677 H=2677:00 +CPU= 18.468
  05:54:06 STEP 2678 H=2678:00 +CPU= 19.034
  05:54:36 STEP 2679 H=2679:00 +CPU= 29.278
  05:54:55 STEP 2680 H=2680:00 +CPU= 18.977
  05:55:14 STEP 2681 H=2681:00 +CPU= 19.382
  05:55:45 STEP 2682 H=2682:00 +CPU= 30.237
  05:56:03 STEP 2683 H=2683:00 +CPU= 18.443
  05:56:23 STEP 2684 H=2684:00 +CPU= 19.195
  05:56:52 STEP 2685 H=2685:00 +CPU= 29.609
  05:57:12 STEP 2686 H=2686:00 +CPU= 19.662
  05:57:31 STEP 2687 H=2687:00 +CPU= 19.127
  05:58:05 STEP 2688 H=2688:00 +CPU= 33.689
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_111.zip
Uploading the intermediate file: upload_file_111.zip
  05:58:23 STEP 2689 H=2689:00 +CPU= 17.919
  05:58:42 STEP 2690 H=2690:00 +CPU= 18.321
  05:59:11 STEP 2691 H=2691:00 +CPU= 29.021
  05:59:30 STEP 2692 H=2692:00 +CPU= 18.878
  05:59:48 STEP 2693 H=2693:00 +CPU= 17.960
  06:00:19 STEP 2694 H=2694:00 +CPU= 30.743
  06:00:38 STEP 2695 H=2695:00 +CPU= 19.036
  06:00:57 STEP 2696 H=2696:00 +CPU= 18.999
  06:01:26 STEP 2697 H=2697:00 +CPU= 28.845
  06:01:45 STEP 2698 H=2698:00 +CPU= 19.247
  06:02:04 STEP 2699 H=2699:00 +CPU= 19.041
  06:02:37 STEP 2700 H=2700:00 +CPU= 32.297
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002700
  06:02:55 STEP 2701 H=2701:00 +CPU= 18.328
  06:03:14 STEP 2702 H=2702:00 +CPU= 18.950
  06:03:44 STEP 2703 H=2703:00 +CPU= 29.017
  06:04:02 STEP 2704 H=2704:00 +CPU= 18.790
  06:04:21 STEP 2705 H=2705:00 +CPU= 18.119
  06:04:50 STEP 2706 H=2706:00 +CPU= 29.476
  06:05:10 STEP 2707 H=2707:00 +CPU= 19.105
  06:05:30 STEP 2708 H=2708:00 +CPU= 20.147
  06:05:59 STEP 2709 H=2709:00 +CPU= 29.229
  06:06:18 STEP 2710 H=2710:00 +CPU= 19.044
  06:06:38 STEP 2711 H=2711:00 +CPU= 19.165
  06:07:12 STEP 2712 H=2712:00 +CPU= 33.844
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_112.zip
Uploading the intermediate file: upload_file_112.zip
  06:07:30 STEP 2713 H=2713:00 +CPU= 17.972
  06:07:48 STEP 2714 H=2714:00 +CPU= 18.548
  06:08:18 STEP 2715 H=2715:00 +CPU= 29.125
  06:08:37 STEP 2716 H=2716:00 +CPU= 18.961
  06:08:55 STEP 2717 H=2717:00 +CPU= 18.215
  06:09:25 STEP 2718 H=2718:00 +CPU= 30.212
  06:09:44 STEP 2719 H=2719:00 +CPU= 18.841
  06:10:04 STEP 2720 H=2720:00 +CPU= 19.509
  06:10:35 STEP 2721 H=2721:00 +CPU= 30.590
  06:10:54 STEP 2722 H=2722:00 +CPU= 19.396
  06:11:13 STEP 2723 H=2723:00 +CPU= 18.598
  06:11:45 STEP 2724 H=2724:00 +CPU= 32.201
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002724
  06:12:04 STEP 2725 H=2725:00 +CPU= 18.226
  06:12:22 STEP 2726 H=2726:00 +CPU= 18.830
  06:12:51 STEP 2727 H=2727:00 +CPU= 28.660
  06:13:10 STEP 2728 H=2728:00 +CPU= 18.791
  06:13:29 STEP 2729 H=2729:00 +CPU= 18.349
  06:13:58 STEP 2730 H=2730:00 +CPU= 29.725
  06:14:17 STEP 2731 H=2731:00 +CPU= 18.528
  06:14:36 STEP 2732 H=2732:00 +CPU= 19.013
  06:15:06 STEP 2733 H=2733:00 +CPU= 29.282
  06:15:26 STEP 2734 H=2734:00 +CPU= 19.852
  06:15:45 STEP 2735 H=2735:00 +CPU= 19.117
  06:16:19 STEP 2736 H=2736:00 +CPU= 34.264
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_113.zip
Uploading the intermediate file: upload_file_113.zip
  06:16:37 STEP 2737 H=2737:00 +CPU= 17.766
  06:16:56 STEP 2738 H=2738:00 +CPU= 18.539
  06:17:25 STEP 2739 H=2739:00 +CPU= 29.112
  06:17:44 STEP 2740 H=2740:00 +CPU= 19.081
  06:18:03 STEP 2741 H=2741:00 +CPU= 18.294
  06:18:32 STEP 2742 H=2742:00 +CPU= 29.541
  06:18:51 STEP 2743 H=2743:00 +CPU= 18.785
  06:19:11 STEP 2744 H=2744:00 +CPU= 19.420
  06:19:40 STEP 2745 H=2745:00 +CPU= 29.110
  06:19:59 STEP 2746 H=2746:00 +CPU= 19.135
  06:20:19 STEP 2747 H=2747:00 +CPU= 19.450
  06:20:52 STEP 2748 H=2748:00 +CPU= 32.821
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002748
  06:21:10 STEP 2749 H=2749:00 +CPU= 18.408
  06:21:29 STEP 2750 H=2750:00 +CPU= 19.002
  06:21:58 STEP 2751 H=2751:00 +CPU= 28.887
  06:22:18 STEP 2752 H=2752:00 +CPU= 19.018
  06:22:36 STEP 2753 H=2753:00 +CPU= 18.184
  06:23:06 STEP 2754 H=2754:00 +CPU= 30.138
  06:23:25 STEP 2755 H=2755:00 +CPU= 18.516
  06:23:44 STEP 2756 H=2756:00 +CPU= 19.182
  06:24:14 STEP 2757 H=2757:00 +CPU= 29.324
  06:24:33 STEP 2758 H=2758:00 +CPU= 19.287
  06:24:52 STEP 2759 H=2759:00 +CPU= 19.334
  06:25:28 STEP 2760 H=2760:00 +CPU= 35.485
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_114.zip
Uploading the intermediate file: upload_file_114.zip
  06:25:46 STEP 2761 H=2761:00 +CPU= 17.749
  06:26:05 STEP 2762 H=2762:00 +CPU= 18.602
  06:26:34 STEP 2763 H=2763:00 +CPU= 29.328
  06:26:53 STEP 2764 H=2764:00 +CPU= 19.012
  06:27:12 STEP 2765 H=2765:00 +CPU= 18.263
  06:27:42 STEP 2766 H=2766:00 +CPU= 30.105
  06:28:01 STEP 2767 H=2767:00 +CPU= 18.660
  06:28:20 STEP 2768 H=2768:00 +CPU= 19.124
  06:28:49 STEP 2769 H=2769:00 +CPU= 29.150
  06:29:09 STEP 2770 H=2770:00 +CPU= 19.237
  06:29:28 STEP 2771 H=2771:00 +CPU= 18.981
  06:30:00 STEP 2772 H=2772:00 +CPU= 32.388
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002772
  06:30:20 STEP 2773 H=2773:00 +CPU= 19.374
  06:30:39 STEP 2774 H=2774:00 +CPU= 19.258
  06:31:08 STEP 2775 H=2775:00 +CPU= 29.180
  06:31:28 STEP 2776 H=2776:00 +CPU= 19.434
  06:31:46 STEP 2777 H=2777:00 +CPU= 18.104
  06:32:16 STEP 2778 H=2778:00 +CPU= 29.748
  06:32:35 STEP 2779 H=2779:00 +CPU= 18.630
  06:32:54 STEP 2780 H=2780:00 +CPU= 19.409
  06:33:24 STEP 2781 H=2781:00 +CPU= 29.236
  06:33:43 STEP 2782 H=2782:00 +CPU= 19.519
  06:34:03 STEP 2783 H=2783:00 +CPU= 19.911
  06:34:37 STEP 2784 H=2784:00 +CPU= 33.790
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_115.zip
Uploading the intermediate file: upload_file_115.zip
  06:34:55 STEP 2785 H=2785:00 +CPU= 18.033
  06:35:15 STEP 2786 H=2786:00 +CPU= 19.335
  06:35:45 STEP 2787 H=2787:00 +CPU= 29.842
  06:36:04 STEP 2788 H=2788:00 +CPU= 19.228
  06:36:23 STEP 2789 H=2789:00 +CPU= 18.290
  06:36:53 STEP 2790 H=2790:00 +CPU= 30.020
  06:37:12 STEP 2791 H=2791:00 +CPU= 18.941
  06:37:31 STEP 2792 H=2792:00 +CPU= 19.531
  06:38:01 STEP 2793 H=2793:00 +CPU= 29.436
  06:38:20 STEP 2794 H=2794:00 +CPU= 19.439
  06:38:40 STEP 2795 H=2795:00 +CPU= 18.953
  06:39:12 STEP 2796 H=2796:00 +CPU= 32.427
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002796
  06:39:31 STEP 2797 H=2797:00 +CPU= 18.480
  06:39:50 STEP 2798 H=2798:00 +CPU= 18.985
  06:40:20 STEP 2799 H=2799:00 +CPU= 29.963
  06:40:39 STEP 2800 H=2800:00 +CPU= 19.253
  06:40:58 STEP 2801 H=2801:00 +CPU= 18.582
  06:41:28 STEP 2802 H=2802:00 +CPU= 29.811
  06:41:47 STEP 2803 H=2803:00 +CPU= 18.605
  06:42:06 STEP 2804 H=2804:00 +CPU= 19.332
  06:42:36 STEP 2805 H=2805:00 +CPU= 29.321
  06:42:55 STEP 2806 H=2806:00 +CPU= 19.309
  06:43:15 STEP 2807 H=2807:00 +CPU= 19.482
  06:43:48 STEP 2808 H=2808:00 +CPU= 33.683
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_116.zip
Uploading the intermediate file: upload_file_116.zip
  06:44:07 STEP 2809 H=2809:00 +CPU= 18.003
  06:44:25 STEP 2810 H=2810:00 +CPU= 18.758
  06:44:55 STEP 2811 H=2811:00 +CPU= 29.340
  06:45:15 STEP 2812 H=2812:00 +CPU= 20.095
  06:45:34 STEP 2813 H=2813:00 +CPU= 18.654
  06:46:04 STEP 2814 H=2814:00 +CPU= 30.335
  06:46:24 STEP 2815 H=2815:00 +CPU= 18.976
  06:46:43 STEP 2816 H=2816:00 +CPU= 19.213
  06:47:13 STEP 2817 H=2817:00 +CPU= 29.980
  06:47:32 STEP 2818 H=2818:00 +CPU= 19.263
  06:47:51 STEP 2819 H=2819:00 +CPU= 18.897
  06:48:24 STEP 2820 H=2820:00 +CPU= 32.288
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002820
  06:48:42 STEP 2821 H=2821:00 +CPU= 18.152
  06:49:01 STEP 2822 H=2822:00 +CPU= 18.952
  06:49:30 STEP 2823 H=2823:00 +CPU= 28.874
  06:49:49 STEP 2824 H=2824:00 +CPU= 18.857
  06:50:07 STEP 2825 H=2825:00 +CPU= 18.162
  06:50:39 STEP 2826 H=2826:00 +CPU= 31.085
  06:50:57 STEP 2827 H=2827:00 +CPU= 18.591
  06:51:17 STEP 2828 H=2828:00 +CPU= 19.372
  06:51:46 STEP 2829 H=2829:00 +CPU= 28.950
  06:52:05 STEP 2830 H=2830:00 +CPU= 19.255
  06:52:25 STEP 2831 H=2831:00 +CPU= 19.160
  06:52:58 STEP 2832 H=2832:00 +CPU= 33.496
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_117.zip
Uploading the intermediate file: upload_file_117.zip
  06:53:16 STEP 2833 H=2833:00 +CPU= 18.112
  06:53:35 STEP 2834 H=2834:00 +CPU= 18.768
  06:54:05 STEP 2835 H=2835:00 +CPU= 29.761
  06:54:24 STEP 2836 H=2836:00 +CPU= 18.734
  06:54:42 STEP 2837 H=2837:00 +CPU= 18.263
  06:55:13 STEP 2838 H=2838:00 +CPU= 30.721
  06:55:33 STEP 2839 H=2839:00 +CPU= 19.390
  06:55:52 STEP 2840 H=2840:00 +CPU= 19.173
  06:56:22 STEP 2841 H=2841:00 +CPU= 29.800
  06:56:42 STEP 2842 H=2842:00 +CPU= 19.480
  06:57:00 STEP 2843 H=2843:00 +CPU= 18.616
  06:57:33 STEP 2844 H=2844:00 +CPU= 32.200
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002844
  06:57:51 STEP 2845 H=2845:00 +CPU= 18.171
  06:58:10 STEP 2846 H=2846:00 +CPU= 19.050
  06:58:39 STEP 2847 H=2847:00 +CPU= 29.010
  06:58:59 STEP 2848 H=2848:00 +CPU= 19.064
  06:59:17 STEP 2849 H=2849:00 +CPU= 18.297
  06:59:47 STEP 2850 H=2850:00 +CPU= 29.623
  07:00:06 STEP 2851 H=2851:00 +CPU= 18.987
  07:00:26 STEP 2852 H=2852:00 +CPU= 20.427
  07:00:56 STEP 2853 H=2853:00 +CPU= 29.059
  07:01:15 STEP 2854 H=2854:00 +CPU= 19.325
  07:01:35 STEP 2855 H=2855:00 +CPU= 19.527
  07:02:09 STEP 2856 H=2856:00 +CPU= 33.658
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_118.zip
Uploading the intermediate file: upload_file_118.zip
  07:02:27 STEP 2857 H=2857:00 +CPU= 18.117
  07:02:46 STEP 2858 H=2858:00 +CPU= 18.751
  07:03:15 STEP 2859 H=2859:00 +CPU= 29.713
  07:03:34 STEP 2860 H=2860:00 +CPU= 18.775
  07:03:53 STEP 2861 H=2861:00 +CPU= 18.259
  07:04:23 STEP 2862 H=2862:00 +CPU= 30.517
  07:04:42 STEP 2863 H=2863:00 +CPU= 18.838
  07:05:02 STEP 2864 H=2864:00 +CPU= 19.311
  07:05:33 STEP 2865 H=2865:00 +CPU= 31.110
  07:05:52 STEP 2866 H=2866:00 +CPU= 19.331
  07:06:11 STEP 2867 H=2867:00 +CPU= 18.568
  07:06:43 STEP 2868 H=2868:00 +CPU= 32.045
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002868
  07:07:02 STEP 2869 H=2869:00 +CPU= 18.320
  07:07:21 STEP 2870 H=2870:00 +CPU= 18.858
  07:07:50 STEP 2871 H=2871:00 +CPU= 29.083
  07:08:09 STEP 2872 H=2872:00 +CPU= 19.009
  07:08:27 STEP 2873 H=2873:00 +CPU= 18.115
  07:08:57 STEP 2874 H=2874:00 +CPU= 29.686
  07:09:16 STEP 2875 H=2875:00 +CPU= 18.659
  07:09:35 STEP 2876 H=2876:00 +CPU= 19.246
  07:10:05 STEP 2877 H=2877:00 +CPU= 29.077
  07:10:25 STEP 2878 H=2878:00 +CPU= 20.216
  07:10:44 STEP 2879 H=2879:00 +CPU= 19.132
  07:11:18 STEP 2880 H=2880:00 +CPU= 33.462
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_119.zip
Uploading the intermediate file: upload_file_119.zip
  07:11:36 STEP 2881 H=2881:00 +CPU= 17.853
Uploading trickle at timestep: 10368000
  07:11:54 STEP 2882 H=2882:00 +CPU= 18.619
  07:12:24 STEP 2883 H=2883:00 +CPU= 29.182
  07:12:43 STEP 2884 H=2884:00 +CPU= 18.878
  07:13:01 STEP 2885 H=2885:00 +CPU= 18.129
  07:13:31 STEP 2886 H=2886:00 +CPU= 30.122
  07:13:50 STEP 2887 H=2887:00 +CPU= 19.005
  07:14:10 STEP 2888 H=2888:00 +CPU= 19.465
  07:14:39 STEP 2889 H=2889:00 +CPU= 29.315
  07:14:59 STEP 2890 H=2890:00 +CPU= 19.325
  07:15:19 STEP 2891 H=2891:00 +CPU= 19.707
  07:15:51 STEP 2892 H=2892:00 +CPU= 32.389
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002892
  07:16:09 STEP 2893 H=2893:00 +CPU= 18.122
  07:16:28 STEP 2894 H=2894:00 +CPU= 18.784
  07:16:57 STEP 2895 H=2895:00 +CPU= 28.915
  07:17:16 STEP 2896 H=2896:00 +CPU= 18.850
  07:17:34 STEP 2897 H=2897:00 +CPU= 17.995
  07:18:04 STEP 2898 H=2898:00 +CPU= 29.666
  07:18:23 STEP 2899 H=2899:00 +CPU= 18.319
  07:18:42 STEP 2900 H=2900:00 +CPU= 19.230
  07:19:11 STEP 2901 H=2901:00 +CPU= 29.301
  07:19:31 STEP 2902 H=2902:00 +CPU= 19.242
  07:19:50 STEP 2903 H=2903:00 +CPU= 18.811
  07:20:24 STEP 2904 H=2904:00 +CPU= 34.045
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_120.zip
Uploading the intermediate file: upload_file_120.zip
  07:20:42 STEP 2905 H=2905:00 +CPU= 18.215
  07:21:01 STEP 2906 H=2906:00 +CPU= 18.432
  07:21:30 STEP 2907 H=2907:00 +CPU= 28.866
  07:21:49 STEP 2908 H=2908:00 +CPU= 18.878
  07:22:07 STEP 2909 H=2909:00 +CPU= 18.211
  07:22:37 STEP 2910 H=2910:00 +CPU= 29.835
  07:22:56 STEP 2911 H=2911:00 +CPU= 18.508
  07:23:15 STEP 2912 H=2912:00 +CPU= 19.207
  07:23:44 STEP 2913 H=2913:00 +CPU= 29.192
  07:24:04 STEP 2914 H=2914:00 +CPU= 19.101
  07:24:22 STEP 2915 H=2915:00 +CPU= 18.793
  07:24:55 STEP 2916 H=2916:00 +CPU= 32.247
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002916
  07:25:14 STEP 2917 H=2917:00 +CPU= 18.748
  07:25:34 STEP 2918 H=2918:00 +CPU= 19.749
  07:26:03 STEP 2919 H=2919:00 +CPU= 28.855
  07:26:22 STEP 2920 H=2920:00 +CPU= 18.978
  07:26:40 STEP 2921 H=2921:00 +CPU= 18.436
  07:27:10 STEP 2922 H=2922:00 +CPU= 29.855
  07:27:29 STEP 2923 H=2923:00 +CPU= 18.561
  07:27:48 STEP 2924 H=2924:00 +CPU= 19.104
  07:28:17 STEP 2925 H=2925:00 +CPU= 29.182
  07:28:37 STEP 2926 H=2926:00 +CPU= 19.323
  07:28:56 STEP 2927 H=2927:00 +CPU= 19.264
  07:29:30 STEP 2928 H=2928:00 +CPU= 33.459
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_121.zip
Uploading the intermediate file: upload_file_121.zip
  07:29:48 STEP 2929 H=2929:00 +CPU= 17.984
  07:30:07 STEP 2930 H=2930:00 +CPU= 18.598
  07:30:37 STEP 2931 H=2931:00 +CPU= 30.438
  07:30:56 STEP 2932 H=2932:00 +CPU= 18.739
  07:31:14 STEP 2933 H=2933:00 +CPU= 17.922
  07:31:44 STEP 2934 H=2934:00 +CPU= 29.560
  07:32:02 STEP 2935 H=2935:00 +CPU= 18.599
  07:32:22 STEP 2936 H=2936:00 +CPU= 19.169
  07:32:51 STEP 2937 H=2937:00 +CPU= 28.993
  07:33:10 STEP 2938 H=2938:00 +CPU= 19.166
  07:33:29 STEP 2939 H=2939:00 +CPU= 18.596
  07:34:01 STEP 2940 H=2940:00 +CPU= 32.180
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002940
  07:34:19 STEP 2941 H=2941:00 +CPU= 18.249
  07:34:38 STEP 2942 H=2942:00 +CPU= 18.877
  07:35:08 STEP 2943 H=2943:00 +CPU= 29.494
  07:35:28 STEP 2944 H=2944:00 +CPU= 19.548
  07:35:46 STEP 2945 H=2945:00 +CPU= 18.427
  07:36:16 STEP 2946 H=2946:00 +CPU= 29.289
  07:36:34 STEP 2947 H=2947:00 +CPU= 18.285
  07:36:53 STEP 2948 H=2948:00 +CPU= 19.075
  07:37:23 STEP 2949 H=2949:00 +CPU= 29.285
  07:37:42 STEP 2950 H=2950:00 +CPU= 19.426
  07:38:01 STEP 2951 H=2951:00 +CPU= 18.940
  07:38:34 STEP 2952 H=2952:00 +CPU= 32.583
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.18310829420388     
  MAXGPFV : MAX. VALUE =   0.746199867914359     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    333888170 BYTES IN      8 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0093( 3.2%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 07:38:34 STEP 2952 H=2952:00 +CPU= 32.583
 END CNT3
 NSTEP =  2952 CNT0   000000000  28.916  28.916  29.063   0.995               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************   138.3     0.0   138.3     0.7   219.2
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********    100.00      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    1563.6    1563.6      4.73      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     251.6     251.6      0.70      0.00
  10 SCAN2M - PHYSICS                             2953    9036.6    9036.6     25.24      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247     809.5     809.5      0.19      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126      14.9      14.9      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985   53952.3   53952.3     50.27      0.00
  14 SUINIF                                          1    1320.0    1320.0      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      35.2      35.2      0.01      0.00
  18 SUSPECG                                         1     246.2     246.2      0.00      0.00
  19 SUSPEC                                          1     254.8     254.8      0.00      0.00
  24 SUGRIDU                                         1     787.3     787.3      0.00      0.00
  25 SPECRT                                          1     138.5     138.5      0.00      0.00
  26 SUGRIDF                                         1     139.4     139.4      0.00      0.00
  27 RESTART FILES - WRITING                       123    1625.6    1625.6      0.19      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               247    1684.3    1684.3      0.39      0.00
  31 POSDDH IN STEPO                                13       0.6       0.6      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    2901.2    2901.2      8.10      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    2430.4    2430.4      6.79      0.00
  39 SU0YOMB                                         1     202.2     202.2      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953      12.7      12.7      0.04      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952     182.4     182.4      0.51      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      35.6      35.6      0.10      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094     126.9     126.9      1.21      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152     115.8     115.8      0.67      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      40.1      40.1      0.23      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      42.5      42.5      0.41      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      15.2      15.2      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      12.7      12.7      0.12      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152      11.2      11.2      0.07      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      16.8      16.8      0.16      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152      14.0      14.0      0.08      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME   105724.0 CPU TIME   62201.7 VECTOR TIME    62201.7


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      100.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc/slots/1/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/1/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214489/ICMSHhnw4+002940
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00t7_2019110100_123_993_12214489_1_r2054758698_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
07:41:58 (1885006): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:20 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 10,623,600 62,201 0.0059
09 May 2023 16:54:20 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 10,368,000 60,581 0.0058
09 May 2023 16:54:17 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 9,504,000 55,122 0.0058
09 May 2023 16:54:15 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 8,640,000 49,673 0.0057
09 May 2023 16:54:11 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 7,776,000 44,324 0.0057
09 May 2023 16:54:09 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 6,912,000 39,253 0.0057
09 May 2023 16:54:05 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 6,048,000 34,173 0.0057
09 May 2023 16:54:02 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 5,184,000 29,074 0.0056
09 May 2023 16:53:57 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 4,320,000 23,994 0.0056
09 May 2023 16:53:20 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 3,456,000 18,873 0.0055
09 May 2023 16:53:14 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 2,592,000 13,891 0.0054
09 May 2023 16:53:11 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 1,728,000 9,168 0.0053
09 May 2023 16:53:07 1484742 22316940 oifs_43r3_00t7_2019110100_123_993_12214489_1 864,000 4,544 0.0053


©2024 climateprediction.net