climateprediction.net home page
Task 22316159

Task 22316159

Name oifs_43r3_0117_2019110100_123_993_12214777_0
Workunit 12214777
Created 24 Feb 2023, 16:13:44 UTC
Sent 24 Feb 2023, 22:06:53 UTC
Report deadline 25 Apr 2023, 22:06:53 UTC
Received 26 Feb 2023, 10:31:09 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1535275
Run time 13 hours 56 min 13 sec
CPU time 13 hours 52 min 11 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.05 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,793.21 MB
Peak swap size 4,974.23 MB
Peak disk usage 1,688.54 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002340
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_97.zip
Uploading the intermediate file: upload_file_97.zip
  10:17:02 STEP 2353 H=2353:00 +CPU= 13.707
  10:17:16 STEP 2354 H=2354:00 +CPU= 13.835
  10:17:38 STEP 2355 H=2355:00 +CPU= 22.048
  10:17:52 STEP 2356 H=2356:00 +CPU= 13.846
  10:18:06 STEP 2357 H=2357:00 +CPU= 14.014
  10:18:29 STEP 2358 H=2358:00 +CPU= 23.423
  10:18:43 STEP 2359 H=2359:00 +CPU= 14.144
  10:18:58 STEP 2360 H=2360:00 +CPU= 14.435
  10:19:19 STEP 2361 H=2361:00 +CPU= 21.775
  10:19:33 STEP 2362 H=2362:00 +CPU= 13.908
  10:19:47 STEP 2363 H=2363:00 +CPU= 13.518
  10:20:11 STEP 2364 H=2364:00 +CPU= 24.288
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002364
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002364
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002364
  10:20:25 STEP 2365 H=2365:00 +CPU= 14.025
  10:20:39 STEP 2366 H=2366:00 +CPU= 13.702
  10:21:01 STEP 2367 H=2367:00 +CPU= 22.201
  10:21:15 STEP 2368 H=2368:00 +CPU= 14.319
  10:21:29 STEP 2369 H=2369:00 +CPU= 13.915
  10:21:51 STEP 2370 H=2370:00 +CPU= 22.015
  10:22:05 STEP 2371 H=2371:00 +CPU= 13.330
  10:22:18 STEP 2372 H=2372:00 +CPU= 13.652
  10:22:41 STEP 2373 H=2373:00 +CPU= 22.190
  10:22:55 STEP 2374 H=2374:00 +CPU= 14.502
  10:23:10 STEP 2375 H=2375:00 +CPU= 14.984
  10:23:36 STEP 2376 H=2376:00 +CPU= 26.296
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_98.zip
Uploading the intermediate file: upload_file_98.zip
  10:23:50 STEP 2377 H=2377:00 +CPU= 13.719
  10:24:04 STEP 2378 H=2378:00 +CPU= 14.330
  10:24:27 STEP 2379 H=2379:00 +CPU= 22.194
  10:24:40 STEP 2380 H=2380:00 +CPU= 13.685
  10:24:54 STEP 2381 H=2381:00 +CPU= 13.516
  10:25:17 STEP 2382 H=2382:00 +CPU= 23.166
  10:25:31 STEP 2383 H=2383:00 +CPU= 14.307
  10:25:45 STEP 2384 H=2384:00 +CPU= 13.838
  10:26:07 STEP 2385 H=2385:00 +CPU= 22.022
  10:26:21 STEP 2386 H=2386:00 +CPU= 13.764
  10:26:35 STEP 2387 H=2387:00 +CPU= 13.915
  10:26:59 STEP 2388 H=2388:00 +CPU= 23.752
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002388
  10:27:12 STEP 2389 H=2389:00 +CPU= 13.301
  10:27:26 STEP 2390 H=2390:00 +CPU= 13.830
  10:27:48 STEP 2391 H=2391:00 +CPU= 21.871
  10:28:02 STEP 2392 H=2392:00 +CPU= 13.827
  10:28:15 STEP 2393 H=2393:00 +CPU= 13.814
  10:28:39 STEP 2394 H=2394:00 +CPU= 23.154
  10:28:52 STEP 2395 H=2395:00 +CPU= 13.326
  10:29:06 STEP 2396 H=2396:00 +CPU= 13.854
  10:29:28 STEP 2397 H=2397:00 +CPU= 21.890
  10:29:42 STEP 2398 H=2398:00 +CPU= 13.847
  10:29:55 STEP 2399 H=2399:00 +CPU= 13.597
  10:30:20 STEP 2400 H=2400:00 +CPU= 25.088
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_99.zip
Uploading the intermediate file: upload_file_99.zip
  10:30:34 STEP 2401 H=2401:00 +CPU= 13.337
Uploading trickle at timestep: 8640000
  10:30:48 STEP 2402 H=2402:00 +CPU= 13.855
  10:31:10 STEP 2403 H=2403:00 +CPU= 22.134
  10:31:25 STEP 2404 H=2404:00 +CPU= 15.092
  10:31:38 STEP 2405 H=2405:00 +CPU= 13.216
  10:32:01 STEP 2406 H=2406:00 +CPU= 22.714
  10:32:15 STEP 2407 H=2407:00 +CPU= 13.889
  10:32:29 STEP 2408 H=2408:00 +CPU= 14.611
  10:32:52 STEP 2409 H=2409:00 +CPU= 22.576
  10:33:06 STEP 2410 H=2410:00 +CPU= 14.215
  10:33:19 STEP 2411 H=2411:00 +CPU= 13.336
  10:33:44 STEP 2412 H=2412:00 +CPU= 24.867
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002412
  10:33:59 STEP 2413 H=2413:00 +CPU= 14.408
  10:34:13 STEP 2414 H=2414:00 +CPU= 14.647
  10:34:35 STEP 2415 H=2415:00 +CPU= 21.979
  10:34:49 STEP 2416 H=2416:00 +CPU= 13.808
  10:35:03 STEP 2417 H=2417:00 +CPU= 14.189
  10:35:26 STEP 2418 H=2418:00 +CPU= 22.487
  10:35:39 STEP 2419 H=2419:00 +CPU= 13.325
  10:35:53 STEP 2420 H=2420:00 +CPU= 13.947
  10:36:15 STEP 2421 H=2421:00 +CPU= 21.617
  10:36:29 STEP 2422 H=2422:00 +CPU= 13.768
  10:36:42 STEP 2423 H=2423:00 +CPU= 13.658
  10:37:08 STEP 2424 H=2424:00 +CPU= 25.412
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_100.zip
Uploading the intermediate file: upload_file_100.zip
  10:37:22 STEP 2425 H=2425:00 +CPU= 14.062
  10:37:36 STEP 2426 H=2426:00 +CPU= 13.955
  10:37:58 STEP 2427 H=2427:00 +CPU= 21.825
  10:38:12 STEP 2428 H=2428:00 +CPU= 14.327
  10:38:26 STEP 2429 H=2429:00 +CPU= 13.727
  10:38:48 STEP 2430 H=2430:00 +CPU= 22.360
  10:39:01 STEP 2431 H=2431:00 +CPU= 13.491
  10:39:15 STEP 2432 H=2432:00 +CPU= 13.678
  10:39:38 STEP 2433 H=2433:00 +CPU= 22.355
  10:39:52 STEP 2434 H=2434:00 +CPU= 14.383
  10:40:06 STEP 2435 H=2435:00 +CPU= 13.674
  10:40:31 STEP 2436 H=2436:00 +CPU= 25.062
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002436
  10:40:45 STEP 2437 H=2437:00 +CPU= 14.196
  10:41:00 STEP 2438 H=2438:00 +CPU= 14.581
  10:41:22 STEP 2439 H=2439:00 +CPU= 22.305
  10:41:36 STEP 2440 H=2440:00 +CPU= 14.466
  10:41:50 STEP 2441 H=2441:00 +CPU= 13.258
  10:42:13 STEP 2442 H=2442:00 +CPU= 23.530
  10:42:27 STEP 2443 H=2443:00 +CPU= 13.965
  10:42:42 STEP 2444 H=2444:00 +CPU= 14.740
  10:43:04 STEP 2445 H=2445:00 +CPU= 22.575
  10:43:18 STEP 2446 H=2446:00 +CPU= 13.830
  10:43:33 STEP 2447 H=2447:00 +CPU= 15.139
  10:43:58 STEP 2448 H=2448:00 +CPU= 24.640
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_101.zip
Uploading the intermediate file: upload_file_101.zip
  10:44:11 STEP 2449 H=2449:00 +CPU= 13.228
  10:44:25 STEP 2450 H=2450:00 +CPU= 13.668
  10:44:47 STEP 2451 H=2451:00 +CPU= 21.601
  10:45:01 STEP 2452 H=2452:00 +CPU= 13.992
  10:45:15 STEP 2453 H=2453:00 +CPU= 14.295
  10:45:38 STEP 2454 H=2454:00 +CPU= 22.957
  10:45:51 STEP 2455 H=2455:00 +CPU= 13.501
  10:46:06 STEP 2456 H=2456:00 +CPU= 14.124
  10:46:29 STEP 2457 H=2457:00 +CPU= 23.197
  10:46:42 STEP 2458 H=2458:00 +CPU= 13.711
  10:46:56 STEP 2459 H=2459:00 +CPU= 13.274
  10:47:19 STEP 2460 H=2460:00 +CPU= 23.674
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002460
  10:47:33 STEP 2461 H=2461:00 +CPU= 13.911
  10:47:47 STEP 2462 H=2462:00 +CPU= 13.993
  10:48:10 STEP 2463 H=2463:00 +CPU= 22.262
  10:48:25 STEP 2464 H=2464:00 +CPU= 15.115
  10:48:38 STEP 2465 H=2465:00 +CPU= 13.465
  10:49:00 STEP 2466 H=2466:00 +CPU= 21.985
  10:49:14 STEP 2467 H=2467:00 +CPU= 13.799
  10:49:28 STEP 2468 H=2468:00 +CPU= 13.759
  10:49:50 STEP 2469 H=2469:00 +CPU= 22.127
  10:50:04 STEP 2470 H=2470:00 +CPU= 14.219
  10:50:18 STEP 2471 H=2471:00 +CPU= 13.685
  10:50:43 STEP 2472 H=2472:00 +CPU= 25.448
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_102.zip
Uploading the intermediate file: upload_file_102.zip
  10:50:57 STEP 2473 H=2473:00 +CPU= 13.578
  10:51:11 STEP 2474 H=2474:00 +CPU= 13.680
  10:51:32 STEP 2475 H=2475:00 +CPU= 21.563
  10:51:46 STEP 2476 H=2476:00 +CPU= 13.802
  10:52:00 STEP 2477 H=2477:00 +CPU= 13.830
  10:52:23 STEP 2478 H=2478:00 +CPU= 23.436
  10:52:37 STEP 2479 H=2479:00 +CPU= 14.134
  10:52:52 STEP 2480 H=2480:00 +CPU= 14.403
  10:53:14 STEP 2481 H=2481:00 +CPU= 21.937
  10:53:28 STEP 2482 H=2482:00 +CPU= 13.671
  10:53:41 STEP 2483 H=2483:00 +CPU= 13.554
  10:54:05 STEP 2484 H=2484:00 +CPU= 23.657
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002484
  10:54:18 STEP 2485 H=2485:00 +CPU= 13.276
  10:54:32 STEP 2486 H=2486:00 +CPU= 13.637
  10:54:53 STEP 2487 H=2487:00 +CPU= 21.634
  10:55:08 STEP 2488 H=2488:00 +CPU= 14.313
  10:55:22 STEP 2489 H=2489:00 +CPU= 13.931
  10:55:45 STEP 2490 H=2490:00 +CPU= 23.040
  10:55:59 STEP 2491 H=2491:00 +CPU= 13.924
  10:56:13 STEP 2492 H=2492:00 +CPU= 14.258
  10:56:35 STEP 2493 H=2493:00 +CPU= 21.977
  10:56:49 STEP 2494 H=2494:00 +CPU= 14.275
  10:57:03 STEP 2495 H=2495:00 +CPU= 14.102
  10:57:28 STEP 2496 H=2496:00 +CPU= 24.813
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_103.zip
Uploading the intermediate file: upload_file_103.zip
  10:57:42 STEP 2497 H=2497:00 +CPU= 13.636
  10:57:55 STEP 2498 H=2498:00 +CPU= 13.748
  10:58:18 STEP 2499 H=2499:00 +CPU= 22.481
  10:58:32 STEP 2500 H=2500:00 +CPU= 14.313
  10:58:46 STEP 2501 H=2501:00 +CPU= 13.848
  10:59:09 STEP 2502 H=2502:00 +CPU= 22.869
  10:59:23 STEP 2503 H=2503:00 +CPU= 13.827
  10:59:37 STEP 2504 H=2504:00 +CPU= 14.235
  11:00:00 STEP 2505 H=2505:00 +CPU= 22.359
  11:00:13 STEP 2506 H=2506:00 +CPU= 13.815
  11:00:27 STEP 2507 H=2507:00 +CPU= 13.353
  11:00:51 STEP 2508 H=2508:00 +CPU= 23.938
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002508
  11:01:04 STEP 2509 H=2509:00 +CPU= 13.402
  11:01:18 STEP 2510 H=2510:00 +CPU= 13.789
  11:01:39 STEP 2511 H=2511:00 +CPU= 21.362
  11:01:53 STEP 2512 H=2512:00 +CPU= 13.789
  11:02:07 STEP 2513 H=2513:00 +CPU= 13.640
  11:02:30 STEP 2514 H=2514:00 +CPU= 22.802
  11:02:43 STEP 2515 H=2515:00 +CPU= 13.743
  11:02:58 STEP 2516 H=2516:00 +CPU= 14.304
  11:03:19 STEP 2517 H=2517:00 +CPU= 21.562
  11:03:33 STEP 2518 H=2518:00 +CPU= 13.706
  11:03:46 STEP 2519 H=2519:00 +CPU= 13.585
  11:04:11 STEP 2520 H=2520:00 +CPU= 24.635
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_104.zip
Uploading the intermediate file: upload_file_104.zip
  11:04:24 STEP 2521 H=2521:00 +CPU= 13.292
  11:04:38 STEP 2522 H=2522:00 +CPU= 13.588
  11:05:00 STEP 2523 H=2523:00 +CPU= 21.519
  11:05:13 STEP 2524 H=2524:00 +CPU= 13.710
  11:05:27 STEP 2525 H=2525:00 +CPU= 13.271
  11:05:48 STEP 2526 H=2526:00 +CPU= 21.943
  11:06:02 STEP 2527 H=2527:00 +CPU= 13.425
  11:06:16 STEP 2528 H=2528:00 +CPU= 13.666
  11:06:37 STEP 2529 H=2529:00 +CPU= 21.555
  11:06:51 STEP 2530 H=2530:00 +CPU= 13.721
  11:07:04 STEP 2531 H=2531:00 +CPU= 13.307
  11:07:29 STEP 2532 H=2532:00 +CPU= 24.376
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002532
  11:07:42 STEP 2533 H=2533:00 +CPU= 13.320
  11:07:56 STEP 2534 H=2534:00 +CPU= 13.663
  11:08:18 STEP 2535 H=2535:00 +CPU= 21.953
  11:08:31 STEP 2536 H=2536:00 +CPU= 13.690
  11:08:45 STEP 2537 H=2537:00 +CPU= 13.247
  11:09:06 STEP 2538 H=2538:00 +CPU= 21.934
  11:09:20 STEP 2539 H=2539:00 +CPU= 13.261
  11:09:33 STEP 2540 H=2540:00 +CPU= 13.642
  11:09:55 STEP 2541 H=2541:00 +CPU= 21.445
  11:10:08 STEP 2542 H=2542:00 +CPU= 13.638
  11:10:22 STEP 2543 H=2543:00 +CPU= 13.569
  11:10:48 STEP 2544 H=2544:00 +CPU= 25.522
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_105.zip
Uploading the intermediate file: upload_file_105.zip
  11:11:02 STEP 2545 H=2545:00 +CPU= 14.010
  11:11:16 STEP 2546 H=2546:00 +CPU= 14.458
  11:11:38 STEP 2547 H=2547:00 +CPU= 22.346
  11:11:53 STEP 2548 H=2548:00 +CPU= 14.440
  11:12:07 STEP 2549 H=2549:00 +CPU= 13.997
  11:12:29 STEP 2550 H=2550:00 +CPU= 22.280
  11:12:43 STEP 2551 H=2551:00 +CPU= 14.254
  11:12:58 STEP 2552 H=2552:00 +CPU= 14.554
  11:13:20 STEP 2553 H=2553:00 +CPU= 21.703
  11:13:34 STEP 2554 H=2554:00 +CPU= 13.761
  11:13:47 STEP 2555 H=2555:00 +CPU= 13.696
  11:14:12 STEP 2556 H=2556:00 +CPU= 24.428
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002556
  11:14:25 STEP 2557 H=2557:00 +CPU= 13.265
  11:14:39 STEP 2558 H=2558:00 +CPU= 13.656
  11:15:00 STEP 2559 H=2559:00 +CPU= 21.406
  11:15:14 STEP 2560 H=2560:00 +CPU= 13.678
  11:15:28 STEP 2561 H=2561:00 +CPU= 14.398
  11:15:51 STEP 2562 H=2562:00 +CPU= 22.518
  11:16:04 STEP 2563 H=2563:00 +CPU= 13.345
  11:16:18 STEP 2564 H=2564:00 +CPU= 13.750
  11:16:39 STEP 2565 H=2565:00 +CPU= 21.474
  11:16:53 STEP 2566 H=2566:00 +CPU= 13.635
  11:17:07 STEP 2567 H=2567:00 +CPU= 13.670
  11:17:32 STEP 2568 H=2568:00 +CPU= 25.705
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_106.zip
Uploading the intermediate file: upload_file_106.zip
  11:17:46 STEP 2569 H=2569:00 +CPU= 13.970
  11:18:00 STEP 2570 H=2570:00 +CPU= 13.923
  11:18:22 STEP 2571 H=2571:00 +CPU= 21.576
  11:18:36 STEP 2572 H=2572:00 +CPU= 13.702
  11:18:50 STEP 2573 H=2573:00 +CPU= 13.953
  11:19:12 STEP 2574 H=2574:00 +CPU= 22.034
  11:19:26 STEP 2575 H=2575:00 +CPU= 14.031
  11:19:40 STEP 2576 H=2576:00 +CPU= 14.380
  11:20:03 STEP 2577 H=2577:00 +CPU= 22.522
  11:20:17 STEP 2578 H=2578:00 +CPU= 14.584
  11:20:31 STEP 2579 H=2579:00 +CPU= 13.989
  11:20:56 STEP 2580 H=2580:00 +CPU= 24.400
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002580
  11:21:09 STEP 2581 H=2581:00 +CPU= 13.946
  11:21:23 STEP 2582 H=2582:00 +CPU= 13.891
  11:21:45 STEP 2583 H=2583:00 +CPU= 22.000
  11:22:00 STEP 2584 H=2584:00 +CPU= 14.175
  11:22:14 STEP 2585 H=2585:00 +CPU= 13.927
  11:22:36 STEP 2586 H=2586:00 +CPU= 22.272
  11:22:50 STEP 2587 H=2587:00 +CPU= 14.010
  11:23:04 STEP 2588 H=2588:00 +CPU= 14.152
  11:23:26 STEP 2589 H=2589:00 +CPU= 21.900
  11:23:40 STEP 2590 H=2590:00 +CPU= 13.650
  11:23:53 STEP 2591 H=2591:00 +CPU= 13.598
  11:24:18 STEP 2592 H=2592:00 +CPU= 24.576
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_107.zip
Uploading the intermediate file: upload_file_107.zip
  11:24:31 STEP 2593 H=2593:00 +CPU= 13.244
  11:24:45 STEP 2594 H=2594:00 +CPU= 13.655
  11:25:07 STEP 2595 H=2595:00 +CPU= 22.096
  11:25:21 STEP 2596 H=2596:00 +CPU= 14.635
  11:25:35 STEP 2597 H=2597:00 +CPU= 13.426
  11:25:57 STEP 2598 H=2598:00 +CPU= 22.190
  11:26:11 STEP 2599 H=2599:00 +CPU= 13.677
  11:26:25 STEP 2600 H=2600:00 +CPU= 13.935
  11:26:47 STEP 2601 H=2601:00 +CPU= 22.074
  11:27:02 STEP 2602 H=2602:00 +CPU= 14.909
  11:27:16 STEP 2603 H=2603:00 +CPU= 13.961
  11:27:41 STEP 2604 H=2604:00 +CPU= 25.141
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002604
  11:27:54 STEP 2605 H=2605:00 +CPU= 13.289
  11:28:08 STEP 2606 H=2606:00 +CPU= 13.722
  11:28:29 STEP 2607 H=2607:00 +CPU= 21.541
  11:28:43 STEP 2608 H=2608:00 +CPU= 13.670
  11:28:56 STEP 2609 H=2609:00 +CPU= 13.209
  11:29:18 STEP 2610 H=2610:00 +CPU= 21.966
  11:29:32 STEP 2611 H=2611:00 +CPU= 13.244
  11:29:45 STEP 2612 H=2612:00 +CPU= 13.627
  11:30:07 STEP 2613 H=2613:00 +CPU= 21.392
  11:30:20 STEP 2614 H=2614:00 +CPU= 13.597
  11:30:34 STEP 2615 H=2615:00 +CPU= 13.657
  11:30:59 STEP 2616 H=2616:00 +CPU= 25.168
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_108.zip
Uploading the intermediate file: upload_file_108.zip
  11:31:12 STEP 2617 H=2617:00 +CPU= 13.256
  11:31:27 STEP 2618 H=2618:00 +CPU= 14.524
  11:31:49 STEP 2619 H=2619:00 +CPU= 21.941
  11:32:03 STEP 2620 H=2620:00 +CPU= 13.868
  11:32:17 STEP 2621 H=2621:00 +CPU= 13.953
  11:32:40 STEP 2622 H=2622:00 +CPU= 22.977
  11:32:53 STEP 2623 H=2623:00 +CPU= 13.291
  11:33:07 STEP 2624 H=2624:00 +CPU= 13.608
  11:33:28 STEP 2625 H=2625:00 +CPU= 21.558
  11:33:42 STEP 2626 H=2626:00 +CPU= 14.244
  11:33:57 STEP 2627 H=2627:00 +CPU= 14.751
  11:34:21 STEP 2628 H=2628:00 +CPU= 24.210
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002628
  11:34:35 STEP 2629 H=2629:00 +CPU= 13.234
  11:34:48 STEP 2630 H=2630:00 +CPU= 13.698
  11:35:10 STEP 2631 H=2631:00 +CPU= 22.005
  11:35:24 STEP 2632 H=2632:00 +CPU= 13.764
  11:35:38 STEP 2633 H=2633:00 +CPU= 13.684
  11:36:00 STEP 2634 H=2634:00 +CPU= 22.167
  11:36:14 STEP 2635 H=2635:00 +CPU= 13.958
  11:36:28 STEP 2636 H=2636:00 +CPU= 14.227
  11:36:50 STEP 2637 H=2637:00 +CPU= 22.027
  11:37:04 STEP 2638 H=2638:00 +CPU= 13.803
  11:37:19 STEP 2639 H=2639:00 +CPU= 14.611
  11:37:44 STEP 2640 H=2640:00 +CPU= 25.570
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_109.zip
Uploading the intermediate file: upload_file_109.zip
  11:37:58 STEP 2641 H=2641:00 +CPU= 13.288
Uploading trickle at timestep: 9504000
  11:38:12 STEP 2642 H=2642:00 +CPU= 14.653
  11:38:34 STEP 2643 H=2643:00 +CPU= 21.745
  11:38:48 STEP 2644 H=2644:00 +CPU= 14.421
  11:39:02 STEP 2645 H=2645:00 +CPU= 13.396
  11:39:24 STEP 2646 H=2646:00 +CPU= 22.521
  11:39:38 STEP 2647 H=2647:00 +CPU= 13.978
  11:39:53 STEP 2648 H=2648:00 +CPU= 14.562
  11:40:15 STEP 2649 H=2649:00 +CPU= 21.771
  11:40:28 STEP 2650 H=2650:00 +CPU= 13.693
  11:40:42 STEP 2651 H=2651:00 +CPU= 13.654
  11:41:06 STEP 2652 H=2652:00 +CPU= 24.332
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002652
  11:41:20 STEP 2653 H=2653:00 +CPU= 13.260
  11:41:33 STEP 2654 H=2654:00 +CPU= 13.653
  11:41:56 STEP 2655 H=2655:00 +CPU= 22.761
  11:42:11 STEP 2656 H=2656:00 +CPU= 14.369
  11:42:24 STEP 2657 H=2657:00 +CPU= 13.288
  11:42:47 STEP 2658 H=2658:00 +CPU= 22.778
  11:43:00 STEP 2659 H=2659:00 +CPU= 13.314
  11:43:14 STEP 2660 H=2660:00 +CPU= 13.744
  11:43:36 STEP 2661 H=2661:00 +CPU= 22.136
  11:43:50 STEP 2662 H=2662:00 +CPU= 14.251
  11:44:04 STEP 2663 H=2663:00 +CPU= 13.690
  11:44:28 STEP 2664 H=2664:00 +CPU= 24.610
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_110.zip
Uploading the intermediate file: upload_file_110.zip
  11:44:42 STEP 2665 H=2665:00 +CPU= 13.529
  11:44:56 STEP 2666 H=2666:00 +CPU= 14.328
  11:45:19 STEP 2667 H=2667:00 +CPU= 22.601
  11:45:33 STEP 2668 H=2668:00 +CPU= 14.380
  11:45:47 STEP 2669 H=2669:00 +CPU= 13.345
  11:46:09 STEP 2670 H=2670:00 +CPU= 22.017
  11:46:22 STEP 2671 H=2671:00 +CPU= 13.405
  11:46:36 STEP 2672 H=2672:00 +CPU= 13.704
  11:46:57 STEP 2673 H=2673:00 +CPU= 21.596
  11:47:12 STEP 2674 H=2674:00 +CPU= 14.325
  11:47:26 STEP 2675 H=2675:00 +CPU= 13.968
  11:47:51 STEP 2676 H=2676:00 +CPU= 24.753
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002676
  11:48:05 STEP 2677 H=2677:00 +CPU= 14.128
  11:48:18 STEP 2678 H=2678:00 +CPU= 13.769
  11:48:41 STEP 2679 H=2679:00 +CPU= 22.494
  11:48:55 STEP 2680 H=2680:00 +CPU= 14.418
  11:49:09 STEP 2681 H=2681:00 +CPU= 13.879
  11:49:31 STEP 2682 H=2682:00 +CPU= 22.185
  11:49:45 STEP 2683 H=2683:00 +CPU= 13.417
  11:49:59 STEP 2684 H=2684:00 +CPU= 14.052
  11:50:22 STEP 2685 H=2685:00 +CPU= 22.596
  11:50:36 STEP 2686 H=2686:00 +CPU= 14.173
  11:50:50 STEP 2687 H=2687:00 +CPU= 14.310
  11:51:16 STEP 2688 H=2688:00 +CPU= 25.712
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_111.zip
Uploading the intermediate file: upload_file_111.zip
  11:51:30 STEP 2689 H=2689:00 +CPU= 13.973
  11:51:44 STEP 2690 H=2690:00 +CPU= 14.617
  11:52:07 STEP 2691 H=2691:00 +CPU= 22.317
  11:52:21 STEP 2692 H=2692:00 +CPU= 14.315
  11:52:35 STEP 2693 H=2693:00 +CPU= 13.508
  11:52:57 STEP 2694 H=2694:00 +CPU= 22.206
  11:53:10 STEP 2695 H=2695:00 +CPU= 13.612
  11:53:25 STEP 2696 H=2696:00 +CPU= 14.745
  11:53:48 STEP 2697 H=2697:00 +CPU= 22.914
  11:54:03 STEP 2698 H=2698:00 +CPU= 14.484
  11:54:17 STEP 2699 H=2699:00 +CPU= 13.895
  11:54:41 STEP 2700 H=2700:00 +CPU= 24.011
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002700
  11:54:54 STEP 2701 H=2701:00 +CPU= 13.380
  11:55:09 STEP 2702 H=2702:00 +CPU= 14.664
  11:55:31 STEP 2703 H=2703:00 +CPU= 22.377
  11:55:46 STEP 2704 H=2704:00 +CPU= 14.788
  11:56:00 STEP 2705 H=2705:00 +CPU= 13.843
  11:56:22 STEP 2706 H=2706:00 +CPU= 22.211
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           11  MAX ETADOT VERTICAL VEL.=   9.535683273630882E-008
  LON  =    57.6562500000000       degrees
  LAT  =    42.0558239509352       degrees
  11:56:36 STEP 2707 H=2707:00 +CPU= 14.036
  11:56:50 STEP 2708 H=2708:00 +CPU= 13.700
  11:57:12 STEP 2709 H=2709:00 +CPU= 22.120
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           13  MAX ETADOT VERTICAL VEL.=   3.251980947612777E-007
  LON  =    54.8437500000000       degrees
  LAT  =    43.1773092288349       degrees
  11:57:26 STEP 2710 H=2710:00 +CPU= 14.430
  11:57:40 STEP 2711 H=2711:00 +CPU= 14.187
  11:58:06 STEP 2712 H=2712:00 +CPU= 25.255
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_112.zip
Uploading the intermediate file: upload_file_112.zip
  11:58:19 STEP 2713 H=2713:00 +CPU= 13.629
  11:58:33 STEP 2714 H=2714:00 +CPU= 13.872
  11:58:55 STEP 2715 H=2715:00 +CPU= 21.914
  11:59:10 STEP 2716 H=2716:00 +CPU= 14.395
  11:59:23 STEP 2717 H=2717:00 +CPU= 13.568
  11:59:46 STEP 2718 H=2718:00 +CPU= 22.564
  12:00:00 STEP 2719 H=2719:00 +CPU= 14.113
  12:00:14 STEP 2720 H=2720:00 +CPU= 14.458
  12:00:38 STEP 2721 H=2721:00 +CPU= 23.227
  12:00:53 STEP 2722 H=2722:00 +CPU= 14.959
  12:01:07 STEP 2723 H=2723:00 +CPU= 14.500
  12:01:32 STEP 2724 H=2724:00 +CPU= 24.932
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002724
  12:01:45 STEP 2725 H=2725:00 +CPU= 13.420
  12:02:00 STEP 2726 H=2726:00 +CPU= 14.764
  12:02:23 STEP 2727 H=2727:00 +CPU= 22.522
  12:02:37 STEP 2728 H=2728:00 +CPU= 14.685
  12:02:52 STEP 2729 H=2729:00 +CPU= 14.080
  12:03:15 STEP 2730 H=2730:00 +CPU= 23.162
  12:03:28 STEP 2731 H=2731:00 +CPU= 13.775
  12:03:43 STEP 2732 H=2732:00 +CPU= 14.114
  12:04:05 STEP 2733 H=2733:00 +CPU= 22.509
  12:04:19 STEP 2734 H=2734:00 +CPU= 13.661
  12:04:32 STEP 2735 H=2735:00 +CPU= 13.654
  12:04:58 STEP 2736 H=2736:00 +CPU= 25.129
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_113.zip
Uploading the intermediate file: upload_file_113.zip
  12:05:12 STEP 2737 H=2737:00 +CPU= 13.995
  12:05:26 STEP 2738 H=2738:00 +CPU= 14.490
  12:05:49 STEP 2739 H=2739:00 +CPU= 22.406
  12:06:02 STEP 2740 H=2740:00 +CPU= 13.664
  12:06:16 STEP 2741 H=2741:00 +CPU= 13.401
  12:06:38 STEP 2742 H=2742:00 +CPU= 22.219
  12:06:51 STEP 2743 H=2743:00 +CPU= 13.292
  12:07:05 STEP 2744 H=2744:00 +CPU= 13.803
  12:07:26 STEP 2745 H=2745:00 +CPU= 21.516
  12:07:41 STEP 2746 H=2746:00 +CPU= 14.455
  12:07:55 STEP 2747 H=2747:00 +CPU= 14.000
  12:08:19 STEP 2748 H=2748:00 +CPU= 24.168
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002748
  12:08:33 STEP 2749 H=2749:00 +CPU= 13.848
  12:08:47 STEP 2750 H=2750:00 +CPU= 14.478
  12:09:10 STEP 2751 H=2751:00 +CPU= 22.142
  12:09:23 STEP 2752 H=2752:00 +CPU= 13.752
  12:09:37 STEP 2753 H=2753:00 +CPU= 13.528
  12:09:59 STEP 2754 H=2754:00 +CPU= 22.198
  12:10:13 STEP 2755 H=2755:00 +CPU= 14.193
  12:10:27 STEP 2756 H=2756:00 +CPU= 13.742
  12:10:49 STEP 2757 H=2757:00 +CPU= 21.597
  12:11:02 STEP 2758 H=2758:00 +CPU= 13.687
  12:11:16 STEP 2759 H=2759:00 +CPU= 13.789
  12:11:44 STEP 2760 H=2760:00 +CPU= 27.357
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_114.zip
Uploading the intermediate file: upload_file_114.zip
  12:11:58 STEP 2761 H=2761:00 +CPU= 14.285
  12:12:12 STEP 2762 H=2762:00 +CPU= 14.044
  12:12:35 STEP 2763 H=2763:00 +CPU= 22.614
  12:12:49 STEP 2764 H=2764:00 +CPU= 14.282
  12:13:02 STEP 2765 H=2765:00 +CPU= 13.318
  12:13:24 STEP 2766 H=2766:00 +CPU= 22.009
  12:13:38 STEP 2767 H=2767:00 +CPU= 13.328
  12:13:51 STEP 2768 H=2768:00 +CPU= 13.787
  12:14:13 STEP 2769 H=2769:00 +CPU= 21.663
  12:14:28 STEP 2770 H=2770:00 +CPU= 14.833
  12:14:42 STEP 2771 H=2771:00 +CPU= 14.190
  12:15:07 STEP 2772 H=2772:00 +CPU= 24.600
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002772
  12:15:20 STEP 2773 H=2773:00 +CPU= 13.383
  12:15:34 STEP 2774 H=2774:00 +CPU= 13.826
  12:15:56 STEP 2775 H=2775:00 +CPU= 21.660
  12:16:10 STEP 2776 H=2776:00 +CPU= 14.719
  12:16:24 STEP 2777 H=2777:00 +CPU= 13.536
  12:16:46 STEP 2778 H=2778:00 +CPU= 22.411
  12:17:00 STEP 2779 H=2779:00 +CPU= 13.333
  12:17:13 STEP 2780 H=2780:00 +CPU= 13.806
  12:17:36 STEP 2781 H=2781:00 +CPU= 22.040
  12:17:50 STEP 2782 H=2782:00 +CPU= 14.157
  12:18:04 STEP 2783 H=2783:00 +CPU= 14.312
  12:18:30 STEP 2784 H=2784:00 +CPU= 26.199
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_115.zip
Uploading the intermediate file: upload_file_115.zip
  12:18:44 STEP 2785 H=2785:00 +CPU= 13.566
  12:18:58 STEP 2786 H=2786:00 +CPU= 14.522
  12:19:20 STEP 2787 H=2787:00 +CPU= 22.090
  12:19:34 STEP 2788 H=2788:00 +CPU= 13.679
  12:19:48 STEP 2789 H=2789:00 +CPU= 14.331
  12:20:11 STEP 2790 H=2790:00 +CPU= 22.486
  12:20:25 STEP 2791 H=2791:00 +CPU= 13.736
  12:20:40 STEP 2792 H=2792:00 +CPU= 15.118
  12:21:03 STEP 2793 H=2793:00 +CPU= 22.664
  12:21:16 STEP 2794 H=2794:00 +CPU= 13.714
  12:21:30 STEP 2795 H=2795:00 +CPU= 13.332
  12:21:54 STEP 2796 H=2796:00 +CPU= 24.683
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002796
  12:22:08 STEP 2797 H=2797:00 +CPU= 13.587
  12:22:22 STEP 2798 H=2798:00 +CPU= 13.771
  12:22:44 STEP 2799 H=2799:00 +CPU= 21.871
  12:22:58 STEP 2800 H=2800:00 +CPU= 14.553
  12:23:12 STEP 2801 H=2801:00 +CPU= 14.058
  12:23:35 STEP 2802 H=2802:00 +CPU= 22.984
  12:23:49 STEP 2803 H=2803:00 +CPU= 13.381
  12:24:02 STEP 2804 H=2804:00 +CPU= 13.801
  12:24:24 STEP 2805 H=2805:00 +CPU= 21.755
  12:24:38 STEP 2806 H=2806:00 +CPU= 13.970
  12:24:52 STEP 2807 H=2807:00 +CPU= 14.078
  12:25:17 STEP 2808 H=2808:00 +CPU= 24.760
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_116.zip
Uploading the intermediate file: upload_file_116.zip
  12:25:31 STEP 2809 H=2809:00 +CPU= 13.764
  12:25:45 STEP 2810 H=2810:00 +CPU= 14.014
  12:26:07 STEP 2811 H=2811:00 +CPU= 22.482
  12:26:22 STEP 2812 H=2812:00 +CPU= 14.509
  12:26:36 STEP 2813 H=2813:00 +CPU= 14.091
  12:26:59 STEP 2814 H=2814:00 +CPU= 22.938
  12:27:12 STEP 2815 H=2815:00 +CPU= 13.413
  12:27:26 STEP 2816 H=2816:00 +CPU= 14.170
  12:27:49 STEP 2817 H=2817:00 +CPU= 22.353
  12:28:03 STEP 2818 H=2818:00 +CPU= 14.099
  12:28:17 STEP 2819 H=2819:00 +CPU= 13.764
  12:28:41 STEP 2820 H=2820:00 +CPU= 23.884
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002820
  12:28:55 STEP 2821 H=2821:00 +CPU= 13.904
  12:29:09 STEP 2822 H=2822:00 +CPU= 14.388
  12:29:31 STEP 2823 H=2823:00 +CPU= 22.369
  12:29:46 STEP 2824 H=2824:00 +CPU= 14.401
  12:29:59 STEP 2825 H=2825:00 +CPU= 13.683
  12:30:22 STEP 2826 H=2826:00 +CPU= 22.076
  12:30:35 STEP 2827 H=2827:00 +CPU= 13.444
  12:30:49 STEP 2828 H=2828:00 +CPU= 14.027
  12:31:11 STEP 2829 H=2829:00 +CPU= 21.512
  12:31:24 STEP 2830 H=2830:00 +CPU= 13.906
  12:31:39 STEP 2831 H=2831:00 +CPU= 14.284
  12:32:04 STEP 2832 H=2832:00 +CPU= 25.122
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_117.zip
Uploading the intermediate file: upload_file_117.zip
  12:32:17 STEP 2833 H=2833:00 +CPU= 13.279
  12:32:31 STEP 2834 H=2834:00 +CPU= 13.690
  12:32:53 STEP 2835 H=2835:00 +CPU= 22.551
  12:33:08 STEP 2836 H=2836:00 +CPU= 14.418
  12:33:22 STEP 2837 H=2837:00 +CPU= 13.943
  12:33:45 STEP 2838 H=2838:00 +CPU= 22.901
  12:33:59 STEP 2839 H=2839:00 +CPU= 13.871
  12:34:12 STEP 2840 H=2840:00 +CPU= 13.754
  12:34:34 STEP 2841 H=2841:00 +CPU= 21.606
  12:34:48 STEP 2842 H=2842:00 +CPU= 13.758
  12:35:01 STEP 2843 H=2843:00 +CPU= 13.609
  12:35:26 STEP 2844 H=2844:00 +CPU= 24.863
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002844
  12:35:40 STEP 2845 H=2845:00 +CPU= 14.094
  12:35:54 STEP 2846 H=2846:00 +CPU= 13.732
  12:36:16 STEP 2847 H=2847:00 +CPU= 21.560
  12:36:30 STEP 2848 H=2848:00 +CPU= 13.967
  12:36:44 STEP 2849 H=2849:00 +CPU= 14.007
  12:37:06 STEP 2850 H=2850:00 +CPU= 22.184
  12:37:20 STEP 2851 H=2851:00 +CPU= 14.281
  12:37:35 STEP 2852 H=2852:00 +CPU= 15.074
  12:37:58 STEP 2853 H=2853:00 +CPU= 22.477
  12:38:13 STEP 2854 H=2854:00 +CPU= 14.814
  12:38:27 STEP 2855 H=2855:00 +CPU= 14.384
  12:38:53 STEP 2856 H=2856:00 +CPU= 25.997
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_118.zip
Uploading the intermediate file: upload_file_118.zip
  12:39:07 STEP 2857 H=2857:00 +CPU= 14.076
  12:39:21 STEP 2858 H=2858:00 +CPU= 14.361
  12:39:43 STEP 2859 H=2859:00 +CPU= 21.581
  12:39:57 STEP 2860 H=2860:00 +CPU= 13.730
  12:40:11 STEP 2861 H=2861:00 +CPU= 13.961
  12:40:34 STEP 2862 H=2862:00 +CPU= 23.144
  12:40:48 STEP 2863 H=2863:00 +CPU= 14.135
  12:41:03 STEP 2864 H=2864:00 +CPU= 14.757
  12:41:25 STEP 2865 H=2865:00 +CPU= 21.977
  12:41:39 STEP 2866 H=2866:00 +CPU= 13.801
  12:41:52 STEP 2867 H=2867:00 +CPU= 13.362
  12:42:16 STEP 2868 H=2868:00 +CPU= 23.727
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002868
  12:42:29 STEP 2869 H=2869:00 +CPU= 13.344
  12:42:43 STEP 2870 H=2870:00 +CPU= 13.973
  12:43:05 STEP 2871 H=2871:00 +CPU= 22.155
  12:43:19 STEP 2872 H=2872:00 +CPU= 13.943
  12:43:33 STEP 2873 H=2873:00 +CPU= 13.356
  12:43:55 STEP 2874 H=2874:00 +CPU= 22.078
  12:44:08 STEP 2875 H=2875:00 +CPU= 13.323
  12:44:22 STEP 2876 H=2876:00 +CPU= 13.738
  12:44:44 STEP 2877 H=2877:00 +CPU= 22.602
  12:44:59 STEP 2878 H=2878:00 +CPU= 14.458
  12:45:13 STEP 2879 H=2879:00 +CPU= 13.791
  12:45:37 STEP 2880 H=2880:00 +CPU= 24.829
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_119.zip
Uploading the intermediate file: upload_file_119.zip
  12:45:52 STEP 2881 H=2881:00 +CPU= 14.041
Uploading trickle at timestep: 10368000
  12:46:05 STEP 2882 H=2882:00 +CPU= 13.968
  12:46:27 STEP 2883 H=2883:00 +CPU= 21.907
  12:46:41 STEP 2884 H=2884:00 +CPU= 13.680
  12:46:55 STEP 2885 H=2885:00 +CPU= 13.997
  12:47:18 STEP 2886 H=2886:00 +CPU= 23.364
  12:47:32 STEP 2887 H=2887:00 +CPU= 13.501
  12:47:46 STEP 2888 H=2888:00 +CPU= 13.733
  12:48:07 STEP 2889 H=2889:00 +CPU= 21.586
  12:48:21 STEP 2890 H=2890:00 +CPU= 13.730
  12:48:34 STEP 2891 H=2891:00 +CPU= 13.308
  12:48:58 STEP 2892 H=2892:00 +CPU= 23.668
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002892
  12:49:11 STEP 2893 H=2893:00 +CPU= 13.336
  12:49:25 STEP 2894 H=2894:00 +CPU= 13.794
  12:49:48 STEP 2895 H=2895:00 +CPU= 22.501
  12:50:02 STEP 2896 H=2896:00 +CPU= 14.164
  12:50:16 STEP 2897 H=2897:00 +CPU= 13.577
  12:50:38 STEP 2898 H=2898:00 +CPU= 21.991
  12:50:51 STEP 2899 H=2899:00 +CPU= 13.330
  12:51:05 STEP 2900 H=2900:00 +CPU= 13.812
  12:51:27 STEP 2901 H=2901:00 +CPU= 21.987
  12:51:41 STEP 2902 H=2902:00 +CPU= 13.843
  12:51:55 STEP 2903 H=2903:00 +CPU= 14.442
  12:52:20 STEP 2904 H=2904:00 +CPU= 25.268
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_120.zip
Uploading the intermediate file: upload_file_120.zip
  12:52:34 STEP 2905 H=2905:00 +CPU= 13.838
  12:52:48 STEP 2906 H=2906:00 +CPU= 13.716
  12:53:10 STEP 2907 H=2907:00 +CPU= 21.662
  12:53:24 STEP 2908 H=2908:00 +CPU= 14.502
  12:53:38 STEP 2909 H=2909:00 +CPU= 13.810
  12:54:01 STEP 2910 H=2910:00 +CPU= 22.677
  12:54:15 STEP 2911 H=2911:00 +CPU= 14.005
  12:54:29 STEP 2912 H=2912:00 +CPU= 14.598
  12:54:52 STEP 2913 H=2913:00 +CPU= 22.811
  12:55:07 STEP 2914 H=2914:00 +CPU= 15.033
  12:55:21 STEP 2915 H=2915:00 +CPU= 14.331
  12:55:47 STEP 2916 H=2916:00 +CPU= 25.429
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002916
  12:56:01 STEP 2917 H=2917:00 +CPU= 14.196
  12:56:16 STEP 2918 H=2918:00 +CPU= 15.030
  12:56:39 STEP 2919 H=2919:00 +CPU= 22.582
  12:56:53 STEP 2920 H=2920:00 +CPU= 14.403
  12:57:07 STEP 2921 H=2921:00 +CPU= 13.517
  12:57:29 STEP 2922 H=2922:00 +CPU= 22.555
  12:57:43 STEP 2923 H=2923:00 +CPU= 13.378
  12:57:57 STEP 2924 H=2924:00 +CPU= 13.965
  12:58:18 STEP 2925 H=2925:00 +CPU= 21.610
  12:58:32 STEP 2926 H=2926:00 +CPU= 13.691
  12:58:46 STEP 2927 H=2927:00 +CPU= 13.689
  12:59:10 STEP 2928 H=2928:00 +CPU= 24.750
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_121.zip
Uploading the intermediate file: upload_file_121.zip
  12:59:24 STEP 2929 H=2929:00 +CPU= 13.322
  12:59:38 STEP 2930 H=2930:00 +CPU= 13.999
  13:00:00 STEP 2931 H=2931:00 +CPU= 21.965
  13:00:14 STEP 2932 H=2932:00 +CPU= 14.614
  13:00:28 STEP 2933 H=2933:00 +CPU= 13.319
  13:00:50 STEP 2934 H=2934:00 +CPU= 22.111
  13:01:03 STEP 2935 H=2935:00 +CPU= 13.456
  13:01:17 STEP 2936 H=2936:00 +CPU= 13.735
  13:01:38 STEP 2937 H=2937:00 +CPU= 21.538
  13:01:52 STEP 2938 H=2938:00 +CPU= 13.866
  13:02:06 STEP 2939 H=2939:00 +CPU= 13.483
  13:02:30 STEP 2940 H=2940:00 +CPU= 23.918
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002940
  13:02:43 STEP 2941 H=2941:00 +CPU= 13.463
  13:02:58 STEP 2942 H=2942:00 +CPU= 14.518
  13:03:21 STEP 2943 H=2943:00 +CPU= 23.026
  13:03:35 STEP 2944 H=2944:00 +CPU= 14.576
  13:03:50 STEP 2945 H=2945:00 +CPU= 14.126
  13:04:12 STEP 2946 H=2946:00 +CPU= 22.586
  13:04:25 STEP 2947 H=2947:00 +CPU= 13.175
  13:04:39 STEP 2948 H=2948:00 +CPU= 13.555
  13:05:00 STEP 2949 H=2949:00 +CPU= 21.352
  13:05:14 STEP 2950 H=2950:00 +CPU= 13.498
  13:05:27 STEP 2951 H=2951:00 +CPU= 13.640
  13:05:52 STEP 2952 H=2952:00 +CPU= 24.996
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.08782611191800     
  MAXGPFV : MAX. VALUE =   0.735151121575513     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    329739114 BYTES IN      8 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0071( 4.2%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 13:05:52 STEP 2952 H=2952:00 +CPU= 24.996
 END CNT3
 NSTEP =  2952 CNT0   000000000  22.376  22.376  22.392   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************    93.5     0.0    93.4     0.7   145.2
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********    100.00      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200     992.6     992.6      6.36      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     153.9     153.9      0.91      0.00
  10 SCAN2M - PHYSICS                             2953    8328.2    8328.2     49.22      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247     510.2     510.2      0.25      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126      11.2      11.2      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985    8381.4    8381.4     16.52      0.00
  14 SUINIF                                          1    1133.2    1133.2      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      29.3      29.3      0.01      0.00
  18 SUSPECG                                         1     215.0     215.0      0.00      0.00
  19 SUSPEC                                          1     220.3     220.3      0.00      0.00
  24 SUGRIDU                                         1     684.7     684.7      0.00      0.00
  25 SPECRT                                          1     108.6     108.6      0.00      0.00
  26 SUGRIDF                                         1     119.5     119.5      0.00      0.00
  27 RESTART FILES - WRITING                       123    1024.5    1024.5      0.25      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               247    1382.3    1382.3      0.68      0.00
  31 POSDDH IN STEPO                                13       1.1       1.1      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    1870.9    1870.9     11.06      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    1740.6    1740.6     10.28      0.00
  39 SU0YOMB                                         1     188.6     188.6      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953       4.9       4.9      0.03      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952      47.6      47.6      0.28      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      10.8      10.8      0.06      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094      80.0      80.0      1.62      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152      83.8      83.8      1.03      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      29.9      29.9      0.37      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      31.2      31.2      0.63      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      12.2      12.2      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094       6.2       6.2      0.13      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152       6.1       6.1      0.08      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      14.7      14.7      0.30      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152      13.2      13.2      0.16      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    49966.3 CPU TIME   49931.1 VECTOR TIME    49931.1


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      212.7
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/38/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc/slots/38/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc/slots/38/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc/slots/38/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/38/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214777/ICMUAhnw4+002952
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_0117_2019110100_123_993_12214777_0_r1091955715_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
13:09:15 (106775): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:36 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 10,623,600 49,931 0.0047
09 May 2023 16:53:36 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 10,368,000 48,722 0.0047
09 May 2023 16:53:33 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 9,504,000 44,650 0.0047
09 May 2023 16:53:30 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 8,640,000 40,608 0.0047
09 May 2023 16:53:27 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 7,776,000 36,535 0.0047
09 May 2023 16:53:23 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 6,912,000 32,514 0.0047
09 May 2023 16:53:17 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 6,048,000 28,482 0.0047
09 May 2023 16:53:14 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 5,184,000 24,450 0.0047
09 May 2023 16:53:10 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 4,320,000 20,388 0.0047
09 May 2023 16:53:07 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 3,456,000 16,346 0.0047
09 May 2023 16:53:04 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 2,592,000 12,274 0.0047
09 May 2023 16:53:01 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 1,728,000 8,211 0.0048
09 May 2023 16:52:58 1535275 22316159 oifs_43r3_0117_2019110100_123_993_12214777_0 864,000 4,129 0.0048


©2024 climateprediction.net