climateprediction.net home page
Task 22278439

Task 22278439

Name oifs_43r3_ps_0039_2007050100_123_976_12192683_0
Workunit 12192683
Created 23 Dec 2022, 14:45:09 UTC
Sent 11 Jan 2023, 22:29:48 UTC
Report deadline 10 Feb 2023, 22:29:48 UTC
Received 14 Jan 2023, 1:19:45 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1538515
Run time 10 hours 45 min 16 sec
CPU time 10 hours 41 min 25 sec
Validate state Valid
Credit 14,868.00
Device peak FLOPS 9.06 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,417.54 MB
Peak swap size 4,978.07 MB
Peak disk usage 3,568.42 MB
Stderr 
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
  16:08:32 STEP 2398 H=2398:00 +CPU= 10.790
  16:08:43 STEP 2399 H=2399:00 +CPU= 11.088
  16:09:03 STEP 2400 H=2400:00 +CPU= 20.170
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002400
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002400
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002388
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002388
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002388
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_99.zip
Uploading the intermediate file: upload_file_99.zip
  16:09:14 STEP 2401 H=2401:00 +CPU= 10.488
  16:09:24 STEP 2402 H=2402:00 +CPU= 10.696
Uploading trickle at timestep: 8640000
  16:09:41 STEP 2403 H=2403:00 +CPU= 16.835
  16:09:52 STEP 2404 H=2404:00 +CPU= 10.900
  16:10:03 STEP 2405 H=2405:00 +CPU= 10.642
  16:10:20 STEP 2406 H=2406:00 +CPU= 16.984
  16:10:30 STEP 2407 H=2407:00 +CPU= 10.571
  16:10:41 STEP 2408 H=2408:00 +CPU= 10.745
  16:10:58 STEP 2409 H=2409:00 +CPU= 16.847
  16:11:09 STEP 2410 H=2410:00 +CPU= 11.122
  16:11:20 STEP 2411 H=2411:00 +CPU= 10.644
  16:11:38 STEP 2412 H=2412:00 +CPU= 18.573
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002412
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002412
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002412
  16:11:49 STEP 2413 H=2413:00 +CPU= 10.510
  16:12:00 STEP 2414 H=2414:00 +CPU= 10.834
  16:12:17 STEP 2415 H=2415:00 +CPU= 17.040
  16:12:27 STEP 2416 H=2416:00 +CPU= 10.816
  16:12:38 STEP 2417 H=2417:00 +CPU= 10.529
  16:12:55 STEP 2418 H=2418:00 +CPU= 17.040
  16:13:05 STEP 2419 H=2419:00 +CPU= 10.449
  16:13:16 STEP 2420 H=2420:00 +CPU= 10.912
  16:13:33 STEP 2421 H=2421:00 +CPU= 16.900
  16:13:44 STEP 2422 H=2422:00 +CPU= 11.187
  16:13:55 STEP 2423 H=2423:00 +CPU= 10.948
  16:14:15 STEP 2424 H=2424:00 +CPU= 19.921
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002424
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002424
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002412
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002412
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002412
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_100.zip
Uploading the intermediate file: upload_file_100.zip
  16:14:26 STEP 2425 H=2425:00 +CPU= 10.458
  16:14:37 STEP 2426 H=2426:00 +CPU= 10.872
  16:14:54 STEP 2427 H=2427:00 +CPU= 16.916
  16:15:04 STEP 2428 H=2428:00 +CPU= 10.809
  16:15:15 STEP 2429 H=2429:00 +CPU= 10.642
  16:15:32 STEP 2430 H=2430:00 +CPU= 16.888
  16:15:42 STEP 2431 H=2431:00 +CPU= 10.515
  16:15:53 STEP 2432 H=2432:00 +CPU= 10.794
  16:16:10 STEP 2433 H=2433:00 +CPU= 16.696
  16:16:21 STEP 2434 H=2434:00 +CPU= 10.913
  16:16:31 STEP 2435 H=2435:00 +CPU= 10.578
  16:16:50 STEP 2436 H=2436:00 +CPU= 18.396
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002436
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002436
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002436
  16:17:00 STEP 2437 H=2437:00 +CPU= 10.477
  16:17:11 STEP 2438 H=2438:00 +CPU= 10.859
  16:17:28 STEP 2439 H=2439:00 +CPU= 16.600
  16:17:39 STEP 2440 H=2440:00 +CPU= 10.722
  16:17:49 STEP 2441 H=2441:00 +CPU= 10.643
  16:18:06 STEP 2442 H=2442:00 +CPU= 17.105
  16:18:17 STEP 2443 H=2443:00 +CPU= 10.475
  16:18:28 STEP 2444 H=2444:00 +CPU= 11.001
  16:18:45 STEP 2445 H=2445:00 +CPU= 16.933
  16:18:56 STEP 2446 H=2446:00 +CPU= 10.822
  16:19:06 STEP 2447 H=2447:00 +CPU= 10.956
  16:19:27 STEP 2448 H=2448:00 +CPU= 20.014
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002448
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002448
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002436
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002436
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002436
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_101.zip
Uploading the intermediate file: upload_file_101.zip
  16:19:37 STEP 2449 H=2449:00 +CPU= 10.591
  16:19:48 STEP 2450 H=2450:00 +CPU= 10.975
  16:20:05 STEP 2451 H=2451:00 +CPU= 16.512
  16:20:15 STEP 2452 H=2452:00 +CPU= 10.820
  16:20:26 STEP 2453 H=2453:00 +CPU= 10.523
  16:20:43 STEP 2454 H=2454:00 +CPU= 16.988
  16:20:54 STEP 2455 H=2455:00 +CPU= 10.673
  16:21:05 STEP 2456 H=2456:00 +CPU= 10.949
  16:21:21 STEP 2457 H=2457:00 +CPU= 16.723
  16:21:32 STEP 2458 H=2458:00 +CPU= 11.190
  16:21:43 STEP 2459 H=2459:00 +CPU= 10.779
  16:22:02 STEP 2460 H=2460:00 +CPU= 18.506
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002460
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002460
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002460
  16:22:13 STEP 2461 H=2461:00 +CPU= 10.742
  16:22:23 STEP 2462 H=2462:00 +CPU= 10.907
  16:22:40 STEP 2463 H=2463:00 +CPU= 16.924
  16:22:51 STEP 2464 H=2464:00 +CPU= 10.833
  16:23:02 STEP 2465 H=2465:00 +CPU= 10.687
  16:23:19 STEP 2466 H=2466:00 +CPU= 16.923
  16:23:30 STEP 2467 H=2467:00 +CPU= 10.813
  16:23:40 STEP 2468 H=2468:00 +CPU= 10.744
  16:23:57 STEP 2469 H=2469:00 +CPU= 16.769
  16:24:08 STEP 2470 H=2470:00 +CPU= 10.855
  16:24:19 STEP 2471 H=2471:00 +CPU= 11.228
  16:24:39 STEP 2472 H=2472:00 +CPU= 20.196
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002472
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002472
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002460
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002460
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002460
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_102.zip
Uploading the intermediate file: upload_file_102.zip
  16:24:50 STEP 2473 H=2473:00 +CPU= 10.574
  16:25:01 STEP 2474 H=2474:00 +CPU= 10.626
  16:25:18 STEP 2475 H=2475:00 +CPU= 16.894
  16:25:28 STEP 2476 H=2476:00 +CPU= 10.890
  16:25:39 STEP 2477 H=2477:00 +CPU= 10.326
  16:25:56 STEP 2478 H=2478:00 +CPU= 16.870
  16:26:06 STEP 2479 H=2479:00 +CPU= 10.603
  16:26:17 STEP 2480 H=2480:00 +CPU= 10.929
  16:26:34 STEP 2481 H=2481:00 +CPU= 16.898
  16:26:45 STEP 2482 H=2482:00 +CPU= 10.988
  16:26:56 STEP 2483 H=2483:00 +CPU= 10.636
  16:27:14 STEP 2484 H=2484:00 +CPU= 18.363
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002484
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002484
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002484
  16:27:25 STEP 2485 H=2485:00 +CPU= 10.647
  16:27:35 STEP 2486 H=2486:00 +CPU= 10.728
  16:27:52 STEP 2487 H=2487:00 +CPU= 16.742
  16:28:03 STEP 2488 H=2488:00 +CPU= 11.251
  16:28:14 STEP 2489 H=2489:00 +CPU= 10.769
  16:28:31 STEP 2490 H=2490:00 +CPU= 16.988
  16:28:42 STEP 2491 H=2491:00 +CPU= 10.756
  16:28:53 STEP 2492 H=2492:00 +CPU= 10.775
  16:29:10 STEP 2493 H=2493:00 +CPU= 16.852
  16:29:21 STEP 2494 H=2494:00 +CPU= 11.032
  16:29:32 STEP 2495 H=2495:00 +CPU= 11.183
  16:29:52 STEP 2496 H=2496:00 +CPU= 19.870
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002496
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002496
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002484
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002484
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002484
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_103.zip
Uploading the intermediate file: upload_file_103.zip
  16:30:02 STEP 2497 H=2497:00 +CPU= 10.409
  16:30:13 STEP 2498 H=2498:00 +CPU= 10.445
  16:30:29 STEP 2499 H=2499:00 +CPU= 16.798
  16:30:40 STEP 2500 H=2500:00 +CPU= 11.006
  16:30:51 STEP 2501 H=2501:00 +CPU= 10.543
  16:31:08 STEP 2502 H=2502:00 +CPU= 17.143
  16:31:19 STEP 2503 H=2503:00 +CPU= 10.728
  16:31:30 STEP 2504 H=2504:00 +CPU= 10.803
  16:31:46 STEP 2505 H=2505:00 +CPU= 16.715
  16:31:57 STEP 2506 H=2506:00 +CPU= 10.920
  16:32:08 STEP 2507 H=2507:00 +CPU= 10.692
  16:32:26 STEP 2508 H=2508:00 +CPU= 18.053
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002508
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002508
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002508
  16:32:37 STEP 2509 H=2509:00 +CPU= 10.585
  16:32:47 STEP 2510 H=2510:00 +CPU= 10.617
  16:33:04 STEP 2511 H=2511:00 +CPU= 16.557
  16:33:15 STEP 2512 H=2512:00 +CPU= 10.792
  16:33:25 STEP 2513 H=2513:00 +CPU= 10.528
  16:33:42 STEP 2514 H=2514:00 +CPU= 17.067
  16:33:53 STEP 2515 H=2515:00 +CPU= 10.867
  16:34:04 STEP 2516 H=2516:00 +CPU= 10.891
  16:34:21 STEP 2517 H=2517:00 +CPU= 16.713
  16:34:32 STEP 2518 H=2518:00 +CPU= 11.008
  16:34:43 STEP 2519 H=2519:00 +CPU= 10.888
  16:35:03 STEP 2520 H=2520:00 +CPU= 19.871
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002520
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002520
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002508
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002508
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002508
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_104.zip
Uploading the intermediate file: upload_file_104.zip
  16:35:13 STEP 2521 H=2521:00 +CPU= 10.296
  16:35:24 STEP 2522 H=2522:00 +CPU= 10.739
  16:35:40 STEP 2523 H=2523:00 +CPU= 16.650
  16:35:51 STEP 2524 H=2524:00 +CPU= 10.698
  16:36:01 STEP 2525 H=2525:00 +CPU= 10.370
  16:36:18 STEP 2526 H=2526:00 +CPU= 16.796
  16:36:29 STEP 2527 H=2527:00 +CPU= 10.601
  16:36:40 STEP 2528 H=2528:00 +CPU= 10.861
  16:36:56 STEP 2529 H=2529:00 +CPU= 16.435
  16:37:07 STEP 2530 H=2530:00 +CPU= 10.976
  16:37:18 STEP 2531 H=2531:00 +CPU= 10.678
  16:37:36 STEP 2532 H=2532:00 +CPU= 18.470
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002532
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002532
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002532
  16:37:47 STEP 2533 H=2533:00 +CPU= 10.798
  16:37:58 STEP 2534 H=2534:00 +CPU= 10.962
  16:38:15 STEP 2535 H=2535:00 +CPU= 17.105
  16:38:26 STEP 2536 H=2536:00 +CPU= 11.011
  16:38:36 STEP 2537 H=2537:00 +CPU= 10.434
  16:38:54 STEP 2538 H=2538:00 +CPU= 17.099
  16:39:04 STEP 2539 H=2539:00 +CPU= 10.461
  16:39:15 STEP 2540 H=2540:00 +CPU= 10.839
  16:39:32 STEP 2541 H=2541:00 +CPU= 16.828
  16:39:43 STEP 2542 H=2542:00 +CPU= 11.057
  16:39:54 STEP 2543 H=2543:00 +CPU= 11.070
  16:40:14 STEP 2544 H=2544:00 +CPU= 19.617
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002544
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002544
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002532
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002532
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002532
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_105.zip
Uploading the intermediate file: upload_file_105.zip
  16:40:24 STEP 2545 H=2545:00 +CPU= 10.453
  16:40:35 STEP 2546 H=2546:00 +CPU= 10.633
  16:40:51 STEP 2547 H=2547:00 +CPU= 16.561
  16:41:02 STEP 2548 H=2548:00 +CPU= 11.038
  16:41:13 STEP 2549 H=2549:00 +CPU= 10.495
  16:41:30 STEP 2550 H=2550:00 +CPU= 16.889
  16:41:40 STEP 2551 H=2551:00 +CPU= 10.565
  16:41:51 STEP 2552 H=2552:00 +CPU= 10.747
  16:42:08 STEP 2553 H=2553:00 +CPU= 16.594
  16:42:18 STEP 2554 H=2554:00 +CPU= 10.922
  16:42:29 STEP 2555 H=2555:00 +CPU= 10.515
  16:42:48 STEP 2556 H=2556:00 +CPU= 18.554
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002556
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002556
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002556
  16:42:58 STEP 2557 H=2557:00 +CPU= 10.588
  16:43:09 STEP 2558 H=2558:00 +CPU= 10.765
  16:43:25 STEP 2559 H=2559:00 +CPU= 16.591
  16:43:37 STEP 2560 H=2560:00 +CPU= 11.059
  16:43:47 STEP 2561 H=2561:00 +CPU= 10.747
  16:44:05 STEP 2562 H=2562:00 +CPU= 17.237
  16:44:16 STEP 2563 H=2563:00 +CPU= 11.107
  16:44:27 STEP 2564 H=2564:00 +CPU= 11.013
  16:44:44 STEP 2565 H=2565:00 +CPU= 16.907
  16:44:54 STEP 2566 H=2566:00 +CPU= 10.883
  16:45:05 STEP 2567 H=2567:00 +CPU= 10.982
  16:45:25 STEP 2568 H=2568:00 +CPU= 19.897
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002568
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002568
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002556
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002556
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002556
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_106.zip
Uploading the intermediate file: upload_file_106.zip
  16:45:36 STEP 2569 H=2569:00 +CPU= 10.437
  16:45:47 STEP 2570 H=2570:00 +CPU= 10.639
  16:46:03 STEP 2571 H=2571:00 +CPU= 16.807
  16:46:14 STEP 2572 H=2572:00 +CPU= 10.840
  16:46:25 STEP 2573 H=2573:00 +CPU= 10.446
  16:46:42 STEP 2574 H=2574:00 +CPU= 17.115
  16:46:53 STEP 2575 H=2575:00 +CPU= 10.863
  16:47:03 STEP 2576 H=2576:00 +CPU= 10.725
  16:47:20 STEP 2577 H=2577:00 +CPU= 16.744
  16:47:31 STEP 2578 H=2578:00 +CPU= 10.823
  16:47:42 STEP 2579 H=2579:00 +CPU= 10.572
  16:48:00 STEP 2580 H=2580:00 +CPU= 18.328
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002580
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002580
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002580
  16:48:11 STEP 2581 H=2581:00 +CPU= 10.742
  16:48:21 STEP 2582 H=2582:00 +CPU= 10.746
  16:48:38 STEP 2583 H=2583:00 +CPU= 17.002
  16:48:49 STEP 2584 H=2584:00 +CPU= 10.831
  16:49:00 STEP 2585 H=2585:00 +CPU= 10.721
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2007050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0039
(argv4) batchid: 976
(argv5) wuid: 12192683
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /home/fritzb/slots/7
Project directory is: /home/fritzb/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683
..mkdir for temp folder for results failed
Copying: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /home/fritzb/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/fritzb/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_b1bb43cbfe264c5e7f6913853174459e to: /home/fritzb/slots/7/oifs_43r3_ps_0039_2007050100_123_976_12192683.zip
Unzipping the namelist zip file: /home/fritzb/slots/7/oifs_43r3_ps_0039_2007050100_123_976_12192683.zip
ic_ancil_file: ic_ancil_12192683
ifsdata_file: ifsdata_12192683
climate_data_file: clim_data_12192683
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_9cd74695f92cb7f9cc06b7717eb86c95 to: /home/fritzb/slots/7/ic_ancil_12192683.zip
Unzipping the IC ancils zip file: /home/fritzb/slots/7/ic_ancil_12192683.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_3f9aac6c880ff30f0b1aa4182f92a3a2 to: /home/fritzb/slots/7/ifsdata/ifsdata_12192683.zip
Unzipping the ifsdata_zip file: /home/fritzb/slots/7/ifsdata/ifsdata_12192683.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/fritzb/slots/7/159l_2/clim_data_12192683.zip
Unzipping the climate data zip file: /home/fritzb/slots/7/159l_2/clim_data_12192683.zip
Checking for progress XML file: /home/fritzb/slots/7/progress_file_12192683.xml
Opened progress file ok : /home/fritzb/slots/7/progress_file_12192683.xml
-- Model is restarting --
Adjusting last_iter, 2586, to previous model restart step.
Creating progress file: /home/fritzb/slots/7/progress_file_12192683.xml
last_cpu_time: 33559
upload_file_number: 107
last_iter: 2567
last_upload: 9244800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050
The child process has been launched with process id: 30770
Executing the command: /home/fritzb/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at 0x1)
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:geile-Sau:1:1:30770:30770] [20230113:164323:1673624603:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  16:43:52 STEP 2568 H=2568:00 +CPU= 26.903
  16:44:08 STEP 2569 H=2569:00 +CPU= 15.720
  16:44:24 STEP 2570 H=2570:00 +CPU= 16.480
  16:44:49 STEP 2571 H=2571:00 +CPU= 24.408
  16:45:06 STEP 2572 H=2572:00 +CPU= 17.298
  16:45:22 STEP 2573 H=2573:00 +CPU= 16.425
  16:45:48 STEP 2574 H=2574:00 +CPU= 25.373
  16:46:04 STEP 2575 H=2575:00 +CPU= 16.522
  16:46:20 STEP 2576 H=2576:00 +CPU= 16.152
  16:46:45 STEP 2577 H=2577:00 +CPU= 24.592
  16:47:01 STEP 2578 H=2578:00 +CPU= 15.981
  16:47:17 STEP 2579 H=2579:00 +CPU= 15.740
  16:47:44 STEP 2580 H=2580:00 +CPU= 27.452
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002580
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002580
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002580
  16:48:01 STEP 2581 H=2581:00 +CPU= 16.579
  16:48:18 STEP 2582 H=2582:00 +CPU= 17.156
  16:48:43 STEP 2583 H=2583:00 +CPU= 24.395
  16:48:58 STEP 2584 H=2584:00 +CPU= 15.694
  16:49:15 STEP 2585 H=2585:00 +CPU= 16.119
  16:49:41 STEP 2586 H=2586:00 +CPU= 26.702
  16:49:58 STEP 2587 H=2587:00 +CPU= 16.293
  16:50:14 STEP 2588 H=2588:00 +CPU= 16.895
  16:50:38 STEP 2589 H=2589:00 +CPU= 23.842
  16:50:55 STEP 2590 H=2590:00 +CPU= 16.255
  16:51:11 STEP 2591 H=2591:00 +CPU= 16.283
  16:51:40 STEP 2592 H=2592:00 +CPU= 28.551
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002592
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002592
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002580
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002580
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002580
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_107.zip
Uploading the intermediate file: upload_file_107.zip
  16:51:56 STEP 2593 H=2593:00 +CPU= 16.089
  16:52:13 STEP 2594 H=2594:00 +CPU= 17.046
  16:52:37 STEP 2595 H=2595:00 +CPU= 24.027
  16:52:53 STEP 2596 H=2596:00 +CPU= 16.369
  16:53:10 STEP 2597 H=2597:00 +CPU= 16.887
  16:53:37 STEP 2598 H=2598:00 +CPU= 26.595
  16:53:53 STEP 2599 H=2599:00 +CPU= 16.481
  16:54:11 STEP 2600 H=2600:00 +CPU= 17.546
  16:54:36 STEP 2601 H=2601:00 +CPU= 25.124
  16:54:54 STEP 2602 H=2602:00 +CPU= 17.586
  16:55:10 STEP 2603 H=2603:00 +CPU= 16.222
  16:55:38 STEP 2604 H=2604:00 +CPU= 28.084
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002604
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002604
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002604
  16:55:54 STEP 2605 H=2605:00 +CPU= 16.339
  16:56:11 STEP 2606 H=2606:00 +CPU= 16.767
  16:56:37 STEP 2607 H=2607:00 +CPU= 25.379
  16:56:53 STEP 2608 H=2608:00 +CPU= 16.819
  16:57:08 STEP 2609 H=2609:00 +CPU= 14.942
  16:57:34 STEP 2610 H=2610:00 +CPU= 25.555
  16:57:50 STEP 2611 H=2611:00 +CPU= 15.805
  16:58:07 STEP 2612 H=2612:00 +CPU= 16.772
  16:58:30 STEP 2613 H=2613:00 +CPU= 23.875
  16:58:47 STEP 2614 H=2614:00 +CPU= 16.493
  16:59:03 STEP 2615 H=2615:00 +CPU= 16.283
  16:59:33 STEP 2616 H=2616:00 +CPU= 29.544
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002616
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002616
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002604
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002604
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002604
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_108.zip
Uploading the intermediate file: upload_file_108.zip
  16:59:48 STEP 2617 H=2617:00 +CPU= 15.265
  17:00:05 STEP 2618 H=2618:00 +CPU= 16.418
  17:00:29 STEP 2619 H=2619:00 +CPU= 24.096
  17:00:46 STEP 2620 H=2620:00 +CPU= 16.780
  17:01:03 STEP 2621 H=2621:00 +CPU= 16.814
  17:01:29 STEP 2622 H=2622:00 +CPU= 26.064
  17:01:46 STEP 2623 H=2623:00 +CPU= 17.187
  17:02:03 STEP 2624 H=2624:00 +CPU= 16.765
  17:02:29 STEP 2625 H=2625:00 +CPU= 25.895
  17:02:45 STEP 2626 H=2626:00 +CPU= 16.013
  17:03:02 STEP 2627 H=2627:00 +CPU= 16.875
  17:03:30 STEP 2628 H=2628:00 +CPU= 28.690
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002628
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002628
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002628
  17:03:47 STEP 2629 H=2629:00 +CPU= 16.398
  17:04:04 STEP 2630 H=2630:00 +CPU= 17.694
  17:04:29 STEP 2631 H=2631:00 +CPU= 24.983
  17:04:46 STEP 2632 H=2632:00 +CPU= 16.177
  17:05:01 STEP 2633 H=2633:00 +CPU= 15.196
  17:05:27 STEP 2634 H=2634:00 +CPU= 26.375
  17:05:44 STEP 2635 H=2635:00 +CPU= 16.330
  17:06:01 STEP 2636 H=2636:00 +CPU= 17.166
  17:06:25 STEP 2637 H=2637:00 +CPU= 24.219
  17:06:42 STEP 2638 H=2638:00 +CPU= 16.625
  17:06:58 STEP 2639 H=2639:00 +CPU= 16.671
  17:07:29 STEP 2640 H=2640:00 +CPU= 30.528
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002640
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002640
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002628
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002628
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002628
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_109.zip
Uploading the intermediate file: upload_file_109.zip
  17:07:45 STEP 2641 H=2641:00 +CPU= 15.888
  17:08:02 STEP 2642 H=2642:00 +CPU= 17.151
  17:08:26 STEP 2643 H=2643:00 +CPU= 23.634
  17:08:43 STEP 2644 H=2644:00 +CPU= 16.974
  17:09:00 STEP 2645 H=2645:00 +CPU= 17.044
  17:09:25 STEP 2646 H=2646:00 +CPU= 25.628
  17:09:41 STEP 2647 H=2647:00 +CPU= 15.535
  17:09:56 STEP 2648 H=2648:00 +CPU= 14.496
  17:10:21 STEP 2649 H=2649:00 +CPU= 25.583
  17:10:39 STEP 2650 H=2650:00 +CPU= 17.330
  17:10:54 STEP 2651 H=2651:00 +CPU= 15.912
  17:11:21 STEP 2652 H=2652:00 +CPU= 26.418
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002652
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002652
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002652
  17:11:35 STEP 2653 H=2653:00 +CPU= 14.204
  17:11:50 STEP 2654 H=2654:00 +CPU= 14.538
  17:12:13 STEP 2655 H=2655:00 +CPU= 23.405
  17:12:29 STEP 2656 H=2656:00 +CPU= 16.164
  17:12:45 STEP 2657 H=2657:00 +CPU= 15.470
  17:13:07 STEP 2658 H=2658:00 +CPU= 22.275
  17:13:22 STEP 2659 H=2659:00 +CPU= 14.596
  17:13:34 STEP 2660 H=2660:00 +CPU= 12.672
  17:13:55 STEP 2661 H=2661:00 +CPU= 20.550
  17:14:09 STEP 2662 H=2662:00 +CPU= 14.249
  17:14:21 STEP 2663 H=2663:00 +CPU= 12.154
  17:14:42 STEP 2664 H=2664:00 +CPU= 20.755
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002664
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002664
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002652
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002652
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002652
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_110.zip
Uploading the intermediate file: upload_file_110.zip
  17:14:54 STEP 2665 H=2665:00 +CPU= 11.523
  17:15:06 STEP 2666 H=2666:00 +CPU= 12.441
  17:15:25 STEP 2667 H=2667:00 +CPU= 19.249
  17:15:37 STEP 2668 H=2668:00 +CPU= 11.462
  17:15:48 STEP 2669 H=2669:00 +CPU= 10.794
  17:16:05 STEP 2670 H=2670:00 +CPU= 17.290
  17:16:15 STEP 2671 H=2671:00 +CPU= 10.393
  17:16:26 STEP 2672 H=2672:00 +CPU= 10.150
  17:16:41 STEP 2673 H=2673:00 +CPU= 15.762
  17:16:52 STEP 2674 H=2674:00 +CPU= 10.221
  17:17:02 STEP 2675 H=2675:00 +CPU= 10.180
  17:17:19 STEP 2676 H=2676:00 +CPU= 16.789
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002676
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002676
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002676
  17:17:28 STEP 2677 H=2677:00 +CPU=  9.593
  17:17:38 STEP 2678 H=2678:00 +CPU=  9.785
  17:17:53 STEP 2679 H=2679:00 +CPU= 14.878
  17:18:03 STEP 2680 H=2680:00 +CPU=  9.856
  17:18:12 STEP 2681 H=2681:00 +CPU=  9.251
  17:18:27 STEP 2682 H=2682:00 +CPU= 15.103
  17:18:36 STEP 2683 H=2683:00 +CPU=  9.043
  17:18:45 STEP 2684 H=2684:00 +CPU=  9.141
  17:18:59 STEP 2685 H=2685:00 +CPU= 14.211
  17:19:09 STEP 2686 H=2686:00 +CPU=  9.334
  17:19:18 STEP 2687 H=2687:00 +CPU=  9.332
  17:19:35 STEP 2688 H=2688:00 +CPU= 17.038
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002688
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002688
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002676
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002676
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002676
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_111.zip
Uploading the intermediate file: upload_file_111.zip
  17:19:44 STEP 2689 H=2689:00 +CPU=  9.101
  17:19:53 STEP 2690 H=2690:00 +CPU=  9.225
  17:20:08 STEP 2691 H=2691:00 +CPU= 14.231
  17:20:17 STEP 2692 H=2692:00 +CPU=  9.147
  17:20:26 STEP 2693 H=2693:00 +CPU=  9.004
  17:20:40 STEP 2694 H=2694:00 +CPU= 14.599
  17:20:50 STEP 2695 H=2695:00 +CPU=  9.097
  17:20:59 STEP 2696 H=2696:00 +CPU=  9.509
  17:21:13 STEP 2697 H=2697:00 +CPU= 14.339
  17:21:23 STEP 2698 H=2698:00 +CPU=  9.279
  17:21:32 STEP 2699 H=2699:00 +CPU=  9.190
  17:21:48 STEP 2700 H=2700:00 +CPU= 15.914
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002700
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002700
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002700
  17:21:57 STEP 2701 H=2701:00 +CPU=  9.028
  17:22:06 STEP 2702 H=2702:00 +CPU=  9.122
  17:22:20 STEP 2703 H=2703:00 +CPU= 14.082
  17:22:29 STEP 2704 H=2704:00 +CPU=  9.059
  17:22:38 STEP 2705 H=2705:00 +CPU=  8.557
  17:22:51 STEP 2706 H=2706:00 +CPU= 13.815
  17:23:00 STEP 2707 H=2707:00 +CPU=  8.648
  17:23:09 STEP 2708 H=2708:00 +CPU=  8.889
  17:23:22 STEP 2709 H=2709:00 +CPU= 13.385
  17:23:31 STEP 2710 H=2710:00 +CPU=  8.720
  17:23:40 STEP 2711 H=2711:00 +CPU=  8.769
  17:23:56 STEP 2712 H=2712:00 +CPU= 16.065
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002712
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002712
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002700
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002700
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002700
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_112.zip
Uploading the intermediate file: upload_file_112.zip
  17:24:04 STEP 2713 H=2713:00 +CPU=  8.479
  17:24:13 STEP 2714 H=2714:00 +CPU=  8.615
  17:24:26 STEP 2715 H=2715:00 +CPU= 13.299
  17:24:35 STEP 2716 H=2716:00 +CPU=  8.716
  17:24:44 STEP 2717 H=2717:00 +CPU=  8.509
  17:24:57 STEP 2718 H=2718:00 +CPU= 13.649
  17:25:06 STEP 2719 H=2719:00 +CPU=  8.551
  17:25:15 STEP 2720 H=2720:00 +CPU=  8.755
  17:25:28 STEP 2721 H=2721:00 +CPU= 13.292
  17:25:37 STEP 2722 H=2722:00 +CPU=  8.736
  17:25:45 STEP 2723 H=2723:00 +CPU=  8.550
  17:26:00 STEP 2724 H=2724:00 +CPU= 14.807
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002724
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002724
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002724
  17:26:08 STEP 2725 H=2725:00 +CPU=  8.490
  17:26:17 STEP 2726 H=2726:00 +CPU=  8.759
  17:26:31 STEP 2727 H=2727:00 +CPU= 13.403
  17:26:39 STEP 2728 H=2728:00 +CPU=  8.777
  17:26:48 STEP 2729 H=2729:00 +CPU=  8.548
  17:27:01 STEP 2730 H=2730:00 +CPU= 13.538
  17:27:10 STEP 2731 H=2731:00 +CPU=  8.490
  17:27:19 STEP 2732 H=2732:00 +CPU=  8.706
  17:27:32 STEP 2733 H=2733:00 +CPU= 13.293
  17:27:41 STEP 2734 H=2734:00 +CPU=  8.684
  17:27:49 STEP 2735 H=2735:00 +CPU=  8.737
  17:28:05 STEP 2736 H=2736:00 +CPU= 16.027
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002736
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002736
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002724
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002724
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002724
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_113.zip
Uploading the intermediate file: upload_file_113.zip
  17:28:14 STEP 2737 H=2737:00 +CPU=  8.437
  17:28:23 STEP 2738 H=2738:00 +CPU=  8.647
  17:28:36 STEP 2739 H=2739:00 +CPU= 13.385
  17:28:45 STEP 2740 H=2740:00 +CPU=  8.657
  17:28:53 STEP 2741 H=2741:00 +CPU=  8.482
  17:29:07 STEP 2742 H=2742:00 +CPU= 13.583
  17:29:15 STEP 2743 H=2743:00 +CPU=  8.525
  17:29:24 STEP 2744 H=2744:00 +CPU=  8.816
  17:29:37 STEP 2745 H=2745:00 +CPU= 13.378
  17:29:46 STEP 2746 H=2746:00 +CPU=  8.717
  17:29:55 STEP 2747 H=2747:00 +CPU=  8.570
  17:30:10 STEP 2748 H=2748:00 +CPU= 14.912
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002748
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002748
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002748
  17:30:18 STEP 2749 H=2749:00 +CPU=  8.511
  17:30:27 STEP 2750 H=2750:00 +CPU=  8.725
  17:30:40 STEP 2751 H=2751:00 +CPU= 13.315
  17:30:49 STEP 2752 H=2752:00 +CPU=  8.650
  17:30:57 STEP 2753 H=2753:00 +CPU=  8.579
  17:31:11 STEP 2754 H=2754:00 +CPU= 13.662
  17:31:19 STEP 2755 H=2755:00 +CPU=  8.491
  17:31:28 STEP 2756 H=2756:00 +CPU=  8.777
  17:31:42 STEP 2757 H=2757:00 +CPU= 13.390
  17:31:50 STEP 2758 H=2758:00 +CPU=  8.738
  17:31:59 STEP 2759 H=2759:00 +CPU=  8.796
  17:32:15 STEP 2760 H=2760:00 +CPU= 16.062
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002760
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002760
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002748
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002748
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002748
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_114.zip
Uploading the intermediate file: upload_file_114.zip
  17:32:24 STEP 2761 H=2761:00 +CPU=  8.432
  17:32:32 STEP 2762 H=2762:00 +CPU=  8.637
  17:32:46 STEP 2763 H=2763:00 +CPU= 13.348
  17:32:54 STEP 2764 H=2764:00 +CPU=  8.691
  17:33:03 STEP 2765 H=2765:00 +CPU=  8.488
  17:33:17 STEP 2766 H=2766:00 +CPU= 13.718
  17:33:25 STEP 2767 H=2767:00 +CPU=  8.460
  17:33:34 STEP 2768 H=2768:00 +CPU=  8.839
  17:33:47 STEP 2769 H=2769:00 +CPU= 13.481
  17:33:56 STEP 2770 H=2770:00 +CPU=  8.708
  17:34:05 STEP 2771 H=2771:00 +CPU=  8.552
  17:34:20 STEP 2772 H=2772:00 +CPU= 14.862
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002772
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002772
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002772
  17:34:28 STEP 2773 H=2773:00 +CPU=  8.476
  17:34:37 STEP 2774 H=2774:00 +CPU=  8.730
  17:34:50 STEP 2775 H=2775:00 +CPU= 13.309
  17:34:59 STEP 2776 H=2776:00 +CPU=  8.701
  17:35:07 STEP 2777 H=2777:00 +CPU=  8.536
  17:35:21 STEP 2778 H=2778:00 +CPU= 13.688
  17:35:29 STEP 2779 H=2779:00 +CPU=  8.421
  17:35:38 STEP 2780 H=2780:00 +CPU=  8.755
  17:35:52 STEP 2781 H=2781:00 +CPU= 13.478
  17:36:00 STEP 2782 H=2782:00 +CPU=  8.721
  17:36:09 STEP 2783 H=2783:00 +CPU=  8.811
  17:36:25 STEP 2784 H=2784:00 +CPU= 16.128
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002784
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002784
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002772
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002772
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002772
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_115.zip
  17:36:34 STEP 2785 H=2785:00 +CPU=  8.430
Uploading the intermediate file: upload_file_115.zip
  17:36:42 STEP 2786 H=2786:00 +CPU=  8.681
  17:36:56 STEP 2787 H=2787:00 +CPU= 13.438
  17:37:05 STEP 2788 H=2788:00 +CPU=  8.642
  17:37:13 STEP 2789 H=2789:00 +CPU=  8.524
  17:37:27 STEP 2790 H=2790:00 +CPU= 13.690
  17:37:35 STEP 2791 H=2791:00 +CPU=  8.466
  17:37:44 STEP 2792 H=2792:00 +CPU=  8.797
  17:37:57 STEP 2793 H=2793:00 +CPU= 13.488
  17:38:06 STEP 2794 H=2794:00 +CPU=  8.708
  17:38:15 STEP 2795 H=2795:00 +CPU=  8.618
  17:38:30 STEP 2796 H=2796:00 +CPU= 14.815
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002796
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002796
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002796
  17:38:38 STEP 2797 H=2797:00 +CPU=  8.442
  17:38:47 STEP 2798 H=2798:00 +CPU=  8.737
  17:39:00 STEP 2799 H=2799:00 +CPU= 13.434
  17:39:09 STEP 2800 H=2800:00 +CPU=  8.677
  17:39:18 STEP 2801 H=2801:00 +CPU=  8.599
  17:39:31 STEP 2802 H=2802:00 +CPU= 13.682
  17:39:40 STEP 2803 H=2803:00 +CPU=  8.485
  17:39:48 STEP 2804 H=2804:00 +CPU=  8.749
  17:40:02 STEP 2805 H=2805:00 +CPU= 13.497
  17:40:11 STEP 2806 H=2806:00 +CPU=  8.721
  17:40:19 STEP 2807 H=2807:00 +CPU=  8.775
  17:40:36 STEP 2808 H=2808:00 +CPU= 16.049
  17:40:44 STEP 2809 H=2809:00 +CPU=  8.386
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002808
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002808
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002796
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002796
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002796
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_116.zip
Uploading the intermediate file: upload_file_116.zip
  17:40:53 STEP 2810 H=2810:00 +CPU=  8.605
Uploading trickle at timestep: 10108800
  17:41:06 STEP 2811 H=2811:00 +CPU= 13.414
  17:41:15 STEP 2812 H=2812:00 +CPU=  8.638
  17:41:23 STEP 2813 H=2813:00 +CPU=  8.503
  17:41:37 STEP 2814 H=2814:00 +CPU= 13.669
  17:41:45 STEP 2815 H=2815:00 +CPU=  8.461
  17:41:54 STEP 2816 H=2816:00 +CPU=  8.742
  17:42:07 STEP 2817 H=2817:00 +CPU= 13.430
  17:42:16 STEP 2818 H=2818:00 +CPU=  8.695
  17:42:25 STEP 2819 H=2819:00 +CPU=  8.537
  17:42:39 STEP 2820 H=2820:00 +CPU= 14.818
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002820
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002820
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002820
  17:42:48 STEP 2821 H=2821:00 +CPU=  8.452
  17:42:57 STEP 2822 H=2822:00 +CPU=  8.748
  17:43:10 STEP 2823 H=2823:00 +CPU= 13.328
  17:43:19 STEP 2824 H=2824:00 +CPU=  8.720
  17:43:27 STEP 2825 H=2825:00 +CPU=  8.576
  17:43:41 STEP 2826 H=2826:00 +CPU= 13.661
  17:43:49 STEP 2827 H=2827:00 +CPU=  8.460
  17:43:58 STEP 2828 H=2828:00 +CPU=  8.759
  17:44:12 STEP 2829 H=2829:00 +CPU= 13.502
  17:44:20 STEP 2830 H=2830:00 +CPU=  8.630
  17:44:29 STEP 2831 H=2831:00 +CPU=  8.741
  17:44:45 STEP 2832 H=2832:00 +CPU= 16.155
  17:44:54 STEP 2833 H=2833:00 +CPU=  8.419
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002832
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002832
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002820
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002820
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002820
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_117.zip
Uploading the intermediate file: upload_file_117.zip
  17:45:02 STEP 2834 H=2834:00 +CPU=  8.657
  17:45:16 STEP 2835 H=2835:00 +CPU= 13.398
  17:45:24 STEP 2836 H=2836:00 +CPU=  8.668
  17:45:33 STEP 2837 H=2837:00 +CPU=  8.618
  17:45:47 STEP 2838 H=2838:00 +CPU= 13.764
  17:45:55 STEP 2839 H=2839:00 +CPU=  8.526
  17:46:04 STEP 2840 H=2840:00 +CPU=  8.772
  17:46:18 STEP 2841 H=2841:00 +CPU= 13.518
  17:46:26 STEP 2842 H=2842:00 +CPU=  8.646
  17:46:35 STEP 2843 H=2843:00 +CPU=  8.554
  17:46:50 STEP 2844 H=2844:00 +CPU= 14.851
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002844
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002844
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002844
  17:46:58 STEP 2845 H=2845:00 +CPU=  8.495
  17:47:07 STEP 2846 H=2846:00 +CPU=  8.742
  17:47:20 STEP 2847 H=2847:00 +CPU= 13.400
  17:47:29 STEP 2848 H=2848:00 +CPU=  8.666
  17:47:38 STEP 2849 H=2849:00 +CPU=  8.616
  17:47:51 STEP 2850 H=2850:00 +CPU= 13.725
  17:48:00 STEP 2851 H=2851:00 +CPU=  8.545
  17:48:09 STEP 2852 H=2852:00 +CPU=  8.792
  17:48:22 STEP 2853 H=2853:00 +CPU= 13.426
  17:48:31 STEP 2854 H=2854:00 +CPU=  8.700
  17:48:40 STEP 2855 H=2855:00 +CPU=  8.797
  17:48:56 STEP 2856 H=2856:00 +CPU= 16.082
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002856
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002856
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002844
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002844
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002844
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_118.zip
Uploading the intermediate file: upload_file_118.zip
  17:49:04 STEP 2857 H=2857:00 +CPU=  8.478
  17:49:13 STEP 2858 H=2858:00 +CPU=  8.723
  17:49:26 STEP 2859 H=2859:00 +CPU= 13.412
  17:49:35 STEP 2860 H=2860:00 +CPU=  8.700
  17:49:44 STEP 2861 H=2861:00 +CPU=  8.558
  17:49:57 STEP 2862 H=2862:00 +CPU= 13.674
  17:50:06 STEP 2863 H=2863:00 +CPU=  8.452
  17:50:15 STEP 2864 H=2864:00 +CPU=  8.874
  17:50:28 STEP 2865 H=2865:00 +CPU= 13.421
  17:50:37 STEP 2866 H=2866:00 +CPU=  8.715
  17:50:45 STEP 2867 H=2867:00 +CPU=  8.577
  17:51:00 STEP 2868 H=2868:00 +CPU= 14.854
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002868
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002868
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002868
  17:51:09 STEP 2869 H=2869:00 +CPU=  8.456
  17:51:17 STEP 2870 H=2870:00 +CPU=  8.703
  17:51:31 STEP 2871 H=2871:00 +CPU= 13.363
  17:51:39 STEP 2872 H=2872:00 +CPU=  8.658
  17:51:48 STEP 2873 H=2873:00 +CPU=  8.531
  17:52:01 STEP 2874 H=2874:00 +CPU= 13.606
  17:52:10 STEP 2875 H=2875:00 +CPU=  8.502
  17:52:19 STEP 2876 H=2876:00 +CPU=  8.812
  17:52:32 STEP 2877 H=2877:00 +CPU= 13.519
  17:52:41 STEP 2878 H=2878:00 +CPU=  8.688
  17:52:50 STEP 2879 H=2879:00 +CPU=  8.801
  17:53:06 STEP 2880 H=2880:00 +CPU= 16.151
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002880
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002880
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002868
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002868
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002868
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_119.zip
Uploading the intermediate file: upload_file_119.zip
  17:53:14 STEP 2881 H=2881:00 +CPU=  8.394
  17:53:23 STEP 2882 H=2882:00 +CPU=  8.645
  17:53:36 STEP 2883 H=2883:00 +CPU= 13.366
  17:53:45 STEP 2884 H=2884:00 +CPU=  8.607
  17:53:53 STEP 2885 H=2885:00 +CPU=  8.476
  17:54:07 STEP 2886 H=2886:00 +CPU= 13.642
  17:54:16 STEP 2887 H=2887:00 +CPU=  8.424
  17:54:24 STEP 2888 H=2888:00 +CPU=  8.748
  17:54:38 STEP 2889 H=2889:00 +CPU= 13.394
  17:54:46 STEP 2890 H=2890:00 +CPU=  8.681
  17:54:55 STEP 2891 H=2891:00 +CPU=  8.518
  17:55:10 STEP 2892 H=2892:00 +CPU= 14.915
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002892
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002892
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002892
  17:55:18 STEP 2893 H=2893:00 +CPU=  8.460
  17:55:27 STEP 2894 H=2894:00 +CPU=  8.734
  17:55:40 STEP 2895 H=2895:00 +CPU= 13.417
  17:55:49 STEP 2896 H=2896:00 +CPU=  8.649
  17:55:58 STEP 2897 H=2897:00 +CPU=  8.517
  17:56:11 STEP 2898 H=2898:00 +CPU= 13.588
  17:56:20 STEP 2899 H=2899:00 +CPU=  8.530
  17:56:28 STEP 2900 H=2900:00 +CPU=  8.757
  17:56:42 STEP 2901 H=2901:00 +CPU= 13.459
  17:56:51 STEP 2902 H=2902:00 +CPU=  8.766
  17:56:59 STEP 2903 H=2903:00 +CPU=  8.773
  17:57:16 STEP 2904 H=2904:00 +CPU= 16.179
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002904
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002904
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002892
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002892
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002892
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_120.zip
Uploading the intermediate file: upload_file_120.zip
  17:57:24 STEP 2905 H=2905:00 +CPU=  8.414
  17:57:33 STEP 2906 H=2906:00 +CPU=  8.607
  17:57:46 STEP 2907 H=2907:00 +CPU= 13.396
  17:57:55 STEP 2908 H=2908:00 +CPU=  8.674
  17:58:03 STEP 2909 H=2909:00 +CPU=  8.497
  17:58:17 STEP 2910 H=2910:00 +CPU= 13.744
  17:58:25 STEP 2911 H=2911:00 +CPU=  8.478
  17:58:34 STEP 2912 H=2912:00 +CPU=  8.769
  17:58:48 STEP 2913 H=2913:00 +CPU= 13.334
  17:58:56 STEP 2914 H=2914:00 +CPU=  8.746
  17:59:05 STEP 2915 H=2915:00 +CPU=  8.544
  17:59:20 STEP 2916 H=2916:00 +CPU= 14.948
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002916
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002916
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002916
  17:59:28 STEP 2917 H=2917:00 +CPU=  8.485
  17:59:37 STEP 2918 H=2918:00 +CPU=  8.745
  17:59:51 STEP 2919 H=2919:00 +CPU= 13.493
  17:59:59 STEP 2920 H=2920:00 +CPU=  8.778
  18:00:08 STEP 2921 H=2921:00 +CPU=  8.535
  18:00:21 STEP 2922 H=2922:00 +CPU= 13.629
  18:00:30 STEP 2923 H=2923:00 +CPU=  8.523
  18:00:39 STEP 2924 H=2924:00 +CPU=  8.723
  18:00:52 STEP 2925 H=2925:00 +CPU= 13.404
  18:01:01 STEP 2926 H=2926:00 +CPU=  8.705
  18:01:10 STEP 2927 H=2927:00 +CPU=  8.820
  18:01:26 STEP 2928 H=2928:00 +CPU= 16.067
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002928
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002928
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002928
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002916
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002916
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002916
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_121.zip
Uploading the intermediate file: upload_file_121.zip
  18:01:34 STEP 2929 H=2929:00 +CPU=  8.468
  18:01:43 STEP 2930 H=2930:00 +CPU=  8.620
  18:01:56 STEP 2931 H=2931:00 +CPU= 13.305
  18:02:05 STEP 2932 H=2932:00 +CPU=  8.658
  18:02:13 STEP 2933 H=2933:00 +CPU=  8.377
  18:02:27 STEP 2934 H=2934:00 +CPU= 13.481
  18:02:35 STEP 2935 H=2935:00 +CPU=  8.484
  18:02:44 STEP 2936 H=2936:00 +CPU=  8.680
  18:02:57 STEP 2937 H=2937:00 +CPU= 13.374
  18:03:06 STEP 2938 H=2938:00 +CPU=  8.683
  18:03:14 STEP 2939 H=2939:00 +CPU=  8.494
  18:03:29 STEP 2940 H=2940:00 +CPU= 14.708
  18:03:37 STEP 2941 H=2941:00 +CPU=  8.406
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002940
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002940
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002940
  18:03:46 STEP 2942 H=2942:00 +CPU=  8.633
  18:03:59 STEP 2943 H=2943:00 +CPU= 13.251
  18:04:08 STEP 2944 H=2944:00 +CPU=  8.635
  18:04:16 STEP 2945 H=2945:00 +CPU=  8.347
  18:04:30 STEP 2946 H=2946:00 +CPU= 13.429
  18:04:38 STEP 2947 H=2947:00 +CPU=  8.381
  18:04:47 STEP 2948 H=2948:00 +CPU=  8.690
  18:05:00 STEP 2949 H=2949:00 +CPU= 13.281
  18:05:09 STEP 2950 H=2950:00 +CPU=  8.608
  18:05:17 STEP 2951 H=2951:00 +CPU=  8.601
  18:05:33 STEP 2952 H=2952:00 +CPU= 15.470
The child process terminated with status: 0
Moving to projects directory: /home/fritzb/slots/7/ICMGGhq0f+002952
Moving to projects directory: /home/fritzb/slots/7/ICMSHhq0f+002952
Moving to projects directory: /home/fritzb/slots/7/ICMUAhq0f+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002940
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002928
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMUAhq0f+002928
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002940
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMSHhq0f+002940
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12192683/ICMGGhq0f+002928
Zipping up the final file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0039_2007050100_123_976_12192683_0_r1782858050_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10620000
18:08:56 (30765): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:18:16 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 10,620,000 38,485 0.0036
09 May 2023 16:18:16 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 10,620,000 38,485 0.0036
09 May 2023 16:18:13 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 10,108,800 36,995 0.0037
09 May 2023 16:16:54 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 8,640,000 31,163 0.0036
09 May 2023 16:16:51 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 7,776,000 28,064 0.0036
09 May 2023 16:16:51 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 7,776,000 28,064 0.0036
09 May 2023 16:16:47 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 6,912,000 24,957 0.0036
09 May 2023 16:16:47 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 6,912,000 24,957 0.0036
09 May 2023 16:16:44 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 6,048,000 21,839 0.0036
09 May 2023 16:16:44 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 5,184,000 18,721 0.0036
09 May 2023 16:16:40 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 4,320,000 15,604 0.0036
09 May 2023 16:16:37 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 3,456,000 12,486 0.0036
09 May 2023 16:16:34 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 2,592,000 9,369 0.0036
09 May 2023 16:16:34 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 2,592,000 9,369 0.0036
09 May 2023 16:16:31 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 1,728,000 6,251 0.0036
09 May 2023 16:16:31 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 1,728,000 6,251 0.0036
09 May 2023 16:16:28 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 864,000 3,135 0.0036
09 May 2023 16:16:28 1537731 22278439 oifs_43r3_ps_0039_2007050100_123_976_12192683_0 864,000 3,135 0.0036


©2024 climateprediction.net