Name | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 |
Workunit | 12192694 |
Created | 23 Dec 2022, 20:05:31 UTC |
Sent | 23 Dec 2022, 20:27:13 UTC |
Report deadline | 22 Jan 2023, 20:27:13 UTC |
Received | 3 Jan 2023, 16:24:50 UTC |
Server state | Over |
Outcome | Success |
Client state | Done |
Exit status | 0 (0x00000000) |
Computer ID | 1519251 |
Run time | 23 hours 30 min 3 sec |
CPU time | 20 hours 18 min 38 sec |
Validate state | Valid |
Credit | 14,873.04 |
Device peak FLOPS | 4.97 GFLOPS |
Application version | OpenIFS 43r3 Perturbed Surface v1.05 x86_64-pc-linux-gnu |
Peak working set size | 4,419.58 MB |
Peak swap size | 4,978.08 MB |
Peak disk usage | 5,067.54 MB |
Stderr | <core_client_version>7.16.6</core_client_version> <![CDATA[ <stderr_txt> b/boinc-client/slots/10/ic_ancil_12192694.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_21e274463ecf4aea2b915fa875af930a to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12192694.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12192694.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12192694.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12192694.zip Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12192694.xml Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12192694.xml -- Model is restarting -- Adjusting last_iter, 2580, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12192694.xml last_cpu_time: 62961 upload_file_number: 107 last_iter: 2567 last_upload: 9244800 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880 The child process has been launched with process id: 4135537 Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:4135537:4135537] [20221226:065422:1672005262:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 06:55:00 STEP 2568 H=2568:00 +CPU= 35.968 06:55:21 STEP 2569 H=2569:00 +CPU= 20.636 06:55:41 STEP 2570 H=2570:00 +CPU= 19.883 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:56:52 STEP 2571 H=2571:00 +CPU= 31.688 06:57:12 STEP 2572 H=2572:00 +CPU= 19.939 06:57:32 STEP 2573 H=2573:00 +CPU= 19.875 06:58:05 STEP 2574 H=2574:00 +CPU= 32.304 Suspend request received from the BOINC client, suspending the child process Resuming the child process 06:59:07 STEP 2575 H=2575:00 +CPU= 19.938 06:59:28 STEP 2576 H=2576:00 +CPU= 20.840 07:00:00 STEP 2577 H=2577:00 +CPU= 32.089 07:00:20 STEP 2578 H=2578:00 +CPU= 20.434 07:00:40 STEP 2579 H=2579:00 +CPU= 19.381 07:01:15 STEP 2580 H=2580:00 +CPU= 34.748 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002580 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002580 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002580 07:01:34 STEP 2581 H=2581:00 +CPU= 19.194 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:02:36 STEP 2582 H=2582:00 +CPU= 20.138 07:03:08 STEP 2583 H=2583:00 +CPU= 31.700 07:03:28 STEP 2584 H=2584:00 +CPU= 19.872 07:03:47 STEP 2585 H=2585:00 +CPU= 19.366 07:04:20 STEP 2586 H=2586:00 +CPU= 32.504 07:04:39 STEP 2587 H=2587:00 +CPU= 19.733 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:05:41 STEP 2588 H=2588:00 +CPU= 20.182 07:06:12 STEP 2589 H=2589:00 +CPU= 31.732 07:06:32 STEP 2590 H=2590:00 +CPU= 19.947 07:06:52 STEP 2591 H=2591:00 +CPU= 19.724 07:07:29 STEP 2592 H=2592:00 +CPU= 36.843 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002592 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002592 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002592 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002568 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002568 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002568 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002580 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002580 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002580 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_107.zip Uploading the intermediate file: upload_file_107.zip 07:07:49 STEP 2593 H=2593:00 +CPU= 19.865 07:08:09 STEP 2594 H=2594:00 +CPU= 20.103 07:08:41 STEP 2595 H=2595:00 +CPU= 31.631 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:09:41 STEP 2596 H=2596:00 +CPU= 20.215 07:10:01 STEP 2597 H=2597:00 +CPU= 19.698 07:10:34 STEP 2598 H=2598:00 +CPU= 32.541 07:10:54 STEP 2599 H=2599:00 +CPU= 20.052 07:11:14 STEP 2600 H=2600:00 +CPU= 20.199 07:11:46 STEP 2601 H=2601:00 +CPU= 32.062 07:12:06 STEP 2602 H=2602:00 +CPU= 20.321 07:12:26 STEP 2603 H=2603:00 +CPU= 19.728 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:13:42 STEP 2604 H=2604:00 +CPU= 34.834 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002604 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002604 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002604 07:14:03 STEP 2605 H=2605:00 +CPU= 20.413 07:14:22 STEP 2606 H=2606:00 +CPU= 19.528 07:14:54 STEP 2607 H=2607:00 +CPU= 31.540 07:15:14 STEP 2608 H=2608:00 +CPU= 20.177 07:15:34 STEP 2609 H=2609:00 +CPU= 19.510 07:16:06 STEP 2610 H=2610:00 +CPU= 32.332 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:17:07 STEP 2611 H=2611:00 +CPU= 20.155 07:17:27 STEP 2612 H=2612:00 +CPU= 19.992 07:17:58 STEP 2613 H=2613:00 +CPU= 31.178 07:18:18 STEP 2614 H=2614:00 +CPU= 19.926 07:18:39 STEP 2615 H=2615:00 +CPU= 20.093 07:19:16 STEP 2616 H=2616:00 +CPU= 37.048 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002616 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002616 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002616 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002592 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002592 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002592 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002604 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002604 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002604 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_108.zip Uploading the intermediate file: upload_file_108.zip 07:19:36 STEP 2617 H=2617:00 +CPU= 19.764 07:19:55 STEP 2618 H=2618:00 +CPU= 19.846 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:20:58 STEP 2619 H=2619:00 +CPU= 30.953 07:21:18 STEP 2620 H=2620:00 +CPU= 20.061 07:21:37 STEP 2621 H=2621:00 +CPU= 19.479 07:22:10 STEP 2622 H=2622:00 +CPU= 32.345 07:22:29 STEP 2623 H=2623:00 +CPU= 19.447 07:22:49 STEP 2624 H=2624:00 +CPU= 19.870 07:23:21 STEP 2625 H=2625:00 +CPU= 32.100 07:23:42 STEP 2626 H=2626:00 +CPU= 20.464 07:24:01 STEP 2627 H=2627:00 +CPU= 19.503 07:24:36 STEP 2628 H=2628:00 +CPU= 34.694 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002628 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002628 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002628 07:24:56 STEP 2629 H=2629:00 +CPU= 19.581 07:25:16 STEP 2630 H=2630:00 +CPU= 19.945 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:26:39 STEP 2631 H=2631:00 +CPU= 31.791 07:26:59 STEP 2632 H=2632:00 +CPU= 20.583 07:27:19 STEP 2633 H=2633:00 +CPU= 19.856 07:27:51 STEP 2634 H=2634:00 +CPU= 32.195 07:28:11 STEP 2635 H=2635:00 +CPU= 19.697 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:29:03 STEP 2636 H=2636:00 +CPU= 20.381 07:29:35 STEP 2637 H=2637:00 +CPU= 32.155 07:29:55 STEP 2638 H=2638:00 +CPU= 20.419 07:30:15 STEP 2639 H=2639:00 +CPU= 20.066 07:30:53 STEP 2640 H=2640:00 +CPU= 37.341 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002640 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002640 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002640 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002616 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002616 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002616 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002628 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002628 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002628 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_109.zip Uploading the intermediate file: upload_file_109.zip 07:31:12 STEP 2641 H=2641:00 +CPU= 19.622 07:31:33 STEP 2642 H=2642:00 +CPU= 20.188 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:32:46 STEP 2643 H=2643:00 +CPU= 32.200 07:33:06 STEP 2644 H=2644:00 +CPU= 20.157 07:33:26 STEP 2645 H=2645:00 +CPU= 20.092 07:33:59 STEP 2646 H=2646:00 +CPU= 32.160 07:34:18 STEP 2647 H=2647:00 +CPU= 19.728 07:34:39 STEP 2648 H=2648:00 +CPU= 20.123 07:35:10 STEP 2649 H=2649:00 +CPU= 31.793 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:36:12 STEP 2650 H=2650:00 +CPU= 20.089 07:36:31 STEP 2651 H=2651:00 +CPU= 19.537 07:37:06 STEP 2652 H=2652:00 +CPU= 34.461 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002652 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002652 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002652 07:37:26 STEP 2653 H=2653:00 +CPU= 19.809 07:37:46 STEP 2654 H=2654:00 +CPU= 20.004 07:38:18 STEP 2655 H=2655:00 +CPU= 32.079 07:38:38 STEP 2656 H=2656:00 +CPU= 20.458 07:38:58 STEP 2657 H=2657:00 +CPU= 19.871 07:39:31 STEP 2658 H=2658:00 +CPU= 32.474 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:40:30 STEP 2659 H=2659:00 +CPU= 19.465 07:40:51 STEP 2660 H=2660:00 +CPU= 20.560 07:41:23 STEP 2661 H=2661:00 +CPU= 32.080 07:41:44 STEP 2662 H=2662:00 +CPU= 20.456 07:42:04 STEP 2663 H=2663:00 +CPU= 20.507 07:42:42 STEP 2664 H=2664:00 +CPU= 37.365 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002664 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002664 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002664 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002640 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002640 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002640 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002652 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002652 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002652 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_110.zip Uploading the intermediate file: upload_file_110.zip 07:43:01 STEP 2665 H=2665:00 +CPU= 19.602 07:43:22 STEP 2666 H=2666:00 +CPU= 20.331 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:44:24 STEP 2667 H=2667:00 +CPU= 31.383 07:44:45 STEP 2668 H=2668:00 +CPU= 20.634 07:45:04 STEP 2669 H=2669:00 +CPU= 19.652 07:45:37 STEP 2670 H=2670:00 +CPU= 32.229 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:46:37 STEP 2671 H=2671:00 +CPU= 20.031 07:46:57 STEP 2672 H=2672:00 +CPU= 20.520 07:47:29 STEP 2673 H=2673:00 +CPU= 31.464 07:47:50 STEP 2674 H=2674:00 +CPU= 20.540 07:48:09 STEP 2675 H=2675:00 +CPU= 19.503 07:48:43 STEP 2676 H=2676:00 +CPU= 34.308 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002676 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002676 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002676 07:49:03 STEP 2677 H=2677:00 +CPU= 19.334 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:49:54 STEP 2678 H=2678:00 +CPU= 20.577 07:50:26 STEP 2679 H=2679:00 +CPU= 31.523 07:50:47 STEP 2680 H=2680:00 +CPU= 20.496 07:51:06 STEP 2681 H=2681:00 +CPU= 19.585 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:52:11 STEP 2682 H=2682:00 +CPU= 32.623 07:52:31 STEP 2683 H=2683:00 +CPU= 19.774 07:52:51 STEP 2684 H=2684:00 +CPU= 20.442 07:53:23 STEP 2685 H=2685:00 +CPU= 31.782 07:53:43 STEP 2686 H=2686:00 +CPU= 20.193 07:54:04 STEP 2687 H=2687:00 +CPU= 20.361 07:54:40 STEP 2688 H=2688:00 +CPU= 36.658 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002688 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002688 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002688 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002664 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002664 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002664 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002676 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002676 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002676 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_111.zip Uploading the intermediate file: upload_file_111.zip 07:55:00 STEP 2689 H=2689:00 +CPU= 19.557 07:55:21 STEP 2690 H=2690:00 +CPU= 20.360 07:55:52 STEP 2691 H=2691:00 +CPU= 31.475 Suspend request received from the BOINC client, suspending the child process Resuming the child process 07:56:52 STEP 2692 H=2692:00 +CPU= 20.220 07:57:12 STEP 2693 H=2693:00 +CPU= 19.446 07:57:44 STEP 2694 H=2694:00 +CPU= 32.451 07:58:04 STEP 2695 H=2695:00 +CPU= 19.706 07:58:25 STEP 2696 H=2696:00 +CPU= 20.400 07:58:56 STEP 2697 H=2697:00 +CPU= 31.542 07:59:17 STEP 2698 H=2698:00 +CPU= 20.987 07:59:37 STEP 2699 H=2699:00 +CPU= 19.981 08:00:13 STEP 2700 H=2700:00 +CPU= 35.285 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002700 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002700 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002700 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:01:12 STEP 2701 H=2701:00 +CPU= 19.696 08:01:32 STEP 2702 H=2702:00 +CPU= 20.026 08:02:04 STEP 2703 H=2703:00 +CPU= 31.400 08:02:24 STEP 2704 H=2704:00 +CPU= 20.377 08:02:44 STEP 2705 H=2705:00 +CPU= 19.656 08:03:16 STEP 2706 H=2706:00 +CPU= 32.102 08:03:36 STEP 2707 H=2707:00 +CPU= 19.735 08:03:56 STEP 2708 H=2708:00 +CPU= 20.458 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:05:20 STEP 2709 H=2709:00 +CPU= 31.832 08:05:40 STEP 2710 H=2710:00 +CPU= 20.072 08:06:01 STEP 2711 H=2711:00 +CPU= 20.133 08:06:38 STEP 2712 H=2712:00 +CPU= 37.038 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002712 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002712 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002712 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002688 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002688 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002688 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002700 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002700 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002700 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_112.zip Uploading the intermediate file: upload_file_112.zip 08:06:55 STEP 2713 H=2713:00 +CPU= 17.620 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:07:40 STEP 2714 H=2714:00 +CPU= 19.478 08:08:11 STEP 2715 H=2715:00 +CPU= 31.139 08:08:31 STEP 2716 H=2716:00 +CPU= 19.894 08:08:51 STEP 2717 H=2717:00 +CPU= 19.497 08:09:22 STEP 2718 H=2718:00 +CPU= 31.664 08:09:42 STEP 2719 H=2719:00 +CPU= 19.420 08:10:02 STEP 2720 H=2720:00 +CPU= 20.156 08:10:34 STEP 2721 H=2721:00 +CPU= 31.602 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:11:25 STEP 2722 H=2722:00 +CPU= 20.322 08:11:45 STEP 2723 H=2723:00 +CPU= 20.212 08:12:20 STEP 2724 H=2724:00 +CPU= 34.527 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002724 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002724 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002724 08:12:40 STEP 2725 H=2725:00 +CPU= 19.810 08:13:00 STEP 2726 H=2726:00 +CPU= 20.450 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:14:02 STEP 2727 H=2727:00 +CPU= 30.922 08:14:23 STEP 2728 H=2728:00 +CPU= 20.358 08:14:43 STEP 2729 H=2729:00 +CPU= 19.844 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:15:56 STEP 2730 H=2730:00 +CPU= 32.145 08:16:16 STEP 2731 H=2731:00 +CPU= 19.734 08:16:36 STEP 2732 H=2732:00 +CPU= 20.073 08:17:07 STEP 2733 H=2733:00 +CPU= 31.230 08:17:27 STEP 2734 H=2734:00 +CPU= 20.387 08:17:48 STEP 2735 H=2735:00 +CPU= 20.406 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:19:25 STEP 2736 H=2736:00 +CPU= 37.004 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002736 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002736 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002736 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002712 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002712 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002712 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002724 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002724 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002724 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_113.zip Uploading the intermediate file: upload_file_113.zip 08:19:44 STEP 2737 H=2737:00 +CPU= 19.389 08:20:05 STEP 2738 H=2738:00 +CPU= 20.379 08:20:36 STEP 2739 H=2739:00 +CPU= 31.140 08:20:56 STEP 2740 H=2740:00 +CPU= 20.342 08:21:17 STEP 2741 H=2741:00 +CPU= 20.215 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:22:41 STEP 2742 H=2742:00 +CPU= 32.172 08:23:01 STEP 2743 H=2743:00 +CPU= 19.483 08:23:21 STEP 2744 H=2744:00 +CPU= 20.338 08:23:53 STEP 2745 H=2745:00 +CPU= 31.744 08:24:13 STEP 2746 H=2746:00 +CPU= 20.291 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:25:14 STEP 2747 H=2747:00 +CPU= 20.013 08:25:48 STEP 2748 H=2748:00 +CPU= 34.002 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002748 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002748 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002748 08:26:08 STEP 2749 H=2749:00 +CPU= 19.483 08:26:28 STEP 2750 H=2750:00 +CPU= 20.250 08:27:00 STEP 2751 H=2751:00 +CPU= 31.732 08:27:20 STEP 2752 H=2752:00 +CPU= 19.986 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:28:42 STEP 2753 H=2753:00 +CPU= 19.536 08:29:14 STEP 2754 H=2754:00 +CPU= 32.012 08:29:33 STEP 2755 H=2755:00 +CPU= 19.774 08:29:54 STEP 2756 H=2756:00 +CPU= 20.124 08:30:25 STEP 2757 H=2757:00 +CPU= 31.294 08:30:46 STEP 2758 H=2758:00 +CPU= 20.521 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:31:57 STEP 2759 H=2759:00 +CPU= 20.484 08:32:34 STEP 2760 H=2760:00 +CPU= 36.530 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002760 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002760 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002760 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002736 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002736 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002736 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002748 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002748 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002748 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_114.zip Uploading the intermediate file: upload_file_114.zip 08:32:54 STEP 2761 H=2761:00 +CPU= 20.039 08:33:14 STEP 2762 H=2762:00 +CPU= 20.603 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:34:36 STEP 2763 H=2763:00 +CPU= 30.777 08:34:57 STEP 2764 H=2764:00 +CPU= 20.338 08:35:16 STEP 2765 H=2765:00 +CPU= 19.562 08:35:48 STEP 2766 H=2766:00 +CPU= 31.612 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:36:50 STEP 2767 H=2767:00 +CPU= 19.891 08:37:11 STEP 2768 H=2768:00 +CPU= 20.481 08:37:42 STEP 2769 H=2769:00 +CPU= 31.506 08:38:02 STEP 2770 H=2770:00 +CPU= 20.277 08:38:22 STEP 2771 H=2771:00 +CPU= 19.734 08:38:57 STEP 2772 H=2772:00 +CPU= 34.578 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002772 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002772 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002772 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:40:08 STEP 2773 H=2773:00 +CPU= 20.133 08:40:28 STEP 2774 H=2774:00 +CPU= 20.316 08:40:59 STEP 2775 H=2775:00 +CPU= 30.640 08:41:20 STEP 2776 H=2776:00 +CPU= 20.730 08:41:39 STEP 2777 H=2777:00 +CPU= 19.430 08:42:11 STEP 2778 H=2778:00 +CPU= 31.363 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:43:11 STEP 2779 H=2779:00 +CPU= 19.554 08:43:31 STEP 2780 H=2780:00 +CPU= 20.225 08:44:05 STEP 2781 H=2781:00 +CPU= 33.978 08:44:26 STEP 2782 H=2782:00 +CPU= 20.936 08:44:47 STEP 2783 H=2783:00 +CPU= 20.273 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:46:16 STEP 2784 H=2784:00 +CPU= 36.946 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002784 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002784 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002784 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002760 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002760 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002760 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002772 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002772 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002772 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_115.zip Uploading the intermediate file: upload_file_115.zip 08:46:36 STEP 2785 H=2785:00 +CPU= 20.084 08:46:57 STEP 2786 H=2786:00 +CPU= 20.613 08:47:28 STEP 2787 H=2787:00 +CPU= 31.517 08:47:49 STEP 2788 H=2788:00 +CPU= 20.280 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:49:10 STEP 2789 H=2789:00 +CPU= 20.247 08:49:43 STEP 2790 H=2790:00 +CPU= 33.187 08:50:03 STEP 2791 H=2791:00 +CPU= 19.931 08:50:24 STEP 2792 H=2792:00 +CPU= 20.910 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:51:38 STEP 2793 H=2793:00 +CPU= 32.075 08:51:59 STEP 2794 H=2794:00 +CPU= 20.922 08:52:19 STEP 2795 H=2795:00 +CPU= 20.205 08:52:54 STEP 2796 H=2796:00 +CPU= 34.673 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002796 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002796 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002796 08:53:14 STEP 2797 H=2797:00 +CPU= 20.467 08:53:35 STEP 2798 H=2798:00 +CPU= 20.610 Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:54:48 STEP 2799 H=2799:00 +CPU= 32.019 Quit request received from BOINC client, ending the child process ..Failed, model did not complete successfully (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 2007050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0050 (argv4) batchid: 976 (argv5) wuid: 12192694 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/10 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_73bc9afffd204c98185851389cea1f2a to: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0050_2007050100_123_976_12192694.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/10/oifs_43r3_ps_0050_2007050100_123_976_12192694.zip ic_ancil_file: ic_ancil_12192694 ifsdata_file: ifsdata_12192694 climate_data_file: clim_data_12192694 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_237bf9814ab604b32c99d038c20310db to: /var/lib/boinc-client/slots/10/ic_ancil_12192694.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/10/ic_ancil_12192694.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_21e274463ecf4aea2b915fa875af930a to: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12192694.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/10/ifsdata/ifsdata_12192694.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/10/159l_2/clim_data_12192694.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/10/159l_2/clim_data_12192694.zip Checking for progress XML file: /var/lib/boinc-client/slots/10/progress_file_12192694.xml Opened progress file ok : /var/lib/boinc-client/slots/10/progress_file_12192694.xml -- Model is restarting -- Adjusting last_iter, 2800, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/10/progress_file_12192694.xml last_cpu_time: 68620 upload_file_number: 116 last_iter: 2783 last_upload: 10022400 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880 The child process has been launched with process id: 4155658 Executing the command: /var/lib/boinc-client/slots/10/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:p500:1:1:4155658:4155658] [20221226:085607:1672012567:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process 08:57:37 STEP 2784 H=2784:00 +CPU= 35.956 08:57:57 STEP 2785 H=2785:00 +CPU= 20.169 08:58:17 STEP 2786 H=2786:00 +CPU= 20.207 08:58:49 STEP 2787 H=2787:00 +CPU= 31.690 08:59:10 STEP 2788 H=2788:00 +CPU= 20.288 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:00:22 STEP 2789 H=2789:00 +CPU= 19.929 09:00:54 STEP 2790 H=2790:00 +CPU= 32.186 09:01:14 STEP 2791 H=2791:00 +CPU= 20.195 09:01:35 STEP 2792 H=2792:00 +CPU= 20.359 09:02:06 STEP 2793 H=2793:00 +CPU= 31.807 09:02:27 STEP 2794 H=2794:00 +CPU= 20.584 09:02:47 STEP 2795 H=2795:00 +CPU= 19.483 09:03:22 STEP 2796 H=2796:00 +CPU= 34.818 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002796 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002796 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002796 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:04:22 STEP 2797 H=2797:00 +CPU= 20.507 09:04:42 STEP 2798 H=2798:00 +CPU= 20.210 09:05:14 STEP 2799 H=2799:00 +CPU= 31.164 09:05:34 STEP 2800 H=2800:00 +CPU= 20.678 09:05:54 STEP 2801 H=2801:00 +CPU= 19.854 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:07:17 STEP 2802 H=2802:00 +CPU= 32.302 09:07:36 STEP 2803 H=2803:00 +CPU= 19.238 09:07:56 STEP 2804 H=2804:00 +CPU= 20.250 09:08:28 STEP 2805 H=2805:00 +CPU= 31.738 09:08:49 STEP 2806 H=2806:00 +CPU= 20.517 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:09:52 STEP 2807 H=2807:00 +CPU= 20.794 09:10:29 STEP 2808 H=2808:00 +CPU= 36.704 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002808 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002808 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002808 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002784 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002784 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002784 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002796 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002796 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002796 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_116.zip Uploading the intermediate file: upload_file_116.zip 09:10:49 STEP 2809 H=2809:00 +CPU= 19.977 09:11:09 STEP 2810 H=2810:00 +CPU= 20.464 09:11:41 STEP 2811 H=2811:00 +CPU= 31.349 09:12:02 STEP 2812 H=2812:00 +CPU= 20.869 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:13:23 STEP 2813 H=2813:00 +CPU= 20.037 09:13:55 STEP 2814 H=2814:00 +CPU= 32.092 09:14:14 STEP 2815 H=2815:00 +CPU= 19.515 09:14:35 STEP 2816 H=2816:00 +CPU= 20.616 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:15:47 STEP 2817 H=2817:00 +CPU= 32.151 09:16:08 STEP 2818 H=2818:00 +CPU= 20.456 09:16:28 STEP 2819 H=2819:00 +CPU= 19.501 09:17:03 STEP 2820 H=2820:00 +CPU= 35.459 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002820 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002820 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002820 09:17:23 STEP 2821 H=2821:00 +CPU= 20.077 09:17:44 STEP 2822 H=2822:00 +CPU= 20.884 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:18:58 STEP 2823 H=2823:00 +CPU= 31.792 09:19:19 STEP 2824 H=2824:00 +CPU= 20.594 09:19:39 STEP 2825 H=2825:00 +CPU= 19.832 09:20:11 STEP 2826 H=2826:00 +CPU= 32.341 09:20:31 STEP 2827 H=2827:00 +CPU= 19.891 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:21:42 STEP 2828 H=2828:00 +CPU= 20.261 09:22:14 STEP 2829 H=2829:00 +CPU= 31.532 09:22:35 STEP 2830 H=2830:00 +CPU= 20.548 09:22:55 STEP 2831 H=2831:00 +CPU= 20.269 09:23:32 STEP 2832 H=2832:00 +CPU= 37.081 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002832 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002832 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002832 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002808 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002808 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002808 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002820 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002820 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002820 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_117.zip Uploading the intermediate file: upload_file_117.zip 09:23:51 STEP 2833 H=2833:00 +CPU= 18.573 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:24:45 STEP 2834 H=2834:00 +CPU= 19.899 09:25:17 STEP 2835 H=2835:00 +CPU= 31.569 09:25:37 STEP 2836 H=2836:00 +CPU= 20.573 09:25:58 STEP 2837 H=2837:00 +CPU= 20.232 09:26:30 STEP 2838 H=2838:00 +CPU= 32.035 09:26:49 STEP 2839 H=2839:00 +CPU= 19.290 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:28:00 STEP 2840 H=2840:00 +CPU= 20.277 09:28:32 STEP 2841 H=2841:00 +CPU= 31.159 09:28:52 STEP 2842 H=2842:00 +CPU= 20.464 09:29:12 STEP 2843 H=2843:00 +CPU= 20.007 09:29:48 STEP 2844 H=2844:00 +CPU= 35.382 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002844 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002844 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002844 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:31:08 STEP 2845 H=2845:00 +CPU= 19.473 09:31:29 STEP 2846 H=2846:00 +CPU= 20.469 09:32:00 STEP 2847 H=2847:00 +CPU= 31.173 09:32:20 STEP 2848 H=2848:00 +CPU= 20.298 09:32:41 STEP 2849 H=2849:00 +CPU= 19.960 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:33:54 STEP 2850 H=2850:00 +CPU= 32.361 09:34:15 STEP 2851 H=2851:00 +CPU= 20.615 09:34:35 STEP 2852 H=2852:00 +CPU= 20.105 09:35:07 STEP 2853 H=2853:00 +CPU= 32.278 09:35:29 STEP 2854 H=2854:00 +CPU= 21.010 09:35:49 STEP 2855 H=2855:00 +CPU= 20.176 09:36:27 STEP 2856 H=2856:00 +CPU= 37.501 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002856 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002856 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002856 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002832 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002832 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002832 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002844 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002844 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002844 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_118.zip Uploading the intermediate file: upload_file_118.zip 09:36:46 STEP 2857 H=2857:00 +CPU= 18.933 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:38:03 STEP 2858 H=2858:00 +CPU= 20.487 09:38:36 STEP 2859 H=2859:00 +CPU= 32.774 09:38:59 STEP 2860 H=2860:00 +CPU= 22.172 09:39:20 STEP 2861 H=2861:00 +CPU= 20.952 09:39:58 STEP 2862 H=2862:00 +CPU= 37.385 09:40:22 STEP 2863 H=2863:00 +CPU= 23.684 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:48:08 STEP 2864 H=2864:00 +CPU= 24.050 09:48:48 STEP 2865 H=2865:00 +CPU= 38.844 09:49:14 STEP 2866 H=2866:00 +CPU= 25.154 09:49:38 STEP 2867 H=2867:00 +CPU= 23.755 Suspend request received from the BOINC client, suspending the child process Resuming the child process 09:58:12 STEP 2868 H=2868:00 +CPU= 41.589 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002868 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002868 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002868 09:58:38 STEP 2869 H=2869:00 +CPU= 25.108 09:59:04 STEP 2870 H=2870:00 +CPU= 25.264 09:59:44 STEP 2871 H=2871:00 +CPU= 38.802 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:07:41 STEP 2872 H=2872:00 +CPU= 24.872 10:08:06 STEP 2873 H=2873:00 +CPU= 24.872 10:08:47 STEP 2874 H=2874:00 +CPU= 39.614 10:09:12 STEP 2875 H=2875:00 +CPU= 24.321 10:09:38 STEP 2876 H=2876:00 +CPU= 25.317 10:10:17 STEP 2877 H=2877:00 +CPU= 38.250 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:14:51 STEP 2878 H=2878:00 +CPU= 23.305 10:15:15 STEP 2879 H=2879:00 +CPU= 23.772 10:16:00 STEP 2880 H=2880:00 +CPU= 43.874 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002880 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002880 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002880 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002856 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002856 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002856 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002868 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002868 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002868 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_119.zip Uploading the intermediate file: upload_file_119.zip 10:16:24 STEP 2881 H=2881:00 +CPU= 23.517 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:20:50 STEP 2882 H=2882:00 +CPU= 24.211 10:21:23 STEP 2883 H=2883:00 +CPU= 33.337 10:21:45 STEP 2884 H=2884:00 +CPU= 21.470 10:22:06 STEP 2885 H=2885:00 +CPU= 21.078 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:24:13 STEP 2886 H=2886:00 +CPU= 33.818 10:24:33 STEP 2887 H=2887:00 +CPU= 20.793 10:24:55 STEP 2888 H=2888:00 +CPU= 21.524 10:25:30 STEP 2889 H=2889:00 +CPU= 34.208 10:25:51 STEP 2890 H=2890:00 +CPU= 21.140 10:26:12 STEP 2891 H=2891:00 +CPU= 20.450 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:31:34 STEP 2892 H=2892:00 +CPU= 39.192 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002892 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002892 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002892 10:31:58 STEP 2893 H=2893:00 +CPU= 23.647 10:32:23 STEP 2894 H=2894:00 +CPU= 24.204 10:33:02 STEP 2895 H=2895:00 +CPU= 38.209 10:33:26 STEP 2896 H=2896:00 +CPU= 23.880 10:33:50 STEP 2897 H=2897:00 +CPU= 23.068 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:37:09 STEP 2898 H=2898:00 +CPU= 37.044 10:37:30 STEP 2899 H=2899:00 +CPU= 21.454 10:37:53 STEP 2900 H=2900:00 +CPU= 21.892 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:40:21 STEP 2901 H=2901:00 +CPU= 36.246 10:40:45 STEP 2902 H=2902:00 +CPU= 23.902 10:41:10 STEP 2903 H=2903:00 +CPU= 24.630 10:41:55 STEP 2904 H=2904:00 +CPU= 44.166 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002904 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002904 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002904 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002880 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002880 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002880 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002892 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002892 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002892 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_120.zip Uploading the intermediate file: upload_file_120.zip 10:42:20 STEP 2905 H=2905:00 +CPU= 23.783 10:42:44 STEP 2906 H=2906:00 +CPU= 24.129 10:43:23 STEP 2907 H=2907:00 +CPU= 37.827 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:45:59 STEP 2908 H=2908:00 +CPU= 24.098 10:46:22 STEP 2909 H=2909:00 +CPU= 22.931 10:47:00 STEP 2910 H=2910:00 +CPU= 37.097 10:47:22 STEP 2911 H=2911:00 +CPU= 22.236 10:47:47 STEP 2912 H=2912:00 +CPU= 23.589 Suspend request received from the BOINC client, suspending the child process Resuming the child process 10:58:59 STEP 2913 H=2913:00 +CPU= 38.503 10:59:22 STEP 2914 H=2914:00 +CPU= 23.275 10:59:45 STEP 2915 H=2915:00 +CPU= 22.914 11:00:26 STEP 2916 H=2916:00 +CPU= 40.482 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002916 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002916 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002916 11:00:49 STEP 2917 H=2917:00 +CPU= 22.600 11:01:14 STEP 2918 H=2918:00 +CPU= 23.657 11:01:51 STEP 2919 H=2919:00 +CPU= 36.684 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 19:06:39 STEP 2920 H=2920:00 +CPU= 23.724 19:07:03 STEP 2921 H=2921:00 +CPU= 23.193 19:07:40 STEP 2922 H=2922:00 +CPU= 36.139 19:08:05 STEP 2923 H=2923:00 +CPU= 24.165 19:08:28 STEP 2924 H=2924:00 +CPU= 22.557 19:09:01 STEP 2925 H=2925:00 +CPU= 33.594 19:09:23 STEP 2926 H=2926:00 +CPU= 21.119 19:09:44 STEP 2927 H=2927:00 +CPU= 21.175 19:10:29 STEP 2928 H=2928:00 +CPU= 43.635 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002928 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002928 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002928 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002904 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002904 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002904 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002916 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002916 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002916 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_121.zip Uploading the intermediate file: upload_file_121.zip 19:10:51 STEP 2929 H=2929:00 +CPU= 22.083 Suspend request received from the BOINC client, suspending the child process Resuming the child process 19:12:45 STEP 2930 H=2930:00 +CPU= 22.772 19:13:23 STEP 2931 H=2931:00 +CPU= 37.367 19:13:47 STEP 2932 H=2932:00 +CPU= 23.292 19:14:09 STEP 2933 H=2933:00 +CPU= 22.138 19:14:48 STEP 2934 H=2934:00 +CPU= 38.129 19:15:12 STEP 2935 H=2935:00 +CPU= 23.056 19:15:36 STEP 2936 H=2936:00 +CPU= 23.480 Suspend request received from the BOINC client, suspending the child process Resuming the child process 19:18:33 STEP 2937 H=2937:00 +CPU= 35.333 19:18:58 STEP 2938 H=2938:00 +CPU= 24.606 19:19:21 STEP 2939 H=2939:00 +CPU= 23.125 19:20:03 STEP 2940 H=2940:00 +CPU= 40.996 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002940 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002940 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002940 19:20:27 STEP 2941 H=2941:00 +CPU= 23.555 19:20:51 STEP 2942 H=2942:00 +CPU= 23.291 19:21:29 STEP 2943 H=2943:00 +CPU= 37.462 19:21:54 STEP 2944 H=2944:00 +CPU= 24.907 19:22:19 STEP 2945 H=2945:00 +CPU= 23.874 Suspend request received from the BOINC client, suspending the child process Resuming the child process 19:25:28 STEP 2946 H=2946:00 +CPU= 37.916 19:25:52 STEP 2947 H=2947:00 +CPU= 22.932 19:26:16 STEP 2948 H=2948:00 +CPU= 24.152 19:26:55 STEP 2949 H=2949:00 +CPU= 38.305 19:27:20 STEP 2950 H=2950:00 +CPU= 24.174 19:27:45 STEP 2951 H=2951:00 +CPU= 24.703 19:28:29 STEP 2952 H=2952:00 +CPU= 43.259 The child process terminated with status: 0 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMGGhq0f+002952 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMSHhq0f+002952 Moving to projects directory: /var/lib/boinc-client/slots/10/ICMUAhq0f+002952 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002952 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002952 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002952 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002928 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002940 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002940 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMGGhq0f+002928 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMSHhq0f+002940 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12192694/ICMUAhq0f+002928 Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0050_2007050100_123_976_12192694_1_r177258880_122.zip Uploading the final file: upload_file_122.zip Uploading trickle at timestep: 10623600 19:31:53 (4155647): called boinc_finish(0) </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 May 2023 15:56:50 | 1519251 | 22280577 | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 | 10,623,600 | 73,118 | 0.0069 |
09 May 2023 15:55:46 | 1519251 | 22280577 | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 | 9,244,800 | 62,710 | 0.0068 |
09 May 2023 15:55:46 | 1519251 | 22280577 | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 | 9,244,800 | 62,710 | 0.0068 |
09 May 2023 15:55:25 | 1519251 | 22280577 | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 | 7,776,000 | 52,706 | 0.0068 |
09 May 2023 15:55:15 | 1519251 | 22280577 | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 | 6,912,000 | 46,951 | 0.0068 |
09 May 2023 15:53:55 | 1519251 | 22280577 | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 | 6,048,000 | 40,949 | 0.0068 |
09 May 2023 15:53:34 | 1519251 | 22280577 | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 | 5,184,000 | 34,992 | 0.0068 |
09 May 2023 15:53:27 | 1519251 | 22280577 | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 | 4,320,000 | 29,136 | 0.0067 |
09 May 2023 15:53:13 | 1519251 | 22280577 | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 | 3,456,000 | 23,372 | 0.0068 |
09 May 2023 15:53:00 | 1519251 | 22280577 | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 | 2,592,000 | 17,583 | 0.0068 |
09 May 2023 15:52:47 | 1519251 | 22280577 | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 | 1,728,000 | 11,901 | 0.0069 |
09 May 2023 15:52:41 | 1519251 | 22280577 | oifs_43r3_ps_0050_2007050100_123_976_12192694_1 | 864,000 | 6,219 | 0.0072 |
©2024 climateprediction.net