climateprediction.net home page
Task 22317810

Task 22317810

Name oifs_43r3_bl_a4rr_2016092300_15_991_12212970_1
Workunit 12212970
Created 14 Apr 2023, 23:51:36 UTC
Sent 14 Apr 2023, 23:53:25 UTC
Report deadline 13 Jun 2023, 23:53:25 UTC
Received 15 Apr 2023, 1:54:40 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1485804
Run time 18 min 32 sec
CPU time 17 min 20 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 6.32 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 4,957.00 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,276.81 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4rr
(argv4) batchid: 991
(argv5) wuid: 12212970
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/12
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12212970
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/12/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/12/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_33b4c22329ace8031022e6f9284c7a21 to: /var/lib/boinc/slots/12/oifs_43r3_bl_a4rr_2016092300_15_991_12212970.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/12/oifs_43r3_bl_a4rr_2016092300_15_991_12212970.zip
ic_ancil_file: ic_ancil_12212970
ifsdata_file: ifsdata_12212970
climate_data_file: clim_data_12212970
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/12/ic_ancil_12212970.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/12/ic_ancil_12212970.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_4f0286ef94964b5c78e13fcc4a168d65 to: /var/lib/boinc/slots/12/ifsdata/ifsdata_12212970.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/12/ifsdata/ifsdata_12212970.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/12/159l_2/clim_data_12212970.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/12/159l_2/clim_data_12212970.zip
Checking for progress XML file: /var/lib/boinc/slots/12/progress_file_12212970.xml
Creating progress file: /var/lib/boinc/slots/12/progress_file_12212970.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a4rr_2016092300_15_991_12212970_1_r732157970
The child process has been launched with process id: 591685
Executing the command: /var/lib/boinc/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:174602:1681519562:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  17:46:29 STEP    0 H=   0:00 +CPU= 23.926
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+000000
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+000000
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+000000
  17:46:48 STEP    1 H=   0:15 +CPU= 19.433
  17:47:08 STEP    2 H=   0:30 +CPU= 19.293
  17:47:27 STEP    3 H=   0:45 +CPU= 19.700
  17:47:47 STEP    4 H=   1:00 +CPU= 19.970
  17:48:07 STEP    5 H=   1:15 +CPU= 19.716
  17:48:27 STEP    6 H=   1:30 +CPU= 19.499
  17:48:47 STEP    7 H=   1:45 +CPU= 19.870
  17:49:07 STEP    8 H=   2:00 +CPU= 20.115
  17:49:26 STEP    9 H=   2:15 +CPU= 19.542
  17:49:46 STEP   10 H=   2:30 +CPU= 19.602
  17:50:06 STEP   11 H=   2:45 +CPU= 20.087
  17:50:31 STEP   12 H=   3:00 +CPU= 24.983
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+000012
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+000012
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+000012
  17:50:52 STEP   13 H=   3:15 +CPU= 20.061
  17:51:17 STEP   14 H=   3:30 +CPU= 20.545
  17:51:36 STEP   15 H=   3:45 +CPU= 19.398
  17:51:56 STEP   16 H=   4:00 +CPU= 20.363
  17:52:17 STEP   17 H=   4:15 +CPU= 19.945
  17:52:36 STEP   18 H=   4:30 +CPU= 19.225
  17:52:56 STEP   19 H=   4:45 +CPU= 19.685
  17:53:16 STEP   20 H=   5:00 +CPU= 20.577
  17:53:36 STEP   21 H=   5:15 +CPU= 19.829
  17:53:56 STEP   22 H=   5:30 +CPU= 19.487
  17:54:15 STEP   23 H=   5:45 +CPU= 19.523
  17:54:40 STEP   24 H=   6:00 +CPU= 24.685
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+000024
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+000024
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+000024
  17:55:00 STEP   25 H=   6:15 +CPU= 19.411
  17:55:20 STEP   26 H=   6:30 +CPU= 20.033
  17:55:40 STEP   27 H=   6:45 +CPU= 20.014
  17:56:00 STEP   28 H=   7:00 +CPU= 19.731
  17:56:19 STEP   29 H=   7:15 +CPU= 19.476
  17:56:39 STEP   30 H=   7:30 +CPU= 19.459
  17:56:58 STEP   31 H=   7:45 +CPU= 19.422
  17:57:18 STEP   32 H=   8:00 +CPU= 20.111
  17:57:38 STEP   33 H=   8:15 +CPU= 19.724
  17:57:58 STEP   34 H=   8:30 +CPU= 19.783
  17:58:18 STEP   35 H=   8:45 +CPU= 19.619
  17:58:42 STEP   36 H=   9:00 +CPU= 24.371
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+000036
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+000036
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+000036
  17:59:02 STEP   37 H=   9:15 +CPU= 19.667
  17:59:22 STEP   38 H=   9:30 +CPU= 19.750
  17:59:41 STEP   39 H=   9:45 +CPU= 19.325
  18:00:01 STEP   40 H=  10:00 +CPU= 20.177
  18:00:21 STEP   41 H=  10:15 +CPU= 19.702
  18:00:41 STEP   42 H=  10:30 +CPU= 20.033
  18:01:01 STEP   43 H=  10:45 +CPU= 19.751
  18:01:21 STEP   44 H=  11:00 +CPU= 20.235
  18:01:41 STEP   45 H=  11:15 +CPU= 19.779
  18:02:01 STEP   46 H=  11:30 +CPU= 19.751
  18:02:21 STEP   47 H=  11:45 +CPU= 20.007
  18:02:49 STEP   48 H=  12:00 +CPU= 27.832
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+000048
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+000048
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+000048
  18:03:09 STEP   49 H=  12:15 +CPU= 19.491
  18:03:28 STEP   50 H=  12:30 +CPU= 19.388
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.096] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 3940MB (heap), 5062MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil))
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc4a8f], nsigs = 1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 3940 MB (maxheap), 5062 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :            CPG_DRV 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :             >OMP-CPG                  (1025) 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :              CPG 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :               CPG_DIA 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180330:1681520610:1048.098] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                GPRH 
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc/slots/12/oifs_43r3_model.exe' : sigcontextptr=0x7ffcdd129310
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 22) with plain hex-dump
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [0]: [0x838803] : 0x838803
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [1]: [0x838e09] : 0x838e09
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [2]: [0x1d8bb20] : 0x1d8bb20
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [3]: [0x1cc4a8f] : 0x1cc4a8f
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [4]: [0x144b066] : 0x144b066
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [5]: [0x143e1ec] : 0x143e1ec
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [6]: [0x1435fbf] : 0x1435fbf
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [7]: [0x1433058] : 0x1433058
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [8]: [0xe5f4b8] : 0xe5f4b8
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [9]: [0x15c1e62] : 0x15c1e62
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [10]: [0x15ac40e] : 0x15ac40e
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [11]: [0x6620b4] : 0x6620b4
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [12]: [0x4a0e7c] : 0x4a0e7c
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [13]: [0x49dc29] : 0x49dc29
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [14]: [0x49ce72] : 0x49ce72
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [15]: [0x49cd68] : 0x49cd68
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [16]: [0x4078ad] : 0x4078ad
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [17]: [0x40276f] : 0x40276f
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [18]: [0x40270d] : 0x40270d
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [19]: [0x1d8287a] : 0x1d8287a
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [20]: [0x1d840d7] : 0x1d840d7
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [21]: [0x4025e5] : 0x4025e5
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.098] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc/slots/12/oifs_43r3_model.exe' : sigcontextptr=0x7ffcdd129220
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 23) with plain hex-dump
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [0]: [0x838803] : 0x838803
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [1]: [0x838e09] : 0x838e09
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [2]: [0x820d70] : 0x820d70
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [3]: [0x1d8bb20] : 0x1d8bb20
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [4]: [0x1cc4a8f] : 0x1cc4a8f
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [5]: [0x144b066] : 0x144b066
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [6]: [0x143e1ec] : 0x143e1ec
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [7]: [0x1435fbf] : 0x1435fbf
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [8]: [0x1433058] : 0x1433058
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [9]: [0xe5f4b8] : 0xe5f4b8
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [10]: [0x15c1e62] : 0x15c1e62
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [11]: [0x15ac40e] : 0x15ac40e
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [12]: [0x6620b4] : 0x6620b4
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [13]: [0x4a0e7c] : 0x4a0e7c
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [14]: [0x49dc29] : 0x49dc29
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [15]: [0x49ce72] : 0x49ce72
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [16]: [0x49cd68] : 0x49cd68
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [17]: [0x4078ad] : 0x4078ad
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [18]: [0x40276f] : 0x40276f
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [19]: [0x40270d] : 0x40270d
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [20]: [0x1d8287a] : 0x1d8287a
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [21]: [0x1d840d7] : 0x1d840d7
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [22]: [0x4025e5] : 0x4025e5
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.108] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:cheong-fun:1:1:591685:591685] [20230414:180331:1681520611:1049.108] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  000000000081FCF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8BB20  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CC4A8F  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000144B066  gprh_                     128  gprh.F90
oifs_43r3_model.e  000000000143E1EC  cpg_dia_                  600  cpg_dia.F90
oifs_43r3_model.e  0000000001435FBF  cpg_                      718  cpg.F90
oifs_43r3_model.e  0000000001433058  cpg_drv_                  351  cpg_drv.F90
oifs_43r3_model.e  0000000000E5F4B8  gp_model_                 419  gp_model.F90
oifs_43r3_model.e  00000000015C1E62  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  00000000015AC40E  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  00000000006620B4  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004A0E7C  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  000000000049DC29  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  000000000049CE72  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049CD68  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  00000000004078AD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040276F  MAIN__                     96  master.F90
oifs_43r3_model.e  000000000040270D  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8287A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D840D7  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000004025E5  Unknown               Unknown  Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01

         AVE   0.217373182283183E-04 0.000000000000000E+00 0.100903497495574E-01
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.214326272218026E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.739959130599269E-05 0.000000000000000E+00 0.180680251366270E-01
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.816785283560797E-05 0.000000000000000E+00 0.189032378783858E-01
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.213068211101764E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.726885068656000E-04 0.000000000000000E+00 0.237960809139654E-01
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.108479076043673E-04 0.000000000000000E+00 0.662584755323978E-02
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.475144257829706E-04 0.000000000000000E+00 0.101161235206373E-01
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.229440417495295E-04 0.000000000000000E+00 0.672216835504817E-02
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.263446712782779E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =    48 STEPO   F00000000
 CREATE RESTART FILE ./srf00001200.0001                                                                                                                                                                                                                                              
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./srf00001200.0001 MODE=w
 IO-STREAM CLOSED - ./srf00001200.0001
 MPI-TASK:   1 - ************ BYTES IN     34 RECORDS TRANSFERRED IN    2.0786 SECONDS******** Mbytes/s, TOTAL TIME=    2.7125(76.6%)
 CREATE RESTART CONTROL FILE ./rcf                                                                                                                   
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    48 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000048 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000048
 MPI-TASK:   1 -    305934202 BYTES IN      6 RECORDS TRANSFERRED IN    0.0006 SECONDS509890.3 Mbytes/s, TOTAL TIME=    0.0069( 8.7%)
 NSTEP =    48 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000048 MODE=a
 IO-STREAM CLOSED - ./ICMSHh7zg+000048
 MPI-TASK:   1 -    707765250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0107 SECONDS 66146.3 Mbytes/s, TOTAL TIME=    0.1860( 5.8%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000048 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000048
 MPI-TASK:   1 -   4894947223 BYTES IN    125 RECORDS TRANSFERRED IN    0.0068 SECONDS719845.2 Mbytes/s, TOTAL TIME=    0.1562( 4.4%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000048 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000048
 MPI-TASK:   1 -    297360569 BYTES IN      2 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0031( 6.5%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000048 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000048
 MPI-TASK:   1 -    305934202 BYTES IN      4 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0054( 5.6%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =    48 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    48 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000048 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000048
 MPI-TASK:   1 -    305934193 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS611868.4 Mbytes/s, TOTAL TIME=    0.0097( 5.2%)
 18:02:49 STEP   48 H=  12:00 +CPU= 27.832
 NSTEP =    49 STEPO   0AAA00AAA
 18:03:09 STEP   49 H=  12:15 +CPU= 19.491
ISTEP=      50 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=      50 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =    50 STEPO   0AAA00AAA
 18:03:28 STEP   50 H=  12:30 +CPU= 19.388
 NSTEP =    51 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 18:02:25 FULLPOS-B DYNFPOS     48     0.980    0.980    0.983     16:14     16:22 0.55175782057077E-04       2GB       0MB
 18:02:27 FULLPOS-V DYNFPOS     48     2.291    2.291    2.297     16:17     16:25 0.55175782057077E-04       2GB       0MB
 18:02:28 FULLPOS-T DYNFPOS     48     0.461    0.461    0.462     16:17     16:25 0.55175782057077E-04       2GB       0MB
 18:02:28 0AAA00AAA STEPO       48     0.449    0.449    0.450     16:18     16:25 0.55175782057077E-04       2GB       0MB
 18:02:49 0AAA00AAA STEPO       49    20.603   20.603   20.688     16:38     16:46 0.55175782057077E-04       2GB       0MB
 18:03:09 0AAA00AAA STEPO       50    19.491   19.491   19.541     16:58     17:06 0.55175782057077E-04       2GB       0MB
 18:03:28 0AAA00AAA STEPO       51    19.388   19.388   19.442     17:17     17:25 0.55175782057077E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "      48",
 CTIME   = "00001200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,          36, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc/slots/12/progress_file_12212970.xml

<running_values>
  <last_cpu_time>1032.160000</last_cpu_time>
  <upload_file_number>0</upload_file_number>
  <last_iter>50</last_iter>
  <last_upload>0</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net