climateprediction.net home page
Task 22245905

Task 22245905

Name oifs_43r3_ps_0871_2021050100_123_945_12163960_0
Workunit 12163960
Created 28 Nov 2022, 21:24:54 UTC
Sent 29 Nov 2022, 4:07:15 UTC
Report deadline 29 Dec 2022, 4:07:15 UTC
Received 29 Nov 2022, 6:12:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1443505
Run time 1 hours 6 min 16 sec
CPU time 1 hours 4 min 2 sec
Validate state Invalid
Credit 120.96
Device peak FLOPS 2.12 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.01
x86_64-pc-linux-gnu
Peak working set size 4,406.88 MB
Peak swap size 4,974.12 MB
Peak disk usage 1,206.49 MB
Stderr
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 0871
(argv4) batchid: 945
(argv5) wuid: 12163960
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /media/stuff/programs/boinc_data/slots/4
Project directory is: /media/stuff/programs/boinc_data/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.01
Location of temp folder: /media/stuff/programs/boinc_data/projects/climateprediction.net/oifs_43r3_ps_12163960
Copying: /media/stuff/programs/boinc_data/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /media/stuff/programs/boinc_data/slots/4/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /media/stuff/programs/boinc_data/slots/4/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_f3264f51845f108481f498e2a1661142 to: /media/stuff/programs/boinc_data/slots/4/oifs_43r3_ps_0871_2021050100_123_945_12163960.zip
Unzipping the namelist zip file: /media/stuff/programs/boinc_data/slots/4/oifs_43r3_ps_0871_2021050100_123_945_12163960.zip
ic_ancil_file: ic_ancil_12163960
ifsdata_file: ifsdata_12163960
climate_data_file: clim_data_12163960
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
Copying IC ancils from: ../../projects/climateprediction.net/jf_f6b249c1bbdd8b0b2d9b7cfe1d7f36ce to: /media/stuff/programs/boinc_data/slots/4/ic_ancil_12163960.zip
Unzipping the IC ancils zip file: /media/stuff/programs/boinc_data/slots/4/ic_ancil_12163960.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_391641fcced85935c968955f134cb786 to: /media/stuff/programs/boinc_data/slots/4/ifsdata/ifsdata_12163960.zip
Unzipping the ifsdata_zip file: /media/stuff/programs/boinc_data/slots/4/ifsdata/ifsdata_12163960.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /media/stuff/programs/boinc_data/slots/4/159l_2/clim_data_12163960.zip
Unzipping the climate data zip file: /media/stuff/programs/boinc_data/slots/4/159l_2/clim_data_12163960.zip
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0871_2021050100_123_945_12163960_0_r2123561304
The child process has been launched with process id: 13141
Executing the command: /media/stuff/programs/boinc_data/slots/4/./master.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:pilot51-server2:1:1:13141:13141] [20221128:231343:1669695223:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 0871
(argv4) batchid: 945
(argv5) wuid: 12163960
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /media/stuff/programs/boinc_data/slots/4
Project directory is: /media/stuff/programs/boinc_data/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.01
Location of temp folder: /media/stuff/programs/boinc_data/projects/climateprediction.net/oifs_43r3_ps_12163960
..mkdir for temp folder for results failed
Copying: /media/stuff/programs/boinc_data/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /media/stuff/programs/boinc_data/slots/4/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /media/stuff/programs/boinc_data/slots/4/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_f3264f51845f108481f498e2a1661142 to: /media/stuff/programs/boinc_data/slots/4/oifs_43r3_ps_0871_2021050100_123_945_12163960.zip
Unzipping the namelist zip file: /media/stuff/programs/boinc_data/slots/4/oifs_43r3_ps_0871_2021050100_123_945_12163960.zip
ic_ancil_file: ic_ancil_12163960
ifsdata_file: ifsdata_12163960
climate_data_file: clim_data_12163960
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
Copying IC ancils from: ../../projects/climateprediction.net/jf_f6b249c1bbdd8b0b2d9b7cfe1d7f36ce to: /media/stuff/programs/boinc_data/slots/4/ic_ancil_12163960.zip
Unzipping the IC ancils zip file: /media/stuff/programs/boinc_data/slots/4/ic_ancil_12163960.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_391641fcced85935c968955f134cb786 to: /media/stuff/programs/boinc_data/slots/4/ifsdata/ifsdata_12163960.zip
Unzipping the ifsdata_zip file: /media/stuff/programs/boinc_data/slots/4/ifsdata/ifsdata_12163960.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /media/stuff/programs/boinc_data/slots/4/159l_2/clim_data_12163960.zip
Unzipping the climate data zip file: /media/stuff/programs/boinc_data/slots/4/159l_2/clim_data_12163960.zip
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0871_2021050100_123_945_12163960_0_r2123561304
The child process has been launched with process id: 14328
Executing the command: /media/stuff/programs/boinc_data/slots/4/./master.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:pilot51-server2:1:1:14328:14328] [20221128:232753:1669696073:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:31:17 STEP    0 H=   0:00 +CPU=121.046
Moving to projects directory: /media/stuff/programs/boinc_data/slots/4/ICMGGhpi1+000000
Moving to projects directory: /media/stuff/programs/boinc_data/slots/4/ICMSHhpi1+000000
Moving to projects directory: /media/stuff/programs/boinc_data/slots/4/ICMUAhpi1+000000
  23:32:38 STEP    1 H=   1:00 +CPU= 81.234
  23:33:52 STEP    2 H=   2:00 +CPU= 73.563
  23:35:50 STEP    3 H=   3:00 +CPU=116.873
  23:37:06 STEP    4 H=   4:00 +CPU= 75.275
  23:38:16 STEP    5 H=   5:00 +CPU= 70.568
  23:40:17 STEP    6 H=   6:00 +CPU=119.567
  23:41:29 STEP    7 H=   7:00 +CPU= 72.194
  23:42:43 STEP    8 H=   8:00 +CPU= 73.811
  23:44:40 STEP    9 H=   9:00 +CPU=116.588
  23:45:54 STEP   10 H=  10:00 +CPU= 72.897
  23:47:04 STEP   11 H=  11:00 +CPU= 70.225
  23:49:10 STEP   12 H=  12:00 +CPU=125.711
Moving to projects directory: /media/stuff/programs/boinc_data/slots/4/ICMGGhpi1+000012
Moving to projects directory: /media/stuff/programs/boinc_data/slots/4/ICMSHhpi1+000012
Moving to projects directory: /media/stuff/programs/boinc_data/slots/4/ICMUAhpi1+000012
  23:50:22 STEP   13 H=  13:00 +CPU= 71.090
  23:51:36 STEP   14 H=  14:00 +CPU= 73.936
  23:53:31 STEP   15 H=  15:00 +CPU=114.645
  23:54:43 STEP   16 H=  16:00 +CPU= 71.785
  23:55:55 STEP   17 H=  17:00 +CPU= 71.601
  23:57:52 STEP   18 H=  18:00 +CPU=117.239
  23:59:03 STEP   19 H=  19:00 +CPU= 70.386
  00:00:17 STEP   20 H=  20:00 +CPU= 73.328
  00:02:13 STEP   21 H=  21:00 +CPU=115.564
  00:03:27 STEP   22 H=  22:00 +CPU= 73.486
  00:04:42 STEP   23 H=  23:00 +CPU= 73.970
  00:06:55 STEP   24 H=  24:00 +CPU=132.541
Moving to projects directory: /media/stuff/programs/boinc_data/slots/4/ICMGGhpi1+000024
Moving to projects directory: /media/stuff/programs/boinc_data/slots/4/ICMSHhpi1+000024
Moving to projects directory: /media/stuff/programs/boinc_data/slots/4/ICMUAhpi1+000024
Adding to the zip: /media/stuff/programs/boinc_data/projects/climateprediction.net/oifs_43r3_ps_12163960/ICMGGhpi1+000000
Adding to the zip: /media/stuff/programs/boinc_data/projects/climateprediction.net/oifs_43r3_ps_12163960/ICMSHhpi1+000000
Adding to the zip: /media/stuff/programs/boinc_data/projects/climateprediction.net/oifs_43r3_ps_12163960/ICMUAhpi1+000000
Adding to the zip: /media/stuff/programs/boinc_data/projects/climateprediction.net/oifs_43r3_ps_12163960/ICMGGhpi1+000012
Adding to the zip: /media/stuff/programs/boinc_data/projects/climateprediction.net/oifs_43r3_ps_12163960/ICMSHhpi1+000012
Adding to the zip: /media/stuff/programs/boinc_data/projects/climateprediction.net/oifs_43r3_ps_12163960/ICMUAhpi1+000012
Zipping up the intermediate file: /media/stuff/programs/boinc_data/projects/climateprediction.net/oifs_43r3_ps_0871_2021050100_123_945_12163960_0_r2123561304_0.zip
Uploading the intermediate file: upload_file_0.zip
Uploading trickle at timestep: 86400
  00:08:06 STEP   25 H=  25:00 +CPU= 70.905
  00:09:20 STEP   26 H=  26:00 +CPU= 73.233
  00:11:16 STEP   27 H=  27:00 +CPU=115.520
  00:12:30 STEP   28 H=  28:00 +CPU= 74.029
  00:13:40 STEP   29 H=  29:00 +CPU= 69.362
  00:15:40 STEP   30 H=  30:00 +CPU=119.260
  00:16:51 STEP   31 H=  31:00 +CPU= 71.300
  00:18:06 STEP   32 H=  32:00 +CPU= 74.758
  00:20:01 STEP   33 H=  33:00 +CPU=114.939
  00:21:12 STEP   34 H=  34:00 +CPU= 70.844
  00:22:24 STEP   35 H=  35:00 +CPU= 70.911
  00:24:33 STEP   36 H=  36:00 +CPU=128.349
Moving to projects directory: /media/stuff/programs/boinc_data/slots/4/ICMGGhpi1+000036
Moving to projects directory: /media/stuff/programs/boinc_data/slots/4/ICMSHhpi1+000036
Moving to projects directory: /media/stuff/programs/boinc_data/slots/4/ICMUAhpi1+000036
  00:25:43 STEP   37 H=  37:00 +CPU= 69.859
  00:26:57 STEP   38 H=  38:00 +CPU= 73.511
  00:28:53 STEP   39 H=  39:00 +CPU=115.354
  00:30:08 STEP   40 H=  40:00 +CPU= 74.397
  00:31:18 STEP   41 H=  41:00 +CPU= 69.907
  00:33:19 STEP   42 H=  42:00 +CPU=120.346
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 14:57:52 1443505 22245905 oifs_43r3_ps_0871_2021050100_123_945_12163960_0 86,400 2,254 0.0261


©2024 climateprediction.net