climateprediction.net home page
Task 22299115

Task 22299115

Name oifs_43r3_ps_0110_1997050100_123_966_12182754_2
Workunit 12182754
Created 17 Jan 2023, 18:24:12 UTC
Sent 17 Jan 2023, 18:29:22 UTC
Report deadline 18 Mar 2023, 18:29:22 UTC
Received 13 Feb 2023, 20:28:48 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1537623
Run time 30 min 24 sec
CPU time 28 min 55 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 7.67 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,368.72 MB
Peak swap size 4,978.06 MB
Peak disk usage 1,200.53 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1997050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0110
(argv4) batchid: 966
(argv5) wuid: 12182754
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /home/galfridian/slots/7
Project directory is: /home/galfridian/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754
Copying: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /home/galfridian/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/galfridian/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_c883ef13b86f702348135e0bdb452751 to: /home/galfridian/slots/7/oifs_43r3_ps_0110_1997050100_123_966_12182754.zip
Unzipping the namelist zip file: /home/galfridian/slots/7/oifs_43r3_ps_0110_1997050100_123_966_12182754.zip
ic_ancil_file: ic_ancil_12182754
ifsdata_file: ifsdata_12182754
climate_data_file: clim_data_12182754
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_be09ab4735f06454c4ccee77ba45af00 to: /home/galfridian/slots/7/ic_ancil_12182754.zip
Unzipping the IC ancils zip file: /home/galfridian/slots/7/ic_ancil_12182754.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_35c300908bdbbdabc09ca235321a0466 to: /home/galfridian/slots/7/ifsdata/ifsdata_12182754.zip
Unzipping the ifsdata_zip file: /home/galfridian/slots/7/ifsdata/ifsdata_12182754.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/galfridian/slots/7/159l_2/clim_data_12182754.zip
Unzipping the climate data zip file: /home/galfridian/slots/7/159l_2/clim_data_12182754.zip
Checking for progress XML file: /home/galfridian/slots/7/progress_file_12182754.xml
Creating progress file: /home/galfridian/slots/7/progress_file_12182754.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0110_1997050100_123_966_12182754_2_r807762138
The child process has been launched with process id: 4509
Executing the command: /home/galfridian/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:4509:4509] [20230213:182353:1676309033:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  18:24:20 STEP    0 H=   0:00 +CPU= 25.276
Moving to projects directory: /home/galfridian/slots/7/ICMGGhq0f+000000
Moving to projects directory: /home/galfridian/slots/7/ICMSHhq0f+000000
Moving to projects directory: /home/galfridian/slots/7/ICMUAhq0f+000000
  18:24:36 STEP    1 H=   1:00 +CPU= 16.584
  18:24:52 STEP    2 H=   2:00 +CPU= 15.142
  18:25:14 STEP    3 H=   3:00 +CPU= 22.648
  18:25:29 STEP    4 H=   4:00 +CPU= 14.493
  18:25:44 STEP    5 H=   5:00 +CPU= 14.454
  18:26:07 STEP    6 H=   6:00 +CPU= 23.643
  18:26:22 STEP    7 H=   7:00 +CPU= 14.401
  18:26:37 STEP    8 H=   8:00 +CPU= 15.036
  18:27:00 STEP    9 H=   9:00 +CPU= 22.982
  18:27:14 STEP   10 H=  10:00 +CPU= 14.402
  18:27:29 STEP   11 H=  11:00 +CPU= 14.401
  18:27:54 STEP   12 H=  12:00 +CPU= 24.728
Moving to projects directory: /home/galfridian/slots/7/ICMGGhq0f+000012
Moving to projects directory: /home/galfridian/slots/7/ICMSHhq0f+000012
Moving to projects directory: /home/galfridian/slots/7/ICMUAhq0f+000012
  18:28:08 STEP   13 H=  13:00 +CPU= 14.041
  18:28:22 STEP   14 H=  14:00 +CPU= 14.453
  18:28:45 STEP   15 H=  15:00 +CPU= 22.575
  18:28:59 STEP   16 H=  16:00 +CPU= 14.452
  18:29:13 STEP   17 H=  17:00 +CPU= 13.908
  18:29:37 STEP   18 H=  18:00 +CPU= 24.039
  18:29:51 STEP   19 H=  19:00 +CPU= 13.981
  18:30:06 STEP   20 H=  20:00 +CPU= 14.588
  18:30:28 STEP   21 H=  21:00 +CPU= 22.149
  18:30:43 STEP   22 H=  22:00 +CPU= 14.421
  18:30:57 STEP   23 H=  23:00 +CPU= 14.521
  18:31:24 STEP   24 H=  24:00 +CPU= 26.912
Moving to projects directory: /home/galfridian/slots/7/ICMGGhq0f+000024
Moving to projects directory: /home/galfridian/slots/7/ICMSHhq0f+000024
Moving to projects directory: /home/galfridian/slots/7/ICMUAhq0f+000024
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754/ICMGGhq0f+000000
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754/ICMSHhq0f+000000
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754/ICMUAhq0f+000000
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754/ICMGGhq0f+000012
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754/ICMSHhq0f+000012
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754/ICMUAhq0f+000012
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0110_1997050100_123_966_12182754_2_r807762138_0.zip
Uploading the intermediate file: upload_file_0.zip
  18:31:40 STEP   25 H=  25:00 +CPU= 14.976
  18:31:55 STEP   26 H=  26:00 +CPU= 15.792
  18:32:19 STEP   27 H=  27:00 +CPU= 23.752
  18:32:36 STEP   28 H=  28:00 +CPU= 15.417
  18:32:51 STEP   29 H=  29:00 +CPU= 15.384
  18:33:16 STEP   30 H=  30:00 +CPU= 24.617
  18:33:31 STEP   31 H=  31:00 +CPU= 15.055
  18:33:47 STEP   32 H=  32:00 +CPU= 15.897
  18:34:11 STEP   33 H=  33:00 +CPU= 23.645
  18:34:27 STEP   34 H=  34:00 +CPU= 15.738
  18:34:44 STEP   35 H=  35:00 +CPU= 15.249
  18:35:11 STEP   36 H=  36:00 +CPU= 27.154
Moving to projects directory: /home/galfridian/slots/7/ICMGGhq0f+000036
Moving to projects directory: /home/galfridian/slots/7/ICMSHhq0f+000036
Moving to projects directory: /home/galfridian/slots/7/ICMUAhq0f+000036
  18:35:26 STEP   37 H=  37:00 +CPU= 15.061
  18:35:41 STEP   38 H=  38:00 +CPU= 15.262
  18:37:25 STEP   39 H=  39:00 +CPU= 26.369
  18:37:40 STEP   40 H=  40:00 +CPU= 14.695
  18:37:55 STEP   41 H=  41:00 +CPU= 14.563
  18:38:18 STEP   42 H=  42:00 +CPU= 23.093
  18:38:33 STEP   43 H=  43:00 +CPU= 15.207
  18:38:49 STEP   44 H=  44:00 +CPU= 15.199
  18:39:12 STEP   45 H=  45:00 +CPU= 22.942
  18:39:27 STEP   46 H=  46:00 +CPU= 15.795
  18:39:43 STEP   47 H=  47:00 +CPU= 15.442
  19:19:42 STEP   48 H=  48:00 +CPU= 35.955
Moving to projects directory: /home/galfridian/slots/7/ICMGGhq0f+000048
Moving to projects directory: /home/galfridian/slots/7/ICMSHhq0f+000048
Moving to projects directory: /home/galfridian/slots/7/ICMUAhq0f+000048
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754/ICMGGhq0f+000024
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754/ICMSHhq0f+000024
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754/ICMUAhq0f+000024
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754/ICMGGhq0f+000036
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754/ICMSHhq0f+000036
Adding to the zip: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754/ICMUAhq0f+000036
Zipping up the intermediate file: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_0110_1997050100_123_966_12182754_2_r807762138_1.zip
Uploading the intermediate file: upload_file_1.zip
  19:19:57 STEP   49 H=  49:00 +CPU= 14.499
  19:20:12 STEP   50 H=  50:00 +CPU= 14.982
  19:20:35 STEP   51 H=  51:00 +CPU= 22.752
  19:36:50 STEP   52 H=  52:00 +CPU= 24.869
  19:46:23 STEP   53 H=  53:00 +CPU= 24.109
  19:46:47 STEP   54 H=  54:00 +CPU= 23.334
  19:47:02 STEP   55 H=  55:00 +CPU= 14.838
  19:47:18 STEP   56 H=  56:00 +CPU= 15.408
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1997050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0110
(argv4) batchid: 966
(argv5) wuid: 12182754
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /home/galfridian/slots/7
Project directory is: /home/galfridian/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754
..mkdir for temp folder for results failed
Copying: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /home/galfridian/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/galfridian/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_c883ef13b86f702348135e0bdb452751 to: /home/galfridian/slots/7/oifs_43r3_ps_0110_1997050100_123_966_12182754.zip
Unzipping the namelist zip file: /home/galfridian/slots/7/oifs_43r3_ps_0110_1997050100_123_966_12182754.zip
ic_ancil_file: ic_ancil_12182754
ifsdata_file: ifsdata_12182754
climate_data_file: clim_data_12182754
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_be09ab4735f06454c4ccee77ba45af00 to: /home/galfridian/slots/7/ic_ancil_12182754.zip
Unzipping the IC ancils zip file: /home/galfridian/slots/7/ic_ancil_12182754.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_35c300908bdbbdabc09ca235321a0466 to: /home/galfridian/slots/7/ifsdata/ifsdata_12182754.zip
Unzipping the ifsdata_zip file: /home/galfridian/slots/7/ifsdata/ifsdata_12182754.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/galfridian/slots/7/159l_2/clim_data_12182754.zip
Unzipping the climate data zip file: /home/galfridian/slots/7/159l_2/clim_data_12182754.zip
Checking for progress XML file: /home/galfridian/slots/7/progress_file_12182754.xml
Opened progress file ok : /home/galfridian/slots/7/progress_file_12182754.xml
-- Model is restarting --
Adjusting last_iter, 57, to previous model restart step.
Creating progress file: /home/galfridian/slots/7/progress_file_12182754.xml
last_cpu_time: 1058
upload_file_number: 2
last_iter: 47
last_upload: 172800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0110_1997050100_123_966_12182754_2_r807762138
The child process has been launched with process id: 1945
Executing the command: /home/galfridian/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:1945:1945] [20230213:195936:1676314776:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  20:00:23 STEP   48 H=  48:00 +CPU= 28.946
  20:00:38 STEP   49 H=  49:00 +CPU= 14.668
  20:00:52 STEP   50 H=  50:00 +CPU= 14.611
  20:06:40 STEP   51 H=  51:00 +CPU= 26.845
  20:07:02 STEP   52 H=  52:00 +CPU= 15.997
  20:07:17 STEP   53 H=  53:00 +CPU= 15.306
  20:07:39 STEP   54 H=  54:00 +CPU= 22.301
  20:07:54 STEP   55 H=  55:00 +CPU= 14.859
  20:08:09 STEP   56 H=  56:00 +CPU= 15.080
  20:12:16 STEP   57 H=  57:00 +CPU= 27.128
  20:12:31 STEP   58 H=  58:00 +CPU= 14.759
  20:12:45 STEP   59 H=  59:00 +CPU= 14.191
  20:13:12 STEP   60 H=  60:00 +CPU= 26.104
Moving to projects directory: /home/galfridian/slots/7/ICMGGhq0f+000060
Moving to projects directory: /home/galfridian/slots/7/ICMSHhq0f+000060
Moving to projects directory: /home/galfridian/slots/7/ICMUAhq0f+000060
  20:13:28 STEP   61 H=  61:00 +CPU= 16.009
  20:13:44 STEP   62 H=  62:00 +CPU= 16.009
  20:15:17 STEP   63 H=  63:00 +CPU= 25.977
  20:15:33 STEP   64 H=  64:00 +CPU= 15.786
  20:15:48 STEP   65 H=  65:00 +CPU= 15.249
  20:16:13 STEP   66 H=  66:00 +CPU= 24.857
  20:16:29 STEP   67 H=  67:00 +CPU= 15.335
  20:16:44 STEP   68 H=  68:00 +CPU= 15.127
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1997050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0110
(argv4) batchid: 966
(argv5) wuid: 12182754
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /home/galfridian/slots/7
Project directory is: /home/galfridian/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_12182754
..mkdir for temp folder for results failed
Copying: /home/galfridian/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /home/galfridian/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/galfridian/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_c883ef13b86f702348135e0bdb452751 to: /home/galfridian/slots/7/oifs_43r3_ps_0110_1997050100_123_966_12182754.zip
Unzipping the namelist zip file: /home/galfridian/slots/7/oifs_43r3_ps_0110_1997050100_123_966_12182754.zip
ic_ancil_file: ic_ancil_12182754
ifsdata_file: ifsdata_12182754
climate_data_file: clim_data_12182754
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_be09ab4735f06454c4ccee77ba45af00 to: /home/galfridian/slots/7/ic_ancil_12182754.zip
Unzipping the IC ancils zip file: /home/galfridian/slots/7/ic_ancil_12182754.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_35c300908bdbbdabc09ca235321a0466 to: /home/galfridian/slots/7/ifsdata/ifsdata_12182754.zip
Unzipping the ifsdata_zip file: /home/galfridian/slots/7/ifsdata/ifsdata_12182754.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/galfridian/slots/7/159l_2/clim_data_12182754.zip
Unzipping the climate data zip file: /home/galfridian/slots/7/159l_2/clim_data_12182754.zip
Checking for progress XML file: /home/galfridian/slots/7/progress_file_12182754.xml
Opened progress file ok : /home/galfridian/slots/7/progress_file_12182754.xml
-- Model is restarting --
Adjusting last_iter, 69, to previous model restart step.
Creating progress file: /home/galfridian/slots/7/progress_file_12182754.xml
last_cpu_time: 1461
upload_file_number: 2
last_iter: 47
last_upload: 172800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0110_1997050100_123_966_12182754_2_r807762138
The child process has been launched with process id: 2935
Executing the command: /home/galfridian/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:galfridian-systemproductname:1:1:2935:2935] [20230213:202744:1676316464:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  20:28:19 STEP   48 H=  48:00 +CPU= 26.175
  20:28:35 STEP   49 H=  49:00 +CPU= 15.365
  20:28:51 STEP   50 H=  50:00 +CPU= 15.748
  20:29:16 STEP   51 H=  51:00 +CPU= 24.214
  20:29:31 STEP   52 H=  52:00 +CPU= 15.089
  20:29:45 STEP   53 H=  53:00 +CPU= 14.598
  20:30:10 STEP   54 H=  54:00 +CPU= 23.953
  20:30:24 STEP   55 H=  55:00 +CPU= 14.788
  20:30:40 STEP   56 H=  56:00 +CPU= 15.553
  20:31:04 STEP   57 H=  57:00 +CPU= 23.941
  20:31:19 STEP   58 H=  58:00 +CPU= 14.976
  20:31:35 STEP   59 H=  59:00 +CPU= 15.246
  20:32:00 STEP   60 H=  60:00 +CPU= 25.648
Moving to projects directory: /home/galfridian/slots/7/ICMGGhq0f+000060
Moving to projects directory: /home/galfridian/slots/7/ICMSHhq0f+000060
Moving to projects directory: /home/galfridian/slots/7/ICMUAhq0f+000060
  20:32:16 STEP   61 H=  61:00 +CPU= 15.656
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net