climateprediction.net home page
Task 22245780

Task 22245780

Name oifs_43r3_ps_0746_2021050100_123_945_12163835_0
Workunit 12163835
Created 28 Nov 2022, 21:05:56 UTC
Sent 29 Nov 2022, 0:32:43 UTC
Report deadline 29 Dec 2022, 0:32:43 UTC
Received 29 Nov 2022, 21:17:57 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1493780
Run time 43 min 11 sec
CPU time 41 min 26 sec
Validate state Invalid
Credit 604.80
Device peak FLOPS 6.91 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.01
x86_64-pc-linux-gnu
Peak working set size 4,740.28 MB
Peak swap size 4,974.12 MB
Peak disk usage 1,271.85 MB
Stderr
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 0746
(argv4) batchid: 945
(argv5) wuid: 12163835
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.01
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_a718c571755baa4da94868a8c252c244 to: /var/lib/boinc-client/slots/3/oifs_43r3_ps_0746_2021050100_123_945_12163835.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_ps_0746_2021050100_123_945_12163835.zip
ic_ancil_file: ic_ancil_12163835
ifsdata_file: ifsdata_12163835
climate_data_file: clim_data_12163835
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
Copying IC ancils from: ../../projects/climateprediction.net/jf_67ac832ab0e1126c049208b2f1a224dc to: /var/lib/boinc-client/slots/3/ic_ancil_12163835.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12163835.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_d6a13863db2c732984e4b06eee983f77 to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12163835.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12163835.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12163835.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12163835.zip
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0746_2021050100_123_945_12163835_0_r422844383
The child process has been launched with process id: 28574
Executing the command: /var/lib/boinc-client/slots/3/./master.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:nettle:1:1:28574:28574] [20221129:123228:1669746748:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  12:32:52 STEP    0 H=   0:00 +CPU= 23.011
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000000
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000000
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000000
  12:33:09 STEP    1 H=   1:00 +CPU= 16.862
  12:33:22 STEP    2 H=   2:00 +CPU= 12.845
  12:33:43 STEP    3 H=   3:00 +CPU= 20.587
  12:33:57 STEP    4 H=   4:00 +CPU= 14.020
  12:34:10 STEP    5 H=   5:00 +CPU= 13.411
  12:34:32 STEP    6 H=   6:00 +CPU= 21.765
  12:34:46 STEP    7 H=   7:00 +CPU= 14.205
  12:35:00 STEP    8 H=   8:00 +CPU= 13.531
  12:35:21 STEP    9 H=   9:00 +CPU= 21.160
  12:35:35 STEP   10 H=  10:00 +CPU= 14.229
  12:35:48 STEP   11 H=  11:00 +CPU= 12.955
  12:36:11 STEP   12 H=  12:00 +CPU= 22.566
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000012
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000012
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000012
  12:36:24 STEP   13 H=  13:00 +CPU= 13.222
  12:36:37 STEP   14 H=  14:00 +CPU= 13.219
  12:36:58 STEP   15 H=  15:00 +CPU= 21.205
  12:37:12 STEP   16 H=  16:00 +CPU= 13.977
  12:37:25 STEP   17 H=  17:00 +CPU= 13.277
  12:37:47 STEP   18 H=  18:00 +CPU= 21.660
  12:38:01 STEP   19 H=  19:00 +CPU= 14.109
  12:38:15 STEP   20 H=  20:00 +CPU= 13.571
  12:38:36 STEP   21 H=  21:00 +CPU= 21.014
  12:38:49 STEP   22 H=  22:00 +CPU= 13.481
  12:39:02 STEP   23 H=  23:00 +CPU= 13.053
  12:39:27 STEP   24 H=  24:00 +CPU= 24.200
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000024
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000024
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMGGhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMSHhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMUAhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMGGhpi1+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMSHhpi1+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMUAhpi1+000012
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0746_2021050100_123_945_12163835_0_r422844383_0.zip
Uploading the intermediate file: upload_file_0.zip
  12:39:40 STEP   25 H=  25:00 +CPU= 13.571
Uploading trickle at timestep: 86400
  12:39:54 STEP   26 H=  26:00 +CPU= 13.503
  12:40:15 STEP   27 H=  27:00 +CPU= 20.788
  12:40:29 STEP   28 H=  28:00 +CPU= 13.981
  12:40:42 STEP   29 H=  29:00 +CPU= 13.227
  12:41:03 STEP   30 H=  30:00 +CPU= 21.421
  12:41:17 STEP   31 H=  31:00 +CPU= 13.491
  12:41:30 STEP   32 H=  32:00 +CPU= 12.980
  12:41:50 STEP   33 H=  33:00 +CPU= 20.197
  12:42:04 STEP   34 H=  34:00 +CPU= 13.986
  12:42:17 STEP   35 H=  35:00 +CPU= 13.179
  12:42:40 STEP   36 H=  36:00 +CPU= 23.081
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000036
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000036
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000036
  12:42:54 STEP   37 H=  37:00 +CPU= 13.631
  12:43:07 STEP   38 H=  38:00 +CPU= 13.613
  12:43:28 STEP   39 H=  39:00 +CPU= 20.963
  12:43:42 STEP   40 H=  40:00 +CPU= 13.946
  12:43:55 STEP   41 H=  41:00 +CPU= 13.119
  12:44:16 STEP   42 H=  42:00 +CPU= 20.629
  12:44:30 STEP   43 H=  43:00 +CPU= 13.538
  12:44:43 STEP   44 H=  44:00 +CPU= 13.265
  12:45:04 STEP   45 H=  45:00 +CPU= 20.861
  12:45:18 STEP   46 H=  46:00 +CPU= 14.734
  12:45:32 STEP   47 H=  47:00 +CPU= 13.584
  12:45:57 STEP   48 H=  48:00 +CPU= 24.910
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000048
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000048
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMGGhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMSHhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMUAhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMGGhpi1+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMSHhpi1+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMUAhpi1+000036
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0746_2021050100_123_945_12163835_0_r422844383_1.zip
Uploading the intermediate file: upload_file_1.zip
  12:46:11 STEP   49 H=  49:00 +CPU= 13.530
Uploading trickle at timestep: 172800
  12:46:25 STEP   50 H=  50:00 +CPU= 13.911
  12:46:45 STEP   51 H=  51:00 +CPU= 20.626
  12:46:58 STEP   52 H=  52:00 +CPU= 13.086
  12:47:12 STEP   53 H=  53:00 +CPU= 13.288
  12:47:33 STEP   54 H=  54:00 +CPU= 21.401
  12:47:47 STEP   55 H=  55:00 +CPU= 13.689
  12:48:01 STEP   56 H=  56:00 +CPU= 13.852
  12:48:22 STEP   57 H=  57:00 +CPU= 21.006
  12:48:36 STEP   58 H=  58:00 +CPU= 14.128
  12:48:49 STEP   59 H=  59:00 +CPU= 13.416
  12:49:12 STEP   60 H=  60:00 +CPU= 22.889
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000060
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000060
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000060
  12:49:25 STEP   61 H=  61:00 +CPU= 12.886
  12:49:38 STEP   62 H=  62:00 +CPU= 13.035
  12:49:59 STEP   63 H=  63:00 +CPU= 20.629
  12:50:12 STEP   64 H=  64:00 +CPU= 13.872
  12:50:26 STEP   65 H=  65:00 +CPU= 13.317
  12:50:47 STEP   66 H=  66:00 +CPU= 21.413
  12:51:01 STEP   67 H=  67:00 +CPU= 13.506
  12:51:14 STEP   68 H=  68:00 +CPU= 13.646
  12:51:35 STEP   69 H=  69:00 +CPU= 20.243
  12:51:48 STEP   70 H=  70:00 +CPU= 13.600
  12:52:01 STEP   71 H=  71:00 +CPU= 13.194
  12:52:25 STEP   72 H=  72:00 +CPU= 23.154
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000072
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000072
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMGGhpi1+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMSHhpi1+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMUAhpi1+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMGGhpi1+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMSHhpi1+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMUAhpi1+000060
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0746_2021050100_123_945_12163835_0_r422844383_2.zip
Uploading the intermediate file: upload_file_2.zip
  12:52:38 STEP   73 H=  73:00 +CPU= 13.474
Uploading trickle at timestep: 259200
  12:52:52 STEP   74 H=  74:00 +CPU= 13.885
  12:53:13 STEP   75 H=  75:00 +CPU= 20.709
  12:53:26 STEP   76 H=  76:00 +CPU= 13.672
  12:53:40 STEP   77 H=  77:00 +CPU= 13.601
  12:54:01 STEP   78 H=  78:00 +CPU= 21.360
  12:54:15 STEP   79 H=  79:00 +CPU= 13.232
  12:54:28 STEP   80 H=  80:00 +CPU= 13.554
  12:54:48 STEP   81 H=  81:00 +CPU= 20.077
  12:55:02 STEP   82 H=  82:00 +CPU= 13.353
  12:55:15 STEP   83 H=  83:00 +CPU= 13.502
  12:55:38 STEP   84 H=  84:00 +CPU= 22.876
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000084
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000084
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000084
  12:55:52 STEP   85 H=  85:00 +CPU= 13.639
  12:56:05 STEP   86 H=  86:00 +CPU= 13.761
  12:56:26 STEP   87 H=  87:00 +CPU= 20.894
  12:56:40 STEP   88 H=  88:00 +CPU= 14.081
  12:56:54 STEP   89 H=  89:00 +CPU= 13.514
  12:57:15 STEP   90 H=  90:00 +CPU= 21.223
  12:57:28 STEP   91 H=  91:00 +CPU= 12.444
  12:57:41 STEP   92 H=  92:00 +CPU= 13.209
  12:58:02 STEP   93 H=  93:00 +CPU= 21.117
  12:58:16 STEP   94 H=  94:00 +CPU= 13.927
  12:58:29 STEP   95 H=  95:00 +CPU= 13.633
  12:58:55 STEP   96 H=  96:00 +CPU= 24.759
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000096
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000096
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMGGhpi1+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMSHhpi1+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMUAhpi1+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMGGhpi1+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMSHhpi1+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMUAhpi1+000084
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0746_2021050100_123_945_12163835_0_r422844383_3.zip
Uploading the intermediate file: upload_file_3.zip
  12:59:09 STEP   97 H=  97:00 +CPU= 13.470
Uploading trickle at timestep: 345600
  12:59:22 STEP   98 H=  98:00 +CPU= 13.967
  12:59:43 STEP   99 H=  99:00 +CPU= 20.996
  12:59:57 STEP  100 H= 100:00 +CPU= 13.521
  13:00:10 STEP  101 H= 101:00 +CPU= 12.615
  13:00:31 STEP  102 H= 102:00 +CPU= 21.216
  13:00:44 STEP  103 H= 103:00 +CPU= 13.391
  13:00:58 STEP  104 H= 104:00 +CPU= 13.847
  13:01:19 STEP  105 H= 105:00 +CPU= 21.069
  13:01:33 STEP  106 H= 106:00 +CPU= 14.053
  13:01:46 STEP  107 H= 107:00 +CPU= 13.238
  13:02:09 STEP  108 H= 108:00 +CPU= 23.030
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000108
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000108
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000108
  13:02:23 STEP  109 H= 109:00 +CPU= 13.492
  13:02:36 STEP  110 H= 110:00 +CPU= 13.437
  13:02:56 STEP  111 H= 111:00 +CPU= 19.686
  13:03:10 STEP  112 H= 112:00 +CPU= 13.882
  13:03:23 STEP  113 H= 113:00 +CPU= 13.393
  13:03:45 STEP  114 H= 114:00 +CPU= 21.182
  13:03:58 STEP  115 H= 115:00 +CPU= 13.366
  13:04:12 STEP  116 H= 116:00 +CPU= 13.652
  13:04:33 STEP  117 H= 117:00 +CPU= 21.089
  13:04:47 STEP  118 H= 118:00 +CPU= 13.910
  13:05:00 STEP  119 H= 119:00 +CPU= 13.730
  13:05:24 STEP  120 H= 120:00 +CPU= 23.160
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000120
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000120
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMGGhpi1+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMSHhpi1+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMUAhpi1+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMGGhpi1+000108
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMSHhpi1+000108
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMUAhpi1+000108
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0746_2021050100_123_945_12163835_0_r422844383_4.zip
Uploading the intermediate file: upload_file_4.zip
  13:05:37 STEP  121 H= 121:00 +CPU= 13.078
  13:05:51 STEP  122 H= 122:00 +CPU= 13.833
Uploading trickle at timestep: 432000
  13:06:12 STEP  123 H= 123:00 +CPU= 20.892
  13:06:25 STEP  124 H= 124:00 +CPU= 13.798
  13:06:39 STEP  125 H= 125:00 +CPU= 13.322
  13:07:01 STEP  126 H= 126:00 +CPU= 21.737
  13:07:14 STEP  127 H= 127:00 +CPU= 13.348
  13:07:28 STEP  128 H= 128:00 +CPU= 13.909
  13:07:49 STEP  129 H= 129:00 +CPU= 21.022
  13:08:02 STEP  130 H= 130:00 +CPU= 12.727
  13:08:15 STEP  131 H= 131:00 +CPU= 13.114
  13:08:38 STEP  132 H= 132:00 +CPU= 23.178
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000132
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000132
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000132
  13:08:51 STEP  133 H= 133:00 +CPU= 13.494
  13:09:05 STEP  134 H= 134:00 +CPU= 13.819
  13:09:26 STEP  135 H= 135:00 +CPU= 21.089
  13:09:40 STEP  136 H= 136:00 +CPU= 13.921
  13:09:53 STEP  137 H= 137:00 +CPU= 13.352
  13:10:15 STEP  138 H= 138:00 +CPU= 21.460
  13:10:28 STEP  139 H= 139:00 +CPU= 13.193
  13:10:41 STEP  140 H= 140:00 +CPU= 12.425
  13:11:01 STEP  141 H= 141:00 +CPU= 20.629
  13:11:15 STEP  142 H= 142:00 +CPU= 14.019
  13:11:29 STEP  143 H= 143:00 +CPU= 13.783
  13:11:54 STEP  144 H= 144:00 +CPU= 24.351
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhpi1+000144
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhpi1+000144
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhpi1+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMGGhpi1+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMSHhpi1+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMUAhpi1+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMGGhpi1+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMSHhpi1+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163835/ICMUAhpi1+000132
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0746_2021050100_123_945_12163835_0_r422844383_5.zip
Uploading the intermediate file: upload_file_5.zip
  13:12:07 STEP  145 H= 145:00 +CPU= 13.609
Uploading trickle at timestep: 518400
  13:12:21 STEP  146 H= 146:00 +CPU= 13.599
  13:12:41 STEP  147 H= 147:00 +CPU= 20.249
  13:12:53 STEP  148 H= 148:00 +CPU= 11.972
  13:13:04 STEP  149 H= 149:00 +CPU= 11.309
  13:13:22 STEP  150 H= 150:00 +CPU= 18.083
  13:13:34 STEP  151 H= 151:00 +CPU= 11.505
  13:13:46 STEP  152 H= 152:00 +CPU= 11.897
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:05:13 1493780 22245780 oifs_43r3_ps_0746_2021050100_123_945_12163835_0 518,400 2,362 0.0046
09 May 2023 15:05:13 1493780 22245780 oifs_43r3_ps_0746_2021050100_123_945_12163835_0 432,000 1,982 0.0046
09 May 2023 15:05:13 1493780 22245780 oifs_43r3_ps_0746_2021050100_123_945_12163835_0 345,600 1,591 0.0046
09 May 2023 15:05:13 1493780 22245780 oifs_43r3_ps_0746_2021050100_123_945_12163835_0 259,200 1,201 0.0046
09 May 2023 15:03:43 1493780 22245780 oifs_43r3_ps_0746_2021050100_123_945_12163835_0 172,800 810 0.0047
09 May 2023 15:03:43 1493780 22245780 oifs_43r3_ps_0746_2021050100_123_945_12163835_0 86,400 419 0.0048


©2024 climateprediction.net