climateprediction.net home page
Task 22316526

Task 22316526

Name oifs_43r3_01av_2019110100_123_993_12215125_0
Workunit 12215125
Created 24 Feb 2023, 17:28:21 UTC
Sent 24 Feb 2023, 17:35:20 UTC
Report deadline 25 Apr 2023, 17:35:20 UTC
Received 24 Feb 2023, 19:38:37 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1509254
Run time 44 min 25 sec
CPU time 44 min 25 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4.48 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,283.68 MB
Peak swap size 4,983.12 MB
Peak disk usage 1,262.88 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_1.21_x86_64-pc-linux-gnu
(argv1) start_date: 2019110100
(argv2) exptid: hnw4
(argv3) unique_member_id: 01av
(argv4) batchid: 993
(argv5) wuid: 12215125
(argv6) fclen: 123
(argv7) app_name: oifs_43r3
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3
version: 1.21
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_7eb22487053620435db0404ebe3d36bc to: /var/lib/boinc-client/slots/7/oifs_43r3_01av_2019110100_123_993_12215125.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_01av_2019110100_123_993_12215125.zip
ic_ancil_file: ic_ancil_12215125
ifsdata_file: ifsdata_12215125
climate_data_file: clim_data_12215125
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_5a458d1039bf39f17bfd19d02b5f9063 to: /var/lib/boinc-client/slots/7/ic_ancil_12215125.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12215125.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1daf4ee6d83b108b60e8293fb099d142 to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12215125.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12215125.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12215125.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12215125.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12215125.xml
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12215125.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_01av_2019110100_123_993_12215125_0_r1796209825
The child process has been launched with process id: 2382451
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x3124020
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [ignore_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [restore_default_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x810730 (old at (nil))
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x810730 (old at (nil))
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [trapfpe_treatment@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x810730 (old at (nil))
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x810730 (old at (nil))
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x810730 (old at (nil))
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x810730 (old at (nil))
[EC_DRHOOK:HP-Z420-WorkStation1:1:1:2382451:2382451] [20230224:130250:1677261770:0.001] [catch_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  13:03:53 STEP    0 H=   0:00 +CPU= 51.198
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhnw4+000000
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhnw4+000000
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhnw4+000000
  13:04:35 STEP    1 H=   1:00 +CPU= 35.473
  13:05:08 STEP    2 H=   2:00 +CPU= 30.533
  13:05:56 STEP    3 H=   3:00 +CPU= 46.016
  13:06:34 STEP    4 H=   4:00 +CPU= 31.667
  13:07:12 STEP    5 H=   5:00 +CPU= 30.518
  13:08:09 STEP    6 H=   6:00 +CPU= 48.365
  13:09:33 STEP    7 H=   7:00 +CPU= 25.667
  13:10:03 STEP    8 H=   8:00 +CPU= 28.175
  13:10:49 STEP    9 H=   9:00 +CPU= 44.152
  13:11:29 STEP   10 H=  10:00 +CPU= 28.995
  13:12:01 STEP   11 H=  11:00 +CPU= 29.246
  13:12:55 STEP   12 H=  12:00 +CPU= 50.942
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhnw4+000012
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhnw4+000012
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhnw4+000012
  13:13:24 STEP   13 H=  13:00 +CPU= 29.360
  13:13:55 STEP   14 H=  14:00 +CPU= 30.269
  13:14:40 STEP   15 H=  15:00 +CPU= 45.056
  13:15:10 STEP   16 H=  16:00 +CPU= 29.683
  13:15:39 STEP   17 H=  17:00 +CPU= 29.526
  13:16:25 STEP   18 H=  18:00 +CPU= 45.541
  13:16:53 STEP   19 H=  19:00 +CPU= 27.511
  13:17:20 STEP   20 H=  20:00 +CPU= 27.800
  13:18:04 STEP   21 H=  21:00 +CPU= 43.234
  13:18:33 STEP   22 H=  22:00 +CPU= 28.772
  13:19:03 STEP   23 H=  23:00 +CPU= 29.654
  13:19:56 STEP   24 H=  24:00 +CPU= 51.099
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhnw4+000024
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhnw4+000024
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhnw4+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMGGhnw4+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMSHhnw4+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMUAhnw4+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMGGhnw4+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMSHhnw4+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMUAhnw4+000012
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01av_2019110100_123_993_12215125_0_r1796209825_0.zip
Uploading the intermediate file: upload_file_0.zip
  13:20:24 STEP   25 H=  25:00 +CPU= 28.043
  13:20:54 STEP   26 H=  26:00 +CPU= 29.864
  13:21:38 STEP   27 H=  27:00 +CPU= 43.838
  13:22:08 STEP   28 H=  28:00 +CPU= 29.789
  13:22:38 STEP   29 H=  29:00 +CPU= 29.583
  13:24:56 STEP   30 H=  30:00 +CPU= 45.292
  13:25:31 STEP   31 H=  31:00 +CPU= 25.145
  13:25:58 STEP   32 H=  32:00 +CPU= 26.588
  13:27:52 STEP   33 H=  33:00 +CPU= 37.349
  13:28:18 STEP   34 H=  34:00 +CPU= 24.993
  13:28:43 STEP   35 H=  35:00 +CPU= 25.031
  13:29:28 STEP   36 H=  36:00 +CPU= 42.737
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhnw4+000036
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhnw4+000036
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhnw4+000036
  13:29:52 STEP   37 H=  37:00 +CPU= 24.587
  13:30:21 STEP   38 H=  38:00 +CPU= 28.318
  13:31:05 STEP   39 H=  39:00 +CPU= 44.233
  13:31:35 STEP   40 H=  40:00 +CPU= 29.410
  13:33:33 STEP   41 H=  41:00 +CPU= 26.072
  13:34:19 STEP   42 H=  42:00 +CPU= 42.894
  13:34:46 STEP   43 H=  43:00 +CPU= 26.787
  13:35:15 STEP   44 H=  44:00 +CPU= 29.163
  13:36:00 STEP   45 H=  45:00 +CPU= 44.527
  13:36:29 STEP   46 H=  46:00 +CPU= 29.465
  13:37:01 STEP   47 H=  47:00 +CPU= 30.600
  13:37:59 STEP   48 H=  48:00 +CPU= 53.263
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhnw4+000048
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhnw4+000048
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhnw4+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMGGhnw4+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMSHhnw4+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMUAhnw4+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMGGhnw4+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMSHhnw4+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMUAhnw4+000036
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01av_2019110100_123_993_12215125_0_r1796209825_1.zip
Uploading the intermediate file: upload_file_1.zip
  13:38:29 STEP   49 H=  49:00 +CPU= 29.287
  13:39:02 STEP   50 H=  50:00 +CPU= 31.397
  13:39:50 STEP   51 H=  51:00 +CPU= 47.355
  13:40:22 STEP   52 H=  52:00 +CPU= 31.192
  13:40:52 STEP   53 H=  53:00 +CPU= 30.322
  13:42:40 STEP   54 H=  54:00 +CPU= 43.454
  13:43:14 STEP   55 H=  55:00 +CPU= 29.967
  13:44:43 STEP   56 H=  56:00 +CPU= 30.529
  13:45:58 STEP   57 H=  57:00 +CPU= 45.680
  13:46:33 STEP   58 H=  58:00 +CPU= 31.178
  13:47:10 STEP   59 H=  59:00 +CPU= 30.489
  13:48:10 STEP   60 H=  60:00 +CPU= 51.625
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhnw4+000060
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhnw4+000060
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhnw4+000060
  13:49:43 STEP   61 H=  61:00 +CPU= 29.228
  13:50:15 STEP   62 H=  62:00 +CPU= 31.027
  13:51:11 STEP   63 H=  63:00 +CPU= 47.357
  13:51:48 STEP   64 H=  64:00 +CPU= 31.166
  13:52:20 STEP   65 H=  65:00 +CPU= 29.395
  13:53:21 STEP   66 H=  66:00 +CPU= 46.875
  13:54:00 STEP   67 H=  67:00 +CPU= 26.388
  13:54:32 STEP   68 H=  68:00 +CPU= 29.781
  13:55:19 STEP   69 H=  69:00 +CPU= 46.490
  13:55:51 STEP   70 H=  70:00 +CPU= 30.514
  13:56:24 STEP   71 H=  71:00 +CPU= 31.483
  13:59:32 STEP   72 H=  72:00 +CPU= 51.902
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhnw4+000072
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhnw4+000072
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhnw4+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMGGhnw4+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMSHhnw4+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMUAhnw4+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMGGhnw4+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMSHhnw4+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215125/ICMUAhnw4+000060
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01av_2019110100_123_993_12215125_0_r1796209825_2.zip
Uploading the intermediate file: upload_file_2.zip
  14:00:08 STEP   73 H=  73:00 +CPU= 29.303
  14:00:49 STEP   74 H=  74:00 +CPU= 31.327
  14:02:22 STEP   75 H=  75:00 +CPU= 46.837
  14:14:14 STEP   76 H=  76:00 +CPU= 29.242
  14:14:49 STEP   77 H=  77:00 +CPU= 30.226
..The child process has been killed with signal: 9
>>> Printing last 70 lines from file: NODE.001_01

SUECSO4: USE AVAILABLE FILES FOR DECADES:   2010 2020
 SUBROUTINE SUECSO4:, UNWEIGHTED AVERAGE:   2.308007743306329E-003
 NSTEP =    75 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.236954861121E-01 1.762096869978E-01 6.981935658239E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.620162075694E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  5.88912699222299E-02 -2.06547015201696E+00  2.14313543822450E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  5.27309850898312E-02 -1.00000000000000E+00  1.00000000000000E+00
  STEPO: evolving YSPSDT_AR1(  1)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191104021500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191104023000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191104024500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191104030000  !!!!!!!!!!!! 
 14:02:22 STEP   75 H=  75:00 +CPU= 46.837
 NSTEP =    76 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.183275738225E-01 1.795209268979E-01 6.974246692519E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.555137392476E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  6.30278590564435E-02 -2.15294353933472E+00  1.85553675233939E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  5.81770954939572E-02 -1.00000000000000E+00  1.00000000000000E+00
  STEPO: evolving YSPSDT_AR1(  1)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191104031500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191104033000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191104034500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191104040000  !!!!!!!!!!!! 
 14:14:14 STEP   76 H=  76:00 +CPU= 29.242
 NSTEP =    77 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.190821223110E-01 1.748008904304E-01 7.043062730115E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.537001513324E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  6.59785597575026E-02 -2.05747641014401E+00  1.88416049927247E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  5.88889175882002E-02 -1.00000000000000E+00  1.00000000000000E+00
  STEPO: evolving YSPSDT_AR1(  1)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191104041500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191104043000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191104044500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191104050000  !!!!!!!!!!!! 
 14:14:49 STEP   77 H=  77:00 +CPU= 30.226
  DATE= 2019   11    4
ISTEP=      78: Reset RSOLINC= 1361.0304 RIP0= 1383.9034
 SU_GHGCLIM, RCARDI,RCH4,RN2O,RCFC11,RCFC12,RNO2:   6.240006412635001E-004
  9.628461857022168E-007  4.996611132045250E-007  9.607432727722499E-010
  2.027017283006666E-009  7.940283000000001E-011
 SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT)     20191101
        4770  9.999999999999998E-005
SUECSO4: USE AVAILABLE FILES FOR DECADES:   2010 2020
 SUBROUTINE SUECSO4:, UNWEIGHTED AVERAGE:   2.307305035117930E-003
 NSTEP =    78 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.183664969527E-01 1.717120725734E-01 7.020186177511E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.531195832043E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  5.30946277953471E-02 -1.74613981148276E+00  1.75514343960941E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  4.83016348123413E-02 -1.00000000000000E+00  1.00000000000000E+00
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 13:56:54 0AAA00AAA STEPO       72     1.717    1.717    3.882     41:57     54:03 0.10880902007753E-04       2GB       0MB
 13:59:33 0AAA00AAA STEPO       73    45.507   45.507  159.034     42:42     56:42 0.10880902007753E-04       2GB       0MB
 14:00:08 0AAA00AAA STEPO       74    29.303   29.303   35.666     43:12     57:18 0.10880902007753E-04       2GB       0MB
 14:00:50 0AAA00AAA STEPO       75    31.329   31.329   41.246     43:43     57:59 0.10880902007753E-04       2GB       0MB
 14:02:22 0AAA00AAA STEPO       76    46.835   46.835   92.559     44:30     59:32 0.10880902007753E-04       2GB       0MB
 14:14:14 0AAA00AAA STEPO       77    29.242   29.242  711.993     44:59     71:24 0.10880902007753E-04       2GB       0MB
 14:14:50 0AAA00AAA STEPO       78    30.354   30.354   36.387     45:29     72:00 0.10880902007753E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "      72",
 CTIME   = "00030000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 5*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =   98323.1277057892     ,
 GMASSI  =   98322.3602073016     
 /
------------------------------------------------
>>> Printing last 17 lines from file: waminfo

PARAM=10U/10V,                                                          
REPRES=GG,                                                              
ANALYSIS PERIOD =       0                                               
FORECAST PERIOD =   10371600                                            
WIND TIME STEP IN SECONDS =    3600                                     
ANALYSIS FROM 20191101000000 TO 20191101000000                          
ASSIMILATION NO                                                         
NEW FORECAST NO                                                         
STATUS STORM1= UNFINISHED                                               
STATUS STORM2= UNFINISHED                                               
STATUS STORM3= UNFINISHED                                               
DATE FOR OUTPUT OF BOTH RESTART FILES = 00000000000000                  
LAST DATE FOR SPECTRA FILE OUTPUT = 20200303000000                      
BEGIN DATE FOR USING SURFACE CURRENT = 20191101000000                   
PARALLEL RESTART = YES                                                  
NUMBER OF MPI TASKS USED =          1                                   
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/7/progress_file_12215125.xml

<running_values>
  <last_cpu_time>2752.080000</last_cpu_time>
  <upload_file_number>3</upload_file_number>
  <last_iter>78</last_iter>
  <last_upload>259200</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net