<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
gress file ok : /var/lib/boinc-client/slots/19/progress_file_12166406.xml
-- Model is restarting --
Adjusting last_iter, 766, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/19/progress_file_12166406.xml
last_cpu_time: 28575
upload_file_number: 7
last_iter: 719
last_upload: 604800
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a00c_2016092300_15_949_12166406_0_r224990618
The child process has been launched with process id: 167858
Executing the command: /var/lib/boinc-client/slots/19/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x30eaa80
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:167858:167858] [20221215:132114:1671070874:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
13:22:08 STEP 720 H= 180:00 +CPU= 43.068
13:22:50 STEP 721 H= 180:15 +CPU= 37.965
13:23:33 STEP 722 H= 180:30 +CPU= 39.244
13:24:12 STEP 723 H= 180:45 +CPU= 36.118
13:24:57 STEP 724 H= 181:00 +CPU= 40.670
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:36:09 STEP 725 H= 181:15 +CPU= 30.165
13:36:49 STEP 726 H= 181:30 +CPU= 37.679
13:37:24 STEP 727 H= 181:45 +CPU= 31.738
13:38:00 STEP 728 H= 182:00 +CPU= 34.666
13:38:36 STEP 729 H= 182:15 +CPU= 33.889
13:39:12 STEP 730 H= 182:30 +CPU= 32.854
13:39:48 STEP 731 H= 182:45 +CPU= 34.146
13:40:32 STEP 732 H= 183:00 +CPU= 41.887
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000732
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000732
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000732
13:41:07 STEP 733 H= 183:15 +CPU= 31.543
13:41:38 STEP 734 H= 183:30 +CPU= 29.713
13:42:08 STEP 735 H= 183:45 +CPU= 27.604
13:42:45 STEP 736 H= 184:00 +CPU= 33.696
13:43:20 STEP 737 H= 184:15 +CPU= 32.173
13:43:55 STEP 738 H= 184:30 +CPU= 33.124
13:44:30 STEP 739 H= 184:45 +CPU= 32.056
13:45:06 STEP 740 H= 185:00 +CPU= 33.850
13:45:42 STEP 741 H= 185:15 +CPU= 33.270
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:48:18 STEP 742 H= 185:30 +CPU= 31.849
13:48:54 STEP 743 H= 185:45 +CPU= 33.555
13:49:39 STEP 744 H= 186:00 +CPU= 40.588
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000744
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000744
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000744
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:52:07 STEP 745 H= 186:15 +CPU= 25.695
13:52:33 STEP 746 H= 186:30 +CPU= 25.187
13:53:03 STEP 747 H= 186:45 +CPU= 28.277
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:56:11 STEP 748 H= 187:00 +CPU= 28.398
13:56:43 STEP 749 H= 187:15 +CPU= 30.792
13:57:13 STEP 750 H= 187:30 +CPU= 28.919
13:57:39 STEP 751 H= 187:45 +CPU= 24.173
13:58:10 STEP 752 H= 188:00 +CPU= 28.691
13:58:36 STEP 753 H= 188:15 +CPU= 25.306
13:59:00 STEP 754 H= 188:30 +CPU= 22.601
13:59:24 STEP 755 H= 188:45 +CPU= 22.942
13:59:59 STEP 756 H= 189:00 +CPU= 32.699
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000756
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000756
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000756
14:00:25 STEP 757 H= 189:15 +CPU= 25.539
14:00:51 STEP 758 H= 189:30 +CPU= 24.513
14:01:15 STEP 759 H= 189:45 +CPU= 23.458
14:01:43 STEP 760 H= 190:00 +CPU= 25.653
14:02:05 STEP 761 H= 190:15 +CPU= 21.136
14:02:29 STEP 762 H= 190:30 +CPU= 22.225
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:04:56 STEP 763 H= 190:45 +CPU= 22.646
14:05:22 STEP 764 H= 191:00 +CPU= 23.538
14:05:46 STEP 765 H= 191:15 +CPU= 23.254
14:06:13 STEP 766 H= 191:30 +CPU= 24.274
14:06:36 STEP 767 H= 191:45 +CPU= 22.576
14:07:12 STEP 768 H= 192:00 +CPU= 32.528
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000768
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000768
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000696
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000708
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000720
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000732
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000744
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000756
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000756
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00c_2016092300_15_949_12166406_0_r224990618_7.zip
Uploading the intermediate file: upload_file_7.zip
14:07:37 STEP 769 H= 192:15 +CPU= 24.265
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:19:34 STEP 770 H= 192:30 +CPU= 19.712
14:19:56 STEP 771 H= 192:45 +CPU= 21.844
14:20:23 STEP 772 H= 193:00 +CPU= 24.902
14:20:49 STEP 773 H= 193:15 +CPU= 24.096
14:21:15 STEP 774 H= 193:30 +CPU= 24.746
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:23:42 STEP 775 H= 193:45 +CPU= 23.463
14:24:06 STEP 776 H= 194:00 +CPU= 23.223
14:24:31 STEP 777 H= 194:15 +CPU= 23.410
14:24:57 STEP 778 H= 194:30 +CPU= 25.045
14:25:23 STEP 779 H= 194:45 +CPU= 25.202
14:25:55 STEP 780 H= 195:00 +CPU= 28.501
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000780
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000780
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000780
14:26:22 STEP 781 H= 195:15 +CPU= 24.083
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:28:43 STEP 782 H= 195:30 +CPU= 20.042
14:29:07 STEP 783 H= 195:45 +CPU= 22.270
14:29:31 STEP 784 H= 196:00 +CPU= 23.029
14:29:57 STEP 785 H= 196:15 +CPU= 24.034
14:30:23 STEP 786 H= 196:30 +CPU= 23.940
14:30:48 STEP 787 H= 196:45 +CPU= 23.324
14:31:13 STEP 788 H= 197:00 +CPU= 24.111
14:31:36 STEP 789 H= 197:15 +CPU= 20.889
14:31:58 STEP 790 H= 197:30 +CPU= 20.833
14:32:19 STEP 791 H= 197:45 +CPU= 20.911
14:32:47 STEP 792 H= 198:00 +CPU= 25.271
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000792
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000792
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000792
14:33:10 STEP 793 H= 198:15 +CPU= 21.649
14:33:31 STEP 794 H= 198:30 +CPU= 20.084
14:33:51 STEP 795 H= 198:45 +CPU= 19.208
14:34:13 STEP 796 H= 199:00 +CPU= 21.567
14:34:34 STEP 797 H= 199:15 +CPU= 19.833
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:38:50 STEP 798 H= 199:30 +CPU= 19.762
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:54:21 STEP 799 H= 199:45 +CPU= 20.333
14:54:43 STEP 800 H= 200:00 +CPU= 21.148
14:55:05 STEP 801 H= 200:15 +CPU= 20.334
14:55:27 STEP 802 H= 200:30 +CPU= 19.919
14:55:49 STEP 803 H= 200:45 +CPU= 20.334
14:56:16 STEP 804 H= 201:00 +CPU= 24.535
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000804
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000804
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000804
14:56:36 STEP 805 H= 201:15 +CPU= 20.252
14:56:57 STEP 806 H= 201:30 +CPU= 19.716
14:57:19 STEP 807 H= 201:45 +CPU= 20.428
14:57:40 STEP 808 H= 202:00 +CPU= 20.917
14:58:01 STEP 809 H= 202:15 +CPU= 19.957
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:00:23 STEP 810 H= 202:30 +CPU= 19.883
15:00:45 STEP 811 H= 202:45 +CPU= 20.961
15:01:06 STEP 812 H= 203:00 +CPU= 19.646
15:01:28 STEP 813 H= 203:15 +CPU= 20.932
15:01:50 STEP 814 H= 203:30 +CPU= 20.324
15:02:14 STEP 815 H= 203:45 +CPU= 22.190
15:02:43 STEP 816 H= 204:00 +CPU= 28.620
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000816
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000816
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000816
15:03:04 STEP 817 H= 204:15 +CPU= 20.003
15:03:26 STEP 818 H= 204:30 +CPU= 20.214
15:03:48 STEP 819 H= 204:45 +CPU= 20.872
15:04:11 STEP 820 H= 205:00 +CPU= 20.338
15:04:33 STEP 821 H= 205:15 +CPU= 21.325
15:04:53 STEP 822 H= 205:30 +CPU= 19.811
15:05:16 STEP 823 H= 205:45 +CPU= 20.748
15:05:38 STEP 824 H= 206:00 +CPU= 21.316
15:06:00 STEP 825 H= 206:15 +CPU= 21.232
15:06:22 STEP 826 H= 206:30 +CPU= 20.702
15:06:43 STEP 827 H= 206:45 +CPU= 20.883
15:07:11 STEP 828 H= 207:00 +CPU= 27.638
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000828
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000828
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000828
15:07:33 STEP 829 H= 207:15 +CPU= 21.487
15:07:55 STEP 830 H= 207:30 +CPU= 20.751
15:08:15 STEP 831 H= 207:45 +CPU= 19.160
15:08:35 STEP 832 H= 208:00 +CPU= 20.435
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:10:56 STEP 833 H= 208:15 +CPU= 20.373
15:11:18 STEP 834 H= 208:30 +CPU= 21.013
15:11:39 STEP 835 H= 208:45 +CPU= 20.500
15:12:01 STEP 836 H= 209:00 +CPU= 20.863
15:12:20 STEP 837 H= 209:15 +CPU= 18.948
15:12:41 STEP 838 H= 209:30 +CPU= 19.079
15:13:02 STEP 839 H= 209:45 +CPU= 19.840
15:13:30 STEP 840 H= 210:00 +CPU= 26.524
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000840
15:13:51 STEP 841 H= 210:15 +CPU= 20.253
15:14:13 STEP 842 H= 210:30 +CPU= 20.465
15:14:36 STEP 843 H= 210:45 +CPU= 21.104
15:15:00 STEP 844 H= 211:00 +CPU= 21.734
15:15:21 STEP 845 H= 211:15 +CPU= 20.003
15:15:44 STEP 846 H= 211:30 +CPU= 20.839
15:16:06 STEP 847 H= 211:45 +CPU= 20.670
15:16:27 STEP 848 H= 212:00 +CPU= 20.052
15:16:47 STEP 849 H= 212:15 +CPU= 19.828
15:17:10 STEP 850 H= 212:30 +CPU= 20.946
15:17:31 STEP 851 H= 212:45 +CPU= 20.181
15:17:59 STEP 852 H= 213:00 +CPU= 26.414
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000852
15:18:19 STEP 853 H= 213:15 +CPU= 19.902
15:18:42 STEP 854 H= 213:30 +CPU= 20.634
15:19:03 STEP 855 H= 213:45 +CPU= 20.149
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:21:24 STEP 856 H= 214:00 +CPU= 20.053
15:21:45 STEP 857 H= 214:15 +CPU= 19.596
15:22:07 STEP 858 H= 214:30 +CPU= 20.433
15:22:28 STEP 859 H= 214:45 +CPU= 20.557
15:22:50 STEP 860 H= 215:00 +CPU= 20.322
15:23:13 STEP 861 H= 215:15 +CPU= 20.792
15:23:34 STEP 862 H= 215:30 +CPU= 19.440
15:23:55 STEP 863 H= 215:45 +CPU= 19.910
15:24:24 STEP 864 H= 216:00 +CPU= 28.359
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00c_2016092300_15_949_12166406_0_r224990618_8.zip
Uploading the intermediate file: upload_file_8.zip
15:24:43 STEP 865 H= 216:15 +CPU= 18.601
15:25:04 STEP 866 H= 216:30 +CPU= 19.538
15:25:25 STEP 867 H= 216:45 +CPU= 20.122
15:25:48 STEP 868 H= 217:00 +CPU= 21.837
15:26:09 STEP 869 H= 217:15 +CPU= 20.151
15:26:32 STEP 870 H= 217:30 +CPU= 20.520
15:26:51 STEP 871 H= 217:45 +CPU= 19.413
15:27:13 STEP 872 H= 218:00 +CPU= 20.049
15:27:32 STEP 873 H= 218:15 +CPU= 18.912
15:27:53 STEP 874 H= 218:30 +CPU= 19.939
15:28:14 STEP 875 H= 218:45 +CPU= 20.108
15:28:40 STEP 876 H= 219:00 +CPU= 24.395
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000876
15:29:01 STEP 877 H= 219:15 +CPU= 19.572
15:29:23 STEP 878 H= 219:30 +CPU= 21.007
15:29:46 STEP 879 H= 219:45 +CPU= 21.216
15:30:14 STEP 880 H= 220:00 +CPU= 26.348
15:30:39 STEP 881 H= 220:15 +CPU= 23.826
15:31:05 STEP 882 H= 220:30 +CPU= 24.044
15:31:35 STEP 883 H= 220:45 +CPU= 28.209
15:32:02 STEP 884 H= 221:00 +CPU= 25.614
15:32:34 STEP 885 H= 221:15 +CPU= 29.373
15:33:09 STEP 886 H= 221:30 +CPU= 33.055
15:33:45 STEP 887 H= 221:45 +CPU= 32.575
15:34:28 STEP 888 H= 222:00 +CPU= 40.339
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000888
15:35:03 STEP 889 H= 222:15 +CPU= 32.800
15:35:40 STEP 890 H= 222:30 +CPU= 34.840
15:36:18 STEP 891 H= 222:45 +CPU= 36.235
15:36:58 STEP 892 H= 223:00 +CPU= 37.344
15:37:38 STEP 893 H= 223:15 +CPU= 37.493
15:38:13 STEP 894 H= 223:30 +CPU= 33.201
15:38:44 STEP 895 H= 223:45 +CPU= 29.470
15:39:20 STEP 896 H= 224:00 +CPU= 34.844
15:40:03 STEP 897 H= 224:15 +CPU= 40.347
15:40:36 STEP 898 H= 224:30 +CPU= 32.245
15:41:09 STEP 899 H= 224:45 +CPU= 31.820
15:41:54 STEP 900 H= 225:00 +CPU= 42.479
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000900
15:42:40 STEP 901 H= 225:15 +CPU= 43.625
15:43:18 STEP 902 H= 225:30 +CPU= 36.368
15:44:00 STEP 903 H= 225:45 +CPU= 38.991
15:44:42 STEP 904 H= 226:00 +CPU= 40.040
15:45:16 STEP 905 H= 226:15 +CPU= 32.889
15:45:54 STEP 906 H= 226:30 +CPU= 35.999
15:46:35 STEP 907 H= 226:45 +CPU= 39.473
15:47:17 STEP 908 H= 227:00 +CPU= 39.426
15:47:51 STEP 909 H= 227:15 +CPU= 31.958
15:48:35 STEP 910 H= 227:30 +CPU= 40.844
15:49:15 STEP 911 H= 227:45 +CPU= 38.934
15:50:05 STEP 912 H= 228:00 +CPU= 47.229
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000912
15:50:45 STEP 913 H= 228:15 +CPU= 37.612
15:51:22 STEP 914 H= 228:30 +CPU= 35.486
15:51:56 STEP 915 H= 228:45 +CPU= 32.226
15:52:32 STEP 916 H= 229:00 +CPU= 34.370
15:53:08 STEP 917 H= 229:15 +CPU= 33.843
15:53:47 STEP 918 H= 229:30 +CPU= 37.770
15:54:22 STEP 919 H= 229:45 +CPU= 33.180
15:55:02 STEP 920 H= 230:00 +CPU= 38.488
15:55:34 STEP 921 H= 230:15 +CPU= 31.420
15:56:03 STEP 922 H= 230:30 +CPU= 27.748
15:56:40 STEP 923 H= 230:45 +CPU= 34.961
15:57:28 STEP 924 H= 231:00 +CPU= 45.913
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000924
15:58:08 STEP 925 H= 231:15 +CPU= 37.658
15:58:42 STEP 926 H= 231:30 +CPU= 32.335
15:59:21 STEP 927 H= 231:45 +CPU= 37.026
15:59:59 STEP 928 H= 232:00 +CPU= 36.460
16:00:31 STEP 929 H= 232:15 +CPU= 31.015
16:01:04 STEP 930 H= 232:30 +CPU= 31.622
16:01:45 STEP 931 H= 232:45 +CPU= 38.756
16:02:17 STEP 932 H= 233:00 +CPU= 31.485
16:02:55 STEP 933 H= 233:15 +CPU= 36.880
16:03:26 STEP 934 H= 233:30 +CPU= 31.049
16:03:59 STEP 935 H= 233:45 +CPU= 31.285
16:04:41 STEP 936 H= 234:00 +CPU= 40.302
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000936
16:05:20 STEP 937 H= 234:15 +CPU= 37.151
16:05:58 STEP 938 H= 234:30 +CPU= 37.563
16:06:34 STEP 939 H= 234:45 +CPU= 35.923
16:07:19 STEP 940 H= 235:00 +CPU= 42.118
16:07:57 STEP 941 H= 235:15 +CPU= 37.492
16:08:34 STEP 942 H= 235:30 +CPU= 34.737
16:09:08 STEP 943 H= 235:45 +CPU= 32.585
16:09:45 STEP 944 H= 236:00 +CPU= 35.828
16:10:21 STEP 945 H= 236:15 +CPU= 33.973
16:11:01 STEP 946 H= 236:30 +CPU= 37.960
16:11:38 STEP 947 H= 236:45 +CPU= 36.067
16:12:26 STEP 948 H= 237:00 +CPU= 46.473
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000948
16:13:01 STEP 949 H= 237:15 +CPU= 34.191
16:13:39 STEP 950 H= 237:30 +CPU= 36.534
16:14:18 STEP 951 H= 237:45 +CPU= 37.910
16:15:01 STEP 952 H= 238:00 +CPU= 40.632
16:15:40 STEP 953 H= 238:15 +CPU= 37.828
16:16:22 STEP 954 H= 238:30 +CPU= 40.676
16:17:01 STEP 955 H= 238:45 +CPU= 37.051
16:17:44 STEP 956 H= 239:00 +CPU= 41.180
16:18:24 STEP 957 H= 239:15 +CPU= 38.819
16:19:03 STEP 958 H= 239:30 +CPU= 36.793
16:19:40 STEP 959 H= 239:45 +CPU= 35.061
16:20:38 STEP 960 H= 240:00 +CPU= 52.739
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00c_2016092300_15_949_12166406_0_r224990618_9.zip
Uploading the intermediate file: upload_file_9.zip
16:21:23 STEP 961 H= 240:15 +CPU= 42.793
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.07_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a00c
(argv4) batchid: 949
(argv5) wuid: 12166406
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/19
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.07
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/19/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/19/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_631ab2f5573e9e721465105175855d25 to: /var/lib/boinc-client/slots/19/oifs_43r3_bl_a00c_2016092300_15_949_12166406.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/19/oifs_43r3_bl_a00c_2016092300_15_949_12166406.zip
ic_ancil_file: ic_ancil_12166406
ifsdata_file: ifsdata_12166406
climate_data_file: clim_data_12166406
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/19/ic_ancil_12166406.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/19/ic_ancil_12166406.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_27988333509a7e4d884173bb9be29183 to: /var/lib/boinc-client/slots/19/ifsdata/ifsdata_12166406.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/19/ifsdata/ifsdata_12166406.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/19/159l_2/clim_data_12166406.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/19/159l_2/clim_data_12166406.zip
Checking for progress XML file: /var/lib/boinc-client/slots/19/progress_file_12166406.xml
Opened progress file ok : /var/lib/boinc-client/slots/19/progress_file_12166406.xml
-- Model is restarting --
Adjusting last_iter, 962, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/19/progress_file_12166406.xml
last_cpu_time: 35395
upload_file_number: 10
last_iter: 959
last_upload: 864000
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a00c_2016092300_15_949_12166406_0_r224990618
The child process has been launched with process id: 186343
Executing the command: /var/lib/boinc-client/slots/19/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x30eaa80
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:186343:186343] [20221215:162244:1671081764:0.001] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
16:23:37 STEP 960 H= 240:00 +CPU= 42.497
16:24:22 STEP 961 H= 240:15 +CPU= 44.144
16:25:14 STEP 962 H= 240:30 +CPU= 49.457
16:25:54 STEP 963 H= 240:45 +CPU= 39.006
16:26:34 STEP 964 H= 241:00 +CPU= 39.458
16:27:16 STEP 965 H= 241:15 +CPU= 40.036
16:28:00 STEP 966 H= 241:30 +CPU= 42.617
16:28:43 STEP 967 H= 241:45 +CPU= 41.340
16:29:28 STEP 968 H= 242:00 +CPU= 42.284
16:30:15 STEP 969 H= 242:15 +CPU= 44.573
16:30:59 STEP 970 H= 242:30 +CPU= 41.287
16:31:39 STEP 971 H= 242:45 +CPU= 38.316
16:32:41 STEP 972 H= 243:00 +CPU= 59.011
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000972
16:33:26 STEP 973 H= 243:15 +CPU= 43.909
16:34:06 STEP 974 H= 243:30 +CPU= 38.558
16:34:52 STEP 975 H= 243:45 +CPU= 44.466
16:35:46 STEP 976 H= 244:00 +CPU= 51.144
16:36:34 STEP 977 H= 244:15 +CPU= 46.085
16:37:23 STEP 978 H= 244:30 +CPU= 47.846
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:47:44 STEP 979 H= 244:45 +CPU= 44.433
16:48:40 STEP 980 H= 245:00 +CPU= 50.529
16:49:28 STEP 981 H= 245:15 +CPU= 45.620
16:50:13 STEP 982 H= 245:30 +CPU= 42.558
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:59:25 STEP 983 H= 245:45 +CPU= 47.088
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:13:02 STEP 984 H= 246:00 +CPU= 57.322
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000984
17:13:59 STEP 985 H= 246:15 +CPU= 49.420
17:14:59 STEP 986 H= 246:30 +CPU= 51.066
17:15:53 STEP 987 H= 246:45 +CPU= 49.052
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:24:26 STEP 988 H= 247:00 +CPU= 46.910
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:27:40 STEP 989 H= 247:15 +CPU= 49.753
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:36:28 STEP 990 H= 247:30 +CPU= 38.146
17:37:02 STEP 991 H= 247:45 +CPU= 29.477
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:49:34 STEP 992 H= 248:00 +CPU= 29.908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
17:56:24 STEP 993 H= 248:15 +CPU= 28.883
17:56:59 STEP 994 H= 248:30 +CPU= 32.072
17:57:37 STEP 995 H= 248:45 +CPU= 35.509
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:00:16 STEP 996 H= 249:00 +CPU= 35.970
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+000996
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:02:47 STEP 997 H= 249:15 +CPU= 26.603
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:06:34 STEP 998 H= 249:30 +CPU= 29.642
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:20:46 STEP 999 H= 249:45 +CPU= 31.484
18:21:21 STEP 1000 H= 250:00 +CPU= 31.527
18:21:56 STEP 1001 H= 250:15 +CPU= 31.242
18:22:31 STEP 1002 H= 250:30 +CPU= 31.000
18:23:07 STEP 1003 H= 250:45 +CPU= 31.943
18:23:42 STEP 1004 H= 251:00 +CPU= 32.569
18:24:16 STEP 1005 H= 251:15 +CPU= 30.769
18:24:54 STEP 1006 H= 251:30 +CPU= 33.815
18:25:32 STEP 1007 H= 251:45 +CPU= 34.712
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.07_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a00c
(argv4) batchid: 949
(argv5) wuid: 12166406
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/19
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.07
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/19/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/19/oifs_43r3_bl_app_1.07_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_631ab2f5573e9e721465105175855d25 to: /var/lib/boinc-client/slots/19/oifs_43r3_bl_a00c_2016092300_15_949_12166406.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/19/oifs_43r3_bl_a00c_2016092300_15_949_12166406.zip
ic_ancil_file: ic_ancil_12166406
ifsdata_file: ifsdata_12166406
climate_data_file: clim_data_12166406
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/19/ic_ancil_12166406.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/19/ic_ancil_12166406.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_27988333509a7e4d884173bb9be29183 to: /var/lib/boinc-client/slots/19/ifsdata/ifsdata_12166406.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/19/ifsdata/ifsdata_12166406.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/19/159l_2/clim_data_12166406.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/19/159l_2/clim_data_12166406.zip
Checking for progress XML file: /var/lib/boinc-client/slots/19/progress_file_12166406.xml
Opened progress file ok : /var/lib/boinc-client/slots/19/progress_file_12166406.xml
-- Model is restarting --
Adjusting last_iter, 1008, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/19/progress_file_12166406.xml
last_cpu_time: 37386
upload_file_number: 10
last_iter: 1007
last_upload: 864000
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a00c_2016092300_15_949_12166406_0_r224990618
The child process has been launched with process id: 215439
Executing the command: /var/lib/boinc-client/slots/19/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x30eaa80
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x80f7e0 (old at 0x401140)
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x80f7e0 (old at (nil))
[EC_DRHOOK:roo:1:1:215439:215439] [20221215:182728:1671089248:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
18:28:15 STEP 1008 H= 252:00 +CPU= 36.731
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+001008
18:28:55 STEP 1009 H= 252:15 +CPU= 36.318
18:29:37 STEP 1010 H= 252:30 +CPU= 37.578
18:30:19 STEP 1011 H= 252:45 +CPU= 38.030
18:30:59 STEP 1012 H= 253:00 +CPU= 36.715
18:31:42 STEP 1013 H= 253:15 +CPU= 38.615
18:32:22 STEP 1014 H= 253:30 +CPU= 35.831
18:33:03 STEP 1015 H= 253:45 +CPU= 37.372
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:35:48 STEP 1016 H= 254:00 +CPU= 36.243
18:36:29 STEP 1017 H= 254:15 +CPU= 36.624
18:37:11 STEP 1018 H= 254:30 +CPU= 37.463
18:37:51 STEP 1019 H= 254:45 +CPU= 36.163
18:38:42 STEP 1020 H= 255:00 +CPU= 45.524
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+001020
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:49:38 STEP 1021 H= 255:15 +CPU= 36.715
18:50:16 STEP 1022 H= 255:30 +CPU= 35.352
18:50:58 STEP 1023 H= 255:45 +CPU= 39.915
18:51:41 STEP 1024 H= 256:00 +CPU= 39.696
18:52:26 STEP 1025 H= 256:15 +CPU= 40.966
18:53:01 STEP 1026 H= 256:30 +CPU= 32.735
18:53:39 STEP 1027 H= 256:45 +CPU= 35.465
18:54:23 STEP 1028 H= 257:00 +CPU= 40.027
18:55:05 STEP 1029 H= 257:15 +CPU= 39.642
18:55:46 STEP 1030 H= 257:30 +CPU= 38.274
18:56:29 STEP 1031 H= 257:45 +CPU= 40.916
18:57:21 STEP 1032 H= 258:00 +CPU= 46.655
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+001032
18:58:00 STEP 1033 H= 258:15 +CPU= 36.311
18:58:39 STEP 1034 H= 258:30 +CPU= 35.340
18:59:19 STEP 1035 H= 258:45 +CPU= 37.572
18:59:59 STEP 1036 H= 259:00 +CPU= 38.132
19:00:40 STEP 1037 H= 259:15 +CPU= 38.370
19:01:25 STEP 1038 H= 259:30 +CPU= 40.215
19:02:02 STEP 1039 H= 259:45 +CPU= 34.270
19:02:41 STEP 1040 H= 260:00 +CPU= 35.867
19:03:19 STEP 1041 H= 260:15 +CPU= 35.656
19:03:53 STEP 1042 H= 260:30 +CPU= 31.144
19:04:33 STEP 1043 H= 260:45 +CPU= 37.017
19:05:20 STEP 1044 H= 261:00 +CPU= 44.653
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+001044
19:05:56 STEP 1045 H= 261:15 +CPU= 34.206
19:06:27 STEP 1046 H= 261:30 +CPU= 29.141
19:07:02 STEP 1047 H= 261:45 +CPU= 33.083
19:07:38 STEP 1048 H= 262:00 +CPU= 33.592
19:08:16 STEP 1049 H= 262:15 +CPU= 35.264
19:08:48 STEP 1050 H= 262:30 +CPU= 30.218
19:09:23 STEP 1051 H= 262:45 +CPU= 33.196
19:10:00 STEP 1052 H= 263:00 +CPU= 35.980
19:10:34 STEP 1053 H= 263:15 +CPU= 31.755
19:11:03 STEP 1054 H= 263:30 +CPU= 27.384
19:11:42 STEP 1055 H= 263:45 +CPU= 36.442
19:12:25 STEP 1056 H= 264:00 +CPU= 40.890
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/19/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12166406/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00c_2016092300_15_949_12166406_0_r224990618_10.zip
Uploading the intermediate file: upload_file_10.zip
19:12:57 STEP 1057 H= 264:15 +CPU= 30.295
19:13:27 STEP 1058 H= 264:30 +CPU= 28.567
19:14:00 STEP 1059 H= 264:45 +CPU= 30.742
19:14:29 STEP 1060 H= 265:00 +CPU= 27.123
19:14:53 STEP 1061 H= 265:15 +CPU= 23.192
19:15:19 STEP 1062 H= 265:30 +CPU= 23.436
Abort request received from BOINC client, ending the child process
</stderr_txt>
]]>
