<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
rhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24458:24458] [20230112:011703:1673461023:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24458:24458] [20230112:011703:1673461023:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24458:24458] [20230112:011703:1673461023:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24458:24458] [20230112:011703:1673461023:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24458:24458] [20230112:011703:1673461023:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:17:31 STEP 0 H= 0:00 +CPU= 24.263
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000000
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000000
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000000
01:17:47 STEP 1 H= 1:00 +CPU= 15.592
01:18:01 STEP 2 H= 2:00 +CPU= 13.614
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:18:25 STEP 3 H= 3:00 +CPU= 22.786
01:18:39 STEP 4 H= 4:00 +CPU= 13.383
01:18:52 STEP 5 H= 5:00 +CPU= 13.601
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:19:17 STEP 6 H= 6:00 +CPU= 22.685
01:19:30 STEP 7 H= 7:00 +CPU= 13.132
01:19:44 STEP 8 H= 8:00 +CPU= 13.500
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:20:09 STEP 9 H= 9:00 +CPU= 23.429
01:20:23 STEP 10 H= 10:00 +CPU= 14.058
01:20:36 STEP 11 H= 11:00 +CPU= 12.924
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:21:04 STEP 12 H= 12:00 +CPU= 25.443
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000012
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000012
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000012
01:21:17 STEP 13 H= 13:00 +CPU= 13.620
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:21:34 STEP 14 H= 14:00 +CPU= 14.667
01:21:56 STEP 15 H= 15:00 +CPU= 22.391
01:22:10 STEP 16 H= 16:00 +CPU= 13.741
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:22:26 STEP 17 H= 17:00 +CPU= 13.596
01:22:51 STEP 18 H= 18:00 +CPU= 25.095
01:23:06 STEP 19 H= 19:00 +CPU= 15.171
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:23:22 STEP 20 H= 20:00 +CPU= 14.152
01:23:44 STEP 21 H= 21:00 +CPU= 21.878
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:24:03 STEP 22 H= 22:00 +CPU= 16.436
01:24:17 STEP 23 H= 23:00 +CPU= 13.848
01:24:42 STEP 24 H= 24:00 +CPU= 25.338
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000024
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000024
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000012
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0064_1997050100_123_966_12182708_0_r1218727546_0.zip
Uploading the intermediate file: upload_file_0.zip
01:24:57 STEP 25 H= 25:00 +CPU= 14.943
01:25:10 STEP 26 H= 26:00 +CPU= 13.540
01:25:32 STEP 27 H= 27:00 +CPU= 21.478
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:25:50 STEP 28 H= 28:00 +CPU= 15.991
01:26:03 STEP 29 H= 29:00 +CPU= 13.429
01:26:28 STEP 30 H= 30:00 +CPU= 23.890
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:26:44 STEP 31 H= 31:00 +CPU= 14.424
01:27:00 STEP 32 H= 32:00 +CPU= 16.036
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:27:27 STEP 33 H= 33:00 +CPU= 24.127
01:27:43 STEP 34 H= 34:00 +CPU= 16.260
01:27:58 STEP 35 H= 35:00 +CPU= 14.945
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:28:27 STEP 36 H= 36:00 +CPU= 26.892
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000036
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000036
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000036
01:28:41 STEP 37 H= 37:00 +CPU= 13.842
01:28:56 STEP 38 H= 38:00 +CPU= 15.412
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:29:21 STEP 39 H= 39:00 +CPU= 23.046
01:29:36 STEP 40 H= 40:00 +CPU= 14.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:29:53 STEP 41 H= 41:00 +CPU= 15.326
01:30:17 STEP 42 H= 42:00 +CPU= 23.932
01:30:32 STEP 43 H= 43:00 +CPU= 14.756
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:30:50 STEP 44 H= 44:00 +CPU= 16.237
01:31:16 STEP 45 H= 45:00 +CPU= 25.175
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:31:34 STEP 46 H= 46:00 +CPU= 16.181
01:31:50 STEP 47 H= 47:00 +CPU= 16.457
01:32:19 STEP 48 H= 48:00 +CPU= 28.452
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000048
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000048
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000036
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000036
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000036
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0064_1997050100_123_966_12182708_0_r1218727546_1.zip
Uploading the intermediate file: upload_file_1.zip
01:32:35 STEP 49 H= 49:00 +CPU= 14.349
01:32:51 STEP 50 H= 50:00 +CPU= 15.852
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:33:16 STEP 51 H= 51:00 +CPU= 23.044
01:33:30 STEP 52 H= 52:00 +CPU= 14.006
01:33:44 STEP 53 H= 53:00 +CPU= 14.408
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:34:11 STEP 54 H= 54:00 +CPU= 24.121
01:34:25 STEP 55 H= 55:00 +CPU= 13.907
01:34:40 STEP 56 H= 56:00 +CPU= 14.988
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:35:06 STEP 57 H= 57:00 +CPU= 24.257
01:35:22 STEP 58 H= 58:00 +CPU= 15.936
01:35:37 STEP 59 H= 59:00 +CPU= 15.437
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:36:05 STEP 60 H= 60:00 +CPU= 25.338
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000060
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000060
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000060
01:36:18 STEP 61 H= 61:00 +CPU= 13.777
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:36:35 STEP 62 H= 62:00 +CPU= 14.617
01:36:58 STEP 63 H= 63:00 +CPU= 22.885
01:37:12 STEP 64 H= 64:00 +CPU= 13.851
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:37:29 STEP 65 H= 65:00 +CPU= 15.016
01:37:52 STEP 66 H= 66:00 +CPU= 23.308
01:38:06 STEP 67 H= 67:00 +CPU= 14.257
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:38:24 STEP 68 H= 68:00 +CPU= 15.582
01:38:48 STEP 69 H= 69:00 +CPU= 23.902
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:39:06 STEP 70 H= 70:00 +CPU= 16.434
01:39:22 STEP 71 H= 71:00 +CPU= 15.322
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:39:52 STEP 72 H= 72:00 +CPU= 27.985
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000072
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000072
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000072
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000060
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000060
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000060
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0064_1997050100_123_966_12182708_0_r1218727546_2.zip
Uploading the intermediate file: upload_file_2.zip
01:40:06 STEP 73 H= 73:00 +CPU= 13.453
01:40:20 STEP 74 H= 74:00 +CPU= 14.191
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:40:44 STEP 75 H= 75:00 +CPU= 22.468
01:40:59 STEP 76 H= 76:00 +CPU= 14.251
01:41:13 STEP 77 H= 77:00 +CPU= 14.253
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:41:40 STEP 78 H= 78:00 +CPU= 25.172
01:41:55 STEP 79 H= 79:00 +CPU= 14.657
01:42:09 STEP 80 H= 80:00 +CPU= 13.695
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:42:34 STEP 81 H= 81:00 +CPU= 23.326
01:42:50 STEP 82 H= 82:00 +CPU= 16.013
01:43:04 STEP 83 H= 83:00 +CPU= 13.788
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:43:31 STEP 84 H= 84:00 +CPU= 25.601
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000084
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000084
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000084
01:43:45 STEP 85 H= 85:00 +CPU= 13.742
01:44:00 STEP 86 H= 86:00 +CPU= 15.002
01:44:22 STEP 87 H= 87:00 +CPU= 22.322
01:44:37 STEP 88 H= 88:00 +CPU= 14.262
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:44:54 STEP 89 H= 89:00 +CPU= 15.754
01:45:18 STEP 90 H= 90:00 +CPU= 23.457
01:45:33 STEP 91 H= 91:00 +CPU= 14.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:45:51 STEP 92 H= 92:00 +CPU= 16.062
01:46:13 STEP 93 H= 93:00 +CPU= 22.136
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:46:31 STEP 94 H= 94:00 +CPU= 15.359
01:46:48 STEP 95 H= 95:00 +CPU= 17.104
01:47:14 STEP 96 H= 96:00 +CPU= 26.268
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000096
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000096
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000096
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000072
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000072
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000072
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000084
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000084
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000084
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0064_1997050100_123_966_12182708_0_r1218727546_3.zip
Uploading the intermediate file: upload_file_3.zip
01:47:32 STEP 97 H= 97:00 +CPU= 15.619
01:47:46 STEP 98 H= 98:00 +CPU= 14.047
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:48:10 STEP 99 H= 99:00 +CPU= 22.535
01:48:26 STEP 100 H= 100:00 +CPU= 15.787
01:48:40 STEP 101 H= 101:00 +CPU= 13.737
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:49:05 STEP 102 H= 102:00 +CPU= 23.451
01:49:20 STEP 103 H= 103:00 +CPU= 14.200
01:49:34 STEP 104 H= 104:00 +CPU= 14.020
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:50:00 STEP 105 H= 105:00 +CPU= 24.098
01:50:14 STEP 106 H= 106:00 +CPU= 14.446
01:50:29 STEP 107 H= 107:00 +CPU= 14.345
01:50:55 STEP 108 H= 108:00 +CPU= 26.206
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000108
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000108
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000108
01:51:08 STEP 109 H= 109:00 +CPU= 13.496
01:51:22 STEP 110 H= 110:00 +CPU= 13.889
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:51:47 STEP 111 H= 111:00 +CPU= 22.567
01:52:01 STEP 112 H= 112:00 +CPU= 13.814
01:52:16 STEP 113 H= 113:00 +CPU= 14.917
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:52:45 STEP 114 H= 114:00 +CPU= 26.840
01:53:01 STEP 115 H= 115:00 +CPU= 16.905
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:53:20 STEP 116 H= 116:00 +CPU= 16.748
01:53:42 STEP 117 H= 117:00 +CPU= 21.849
01:53:56 STEP 118 H= 118:00 +CPU= 14.016
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:54:13 STEP 119 H= 119:00 +CPU= 14.462
01:54:41 STEP 120 H= 120:00 +CPU= 28.441
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000120
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000120
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000120
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000096
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000096
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000096
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000108
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000108
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000108
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0064_1997050100_123_966_12182708_0_r1218727546_4.zip
Uploading the intermediate file: upload_file_4.zip
01:54:57 STEP 121 H= 121:00 +CPU= 15.522
01:55:11 STEP 122 H= 122:00 +CPU= 14.858
01:55:35 STEP 123 H= 123:00 +CPU= 23.437
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:55:52 STEP 124 H= 124:00 +CPU= 15.670
01:56:06 STEP 125 H= 125:00 +CPU= 13.375
01:56:29 STEP 126 H= 126:00 +CPU= 23.027
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:56:45 STEP 127 H= 127:00 +CPU= 13.768
01:56:59 STEP 128 H= 128:00 +CPU= 14.418
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:57:26 STEP 129 H= 129:00 +CPU= 24.539
01:57:40 STEP 130 H= 130:00 +CPU= 13.814
01:57:53 STEP 131 H= 131:00 +CPU= 13.724
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:58:22 STEP 132 H= 132:00 +CPU= 27.057
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000132
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000132
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000132
01:58:37 STEP 133 H= 133:00 +CPU= 14.474
01:58:52 STEP 134 H= 134:00 +CPU= 14.679
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
01:59:17 STEP 135 H= 135:00 +CPU= 22.892
01:59:31 STEP 136 H= 136:00 +CPU= 14.327
01:59:44 STEP 137 H= 137:00 +CPU= 13.438
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:00:11 STEP 138 H= 138:00 +CPU= 24.729
02:00:25 STEP 139 H= 139:00 +CPU= 14.092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:00:41 STEP 140 H= 140:00 +CPU= 13.796
02:01:04 STEP 141 H= 141:00 +CPU= 23.217
02:01:18 STEP 142 H= 142:00 +CPU= 14.104
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:01:35 STEP 143 H= 143:00 +CPU= 14.493
02:02:01 STEP 144 H= 144:00 +CPU= 26.154
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000144
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000144
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000144
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000120
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000120
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000120
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000132
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000132
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000132
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0064_1997050100_123_966_12182708_0_r1218727546_5.zip
Uploading the intermediate file: upload_file_5.zip
02:02:15 STEP 145 H= 145:00 +CPU= 13.373
02:02:29 STEP 146 H= 146:00 +CPU= 14.153
02:02:52 STEP 147 H= 147:00 +CPU= 22.982
02:03:06 STEP 148 H= 148:00 +CPU= 14.518
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:03:23 STEP 149 H= 149:00 +CPU= 14.991
02:03:47 STEP 150 H= 150:00 +CPU= 23.504
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:04:04 STEP 151 H= 151:00 +CPU= 15.237
02:04:18 STEP 152 H= 152:00 +CPU= 13.871
02:04:40 STEP 153 H= 153:00 +CPU= 22.388
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:05:00 STEP 154 H= 154:00 +CPU= 17.074
02:05:14 STEP 155 H= 155:00 +CPU= 14.952
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:05:45 STEP 156 H= 156:00 +CPU= 28.040
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000156
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000156
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000156
02:05:59 STEP 157 H= 157:00 +CPU= 14.287
02:06:13 STEP 158 H= 158:00 +CPU= 13.917
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:06:40 STEP 159 H= 159:00 +CPU= 24.864
02:06:56 STEP 160 H= 160:00 +CPU= 16.127
02:07:11 STEP 161 H= 161:00 +CPU= 15.057
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:07:37 STEP 162 H= 162:00 +CPU= 24.288
02:07:52 STEP 163 H= 163:00 +CPU= 14.934
02:08:08 STEP 164 H= 164:00 +CPU= 15.677
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:08:33 STEP 165 H= 165:00 +CPU= 22.849
02:08:48 STEP 166 H= 166:00 +CPU= 15.121
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:09:05 STEP 167 H= 167:00 +CPU= 15.554
02:09:33 STEP 168 H= 168:00 +CPU= 27.713
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000168
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000168
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000168
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000144
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000144
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000144
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000156
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000156
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000156
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0064_1997050100_123_966_12182708_0_r1218727546_6.zip
Uploading the intermediate file: upload_file_6.zip
02:09:48 STEP 169 H= 169:00 +CPU= 14.557
02:10:02 STEP 170 H= 170:00 +CPU= 14.646
02:10:24 STEP 171 H= 171:00 +CPU= 21.563
02:10:37 STEP 172 H= 172:00 +CPU= 13.248
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:10:56 STEP 173 H= 173:00 +CPU= 16.346
02:11:21 STEP 174 H= 174:00 +CPU= 25.112
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:11:37 STEP 175 H= 175:00 +CPU= 14.380
02:11:52 STEP 176 H= 176:00 +CPU= 14.794
02:12:14 STEP 177 H= 177:00 +CPU= 22.331
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:12:32 STEP 178 H= 178:00 +CPU= 15.148
02:12:46 STEP 179 H= 179:00 +CPU= 14.454
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:13:14 STEP 180 H= 180:00 +CPU= 25.924
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000180
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000180
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000180
02:13:28 STEP 181 H= 181:00 +CPU= 13.662
02:13:41 STEP 182 H= 182:00 +CPU= 13.592
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:14:07 STEP 183 H= 183:00 +CPU= 23.325
02:14:21 STEP 184 H= 184:00 +CPU= 14.101
02:14:35 STEP 185 H= 185:00 +CPU= 13.811
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:15:00 STEP 186 H= 186:00 +CPU= 23.543
02:15:13 STEP 187 H= 187:00 +CPU= 13.085
02:15:29 STEP 188 H= 188:00 +CPU= 15.834
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:15:56 STEP 189 H= 189:00 +CPU= 24.265
02:16:11 STEP 190 H= 190:00 +CPU= 14.224
02:16:24 STEP 191 H= 191:00 +CPU= 13.914
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:16:54 STEP 192 H= 192:00 +CPU= 27.544
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000192
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000192
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000192
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000168
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000168
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000168
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000180
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000180
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000180
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0064_1997050100_123_966_12182708_0_r1218727546_7.zip
Uploading the intermediate file: upload_file_7.zip
02:17:07 STEP 193 H= 193:00 +CPU= 13.306
02:17:23 STEP 194 H= 194:00 +CPU= 15.185
02:17:46 STEP 195 H= 195:00 +CPU= 23.323
02:18:01 STEP 196 H= 196:00 +CPU= 15.255
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:18:19 STEP 197 H= 197:00 +CPU= 15.649
02:18:42 STEP 198 H= 198:00 +CPU= 22.740
02:18:55 STEP 199 H= 199:00 +CPU= 13.855
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:19:12 STEP 200 H= 200:00 +CPU= 14.958
02:19:36 STEP 201 H= 201:00 +CPU= 23.533
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:19:53 STEP 202 H= 202:00 +CPU= 14.905
02:20:08 STEP 203 H= 203:00 +CPU= 14.794
02:20:34 STEP 204 H= 204:00 +CPU= 25.059
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000204
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000204
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000204
02:20:52 STEP 205 H= 205:00 +CPU= 16.186
02:21:07 STEP 206 H= 206:00 +CPU= 15.421
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:21:34 STEP 207 H= 207:00 +CPU= 23.759
02:21:49 STEP 208 H= 208:00 +CPU= 15.340
02:22:04 STEP 209 H= 209:00 +CPU= 14.419
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
02:22:30 STEP 210 H= 210:00 +CPU= 24.616
02:22:44 STEP 211 H= 211:00 +CPU= 13.488
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1997050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0064
(argv4) batchid: 966
(argv5) wuid: 12182708
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/24
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/24/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/24/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_df72f18921c8185eca0f51953bc412d4 to: /var/lib/boinc/slots/24/oifs_43r3_ps_0064_1997050100_123_966_12182708.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/24/oifs_43r3_ps_0064_1997050100_123_966_12182708.zip
ic_ancil_file: ic_ancil_12182708
ifsdata_file: ifsdata_12182708
climate_data_file: clim_data_12182708
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_4f0afe2b469804989d8b3f4723b1897a to: /var/lib/boinc/slots/24/ic_ancil_12182708.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/24/ic_ancil_12182708.zip
03:12:17 STEP 212 H= 212:00 +CPU= 31.305
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_12bc9f01ce41a89274e5e41da88e4e43 to: /var/lib/boinc/slots/24/ifsdata/ifsdata_12182708.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/24/ifsdata/ifsdata_12182708.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/24/159l_2/clim_data_12182708.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/24/159l_2/clim_data_12182708.zip
Checking for progress XML file: /var/lib/boinc/slots/24/progress_file_12182708.xml
Opened progress file ok : /var/lib/boinc/slots/24/progress_file_12182708.xml
-- Model is restarting --
Adjusting last_iter, 212, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/24/progress_file_12182708.xml
last_cpu_time: 3794
upload_file_number: 8
last_iter: 191
last_upload: 691200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0064_1997050100_123_966_12182708_0_r1218727546
The child process has been launched with process id: 24729
Executing the command: /var/lib/boinc/slots/24/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:24729:24729] [20230112:031228:1673467948:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
03:15:27 STEP 213 H= 213:00 +CPU= 70.120
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Invalid characters in stoi string: STEPO
Unable to update iter, resetting to last_iter.
ifs_line =
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1997050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0064
(argv4) batchid: 966
(argv5) wuid: 12182708
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/24
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/24/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/24/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
05:14:50 STEP 214 H= 214:00 +CPU=164.016
05:15:01 STEP 192 H= 192:00 +CPU=175.659
05:15:13 STEP 215 H= 215:00 +CPU= 15.715
Copying the namelist files from: ../../projects/climateprediction.net/jf_df72f18921c8185eca0f51953bc412d4 to: /var/lib/boinc/slots/24/oifs_43r3_ps_0064_1997050100_123_966_12182708.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/24/oifs_43r3_ps_0064_1997050100_123_966_12182708.zip
ic_ancil_file: ic_ancil_12182708
ifsdata_file: ifsdata_12182708
climate_data_file: clim_data_12182708
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_4f0afe2b469804989d8b3f4723b1897a to: /var/lib/boinc/slots/24/ic_ancil_12182708.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/24/ic_ancil_12182708.zip
05:48:37 STEP 193 H= 193:00 +CPU=554.576
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_12bc9f01ce41a89274e5e41da88e4e43 to: /var/lib/boinc/slots/24/ifsdata/ifsdata_12182708.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/24/ifsdata/ifsdata_12182708.zip
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1997050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0064
(argv4) batchid: 966
(argv5) wuid: 12182708
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/24
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/24/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/24/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
15:34:11 STEP 216 H= 216:00 +CPU=442.234
15:34:26 STEP 217 H= 217:00 +CPU= 15.493
Copying the namelist files from: ../../projects/climateprediction.net/jf_df72f18921c8185eca0f51953bc412d4 to: /var/lib/boinc/slots/24/oifs_43r3_ps_0064_1997050100_123_966_12182708.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/24/oifs_43r3_ps_0064_1997050100_123_966_12182708.zip
ic_ancil_file: ic_ancil_12182708
ifsdata_file: ifsdata_12182708
climate_data_file: clim_data_12182708
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_4f0afe2b469804989d8b3f4723b1897a to: /var/lib/boinc/slots/24/ic_ancil_12182708.zip
15:34:43 STEP 218 H= 218:00 +CPU= 16.508
Unzipping the IC ancils zip file: /var/lib/boinc/slots/24/ic_ancil_12182708.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_12bc9f01ce41a89274e5e41da88e4e43 to: /var/lib/boinc/slots/24/ifsdata/ifsdata_12182708.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/24/ifsdata/ifsdata_12182708.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/24/159l_2/clim_data_12182708.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/24/159l_2/clim_data_12182708.zip
Checking for progress XML file: /var/lib/boinc/slots/24/progress_file_12182708.xml
Opened progress file ok : /var/lib/boinc/slots/24/progress_file_12182708.xml
-- Model is restarting --
Adjusting last_iter, 192, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/24/progress_file_12182708.xml
last_cpu_time: 3847
upload_file_number: 8
last_iter: 191
last_upload: 691200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0064_1997050100_123_966_12182708_0_r1218727546
The child process has been launched with process id: 25585
Executing the command: /var/lib/boinc/slots/24/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:25585:25585] [20230112:153452:1673512492:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:35:10 STEP 219 H= 219:00 +CPU= 26.180
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Invalid characters in stoi string: STEPO
Unable to update iter, resetting to last_iter.
ifs_line =
Invalid characters in stoi string: STEPO
Unable to update iter, resetting to last_iter.
ifs_line =
Invalid characters in stoi string: STEPO
Unable to update iter, resetting to last_iter.
ifs_line =
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Invalid characters in stoi string: STEPO
Unable to update iter, resetting to last_iter.
ifs_line =
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Invalid characters in stoi string: STEPO
Unable to update iter, resetting to last_iter.
ifs_line =
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1997050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0064
(argv4) batchid: 966
(argv5) wuid: 12182708
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/24
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/24/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/24/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1997050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0064
(argv4) batchid: 966
(argv5) wuid: 12182708
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/24
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/24/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/24/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_df72f18921c8185eca0f51953bc412d4 to: /var/lib/boinc/slots/24/oifs_43r3_ps_0064_1997050100_123_966_12182708.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/24/oifs_43r3_ps_0064_1997050100_123_966_12182708.zip
ic_ancil_file: ic_ancil_12182708
ifsdata_file: ifsdata_12182708
climate_data_file: clim_data_12182708
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_4f0afe2b469804989d8b3f4723b1897a to: /var/lib/boinc/slots/24/ic_ancil_12182708.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/24/ic_ancil_12182708.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_12bc9f01ce41a89274e5e41da88e4e43 to: /var/lib/boinc/slots/24/ifsdata/ifsdata_12182708.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/24/ifsdata/ifsdata_12182708.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/24/159l_2/clim_data_12182708.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/24/159l_2/clim_data_12182708.zip
Checking for progress XML file: /var/lib/boinc/slots/24/progress_file_12182708.xml
Opened progress file ok : /var/lib/boinc/slots/24/progress_file_12182708.xml
-- Model is restarting --
Adjusting last_iter, -999, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/24/progress_file_12182708.xml
last_cpu_time: 3918
upload_file_number: 8
last_iter: -985
last_upload: 691200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0064_1997050100_123_966_12182708_0_r1218727546
The child process has been launched with process id: 25843
Executing the command: /var/lib/boinc/slots/24/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.003] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.004] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.004] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:vm9:1:1:25843:25843] [20230112:173506:1673519706:0.006] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:12:43 STEP 216 H= 216:00 +CPU=132.954
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGhq0f+000216
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHhq0f+000216
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAhq0f+000216
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000192
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000192
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000192
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMGGhq0f+000204
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMSHhq0f+000204
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12182708/ICMUAhq0f+000204
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0064_1997050100_123_966_12182708_0_r1218727546_8.zip
Uploading the intermediate file: upload_file_8.zip
18:12:58 STEP 217 H= 217:00 +CPU= 14.573
18:13:13 STEP 218 H= 218:00 +CPU= 14.461
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:13:40 STEP 219 H= 219:00 +CPU= 25.188
18:13:54 STEP 220 H= 220:00 +CPU= 13.931
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
18:14:36 STEP 221 H= 221:00 +CPU= 16.757
18:15:00 STEP 222 H= 222:00 +CPU= 23.680
18:15:14 STEP 223 H= 223:00 +CPU= 14.420
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
The child process terminated with status: 0
..Failed, model did not complete successfully
</stderr_txt>
]]>
