Task 21766313

Name	hadcm3s_gf52_190012_240_844_011910798_1
Workunit	11910798
Created	18 Oct 2019, 3:20:25 UTC
Sent	18 Oct 2019, 3:44:28 UTC
Report deadline	29 Sep 2020, 9:04:28 UTC
Received	26 Nov 2019, 14:09:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1452642
Run time	7 days 15 hours 21 min 7 sec
CPU time	6 days 11 hours 52 min 7 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	3.43 GFLOPS
Application version	UK Met Office HadCM3 short v8.36 i686-pc-linux-gnu
Peak working set size	165.70 MB
Peak swap size	214.84 MB
Peak disk usage	99.16 MB
Stderr	<core_client_version>7.9.3</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234)</message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... MainError: 01:12:06 PM No files match the supplied pattern. MainError: 01:12:06 PM No files match the supplied pattern. MainError: 07:43:23 AM No files match the supplied pattern. MainError: 07:43:23 AM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 12:44:42 AM No files match the supplied pattern. MainError: 12:44:42 AM No files match the supplied pattern. MainError: 07:56:04 PM No files match the supplied pattern. MainError: 07:56:04 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 03:10:56 PM No files match the supplied pattern. MainError: 03:10:56 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 03:14:50 AM No files match the supplied pattern. MainError: 03:14:50 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 03:05:19 AM No files match the supplied pattern. MainError: 03:05:19 AM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 02:52:50 PM No files match the supplied pattern. MainError: 02:52:51 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 02:11:03 PM No files match the supplied pattern. MainError: 02:11:03 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f75070] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f75059] /lib/i386-linux-gnu/libc.so.6(gsignal+0xc2)[0xf7c79832] /lib/i386-linux-gnu/libc.so.6(abort+0x121)[0xf7c7acc1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842eda2] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848b8f1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7c64e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32495, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4e070] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f4e059] /lib/i386-linux-gnu/libc.so.6(gsignal+0xc2)[0xf7c52832] /lib/i386-linux-gnu/libc.so.6(abort+0x121)[0xf7c53cc1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842eda2] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848b8f1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7c3de81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32495, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f49070] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f49059] /lib/i386-linux-gnu/libc.so.6(gsignal+0xc2)[0xf7c4d832] /lib/i386-linux-gnu/libc.so.6(abort+0x121)[0xf7c4ecc1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842eda2] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848b8f1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7c38e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32495, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb5070] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fb5059] /lib/i386-linux-gnu/libc.so.6(gsignal+0xc2)[0xf7cb9832] /lib/i386-linux-gnu/libc.so.6(abort+0x121)[0xf7cbacc1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842eda2] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848b8f1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7ca4e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32495, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ee3070] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ee3059] /lib/i386-linux-gnu/libc.so.6(gsignal+0xc2)[0xf7be7832] /lib/i386-linux-gnu/libc.so.6(abort+0x121)[0xf7be8cc1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842eda2] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848b8f1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7bd2e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32495, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x84ff4f7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f02070] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f02059] /lib/i386-linux-gnu/libc.so.6(gsignal+0xc2)[0xf7c06832] /lib/i386-linux-gnu/libc.so.6(abort+0x121)[0xf7c07cc1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x842eda2] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x848b8f1] /var/lib/boinc-client/projects/climateprediction.net/hadcm3s_um_8.36_i686-pc-linux-gnu[0x8496bad] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7bf1e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32495, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 09:06:58 (32495): called boinc_finish(22) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Nov 2019 14:13:48	1452642	21766313	hadcm3s_gf52_190012_240_844_011910798_1	233,280	521,647	2.2361
24 Nov 2019 14:56:36	1452642	21766313	hadcm3s_gf52_190012_240_844_011910798_1	207,360	474,822	2.2898
23 Nov 2019 03:11:31	1452642	21766313	hadcm3s_gf52_190012_240_844_011910798_1	181,440	430,356	2.3719
22 Nov 2019 03:20:07	1452642	21766313	hadcm3s_gf52_190012_240_844_011910798_1	155,520	381,271	2.4516
09 Nov 2019 15:16:11	1452642	21766313	hadcm3s_gf52_190012_240_844_011910798_1	129,600	331,300	2.5563
05 Nov 2019 19:56:37	1452642	21766313	hadcm3s_gf52_190012_240_844_011910798_1	103,680	263,798	2.5443
05 Nov 2019 00:46:14	1452642	21766313	hadcm3s_gf52_190012_240_844_011910798_1	77,760	195,329	2.5119
21 Oct 2019 07:43:47	1452642	21766313	hadcm3s_gf52_190012_240_844_011910798_1	51,840	129,708	2.5021
20 Oct 2019 13:33:22	1452642	21766313	hadcm3s_gf52_190012_240_844_011910798_1	25,920	63,733	2.4588