Task 13662141

Name	hadcm3n_ylow_1980_40_007538728_4
Workunit	7735960
Created	26 Nov 2011, 0:01:29 UTC
Sent	26 Nov 2011, 0:02:43 UTC
Report deadline	25 Feb 2012, 7:29:54 UTC
Received	18 Dec 2011, 14:11:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1069747
Run time	7 days 17 hours 48 min 7 sec
CPU time	6 days 9 hours 59 min 43 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.61 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:00:49 (2963): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:19 (6415): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:03:11 (6458): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:05:18 (6496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:06:41 (6537): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:08:41 (6685): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:10:28 (6731): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:13:04 (6773): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:02 (6934): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08e0beb8 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6eb72)[0xf74e0b72] /lib32/libc.so.6(+0x6f812)[0xf74e1812] /lib32/libc.so.6(cfree+0x6d)[0xf74e48cd] /usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76e1baf] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf76e1c0b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf748b0f3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:01 31982847 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:01 31982847 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 08db6000-08e1c000 rw-p 00000000 00:00 0 [heap] f6e00000-f6e21000 rw-p 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6ff4000-f746f000 rw-s 00000000 08:01 37355769 /var/lib/boinc-client/slots/9/141780 f746f000-f7472000 rw-p 00000000 00:00 0 f7472000-f75e5000 r-xp 00000000 08:01 36438070 /lib32/libc-2.13.so f75e5000-f75e6000 ---p 00173000 08:01 36438070 /lib32/libc-2.13.so f75e6000-f75e8000 r--p 00173000 08:01 36438070 /lib32/libc-2.13.so f75e8000-f75e9000 rw-p 00175000 08:01 36438070 /lib32/libc-2.13.so f75e9000-f75ec000 rw-p 00000000 00:00 0 f75ec000-f7608000 r-xp 00000000 08:01 32637075 /usr/lib32/libgcc_s.so.1 f7608000-f7609000 r--p 0001b000 08:01 32637075 /usr/lib32/libgcc_s.so.1 f7609000-f760a000 rw-p 0001c000 08:01 32637075 /usr/lib32/libgcc_s.so.1 f760a000-f7632000 r-xp 00000000 08:01 36438082 /lib32/libm-2.13.so f7632000-f7633000 r--p 00028000 08:01 36438082 /lib32/libm-2.13.so f7633000-f7634000 rw-p 00029000 08:01 36438082 /lib32/libm-2.13.so f7634000-f7712000 r-xp 00000000 08:01 32637054 /usr/lib32/libstdc++.so.6.0.16 f7712000-f7713000 ---p 000de000 08:01 32637054 /usr/lib32/libstdc++.so.6.0.16 f7713000-f7717000 r--p 000de000 08:01 32637054 /usr/lib32/libstdc++.so.6.0.16 f7717000-f7718000 rw-p 000e2000 08:01 32637054 /usr/lib32/libstdc++.so.6.0.16 f7718000-f7720000 rw-p 00000000 00:00 0 f7720000-f7723000 r-xp 00000000 08:01 36438071 /lib32/libdl-2.13.so f7723000-f7724000 r--p 00002000 08:01 36438071 /lib32/libdl-2.13.so f7724000-f7725000 rw-p 00003000 08:01 36438071 /lib32/libdl-2.13.so f7725000-f773c000 r-xp 00000000 08:01 36438078 /lib32/libpthread-2.13.so f773c000-f773d000 r--p 00016000 08:01 36438078 /lib32/libpthread-2.13.so f773d000-f773e000 rw-p 00017000 08:01 36438078 /lib32/libpthread-2.13.so f773e000-f7740000 rw-p 00000000 00:00 0 f7767000-f7768000 rw-p 00000000 00:00 0 f7768000-f7769000 ---p 00000000 00:00 0 f7769000-f776c000 rw-p 00000000 00:00 0 f776c000-f776e000 rw-s 00000000 08:01 37355678 /var/lib/boinc-client/slots/9/boinc_mmap_file f776e000-f7770000 rw-p 00000000 00:00 0 f7770000-f7771000 r-xp 00000000 00:00 0 [vdso] f7771000-f778f000 r-xp 00000000 08:01 47448171 /lib/i386-linux-gnu/ld-2.13.so f778f000-f7790000 r--p 0001d000 08:01 47448171 /lib/i386-linux-gnu/ld-2.13.so f7790000-f7791000 rw-p 0001e000 08:01 47448171 /lib/i386-linux-gnu/ld-2.13.so ff929000-ff999000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf7770400] [0xf7770430] /lib32/libc.so.6(gsignal+0x4f)[0xf749fc4f] /lib32/libc.so.6(abort+0x175)[0xf74a3175] /lib32/libc.so.6(+0x63e8c)[0xf74d5e8c] /lib32/libc.so.6(+0x6eb72)[0xf74e0b72] /lib32/libc.so.6(+0x6f812)[0xf74e1812] /lib32/libc.so.6(cfree+0x6d)[0xf74e48cd] /usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76e1baf] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf76e1c0b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf748b0f3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Dec 2011 14:13:37	1069747	13662141	hadcm3n_ylow_1980_40_007538728_4	259,200	554,376	2.1388
16 Dec 2011 13:08:00	1069747	13662141	hadcm3n_ylow_1980_40_007538728_4	233,280	499,940	2.1431
14 Dec 2011 18:32:33	1069747	13662141	hadcm3n_ylow_1980_40_007538728_4	207,360	444,044	2.1414
13 Dec 2011 12:17:28	1069747	13662141	hadcm3n_ylow_1980_40_007538728_4	181,440	389,052	2.1442
11 Dec 2011 18:19:59	1069747	13662141	hadcm3n_ylow_1980_40_007538728_4	155,520	333,788	2.1463
10 Dec 2011 13:17:04	1069747	13662141	hadcm3n_ylow_1980_40_007538728_4	129,600	277,405	2.1405
07 Dec 2011 21:08:52	1069747	13662141	hadcm3n_ylow_1980_40_007538728_4	103,680	221,182	2.1333
04 Dec 2011 20:07:10	1069747	13662141	hadcm3n_ylow_1980_40_007538728_4	77,760	165,078	2.1229
03 Dec 2011 13:32:20	1069747	13662141	hadcm3n_ylow_1980_40_007538728_4	51,840	110,039	2.1227
30 Nov 2011 16:42:24	1069747	13662141	hadcm3n_ylow_1980_40_007538728_4	25,920	54,328	2.0960