Task 13597356

Name	hadcm3n_ya69_1980_40_007534681_3
Workunit	7731913
Created	5 Nov 2011, 5:59:38 UTC
Sent	5 Nov 2011, 7:30:36 UTC
Report deadline	4 Feb 2012, 14:57:47 UTC
Received	3 Jan 2012, 17:52:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1027655
Run time	12 days 23 hours 52 min 18 sec
CPU time	10 days 20 hours 0 min 40 sec
Validate state	Invalid
Credit	5,909.76
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(1971,0xa07d4540) malloc: * error for object 0x102d804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1971,0xa07d4540) malloc: * error for object 0x102d800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1971,0xa07d4540) malloc: * error for object 0x102d800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(200,0xa07d4540) malloc: * error for object 0x1800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(200,0xa07d4540) malloc: * error for object 0x1801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(200,0xa07d4540) malloc: * error for object 0x1801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(200,0xa07d4540) malloc: * error for object 0x1801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(200,0xa07d4540) malloc: * error for object 0x1801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(200,0xa07d4540) malloc: * error for object 0x1801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(200,0xa07d4540) malloc: * error for object 0x1801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(200,0xa07d4540) malloc: * error for object 0x1801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(200,0xa07d4540) malloc: * error for object 0x1801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(200,0xa07d4540) malloc: * error for object 0x1801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(8428,0xa07d4540) malloc: * error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8428,0xa07d4540) malloc: * error for object 0x1001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8428,0xa07d4540) malloc: * error for object 0x1001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8428,0xa07d4540) malloc: * error for object 0x1001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8428,0xa07d4540) malloc: * error for object 0x1001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8428,0xa07d4540) malloc: * error for object 0x1001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8428,0xa07d4540) malloc: * error for object 0x1001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8428,0xa07d4540) malloc: * error for object 0x1001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8428,0xa07d4540) malloc: * error for object 0x1001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8428,0xa07d4540) malloc: * error for object 0x1001c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8428,0xa07d4540) malloc: * error for object 0x1001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug 00:48:00 (8428): No heartbeat from core client for 30 sec - exiting 00:48:01 (8428): No heartbeat from core client for 30 sec - exiting 00:48:02 (8428): No heartbeat from core client for 30 sec - exiting 00:48:03 (8428): No heartbeat from core client for 30 sec - exiting 00:48:04 (8428): No heartbeat from core client for 30 sec - exiting 00:48:05 (8428): No heartbeat from core client for 30 sec - exiting 00:48:06 (8428): No heartbeat from core client for 30 sec - exiting 00:48:07 (8428): No heartbeat from core client for 30 sec - exiting 00:48:08 (8428): No heartbeat from core client for 30 sec - exiting 00:48:09 (8428): No heartbeat from core client for 30 sec - exiting 00:48:10 (8428): No heartbeat from core client for 30 sec - exiting 00:48:11 (8428): No heartbeat from core client for 30 sec - exiting 00:48:12 (8428): No heartbeat from core client for 30 sec - exiting 00:48:13 (8428): No heartbeat from core client for 30 sec - exiting 00:48:14 (8428): No heartbeat from core client for 30 sec - exiting 00:48:15 (8428): No heartbeat from core client for 30 sec - exiting 00:48:16 (8428): No heartbeat from core client for 30 sec - exiting 00:48:17 (8428): No heartbeat from core client for 30 sec - exiting 00:48:18 (8428): No heartbeat from core client for 30 sec - exiting 00:48:19 (8428): No heartbeat from core client for 30 sec - exiting 00:48:20 (8428): No heartbeat from core client for 30 sec - exiting 00:48:21 (8428): No heartbeat from core client for 30 sec - exiting 00:48:22 (8428): No heartbeat from core client for 30 sec - exiting 00:48:23 (8428): No heartbeat from core client for 30 sec - exiting 00:48:24 (8428): No heartbeat from core client for 30 sec - exiting 00:48:25 (8428): No heartbeat from core client for 30 sec - exiting 00:48:26 (8428): No heartbeat from core client for 30 sec - exiting 00:48:27 (8428): No heartbeat from core client for 30 sec - exiting 00:48:28 (8428): No heartbeat from core client for 30 sec - exiting 00:48:30 (8428): No heartbeat from core client for 30 sec - exiting 00:48:31 (8428): No heartbeat from core client for 30 sec - exiting 00:48:32 (8428): No heartbeat from core client for 30 sec - exiting 00:48:33 (8428): No heartbeat from core client for 30 sec - exiting 00:48:34 (8428): No heartbeat from core client for 30 sec - exiting 00:48:35 (8428): No heartbeat from core client for 30 sec - exiting 00:48:36 (8428): No heartbeat from core client for 30 sec - exiting 00:48:37 (8428): No heartbeat from core client for 30 sec - exiting 00:48:38 (8428): No heartbeat from core client for 30 sec - exiting 00:48:39 (8428): No heartbeat from core client for 30 sec - exiting 00:48:40 (8428): No heartbeat from core client for 30 sec - exiting 00:48:41 (8428): No heartbeat from core client for 30 sec - exiting 00:48:42 (8428): No heartbeat from core client for 30 sec - exiting 00:48:43 (8428): No heartbeat from core client for 30 sec - exiting 00:48:44 (8428): No heartbeat from core client for 30 sec - exiting 00:48:45 (8428): No heartbeat from core client for 30 sec - exiting 00:48:46 (8428): No heartbeat from core client for 30 sec - exiting 00:48:47 (8428): No heartbeat from core client for 30 sec - exiting 00:48:48 (8428): No heartbeat from core client for 30 sec - exiting 00:48:49 (8428): No heartbeat from core client for 30 sec - exiting 00:48:50 (8428): No heartbeat from core client for 30 sec - exiting 00:48:51 (8428): No heartbeat from core client for 30 sec - exiting 00:48:52 (8428): No heartbeat from core client for 30 sec - exiting 00:48:53 (8428): No heartbeat from core client for 30 sec - exiting 00:48:54 (8428): No heartbeat from core client for 30 sec - exiting 00:48:55 (8428): No heartbeat from core client for 30 sec - exiting 00:48:56 (8428): No heartbeat from core client for 30 sec - exiting 00:48:57 (8428): No heartbeat from core client for 30 sec - exiting 00:48:58 (8428): No heartbeat from core client for 30 sec - exiting 00:48:59 (8428): No heartbeat from core client for 30 sec - exiting 00:49:00 (8428): No heartbeat from core client for 30 sec - exiting 00:49:01 (8428): No heartbeat from core client for 30 sec - exiting 00:49:02 (8428): No heartbeat from core client for 30 sec - exiting 00:49:03 (8428): No heartbeat from core client for 30 sec - exiting 00:49:04 (8428): No heartbeat from core client for 30 sec - exiting 00:49:05 (8428): No heartbeat from core client for 30 sec - exiting 00:49:06 (8428): No heartbeat from core client for 30 sec - exiting 00:49:07 (8428): No heartbeat from core client for 30 sec - exiting 00:49:08 (8428): No heartbeat from core client for 30 sec - exiting 00:49:10 (8428): No heartbeat from core client for 30 sec - exiting 00:49:11 (8428): No heartbeat from core client for 30 sec - exiting 00:49:12 (8428): No heartbeat from core client for 30 sec - exiting 00:49:13 (8428): No heartbeat from core client for 30 sec - exiting 00:49:14 (8428): No heartbeat from core client for 30 sec - exiting 00:49:15 (8428): No heartbeat from core client for 30 sec - exiting 00:49:16 (8428): No heartbeat from core client for 30 sec - exiting 00:49:17 (8428): No heartbeat from core client for 30 sec - exiting 00:49:18 (8428): No heartbeat from core client for 30 sec - exiting 00:49:19 (8428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Dec 2011 19:32:48	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	492,480	927,274	1.8829
30 Dec 2011 13:37:29	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	466,560	878,546	1.8830
28 Dec 2011 02:18:26	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	440,640	829,959	1.8835
27 Dec 2011 11:38:11	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	414,720	781,166	1.8836
26 Dec 2011 20:44:06	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	388,800	732,168	1.8831
26 Dec 2011 05:49:35	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	362,880	683,188	1.8827
25 Dec 2011 14:35:05	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	336,960	634,175	1.8820
23 Dec 2011 16:12:49	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	311,040	585,126	1.8812
22 Dec 2011 19:51:50	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	285,120	536,546	1.8818
28 Nov 2011 10:31:07	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	259,200	487,643	1.8813
27 Nov 2011 06:09:53	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	233,280	438,352	1.8791
26 Nov 2011 01:37:47	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	207,360	389,423	1.8780
25 Nov 2011 10:51:29	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	181,440	340,651	1.8775
24 Nov 2011 19:51:14	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	155,520	291,823	1.8764
24 Nov 2011 03:40:16	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	129,600	242,750	1.8731
20 Nov 2011 04:36:55	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	103,680	193,912	1.8703
08 Nov 2011 00:18:11	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	77,760	145,558	1.8719
07 Nov 2011 07:38:24	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	51,840	96,999	1.8711
06 Nov 2011 01:40:20	1027655	13597356	hadcm3n_ya69_1980_40_007534681_3	25,920	48,570	1.8738