Task 13735343

Name	hadcm3n_yn0f_1980_40_007608199_0
Workunit	7786329
Created	6 Dec 2011, 5:38:32 UTC
Sent	6 Dec 2011, 5:51:55 UTC
Report deadline	6 Mar 2012, 13:19:06 UTC
Received	23 Dec 2011, 9:00:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1117964
Run time	14 days 4 hours 48 min 52 sec
CPU time	12 days 15 hours 5 min 59 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.06 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 09:54:17 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:10:57 (7628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:36:57 (7624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:41:16 (4404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6428, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:00:42 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:18 (8808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:06:52 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:06:53 (3140): No heartbeat from core client for 30 sec - exiting 22:06:54 (3140): No heartbeat from core client for 30 sec - exiting 22:06:55 (3140): No heartbeat from core client for 30 sec - exiting 22:06:56 (3140): No heartbeat from core client for 30 sec - exiting 22:06:57 (3140): No heartbeat from core client for 30 sec - exiting 22:06:58 (3140): No heartbeat from core client for 30 sec - exiting 22:07:00 (3140): No heartbeat from core client for 30 sec - exiting 22:07:01 (3140): No heartbeat from core client for 30 sec - exiting 22:07:02 (3140): No heartbeat from core client for 30 sec - exiting 22:07:03 (3140): No heartbeat from core client for 30 sec - exiting 22:08:18 (8904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:10:15 (7508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:11:10 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:05 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:18:34 (8280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:57:41 (944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:12:43 (7364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:42 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:43 (6068): No heartbeat from core client for 30 sec - exiting 17:16:44 (6068): No heartbeat from core client for 30 sec - exiting 17:16:45 (6068): No heartbeat from core client for 30 sec - exiting 17:16:46 (6068): No heartbeat from core client for 30 sec - exiting 17:16:47 (6068): No heartbeat from core client for 30 sec - exiting 17:16:48 (6068): No heartbeat from core client for 30 sec - exiting 17:16:50 (6068): No heartbeat from core client for 30 sec - exiting 17:16:51 (6068): No heartbeat from core client for 30 sec - exiting 17:16:52 (6068): No heartbeat from core client for 30 sec - exiting 17:16:53 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:06:19 (8356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:18 (3084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:19 (3084): No heartbeat from core client for 30 sec - exiting 09:14:20 (3084): No heartbeat from core client for 30 sec - exiting 09:14:21 (3084): No heartbeat from core client for 30 sec - exiting 09:14:22 (3084): No heartbeat from core client for 30 sec - exiting 09:14:23 (3084): No heartbeat from core client for 30 sec - exiting 09:14:24 (3084): No heartbeat from core client for 30 sec - exiting 09:14:25 (3084): No heartbeat from core client for 30 sec - exiting 09:14:26 (3084): No heartbeat from core client for 30 sec - exiting 09:14:28 (3084): No heartbeat from core client for 30 sec - exiting 09:14:29 (3084): No heartbeat from core client for 30 sec - exiting 09:33:39 (7932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:36:46 (6356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:39:45 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:09 (2812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:10 (2812): No heartbeat from core client for 30 sec - exiting 10:51:11 (2812): No heartbeat from core client for 30 sec - exiting 10:51:12 (2812): No heartbeat from core client for 30 sec - exiting 10:51:13 (2812): No heartbeat from core client for 30 sec - exiting 10:51:14 (2812): No heartbeat from core client for 30 sec - exiting 10:51:15 (2812): No heartbeat from core client for 30 sec - exiting 10:51:16 (2812): No heartbeat from core client for 30 sec - exiting 10:51:17 (2812): No heartbeat from core client for 30 sec - exiting 10:51:18 (2812): No heartbeat from core client for 30 sec - exiting 10:51:20 (2812): No heartbeat from core client for 30 sec - exiting 10:58:03 (6564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:58:04 (6564): No heartbeat from core client for 30 sec - exiting 10:58:05 (6564): No heartbeat from core client for 30 sec - exiting 10:58:07 (6564): No heartbeat from core client for 30 sec - exiting 10:58:08 (6564): No heartbeat from core client for 30 sec - exiting 10:58:09 (6564): No heartbeat from core client for 30 sec - exiting 10:58:10 (6564): No heartbeat from core client for 30 sec - exiting 10:58:11 (6564): No heartbeat from core client for 30 sec - exiting 10:58:12 (6564): No heartbeat from core client for 30 sec - exiting 10:58:13 (6564): No heartbeat from core client for 30 sec - exiting 10:58:14 (6564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:07:33 (8040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:35 (8040): No heartbeat from core client for 30 sec - exiting 19:07:36 (8040): No heartbeat from core client for 30 sec - exiting 19:07:37 (8040): No heartbeat from core client for 30 sec - exiting 19:07:38 (8040): No heartbeat from core client for 30 sec - exiting 19:07:39 (8040): No heartbeat from core client for 30 sec - exiting 19:07:40 (8040): No heartbeat from core client for 30 sec - exiting 19:07:41 (8040): No heartbeat from core client for 30 sec - exiting 19:07:42 (8040): No heartbeat from core client for 30 sec - exiting 19:07:43 (8040): No heartbeat from core client for 30 sec - exiting 19:07:44 (8040): No heartbeat from core client for 30 sec - exiting 19:20:36 (7344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:58:30 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:04:15 (6392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:04:16 (6392): No heartbeat from core client for 30 sec - exiting 09:04:17 (6392): No heartbeat from core client for 30 sec - exiting 09:04:18 (6392): No heartbeat from core client for 30 sec - exiting 09:04:19 (6392): No heartbeat from core client for 30 sec - exiting 09:04:21 (6392): No heartbeat from core client for 30 sec - exiting 09:04:29 (6392): No heartbeat from core client for 30 sec - exiting 09:04:30 (6392): No heartbeat from core client for 30 sec - exiting 09:05:01 (6392): No heartbeat from core client for 30 sec - exiting 09:19:24 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:29:24 (6228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:36 (3136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:23:31 (5584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:17 (5508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:39:33 (4552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:10:17 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:43:42 (8188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:29:48 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:52:11 (6808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:18:40 (2268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:18:42 (2268): No heartbeat from core client for 30 sec - exiting 22:18:43 (2268): No heartbeat from core client for 30 sec - exiting 22:18:44 (2268): No heartbeat from core client for 30 sec - exiting 22:18:45 (2268): No heartbeat from core client for 30 sec - exiting 22:18:46 (2268): No heartbeat from core client for 30 sec - exiting 22:18:47 (2268): No heartbeat from core client for 30 sec - exiting 22:18:48 (2268): No heartbeat from core client for 30 sec - exiting 22:18:49 (2268): No heartbeat from core client for 30 sec - exiting 22:18:50 (2268): No heartbeat from core client for 30 sec - exiting 22:18:51 (2268): No heartbeat from core client for 30 sec - exiting 22:29:36 (6412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:37:24 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:46 (3256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:41:58 (2532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:46:49 (1156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:10 (6420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:23 (3000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:04:20 (7276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:40 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:22:49 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:40 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:57 (6648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:13:41 (5020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:50:51 (6876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77E93232 read attempt to address 0x40CE842E Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7856, selfPID=7856, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77E93232 read attempt to address 0x40CE842E Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Dec 2011 07:00:51	1117964	13735343	hadcm3n_yn0f_1980_40_007608199_0	259,200	1,085,974	4.1897
21 Dec 2011 11:53:40	1117964	13735343	hadcm3n_yn0f_1980_40_007608199_0	233,280	977,907	4.1920
20 Dec 2011 05:47:08	1117964	13735343	hadcm3n_yn0f_1980_40_007608199_0	207,360	866,264	4.1776
18 Dec 2011 05:11:53	1117964	13735343	hadcm3n_yn0f_1980_40_007608199_0	181,440	754,259	4.1571
16 Dec 2011 14:08:14	1117964	13735343	hadcm3n_yn0f_1980_40_007608199_0	155,520	641,983	4.1280
15 Dec 2011 05:28:28	1117964	13735343	hadcm3n_yn0f_1980_40_007608199_0	129,600	530,491	4.0933
12 Dec 2011 22:52:11	1117964	13735343	hadcm3n_yn0f_1980_40_007608199_0	103,680	417,094	4.0229
11 Dec 2011 14:13:10	1117964	13735343	hadcm3n_yn0f_1980_40_007608199_0	77,760	307,923	3.9599
11 Dec 2011 14:13:10	1117964	13735343	hadcm3n_yn0f_1980_40_007608199_0	51,840	219,649	4.2371
08 Dec 2011 05:57:20	1117964	13735343	hadcm3n_yn0f_1980_40_007608199_0	25,920	113,950	4.3962