Task 15747795

Name	hadcm3n_4g8d_1940_40_008302868_4
Workunit	8454003
Created	23 Apr 2013, 18:43:09 UTC
Sent	23 Apr 2013, 18:43:11 UTC
Report deadline	24 Jul 2013, 2:10:22 UTC
Received	18 Jul 2013, 14:12:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	985115
Run time	25 days 4 hours 4 min 31 sec
CPU time	23 days 4 hours 19 min 28 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	1.92 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:45:00 (7168): No heartbeat from core client for 30 sec - exiting 13:45:01 (7168): No heartbeat from core client for 30 sec - exiting 13:45:02 (7168): No heartbeat from core client for 30 sec - exiting 13:45:04 (7168): No heartbeat from core client for 30 sec - exiting 13:45:05 (7168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:49:14 (7344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:42:02 (6888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6636, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:33:53 (1036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:24:33 (6588): No heartbeat from core client for 30 sec - exiting 00:24:35 (6588): No heartbeat from core client for 30 sec - exiting 00:24:36 (6588): No heartbeat from core client for 30 sec - exiting 00:24:37 (6588): No heartbeat from core client for 30 sec - exiting 00:24:38 (6588): No heartbeat from core client for 30 sec - exiting 00:24:39 (6588): No heartbeat from core client for 30 sec - exiting 00:24:40 (6588): No heartbeat from core client for 30 sec - exiting 00:24:41 (6588): No heartbeat from core client for 30 sec - exiting 00:24:42 (6588): No heartbeat from core client for 30 sec - exiting 00:24:44 (6588): No heartbeat from core client for 30 sec - exiting 00:24:45 (6588): No heartbeat from core client for 30 sec - exiting 00:24:46 (6588): No heartbeat from core client for 30 sec - exiting 00:24:47 (6588): No heartbeat from core client for 30 sec - exiting 00:24:48 (6588): No heartbeat from core client for 30 sec - exiting 00:24:49 (6588): No heartbeat from core client for 30 sec - exiting 00:24:50 (6588): No heartbeat from core client for 30 sec - exiting 00:24:51 (6588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:58:38 (6496): No heartbeat from core client for 30 sec - exiting 12:58:39 (6496): No heartbeat from core client for 30 sec - exiting 12:58:40 (6496): No heartbeat from core client for 30 sec - exiting 12:58:41 (6496): No heartbeat from core client for 30 sec - exiting 12:58:42 (6496): No heartbeat from core client for 30 sec - exiting 12:58:44 (6496): No heartbeat from core client for 30 sec - exiting 12:58:45 (6496): No heartbeat from core client for 30 sec - exiting 12:58:46 (6496): No heartbeat from core client for 30 sec - exiting 12:58:47 (6496): No heartbeat from core client for 30 sec - exiting 12:58:48 (6496): No heartbeat from core client for 30 sec - exiting 12:58:49 (6496): No heartbeat from core client for 30 sec - exiting 12:58:50 (6496): No heartbeat from core client for 30 sec - exiting 12:58:51 (6496): No heartbeat from core client for 30 sec - exiting 12:58:52 (6496): No heartbeat from core client for 30 sec - exiting 12:58:53 (6496): No heartbeat from core client for 30 sec - exiting 12:58:55 (6496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:46:45 (4280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:18:36 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:57:29 (4560): No heartbeat from core client for 30 sec - exiting 12:57:30 (4560): No heartbeat from core client for 30 sec - exiting 12:57:32 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:33 (4560): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Co16:37:40 (1220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5988, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:22:39 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:53:06 (7536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:58:46 (6788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:46:18 (4276): No heartbeat from core client for 30 sec - exiting 11:46:19 (4276): No heartbeat from core client for 30 sec - exiting 11:46:21 (4276): No heartbeat from core client for 30 sec - exiting 11:46:22 (4276): No heartbeat from core client for 30 sec - exiting 11:46:23 (4276): No heartbeat from core client for 30 sec - exiting 11:46:24 (4276): No heartbeat from core client for 30 sec - exiting 11:46:25 (4276): No heartbeat from core client for 30 sec - exiting 11:46:26 (4276): No heartbeat from core client for 30 sec - exiting 11:46:27 (4276): No heartbeat from core client for 30 sec - exiting 11:46:29 (4276): No heartbeat from core client for 30 sec - exiting 11:46:30 (4276): No heartbeat from core client for 30 sec - exiting 11:46:31 (4276): No heartbeat from core client for 30 sec - exiting 11:46:32 (4276): No heartbeat from core client for 30 sec - exiting 11:46:33 (4276): No heartbeat from core client for 30 sec - exiting 11:46:34 (4276): No heartbeat from core client for 30 sec - exiting 11:46:36 (4276): No heartbeat from core client for 30 sec - exiting 11:46:37 (4276): No heartbeat from core client for 30 sec - exiting 11:46:38 (4276): No heartbeat from core client for 30 sec - exiting 11:46:39 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:37:43 (3904): No heartbeat from core client for 30 sec - exiting 07:37:45 (3904): No heartbeat from core client for 30 sec - exiting 07:37:46 (3904): No heartbeat from core client for 30 sec - exiting 07:37:47 (3904): No heartbeat from core client for 30 sec - exiting 07:37:48 (3904): No heartbeat from core client for 30 sec - exiting 07:37:49 (3904): No heartbeat from core client for 30 sec - exiting 07:37:50 (3904): No heartbeat from core client for 30 sec - exiting 07:37:51 (3904): No heartbeat from core client for 30 sec - exiting 07:37:52 (3904): No heartbeat from core client for 30 sec - exiting 07:37:53 (3904): No heartbeat from core client for 30 sec - exiting 07:37:54 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:17:26 (172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77646737 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... 14:54:04 (6912): No heartbeat from core client for 30 sec - exiting 14:54:05 (6912): No heartbeat from core client for 30 sec - exiting 14:54:07 (6912): No heartbeat from core client for 30 sec - exiting 14:54:08 (6912): No heartbeat from core client for 30 sec - exiting 14:54:09 (6912): No heartbeat from core client for 30 sec - exiting 14:54:10 (6912): No heartbeat from core client for 30 sec - exiting 14:54:11 (6912): No heartbeat from core client for 30 sec - exiting 14:54:12 (6912): No heartbeat from core client for 30 sec - exiting 14:54:13 (6912): No heartbeat from core client for 30 sec - exiting 14:54:14 (6912): No heartbeat from core client for 30 sec - exiting 14:54:15 (6912): No heartbeat from core client for 30 sec - exiting 14:54:16 (6912): No heartbeat from core client for 30 sec - exiting 14:54:17 (6912): No heartbeat from core client for 30 sec - exiting 14:54:19 (6912): No heartbeat from core client for 30 sec - exiting 14:54:20 (6912): No heartbeat from core client for 30 sec - exiting 14:54:21 (6912): No heartbeat from core client for 30 sec - exiting 14:54:22 (6912): No heartbeat from core client for 30 sec - exiting 14:54:23 (6912): No heartbeat from core client for 30 sec - exiting 14:54:24 (6912): No heartbeat from core client for 30 sec - exiting 14:54:25 (6912): No heartbeat from core client for 30 sec - exiting 14:54:26 (6912): No heartbeat from core client for 30 sec - exiting 14:54:27 (6912): No heartbeat from core client for 30 sec - exiting 14:54:28 (6912): No heartbeat from core client for 30 sec - exiting 14:54:30 (6912): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x7727E7CA read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 17:16:43	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	777,600	1,982,195	2.5491
23 Jul 2013 17:16:43	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	751,680	1,913,273	2.5453
09 Jul 2013 19:40:53	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	725,760	1,789,516	2.4657
09 Jul 2013 03:06:22	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	699,840	1,729,840	2.4718
06 Jul 2013 14:59:10	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	673,920	1,667,128	2.4738
06 Jul 2013 04:13:23	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	648,000	1,603,904	2.4752
03 Jul 2013 19:51:13	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	622,080	1,547,375	2.4874
03 Jul 2013 03:44:14	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	596,160	1,490,010	2.4993
02 Jul 2013 11:55:44	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	570,240	1,433,710	2.5142
27 Jun 2013 14:11:15	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	544,320	1,354,006	2.4875
26 Jun 2013 09:45:02	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	518,400	1,288,964	2.4864
24 Jun 2013 15:12:49	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	492,480	1,216,878	2.4709
21 Jun 2013 21:16:43	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	466,560	1,143,938	2.4519
08 Jun 2013 21:24:43	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	440,640	1,074,394	2.4383
06 Jun 2013 05:29:45	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	414,720	1,006,998	2.4281
03 Jun 2013 16:10:40	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	388,800	934,562	2.4037
02 Jun 2013 11:04:33	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	362,880	869,439	2.3959
31 May 2013 19:34:26	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	336,960	809,519	2.4024
28 May 2013 18:14:22	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	311,040	746,841	2.4011
23 May 2013 22:13:56	985115	15747795	hadcm3n_4g8d_1940_40_008302868_4	285,120	665,868	2.3354