Task 15780380

Name	hadcm3n_4fs8_1980_40_008367188_0
Workunit	8518047
Created	13 May 2013, 4:44:43 UTC
Sent	13 May 2013, 4:45:00 UTC
Report deadline	12 Aug 2013, 12:12:11 UTC
Received	6 Jun 2013, 11:58:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1273094
Run time	3 days 21 hours 17 min 34 sec
CPU time	3 days 20 hours 44 min 35 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.09 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:11:31 (4908): No heartbeat from core client for 30 sec - exiting 06:11:32 (4908): No heartbeat from core client for 30 sec - exiting 06:11:33 (4908): No heartbeat from core client for 30 sec - exiting 06:11:34 (4908): No heartbeat from core client for 30 sec - exiting 06:11:35 (4908): No heartbeat from core client for 30 sec - exiting 06:11:36 (4908): No heartbeat from core client for 30 sec - exiting 06:11:37 (4908): No heartbeat from core client for 30 sec - exiting 06:11:38 (4908): No heartbeat from core client for 30 sec - exiting 06:11:39 (4908): No heartbeat from core client for 30 sec - exiting 06:11:41 (4908): No heartbeat from core client for 30 sec - exiting 06:11:42 (4908): No heartbeat from core client for 30 sec - exiting 06:11:43 (4908): No heartbeat from core client for 30 sec - exiting 06:11:44 (4908): No heartbeat from core client for 30 sec - exiting 06:11:45 (4908): No heartbeat from core client for 30 sec - exiting 06:11:46 (4908): No heartbeat from core client for 30 sec - exiting 06:11:47 (4908): No heartbeat from core client for 30 sec - exiting 06:11:48 (4908): No heartbeat from core client for 30 sec - exiting 06:11:49 (4908): No heartbeat from core client for 30 sec - exiting 06:11:50 (4908): No heartbeat from core client for 30 sec - exiting 06:11:51 (4908): No heartbeat from core client for 30 sec - exiting 06:11:53 (4908): No heartbeat from core client for 30 sec - exiting 06:11:54 (4908): No heartbeat from core client for 30 sec - exiting 06:11:55 (4908): No heartbeat from core client for 30 sec - exiting 06:11:56 (4908): No heartbeat from core client for 30 sec - exiting 06:11:57 (4908): No heartbeat from core client for 30 sec - exiting 06:11:58 (4908): No heartbeat from core client for 30 sec - exiting 06:11:59 (4908): No heartbeat from core client for 30 sec - exiting 06:12:00 (4908): No heartbeat from core client for 30 sec - exiting 06:12:01 (4908): No heartbeat from core client for 30 sec - exiting 06:12:02 (4908): No heartbeat from core client for 30 sec - exiting 06:12:04 (4908): No heartbeat from core client for 30 sec - exiting 06:12:05 (4908): No heartbeat from core client for 30 sec - exiting 06:12:06 (4908): No heartbeat from core client for 30 sec - exiting 06:12:07 (4908): No heartbeat from core client for 30 sec - exiting 06:12:08 (4908): No heartbeat from core client for 30 sec - exiting 06:12:09 (4908): No heartbeat from core client for 30 sec - exiting 06:12:10 (4908): No heartbeat from core client for 30 sec - exiting 06:12:11 (4908): No heartbeat from core client for 30 sec - exiting 06:12:12 (4908): No heartbeat from core client for 30 sec - exiting 06:12:13 (4908): No heartbeat from core client for 30 sec - exiting 06:12:14 (4908): No heartbeat from core client for 30 sec - exiting 06:12:16 (4908): No heartbeat from core client for 30 sec - exiting 06:12:17 (4908): No heartbeat from core client for 30 sec - exiting 06:12:18 (4908): No heartbeat from core client for 30 sec - exiting 06:12:19 (4908): No heartbeat from core client for 30 sec - exiting 06:12:20 (4908): No heartbeat from core client for 30 sec - exiting 06:12:21 (4908): No heartbeat from core client for 30 sec - exiting 06:12:22 (4908): No heartbeat from core client for 30 sec - exiting 06:12:23 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:12:01 (5552): No heartbeat from core client for 30 sec - exiting 12:12:02 (5552): No heartbeat from core client for 30 sec - exiting 12:12:03 (5552): No heartbeat from core client for 30 sec - exiting 12:12:05 (5552): No heartbeat from core client for 30 sec - exiting 12:12:06 (5552): No heartbeat from core client for 30 sec - exiting 12:12:07 (5552): No heartbeat from core client for 30 sec - exiting 12:12:08 (5552): No heartbeat from core client for 30 sec - exiting 12:12:09 (5552): No heartbeat from core client for 30 sec - exiting 12:12:10 (5552): No heartbeat from core client for 30 sec - exiting 12:12:11 (5552): No heartbeat from core client for 30 sec - exiting 12:12:12 (5552): No heartbeat from core client for 30 sec - exiting 12:12:13 (5552): No heartbeat from core client for 30 sec - exiting 12:12:14 (5552): No heartbeat from core client for 30 sec - exiting 12:12:16 (5552): No heartbeat from core client for 30 sec - exiting 12:12:17 (5552): No heartbeat from core client for 30 sec - exiting 12:12:18 (5552): No heartbeat from core client for 30 sec - exiting 12:12:19 (5552): No heartbeat from core client for 30 sec - exiting 12:12:20 (5552): No heartbeat from core client for 30 sec - exiting 12:12:21 (5552): No heartbeat from core client for 30 sec - exiting 12:12:22 (5552): No heartbeat from core client for 30 sec - exiting 12:12:23 (5552): No heartbeat from core client for 30 sec - exiting 12:12:24 (5552): No heartbeat from core client for 30 sec - exiting 12:12:25 (5552): No heartbeat from core client for 30 sec - exiting 12:12:26 (5552): No heartbeat from core client for 30 sec - exiting 12:12:28 (5552): No heartbeat from core client for 30 sec - exiting 12:12:29 (5552): No heartbeat from core client for 30 sec - exiting 12:12:30 (5552): No heartbeat from core client for 30 sec - exiting 12:12:31 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5240, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:49:25 (6768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:20:55 (5644): No heartbeat from core client for 30 sec - exiting 12:20:56 (5644): No heartbeat from core client for 30 sec - exiting 12:20:57 (5644): No heartbeat from core client for 30 sec - exiting 12:20:58 (5644): No heartbeat from core client for 30 sec - exiting 12:20:59 (5644): No heartbeat from core client for 30 sec - exiting 12:21:00 (5644): No heartbeat from core client for 30 sec - exiting 12:21:01 (5644): No heartbeat from core client for 30 sec - exiting 12:21:02 (5644): No heartbeat from core client for 30 sec - exiting 12:21:03 (5644): No heartbeat from core client for 30 sec - exiting 12:21:04 (5644): No heartbeat from core client for 30 sec - exiting 12:21:06 (5644): No heartbeat from core client for 30 sec - exiting 12:21:07 (5644): No heartbeat from core client for 30 sec - exiting 12:21:08 (5644): No heartbeat from core client for 30 sec - exiting 12:21:09 (5644): No heartbeat from core client for 30 sec - exiting 12:21:10 (5644): No heartbeat from core client for 30 sec - exiting 12:21:11 (5644): No heartbeat from core client for 30 sec - exiting 12:21:12 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:33 (2636): No heartbeat from core client for 30 sec - exiting 06:24:34 (2636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:09:46 (5768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4924, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2008, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3320, iMonCtr=1 Model crash detected, will try to restart... 06:18:00 (5976): No heartbeat from core client for 30 sec - exiting 06:18:01 (5976): No heartbeat from core client for 30 sec - exiting 06:18:02 (5976): No heartbeat from core client for 30 sec - exiting 06:18:04 (5976): No heartbeat from core client for 30 sec - exiting 06:18:05 (5976): No heartbeat from core client for 30 sec - exiting 06:18:06 (5976): No heartbeat from core client for 30 sec - exiting 06:18:07 (5976): No heartbeat from core client for 30 sec - exiting 06:18:08 (5976): No heartbeat from core client for 30 sec - exiting 06:18:09 (5976): No heartbeat from core client for 30 sec - exiting 06:18:10 (5976): No heartbeat from core client for 30 sec - exiting 06:18:11 (5976): No heartbeat from core client for 30 sec - exiting 06:18:12 (5976): No heartbeat from core client for 30 sec - exiting 06:18:13 (5976): No heartbeat from core client for 30 sec - exiting 06:18:14 (5976): No heartbeat from core client for 30 sec - exiting 06:18:16 (5976): No heartbeat from core client for 30 sec - exiting 06:18:17 (5976): No heartbeat from core client for 30 sec - exiting 06:18:18 (5976): No heartbeat from core client for 30 sec - exiting 06:18:19 (5976): No heartbeat from core client for 30 sec - exiting 06:18:20 (5976): No heartbeat from core client for 30 sec - exiting 06:18:21 (5976): No heartbeat from core client for 30 sec - exiting 06:18:22 (5976): No heartbeat from core client for 30 sec - exiting 06:18:23 (5976): No heartbeat from core client for 30 sec - exiting 06:18:24 (5976): No heartbeat from core client for 30 sec - exiting 06:18:25 (5976): No heartbeat from core client for 30 sec - exiting 06:18:26 (5976): No heartbeat from core client for 30 sec - exiting 06:18:28 (5976): No heartbeat from core client for 30 sec - exiting 06:18:29 (5976): No heartbeat from core client for 30 sec - exiting 06:18:30 (5976): No heartbeat from core client for 30 sec - exiting 06:18:31 (5976): No heartbeat from core client for 30 sec - exiting 06:18:32 (5976): No heartbeat from core client for 30 sec - exiting 06:18:33 (5976): No heartbeat from core client for 30 sec - exiting 06:18:34 (5976): No heartbeat from core client for 30 sec - exiting 06:18:35 (5976): No heartbeat from core client for 30 sec - exiting 06:18:36 (5976): No heartbeat from core client for 30 sec - exiting 06:18:37 (5976): No heartbeat from core client for 30 sec - exiting 06:18:39 (5976): No heartbeat from core client for 30 sec - exiting 06:18:40 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5592, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 14:16:22 (724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:37:45 (5052): No heartbeat from core client for 30 sec - exiting 06:37:47 (5052): No heartbeat from core client for 30 sec - exiting 06:37:48 (5052): No heartbeat from core client for 30 sec - exiting 06:37:49 (5052): No heartbeat from core client for 30 sec - exiting 06:37:50 (5052): No heartbeat from core client for 30 sec - exiting 06:37:51 (5052): No heartbeat from core client for 30 sec - exiting 06:37:52 (5052): No heartbeat from core client for 30 sec - exiting 06:37:53 (5052): No heartbeat from core client for 30 sec - exiting 06:37:54 (5052): No heartbeat from core client for 30 sec - exiting 06:37:55 (5052): No heartbeat from core client for 30 sec - exiting 06:37:56 (5052): No heartbeat from core client for 30 sec - exiting 06:37:57 (5052): No heartbeat from core client for 30 sec - exiting 06:37:59 (5052): No heartbeat from core client for 30 sec - exiting 06:38:00 (5052): No heartbeat from core client for 30 sec - exiting 06:38:01 (5052): No heartbeat from core client for 30 sec - exiting 06:38:02 (5052): No heartbeat from core client for 30 sec - exiting 06:38:03 (5052): No heartbeat from core client for 30 sec - exiting 06:38:04 (5052): No heartbeat from core client for 30 sec - exiting 06:38:05 (5052): No heartbeat from core client for 30 sec - exiting 06:38:06 (5052): No heartbeat from core client for 30 sec - exiting 06:38:07 (5052): No heartbeat from core client for 30 sec - exiting 06:38:08 (5052): No heartbeat from core client for 30 sec - exiting 06:38:09 (5052): No heartbeat from core client for 30 sec - exiting 06:38:11 (5052): No heartbeat from core client for 30 sec - exiting 06:38:12 (5052): No heartbeat from core client for 30 sec - exiting 06:38:13 (5052): No heartbeat from core client for 30 sec - exiting 06:38:14 (5052): No heartbeat from core client for 30 sec - exiting 06:38:15 (5052): No heartbeat from core client for 30 sec - exiting 06:38:16 (5052): No heartbeat from core client for 30 sec - exiting 06:38:17 (5052): No heartbeat from core client for 30 sec - exiting 06:38:18 (5052): No heartbeat from core client for 30 sec - exiting 06:38:19 (5052): No heartbeat from core client for 30 sec - exiting 06:38:20 (5052): No heartbeat from core client for 30 sec - exiting 06:38:21 (5052): No heartbeat from core client for 30 sec - exiting 06:38:23 (5052): No heartbeat from core client for 30 sec - exiting 06:38:24 (5052): No heartbeat from core client for 30 sec - exiting 06:38:25 (5052): No heartbeat from core client for 30 sec - exiting 06:38:26 (5052): No heartbeat from core client for 30 sec - exiting 06:38:27 (5052): No heartbeat from core client for 30 sec - exiting 06:38:28 (5052): No heartbeat from core client for 30 sec - exiting 06:38:29 (5052): No heartbeat from core client for 30 sec - exiting 06:38:30 (5052): No heartbeat from core client for 30 sec - exiting 06:38:31 (5052): No heartbeat from core client for 30 sec - exiting 06:38:32 (5052): No heartbeat from core client for 30 sec - exiting 06:38:33 (5052): No heartbeat from core client for 30 sec - exiting 06:38:35 (5052): No heartbeat from core client for 30 sec - exiting 06:38:36 (5052): No heartbeat from core client for 30 sec - exiting 06:38:37 (5052): No heartbeat from core client for 30 sec - exiting 06:38:38 (5052): No heartbeat from core client for 30 sec - exiting 06:38:39 (5052): No heartbeat from core client for 30 sec - exiting 06:38:40 (5052): No heartbeat from core client for 30 sec - exiting 06:38:41 (5052): No heartbeat from core client for 30 sec - exiting 06:38:42 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:12 (4620): No heartbeat from core client for 30 sec - exiting 08:52:13 (4620): No heartbeat from core client for 30 sec - exiting 08:52:15 (4620): No heartbeat from core client for 30 sec - exiting 08:52:16 (4620): No heartbeat from core client for 30 sec - exiting 08:52:17 (4620): No heartbeat from core client for 30 sec - exiting 08:52:18 (4620): No heartbeat from core client for 30 sec - exiting 08:52:19 (4620): No heartbeat from core client for 30 sec - exiting 08:52:20 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4924, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRet12:16:23 (4776): No heartbeat from core client for 30 sec - exiting 12:16:25 (4776): No heartbeat from core client for 30 sec - exiting 12:16:26 (4776): No heartbeat from core client for 30 sec - exiting 12:16:27 (4776): No heartbeat from core client for 30 sec - exiting 12:16:28 (4776): No heartbeat from core client for 30 sec - exiting 12:16:30 (4776): No heartbeat from core client for 30 sec - exiting 12:16:31 (4776): No heartbeat from core client for 30 sec - exiting 12:16:32 (4776): No heartbeat from core client for 30 sec - exiting 12:16:33 (4776): No heartbeat from core client for 30 sec - exiting 12:16:34 (4776): No heartbeat from core client for 30 sec - exiting 12:16:35 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:25:40 (5004): No heartbeat from core client for 30 sec - exiting 06:25:41 (5004): No heartbeat from core client for 30 sec - exiting 06:25:42 (5004): No heartbeat from core client for 30 sec - exiting 06:25:43 (5004): No heartbeat from core client for 30 sec - exiting 06:25:44 (5004): No heartbeat from core client for 30 sec - exiting 06:25:45 (5004): No heartbeat from core client for 30 sec - exiting 06:25:46 (5004): No heartbeat from core client for 30 sec - exiting 06:25:47 (5004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76FFFF2B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jun 2013 12:03:42	1273094	15780380	hadcm3n_4fs8_1980_40_008367188_0	259,200	333,859	1.2880
05 Jun 2013 08:00:05	1273094	15780380	hadcm3n_4fs8_1980_40_008367188_0	233,280	300,508	1.2882
03 Jun 2013 07:12:20	1273094	15780380	hadcm3n_4fs8_1980_40_008367188_0	207,360	267,705	1.2910
30 May 2013 11:05:14	1273094	15780380	hadcm3n_4fs8_1980_40_008367188_0	181,440	234,852	1.2944
27 May 2013 12:55:24	1273094	15780380	hadcm3n_4fs8_1980_40_008367188_0	155,520	201,384	1.2949
23 May 2013 12:24:18	1273094	15780380	hadcm3n_4fs8_1980_40_008367188_0	129,600	167,994	1.2963
22 May 2013 04:26:46	1273094	15780380	hadcm3n_4fs8_1980_40_008367188_0	103,680	134,257	1.2949
20 May 2013 08:30:45	1273094	15780380	hadcm3n_4fs8_1980_40_008367188_0	77,760	101,034	1.2993
16 May 2013 16:06:13	1273094	15780380	hadcm3n_4fs8_1980_40_008367188_0	51,840	66,843	1.2894
14 May 2013 12:09:56	1273094	15780380	hadcm3n_4fs8_1980_40_008367188_0	25,920	33,241	1.2824