Task 15989501

Name	hadcm3n_7y9x_1980_40_008455704_0
Workunit	8606560
Created	30 Aug 2013, 18:37:22 UTC
Sent	13 Sep 2013, 9:43:50 UTC
Report deadline	13 Dec 2013, 17:11:01 UTC
Received	30 Sep 2013, 16:27:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1087624
Run time	5 days 0 hours 34 min 25 sec
CPU time	4 days 21 hours 44 min 15 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.70 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 14:08:46 (5816): No heartbeat from core client for 30 sec - exiting 14:08:47 (5816): No heartbeat from core client for 30 sec - exiting 14:08:48 (5816): No heartbeat from core client for 30 sec - exiting 14:08:49 (5816): No heartbeat from core client for 30 sec - exiting 14:08:50 (5816): No heartbeat from core client for 30 sec - exiting 14:08:51 (5816): No heartbeat from core client for 30 sec - exiting 14:08:52 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6456, iMonCtr=1 Model crash detected, will try to restart... 22:34:59 (6988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:08 (7284): No heartbeat from core client for 30 sec - exiting 08:47:09 (7284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:29:59 (6996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:20:55 (5960): No heartbeat from core client for 30 sec - exiting 15:20:57 (5960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:36:08 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3292, iMonCtr=1 Model crash detected, will try to restart... 10:02:01 (1108): No heartbeat from core client for 30 sec - exiting 10:02:02 (1108): No heartbeat from core client for 30 sec - exiting 10:02:03 (1108): No heartbeat from core client for 30 sec - exiting 10:02:04 (1108): No heartbeat from core client for 30 sec - exiting 10:02:05 (1108): No heartbeat from core client for 30 sec - exiting 10:02:06 (1108): No heartbeat from core client for 30 sec - exiting 10:02:07 (1108): No heartbeat from core client for 30 sec - exiting 10:02:08 (1108): No heartbeat from core client for 30 sec - exiting 10:02:09 (1108): No heartbeat from core client for 30 sec - exiting 10:02:10 (1108): No heartbeat from core client for 30 sec - exiting 10:02:11 (1108): No heartbeat from core client for 30 sec - exiting 10:02:12 (1108): No heartbeat from core client for 30 sec - exiting 10:02:13 (1108): No heartbeat from core client for 30 sec - exiting 10:02:14 (1108): No heartbeat from core client for 30 sec - exiting 10:02:15 (1108): No heartbeat from core client for 30 sec - exiting 10:02:16 (1108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4572, iMonCtr=1 Model crash detected, will try to restart... 09:48:13 (5152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:13:14 (1196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7188, iMonCtr=1 Model crash detected, will try to restart... 15:07:13 (6932): No heartbeat from core client for 30 sec - exiting 15:07:14 (6932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:01 (1204): No heartbeat from core client for 30 sec - exiting 18:45:02 (1204): No heartbeat from core client for 30 sec - exiting 18:45:04 (1204): No heartbeat from core client for 30 sec - exiting 18:45:05 (1204): No heartbeat from core client for 30 sec - exiting 18:45:06 (1204): No heartbeat from core client for 30 sec - exiting 18:45:07 (1204): No heartbeat from core client for 30 sec - exiting 18:45:08 (1204): No heartbeat from core client for 30 sec - exiting 18:45:09 (1204): No heartbeat from core client for 30 sec - exiting 18:45:10 (1204): No heartbeat from core client for 30 sec - exiting 18:45:11 (1204): No heartbeat from core client for 30 sec - exiting 18:45:12 (1204): No heartbeat from core client for 30 sec - exiting 18:45:13 (1204): No heartbeat from core client for 30 sec - exiting 18:45:14 (1204): No heartbeat from core client for 30 sec - exiting 18:45:15 (1204): No heartbeat from core client for 30 sec - exiting 18:45:16 (1204): No heartbeat from core client for 30 sec - exiting 18:45:17 (1204): No heartbeat from core client for 30 sec - exiting 18:45:18 (1204): No heartbeat from core client for 30 sec - exiting 18:45:19 (1204): No heartbeat from core client for 30 sec - exiting 18:45:20 (1204): No heartbeat from core client for 30 sec - exiting 18:45:21 (1204): No heartbeat from core client for 30 sec - exiting 18:45:22 (1204): No heartbeat from core client for 30 sec - exiting 18:45:23 (1204): No heartbeat from core client for 30 sec - exiting 18:45:24 (1204): No heartbeat from core client for 30 sec - exiting 18:45:25 (1204): No heartbeat from core client for 30 sec - exiting 18:45:26 (1204): No heartbeat from core client for 30 sec - exiting 18:45:27 (1204): No heartbeat from core client for 30 sec - exiting 18:45:28 (1204): No heartbeat from core client for 30 sec - exiting 18:45:29 (1204): No heartbeat from core client for 30 sec - exiting 18:45:30 (1204): No heartbeat from core client for 30 sec - exiting 18:45:31 (1204): No heartbeat from core client for 30 sec - exiting 18:45:32 (1204): No heartbeat from core client for 30 sec - exiting 18:45:33 (1204): No heartbeat from core client for 30 sec - exiting 18:45:34 (1204): No heartbeat from core client for 30 sec - exiting 18:45:35 (1204): No heartbeat from core client for 30 sec - exiting 18:45:36 (1204): No heartbeat from core client for 30 sec - exiting 18:45:37 (1204): No heartbeat from core client for 30 sec - exiting 18:45:38 (1204): No heartbeat from core client for 30 sec - exiting 18:45:39 (1204): No heartbeat from core client for 30 sec - exiting 18:45:40 (1204): No heartbeat from core client for 30 sec - exiting 18:45:41 (1204): No heartbeat from core client for 30 sec - exiting 18:45:42 (1204): No heartbeat from core client for 30 sec - exiting 18:45:43 (1204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:59 (8132): No heartbeat from core client for 30 sec - exiting 19:31:00 (8132): No heartbeat from core client for 30 sec - exiting 19:31:01 (8132): No heartbeat from core client for 30 sec - exiting 19:31:02 (8132): No heartbeat from core client for 30 sec - exiting 19:31:03 (8132): No heartbeat from core client for 30 sec - exiting 19:31:04 (8132): No heartbeat from core client for 30 sec - exiting 19:31:05 (8132): No heartbeat from core client for 30 sec - exiting 19:31:06 (8132): No heartbeat from core client for 30 sec - exiting 19:31:07 (8132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:56:44 (6512): No heartbeat from core client for 30 sec - exiting 18:56:45 (6512): No heartbeat from core client for 30 sec - exiting 18:56:46 (6512): No heartbeat from core client for 30 sec - exiting 18:56:47 (6512): No heartbeat from core client for 30 sec - exiting 18:56:48 (6512): No heartbeat from core client for 30 sec - exiting 18:56:49 (6512): No heartbeat from core client for 30 sec - exiting 18:56:50 (6512): No heartbeat from core client for 30 sec - exiting 18:56:51 (6512): No heartbeat from core client for 30 sec - exiting 18:56:52 (6512): No heartbeat from core client for 30 sec - exiting 18:56:53 (6512): No heartbeat from core client for 30 sec - exiting 18:56:54 (6512): No heartbeat from core client for 30 sec - exiting 18:56:55 (6512): No heartbeat from core client for 30 sec - exiting 18:56:56 (6512): No heartbeat from core client for 30 sec - exiting 18:56:57 (6512): No heartbeat from core client for 30 sec - exiting 18:56:58 (6512): No heartbeat from core client for 30 sec - exiting 18:56:59 (6512): No heartbeat from core client for 30 sec - exiting 18:57:00 (6512): No heartbeat from core client for 30 sec - exiting 18:57:01 (6512): No heartbeat from core client for 30 sec - exiting 18:57:02 (6512): No heartbeat from core client for 30 sec - exiting 18:57:03 (6512): No heartbeat from core client for 30 sec - exiting 18:57:04 (6512): No heartbeat from core client for 30 sec - exiting 18:57:05 (6512): No heartbeat from core client for 30 sec - exiting 18:57:06 (6512): No heartbeat from core client for 30 sec - exiting 18:57:07 (6512): No heartbeat from core client for 30 sec - exiting 18:57:08 (6512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:23:18 (6612): No heartbeat from core client for 30 sec - exiting 18:23:19 (6612): No heartbeat from core client for 30 sec - exiting 18:23:20 (6612): No heartbeat from core client for 30 sec - exiting 18:23:21 (6612): No heartbeat from core client for 30 sec - exiting 18:23:22 (6612): No heartbeat from core client for 30 sec - exiting 18:23:23 (6612): No heartbeat from core client for 30 sec - exiting 18:23:24 (6612): No heartbeat from core client for 30 sec - exiting 18:23:25 (6612): No heartbeat from core client for 30 sec - exiting 18:23:26 (6612): No heartbeat from core client for 30 sec - exiting 18:23:27 (6612): No heartbeat from core client for 30 sec - exiting 18:23:28 (6612): No heartbeat from core client for 30 sec - exiting 18:23:29 (6612): No heartbeat from core client for 30 sec - exiting 18:23:30 (6612): No heartbeat from core client for 30 sec - exiting 18:23:31 (6612): No heartbeat from core client for 30 sec - exiting 18:23:32 (6612): No heartbeat from core client for 30 sec - exiting 18:23:33 (6612): No heartbeat from core client for 30 sec - exiting 18:23:34 (6612): No heartbeat from core client for 30 sec - exiting 18:23:35 (6612): No heartbeat from core client for 30 sec - exiting 18:23:36 (6612): No heartbeat from core client for 30 sec - exiting 18:23:37 (6612): No heartbeat from core client for 30 sec - exiting 18:23:38 (6612): No heartbeat from core client for 30 sec - exiting 18:23:39 (6612): No heartbeat from core client for 30 sec - exiting 18:23:40 (6612): No heartbeat from core client for 30 sec - exiting 18:23:41 (6612): No heartbeat from core client for 30 sec - exiting 18:23:42 (6612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:23:43 (6612): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9140, iMonCtr=1 Model crash detected, will try to restart... 08:46:19 (7888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:29:45 (7164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:29:47 (7164): No heartbeat from core client for 30 sec - exiting 09:44:06 (8164): No heartbeat from core client for 30 sec - exiting 09:44:07 (8164): No heartbeat from core client for 30 sec - exiting 09:44:08 (8164): No heartbeat from core client for 30 sec - exiting 09:44:09 (8164): No heartbeat from core client for 30 sec - exiting 09:44:10 (8164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:10:17 (8060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6748, iMonCtr=1 Model crash detected, will try to restart... 16:06:53 (6528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:11:51 (6628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:56:14 (5856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:40:38 (3972): No heartbeat from core client for 30 sec - exiting 13:40:39 (3972): No heartbeat from core client for 30 sec - exiting 13:40:40 (3972): No heartbeat from core client for 30 sec - exiting 13:40:41 (3972): No heartbeat from core client for 30 sec - exiting 13:40:42 (3972): No heartbeat from core client for 30 sec - exiting 13:40:43 (3972): No heartbeat from core client for 30 sec - exiting 13:40:44 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1392, iMonCtr=1 Model crash detected, will try to restart... 17:42:51 (5684): No heartbeat from core client for 30 sec - exiting 17:42:52 (5684): No heartbeat from core client for 30 sec - exiting 17:42:53 (5684): No heartbeat from core client for 30 sec - exiting 17:42:54 (5684): No heartbeat from core client for 30 sec - exiting 17:42:55 (5684): No heartbeat from core client for 30 sec - exiting 17:42:56 (5684): No heartbeat from core client for 30 sec - exiting 17:42:57 (5684): No heartbeat from core client for 30 sec - exiting 17:42:58 (5684): No heartbeat from core client for 30 sec - exiting 17:42:59 (5684): No heartbeat from core client for 30 sec - exiting 17:43:00 (5684): No heartbeat from core client for 30 sec - exiting 17:43:01 (5684): No heartbeat from core client for 30 sec - exiting 17:43:02 (5684): No heartbeat from core client for 30 sec - exiting 17:43:03 (5684): No heartbeat from core client for 30 sec - exiting 17:43:04 (5684): No heartbeat from core client for 30 sec - exiting 17:43:05 (5684): No heartbeat from core client for 30 sec - exiting 17:43:06 (5684): No heartbeat from core client for 30 sec - exiting 17:43:07 (5684): No heartbeat from core client for 30 sec - exiting 17:43:08 (5684): No heartbeat from core client for 30 sec - exiting 17:43:09 (5684): No heartbeat from core client for 30 sec - exiting 17:43:10 (5684): No heartbeat from core client for 30 sec - exiting 17:43:11 (5684): No heartbeat from core client for 30 sec - exiting 17:43:12 (5684): No heartbeat from core client for 30 sec - exiting 17:43:13 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:43:14 (5684): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 19:28:37 (7380): No heartbeat from core client for 30 sec - exiting 19:28:38 (7380): No heartbeat from core client for 30 sec - exiting 19:28:39 (7380): No heartbeat from core client for 30 sec - exiting 19:28:40 (7380): No heartbeat from core client for 30 sec - exiting 19:28:41 (7380): No heartbeat from core client for 30 sec - exiting 19:28:42 (7380): No heartbeat from core client for 30 sec - exiting 19:28:43 (7380): No heartbeat from core client for 30 sec - exiting 19:28:44 (7380): No heartbeat from core client for 30 sec - exiting 19:28:45 (7380): No heartbeat from core client for 30 sec - exiting 19:28:46 (7380): No heartbeat from core client for 30 sec - exiting 19:28:47 (7380): No heartbeat from core client for 30 sec - exiting 19:28:48 (7380): No heartbeat from core client for 30 sec - exiting 19:28:49 (7380): No heartbeat from core client for 30 sec - exiting 19:28:50 (7380): No heartbeat from core client for 30 sec - exiting 19:28:51 (7380): No heartbeat from core client for 30 sec - exiting 19:28:52 (7380): No heartbeat from core client for 30 sec - exiting 19:28:53 (7380): No heartbeat from core client for 30 sec - exiting 19:28:54 (7380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:55 (7380): No heartbeat from core client for 30 sec - exiting 19:28:56 (7380): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1164, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1164, iMonCtr=1 Model crash detected, will try to restart... 11:53:37 (7452): No heartbeat from core client for 30 sec - exiting 11:53:39 (7452): No heartbeat from core client for 30 sec - exiting 11:53:40 (7452): No heartbeat from core client for 30 sec - exiting 11:53:41 (7452): No heartbeat from core client for 30 sec - exiting 11:53:42 (7452): No heartbeat from core client for 30 sec - exiting 11:53:43 (7452): No heartbeat from core client for 30 sec - exiting 11:53:44 (7452): No heartbeat from core client for 30 sec - exiting 11:53:45 (7452): No heartbeat from core client for 30 sec - exiting 11:53:46 (7452): No heartbeat from core client for 30 sec - exiting 11:53:47 (7452): No heartbeat from core client for 30 sec - exiting 11:53:48 (7452): No heartbeat from core client for 30 sec - exiting 11:53:49 (7452): No heartbeat from core client for 30 sec - exiting 11:53:50 (7452): No heartbeat from core client for 30 sec - exiting 11:53:51 (7452): No heartbeat from core client for 30 sec - exiting 11:53:52 (7452): No heartbeat from core client for 30 sec - exiting 11:53:53 (7452): No heartbeat from core client for 30 sec - exiting 11:53:54 (7452): No heartbeat from core client for 30 sec - exiting 11:53:55 (7452): No heartbeat from core client for 30 sec - exiting 11:53:56 (7452): No heartbeat from core client for 30 sec - exiting 11:53:57 (7452): No heartbeat from core client for 30 sec - exiting 11:53:58 (7452): No heartbeat from core client for 30 sec - exiting 11:53:59 (7452): No heartbeat from core client for 30 sec - exiting 11:54:00 (7452): No heartbeat from core client for 30 sec - exiting 11:54:01 (7452): No heartbeat from core client for 30 sec - exiting 11:54:02 (7452): No heartbeat from core client for 30 sec - exiting 11:54:03 (7452): No heartbeat from core client for 30 sec - exiting 11:54:04 (7452): No heartbeat from core client for 30 sec - exiting 11:54:05 (7452): No heartbeat from core client for 30 sec - exiting 11:54:06 (7452): No heartbeat from core client for 30 sec - exiting 11:54:07 (7452): No heartbeat from core client for 30 sec - exiting 11:54:08 (7452): No heartbeat from core client for 30 sec - exiting 11:54:09 (7452): No heartbeat from core client for 30 sec - exiting 11:54:10 (7452): No heartbeat from core client for 30 sec - exiting 11:54:11 (7452): No heartbeat from core client for 30 sec - exiting 11:54:12 (7452): No heartbeat from core client for 30 sec - exiting 11:54:13 (7452): No heartbeat from core client for 30 sec - exiting 11:54:14 (7452): No heartbeat from core client for 30 sec - exiting 11:54:15 (7452): No heartbeat from core client for 30 sec - exiting 11:54:16 (7452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77DA67A7 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... 16:33:44 (6108): No heartbeat from core client for 30 sec - exiting 16:33:45 (6108): No heartbeat from core client for 30 sec - exiting 16:33:46 (6108): No heartbeat from core client for 30 sec - exiting 16:33:47 (6108): No heartbeat from core client for 30 sec - exiting 16:33:48 (6108): No heartbeat from core client for 30 sec - exiting 16:33:49 (6108): No heartbeat from core client for 30 sec - exiting 16:33:50 (6108): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x774E6B0D read attempt to address 0x00000004 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Sep 2013 10:20:57	1087624	15989501	hadcm3n_7y9x_1980_40_008455704_0	259,200	409,929	1.5815
26 Sep 2013 21:38:36	1087624	15989501	hadcm3n_7y9x_1980_40_008455704_0	233,280	368,704	1.5805
26 Sep 2013 09:27:26	1087624	15989501	hadcm3n_7y9x_1980_40_008455704_0	207,360	326,012	1.5722
25 Sep 2013 09:24:13	1087624	15989501	hadcm3n_7y9x_1980_40_008455704_0	181,440	285,193	1.5718
23 Sep 2013 17:00:57	1087624	15989501	hadcm3n_7y9x_1980_40_008455704_0	155,520	243,834	1.5679
20 Sep 2013 16:54:41	1087624	15989501	hadcm3n_7y9x_1980_40_008455704_0	129,600	200,892	1.5501
19 Sep 2013 17:58:09	1087624	15989501	hadcm3n_7y9x_1980_40_008455704_0	103,680	159,765	1.5409
17 Sep 2013 14:12:19	1087624	15989501	hadcm3n_7y9x_1980_40_008455704_0	77,760	119,729	1.5397
16 Sep 2013 07:46:29	1087624	15989501	hadcm3n_7y9x_1980_40_008455704_0	51,840	80,370	1.5503
13 Sep 2013 21:23:55	1087624	15989501	hadcm3n_7y9x_1980_40_008455704_0	25,920	40,695	1.5700