Task 13375407

Name	hadcm3n_t1vn_1940_40_007452120_2
Workunit	7649623
Created	11 Sep 2011, 15:59:39 UTC
Sent	11 Sep 2011, 16:08:30 UTC
Report deadline	11 Dec 2011, 23:35:41 UTC
Received	27 Sep 2011, 17:11:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1117964
Run time	12 days 18 hours 3 min 26 sec
CPU time	11 days 15 hours 42 min 8 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.06 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:49:21 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:06:43 (1368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:16:18 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:25:21 (7732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:06 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:51:24 (6676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:36:07 (5464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:38:10 (6236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:38:11 (6236): No heartbeat from core client for 30 sec - exiting 10:38:12 (6236): No heartbeat from core client for 30 sec - exiting 10:38:13 (6236): No heartbeat from core client for 30 sec - exiting 10:38:14 (6236): No heartbeat from core client for 30 sec - exiting 10:38:15 (6236): No heartbeat from core client for 30 sec - exiting 10:38:16 (6236): No heartbeat from core client for 30 sec - exiting 10:38:17 (6236): No heartbeat from core client for 30 sec - exiting 10:38:18 (6236): No heartbeat from core client for 30 sec - exiting 10:38:20 (6236): No heartbeat from core client for 30 sec - exiting 10:38:21 (6236): No heartbeat from core client for 30 sec - exiting 10:41:48 (3648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:37 (6448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:38 (6448): No heartbeat from core client for 30 sec - exiting 10:52:39 (6448): No heartbeat from core client for 30 sec - exiting 10:52:40 (6448): No heartbeat from core client for 30 sec - exiting 10:52:41 (6448): No heartbeat from core client for 30 sec - exiting 10:52:42 (6448): No heartbeat from core client for 30 sec - exiting 10:52:43 (6448): No heartbeat from core client for 30 sec - exiting 10:52:44 (6448): No heartbeat from core client for 30 sec - exiting 10:52:45 (6448): No heartbeat from core client for 30 sec - exiting 10:52:46 (6448): No heartbeat from core client for 30 sec - exiting 10:52:48 (6448): No heartbeat from core client for 30 sec - exiting 10:54:08 (2884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:12 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:13 (3276): No heartbeat from core client for 30 sec - exiting 10:57:14 (3276): No heartbeat from core client for 30 sec - exiting 10:57:15 (3276): No heartbeat from core client for 30 sec - exiting 10:57:16 (3276): No heartbeat from core client for 30 sec - exiting 10:57:18 (3276): No heartbeat from core client for 30 sec - exiting 10:57:19 (3276): No heartbeat from core client for 30 sec - exiting 10:57:20 (3276): No heartbeat from core client for 30 sec - exiting 10:57:21 (3276): No heartbeat from core client for 30 sec - exiting 10:57:22 (3276): No heartbeat from core client for 30 sec - exiting 10:57:23 (3276): No heartbeat from core client for 30 sec - exiting 11:01:00 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:01:01 (6020): No heartbeat from core client for 30 sec - exiting 11:01:02 (6020): No heartbeat from core client for 30 sec - exiting 11:01:03 (6020): No heartbeat from core client for 30 sec - exiting 11:01:04 (6020): No heartbeat from core client for 30 sec - exiting 11:01:05 (6020): No heartbeat from core client for 30 sec - exiting 11:01:06 (6020): No heartbeat from core client for 30 sec - exiting 11:01:07 (6020): No heartbeat from core client for 30 sec - exiting 11:01:09 (6020): No heartbeat from core client for 30 sec - exiting 11:01:10 (6020): No heartbeat from core client for 30 sec - exiting 11:01:11 (6020): No heartbeat from core client for 30 sec - exiting 11:02:13 (6536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:14 (6536): No heartbeat from core client for 30 sec - exiting 11:02:15 (6536): No heartbeat from core client for 30 sec - exiting 11:02:16 (6536): No heartbeat from core client for 30 sec - exiting 11:02:17 (6536): No heartbeat from core client for 30 sec - exiting 11:02:18 (6536): No heartbeat from core client for 30 sec - exiting 11:02:20 (6536): No heartbeat from core client for 30 sec - exiting 11:02:21 (6536): No heartbeat from core client for 30 sec - exiting 11:02:22 (6536): No heartbeat from core client for 30 sec - exiting 11:02:23 (6536): No heartbeat from core client for 30 sec - exiting 11:02:24 (6536): No heartbeat from core client for 30 sec - exiting 11:07:20 (1868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:59 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:14:10 (6620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:33:08 (6948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:00 (1876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:30:53 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:01 (6392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:08 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:09 (5976): No heartbeat from core client for 30 sec - exiting 09:44:10 (5976): No heartbeat from core client for 30 sec - exiting 09:44:11 (5976): No heartbeat from core client for 30 sec - exiting 09:44:12 (5976): No heartbeat from core client for 30 sec - exiting 09:44:13 (5976): No heartbeat from core client for 30 sec - exiting 09:44:14 (5976): No heartbeat from core client for 30 sec - exiting 09:44:15 (5976): No heartbeat from core client for 30 sec - exiting 09:44:16 (5976): No heartbeat from core client for 30 sec - exiting 09:44:17 (5976): No heartbeat from core client for 30 sec - exiting 09:44:18 (5976): No heartbeat from core client for 30 sec - exiting 09:45:38 (6280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:45:39 (6280): No heartbeat from core client for 30 sec - exiting 09:45:40 (6280): No heartbeat from core client for 30 sec - exiting 09:45:41 (6280): No heartbeat from core client for 30 sec - exiting 09:45:42 (6280): No heartbeat from core client for 30 sec - exiting 09:45:43 (6280): No heartbeat from core client for 30 sec - exiting 09:45:44 (6280): No heartbeat from core client for 30 sec - exiting 09:45:45 (6280): No heartbeat from core client for 30 sec - exiting 09:45:46 (6280): No heartbeat from core client for 30 sec - exiting 09:45:47 (6280): No heartbeat from core client for 30 sec - exiting 09:45:48 (6280): No heartbeat from core client for 30 sec - exiting 10:08:31 (6208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:08:32 (6208): No heartbeat from core client for 30 sec - exiting 10:08:33 (6208): No heartbeat from core client for 30 sec - exiting 10:08:34 (6208): No heartbeat from core client for 30 sec - exiting 10:08:35 (6208): No heartbeat from core client for 30 sec - exiting 10:08:36 (6208): No heartbeat from core client for 30 sec - exiting 10:08:37 (6208): No heartbeat from core client for 30 sec - exiting 10:08:38 (6208): No heartbeat from core client for 30 sec - exiting 10:08:39 (6208): No heartbeat from core client for 30 sec - exiting 10:08:40 (6208): No heartbeat from core client for 30 sec - exiting 10:08:41 (6208): No heartbeat from core client for 30 sec - exiting forrtl: Access is denied. 10:09:27 (5320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:09:28 (5320): No heartbeat from core client for 30 sec - exiting 10:09:29 (5320): No heartbeat from core client for 30 sec - exiting 10:09:30 (5320): No heartbeat from core client for 30 sec - exiting 10:09:31 (5320): No heartbeat from core client for 30 sec - exiting 10:09:32 (5320): No heartbeat from core client for 30 sec - exiting 10:09:33 (5320): No heartbeat from core client for 30 sec - exiting 10:09:34 (5320): No heartbeat from core client for 30 sec - exiting 10:09:35 (5320): No heartbeat from core client for 30 sec - exiting 10:09:36 (5320): No heartbeat from core client for 30 sec - exiting 10:09:37 (5320): No heartbeat from core client for 30 sec - exiting 10:13:25 (3196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:55 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:56 (4232): No heartbeat from core client for 30 sec - exiting 10:15:57 (4232): No heartbeat from core client for 30 sec - exiting 10:15:58 (4232): No heartbeat from core client for 30 sec - exiting 10:15:59 (4232): No heartbeat from core client for 30 sec - exiting 10:16:00 (4232): No heartbeat from core client for 30 sec - exiting 10:16:01 (4232): No heartbeat from core client for 30 sec - exiting 10:16:02 (4232): No heartbeat from core client for 30 sec - exiting 10:16:03 (4232): No heartbeat from core client for 30 sec - exiting 10:16:04 (4232): No heartbeat from core client for 30 sec - exiting 10:16:05 (4232): No heartbeat from core client for 30 sec - exiting 10:30:19 (6272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:22 (1976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:23 (1976): No heartbeat from core client for 30 sec - exiting 10:32:24 (1976): No heartbeat from core client for 30 sec - exiting 10:32:25 (1976): No heartbeat from core client for 30 sec - exiting 10:32:26 (1976): No heartbeat from core client for 30 sec - exiting 10:32:27 (1976): No heartbeat from core client for 30 sec - exiting 10:32:28 (1976): No heartbeat from core client for 30 sec - exiting 10:32:29 (1976): No heartbeat from core client for 30 sec - exiting 10:32:30 (1976): No heartbeat from core client for 30 sec - exiting 10:32:31 (1976): No heartbeat from core client for 30 sec - exiting 10:32:32 (1976): No heartbeat from core client for 30 sec - exiting 10:39:12 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:39:13 (5708): No heartbeat from core client for 30 sec - exiting 10:39:14 (5708): No heartbeat from core client for 30 sec - exiting 10:39:15 (5708): No heartbeat from core client for 30 sec - exiting 10:39:16 (5708): No heartbeat from core client for 30 sec - exiting 10:39:17 (5708): No heartbeat from core client for 30 sec - exiting 10:39:18 (5708): No heartbeat from core client for 30 sec - exiting 10:39:19 (5708): No heartbeat from core client for 30 sec - exiting 10:39:20 (5708): No heartbeat from core client for 30 sec - exiting 10:39:21 (5708): No heartbeat from core client for 30 sec - exiting 10:39:22 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:57:57 (3804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:53 (6484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:27:54 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:54 (7968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:34 (7096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:31:53 (7772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:36:33 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x774771E3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3648, selfPID=3648, iMonCtr=1 17:19:05 (528): No heartbeat from core client for 30 sec - exiting 17:19:06 (528): No heartbeat from core client for 30 sec - exiting 17:19:07 (528): No heartbeat from core client for 30 sec - exiting 17:19:08 (528): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77472EC0 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Sep 2011 17:11:37	1117964	13375407	hadcm3n_t1vn_1940_40_007452120_2	259,200	987,777	3.8109
26 Sep 2011 11:01:09	1117964	13375407	hadcm3n_t1vn_1940_40_007452120_2	233,280	879,441	3.7699
23 Sep 2011 04:23:09	1117964	13375407	hadcm3n_t1vn_1940_40_007452120_2	207,360	763,944	3.6841
22 Sep 2011 02:03:24	1117964	13375407	hadcm3n_t1vn_1940_40_007452120_2	181,440	650,940	3.5876
20 Sep 2011 16:24:07	1117964	13375407	hadcm3n_t1vn_1940_40_007452120_2	155,520	548,489	3.5268
19 Sep 2011 11:55:19	1117964	13375407	hadcm3n_t1vn_1940_40_007452120_2	129,600	458,743	3.5397
18 Sep 2011 11:24:32	1117964	13375407	hadcm3n_t1vn_1940_40_007452120_2	103,680	369,923	3.5679
18 Sep 2011 07:30:30	1117964	13375407	hadcm3n_t1vn_1940_40_007452120_2	77,760	288,076	3.7047
15 Sep 2011 13:53:35	1117964	13375407	hadcm3n_t1vn_1940_40_007452120_2	51,840	200,109	3.8601
13 Sep 2011 21:13:54	1117964	13375407	hadcm3n_t1vn_1940_40_007452120_2	25,920	105,256	4.0608