Task 15991048

Name	hadcm3n_7zfi_1980_40_008457201_0
Workunit	8608057
Created	30 Aug 2013, 19:32:30 UTC
Sent	30 Aug 2013, 19:49:27 UTC
Report deadline	30 Nov 2013, 3:16:38 UTC
Received	13 Sep 2013, 9:43:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1087624
Run time	4 days 22 hours 34 min 18 sec
CPU time	4 days 20 hours 51 min 26 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.16 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 14:10:31 (7788): No heartbeat from core client for 30 sec - exiting 14:10:32 (7788): No heartbeat from core client for 30 sec - exiting 14:10:33 (7788): No heartbeat from core client for 30 sec - exiting 14:10:34 (7788): No heartbeat from core client for 30 sec - exiting 14:10:35 (7788): No heartbeat from core client for 30 sec - exiting 14:10:36 (7788): No heartbeat from core client for 30 sec - exiting 14:10:37 (7788): No heartbeat from core client for 30 sec - exiting 14:10:38 (7788): No heartbeat from core client for 30 sec - exiting 14:10:39 (7788): No heartbeat from core client for 30 sec - exiting 14:10:40 (7788): No heartbeat from core client for 30 sec - exiting 14:10:41 (7788): No heartbeat from core client for 30 sec - exiting 14:10:42 (7788): No heartbeat from core client for 30 sec - exiting 14:10:43 (7788): No heartbeat from core client for 30 sec - exiting 14:10:44 (7788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7276, iMonCtr=1 Model crash detected, will try to restart... 10:16:48 (8068): No heartbeat from core client for 30 sec - exiting 10:16:49 (8068): No heartbeat from core client for 30 sec - exiting 10:16:50 (8068): No heartbeat from core client for 30 sec - exiting 10:16:51 (8068): No heartbeat from core client for 30 sec - exiting 10:16:52 (8068): No heartbeat from core client for 30 sec - exiting 10:16:53 (8068): No heartbeat from core client for 30 sec - exiting 10:16:54 (8068): No heartbeat from core client for 30 sec - exiting 10:16:55 (8068): No heartbeat from core client for 30 sec - exiting 10:16:56 (8068): No heartbeat from core client for 30 sec - exiting 10:16:57 (8068): No heartbeat from core client for 30 sec - exiting 10:16:58 (8068): No heartbeat from core client for 30 sec - exiting 10:16:59 (8068): No heartbeat from core client for 30 sec - exiting 10:17:00 (8068): No heartbeat from core client for 30 sec - exiting 10:17:01 (8068): No heartbeat from core client for 30 sec - exiting 10:17:02 (8068): No heartbeat from core client for 30 sec - exiting 10:17:03 (8068): No heartbeat from core client for 30 sec - exiting 10:17:04 (8068): No heartbeat from core client for 30 sec - exiting 10:17:05 (8068): No heartbeat from core client for 30 sec - exiting 10:17:06 (8068): No heartbeat from core client for 30 sec - exiting 10:17:07 (8068): No heartbeat from core client for 30 sec - exiting 10:17:08 (8068): No heartbeat from core client for 30 sec - exiting 10:17:09 (8068): No heartbeat from core client for 30 sec - exiting 10:17:10 (8068): No heartbeat from core client for 30 sec - exiting 10:17:11 (8068): No heartbeat from core client for 30 sec - exiting 10:17:12 (8068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:56:48 (6264): No heartbeat from core client for 30 sec - exiting 18:56:49 (6264): No heartbeat from core client for 30 sec - exiting 18:56:50 (6264): No heartbeat from core client for 30 sec - exiting 18:56:51 (6264): No heartbeat from core client for 30 sec - exiting 18:56:52 (6264): No heartbeat from core client for 30 sec - exiting 18:56:53 (6264): No heartbeat from core client for 30 sec - exiting 18:56:54 (6264): No heartbeat from core client for 30 sec - exiting 18:56:55 (6264): No heartbeat from core client for 30 sec - exiting 18:56:56 (6264): No heartbeat from core client for 30 sec - exiting 18:56:57 (6264): No heartbeat from core client for 30 sec - exiting 18:56:58 (6264): No heartbeat from core client for 30 sec - exiting 18:56:59 (6264): No heartbeat from core client for 30 sec - exiting 18:57:00 (6264): No heartbeat from core client for 30 sec - exiting 18:57:01 (6264): No heartbeat from core client for 30 sec - exiting 18:57:02 (6264): No heartbeat from core client for 30 sec - exiting 18:57:03 (6264): No heartbeat from core client for 30 sec - exiting 18:57:04 (6264): No heartbeat from core client for 30 sec - exiting 18:57:05 (6264): No heartbeat from core client for 30 sec - exiting 18:57:06 (6264): No heartbeat from core client for 30 sec - exiting 18:57:07 (6264): No heartbeat from core client for 30 sec - exiting 18:57:08 (6264): No heartbeat from core client for 30 sec - exiting 18:57:09 (6264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=948, iMonCtr=1 Model crash detected, will try to restart... 09:17:59 (6096): No heartbeat from core client for 30 sec - exiting 09:18:00 (6096): No heartbeat from core client for 30 sec - exiting 09:18:01 (6096): No heartbeat from core client for 30 sec - exiting 09:18:02 (6096): No heartbeat from core client for 30 sec - exiting 09:18:03 (6096): No heartbeat from core client for 30 sec - exiting 09:18:04 (6096): No heartbeat from core client for 30 sec - exiting 09:18:05 (6096): No heartbeat from core client for 30 sec - exiting 09:18:06 (6096): No heartbeat from core client for 30 sec - exiting 09:18:07 (6096): No heartbeat from core client for 30 sec - exiting 09:18:08 (6096): No heartbeat from core client for 30 sec - exiting 09:18:09 (6096): No heartbeat from core client for 30 sec - exiting 09:18:10 (6096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:41:01 (6260): No heartbeat from core client for 30 sec - exiting 18:41:02 (6260): No heartbeat from core client for 30 sec - exiting 18:41:03 (6260): No heartbeat from core client for 30 sec - exiting 18:41:04 (6260): No heartbeat from core client for 30 sec - exiting 18:41:05 (6260): No heartbeat from core client for 30 sec - exiting 18:41:06 (6260): No heartbeat from core client for 30 sec - exiting 18:41:07 (6260): No heartbeat from core client for 30 sec - exiting 18:41:08 (6260): No heartbeat from core client for 30 sec - exiting 18:41:09 (6260): No heartbeat from core client for 30 sec - exiting 18:41:10 (6260): No heartbeat from core client for 30 sec - exiting 18:41:11 (6260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7340, iMonCtr=1 Model crash detected, will try to restart... 11:05:22 (6536): No heartbeat from core client for 30 sec - exiting 11:05:23 (6536): No heartbeat from core client for 30 sec - exiting 11:05:24 (6536): No heartbeat from core client for 30 sec - exiting 11:05:25 (6536): No heartbeat from core client for 30 sec - exiting 11:05:26 (6536): No heartbeat from core client for 30 sec - exiting 11:05:27 (6536): No heartbeat from core client for 30 sec - exiting 11:05:28 (6536): No heartbeat from core client for 30 sec - exiting 11:05:29 (6536): No heartbeat from core client for 30 sec - exiting 11:05:30 (6536): No heartbeat from core client for 30 sec - exiting 11:05:31 (6536): No heartbeat from core client for 30 sec - exiting 11:05:32 (6536): No heartbeat from core client for 30 sec - exiting 11:05:33 (6536): No heartbeat from core client for 30 sec - exiting 11:05:34 (6536): No heartbeat from core client for 30 sec - exiting 11:05:35 (6536): No heartbeat from core client for 30 sec - exiting 11:05:36 (6536): No heartbeat from core client for 30 sec - exiting 11:05:37 (6536): No heartbeat from core client for 30 sec - exiting 11:05:38 (6536): No heartbeat from core client for 30 sec - exiting 11:05:39 (6536): No heartbeat from core client for 30 sec - exiting 11:05:40 (6536): No heartbeat from core client for 30 sec - exiting 11:05:41 (6536): No heartbeat from core client for 30 sec - exiting 11:05:42 (6536): No heartbeat from core client for 30 sec - exiting 11:05:43 (6536): No heartbeat from core client for 30 sec - exiting 11:05:44 (6536): No heartbeat from core client for 30 sec - exiting 11:05:46 (6536): No heartbeat from core client for 30 sec - exiting 11:05:47 (6536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:11:39 (8088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C18:09:16 (6204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:35 (6592): No heartbeat from core client for 30 sec - exiting 12:03:37 (6592): No heartbeat from core client for 30 sec - exiting 12:03:38 (6592): No heartbeat from core client for 30 sec - exiting 12:03:39 (6592): No heartbeat from core client for 30 sec - exiting 12:03:40 (6592): No heartbeat from core client for 30 sec - exiting 12:03:41 (6592): No heartbeat from core client for 30 sec - exiting 12:03:42 (6592): No heartbeat from core client for 30 sec - exiting 12:03:43 (6592): No heartbeat from core client for 30 sec - exiting 12:03:44 (6592): No heartbeat from core client for 30 sec - exiting 12:03:45 (6592): No heartbeat from core client for 30 sec - exiting 12:03:46 (6592): No heartbeat from core client for 30 sec - exiting 12:03:47 (6592): No heartbeat from core client for 30 sec - exiting 12:03:48 (6592): No heartbeat from core client for 30 sec - exiting 12:03:49 (6592): No heartbeat from core client for 30 sec - exiting 12:03:50 (6592): No heartbeat from core client for 30 sec - exiting 12:03:51 (6592): No heartbeat from core client for 30 sec - exiting 12:03:52 (6592): No heartbeat from core client for 30 sec - exiting 12:03:53 (6592): No heartbeat from core client for 30 sec - exiting 12:03:54 (6592): No heartbeat from core client for 30 sec - exiting 12:03:55 (6592): No heartbeat from core client for 30 sec - exiting 12:03:56 (6592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:09 (7704): No heartbeat from core client for 30 sec - exiting 21:33:10 (7704): No heartbeat from core client for 30 sec - exiting 21:33:11 (7704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:31:27 (6564): No heartbeat from core client for 30 sec - exiting 15:31:28 (6564): No heartbeat from core client for 30 sec - exiting 15:31:29 (6564): No heartbeat from core client for 30 sec - exiting 15:31:30 (6564): No heartbeat from core client for 30 sec - exiting 15:31:31 (6564): No heartbeat from core client for 30 sec - exiting 15:31:32 (6564): No heartbeat from core client for 30 sec - exiting 15:31:33 (6564): No heartbeat from core client for 30 sec - exiting 15:31:34 (6564): No heartbeat from core client for 30 sec - exiting 15:31:35 (6564): No heartbeat from core client for 30 sec - exiting 15:31:36 (6564): No heartbeat from core client for 30 sec - exiting 15:31:37 (6564): No heartbeat from core client for 30 sec - exiting 15:31:38 (6564): No heartbeat from core client for 30 sec - exiting 15:31:39 (6564): No heartbeat from core client for 30 sec - exiting 15:31:40 (6564): No heartbeat from core client for 30 sec - exiting 15:31:41 (6564): No heartbeat from core client for 30 sec - exiting 15:31:42 (6564): No heartbeat from core client for 30 sec - exiting 15:31:43 (6564): No heartbeat from core client for 30 sec - exiting 15:31:44 (6564): No heartbeat from core client for 30 sec - exiting 15:31:45 (6564): No heartbeat from core client for 30 sec - exiting 15:31:46 (6564): No heartbeat from core client for 30 sec - exiting 15:31:47 (6564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:02:08 (7108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:09 (7868): No heartbeat from core client for 30 sec - exiting 08:54:10 (7868): No heartbeat from core client for 30 sec - exiting 08:54:11 (7868): No heartbeat from core client for 30 sec - exiting 08:54:12 (7868): No heartbeat from core client for 30 sec - exiting 08:54:13 (7868): No heartbeat from core client for 30 sec - exiting 08:54:14 (7868): No heartbeat from core client for 30 sec - exiting 08:54:15 (7868): No heartbeat from core client for 30 sec - exiting 08:54:16 (7868): No heartbeat from core client for 30 sec - exiting 08:54:17 (7868): No heartbeat from core client for 30 sec - exiting 08:54:18 (7868): No heartbeat from core client for 30 sec - exiting 08:54:19 (7868): No heartbeat from core client for 30 sec - exiting 08:54:20 (7868): No heartbeat from core client for 30 sec - exiting 08:54:21 (7868): No heartbeat from core client for 30 sec - exiting 08:54:22 (7868): No heartbeat from core client for 30 sec - exiting 08:54:23 (7868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:52 (7920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:05 (6428): No heartbeat from core client for 30 sec - exiting 09:05:06 (6428): No heartbeat from core client for 30 sec - exiting 09:05:07 (6428): No heartbeat from core client for 30 sec - exiting 09:05:08 (6428): No heartbeat from core client for 30 sec - exiting 09:05:09 (6428): No heartbeat from core client for 30 sec - exiting 09:05:10 (6428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:30:29 (7580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76F26018 read attempt to address 0x00000004 Engaging BOINC Windows Runtime Debugger... 09:24:23 (6060): No heartbeat from core client for 30 sec - exiting 09:24:24 (6060): No heartbeat from core client for 30 sec - exiting 09:24:25 (6060): No heartbeat from core client for 30 sec - exiting 09:24:26 (6060): No heartbeat from core client for 30 sec - exiting 09:24:27 (6060): No heartbeat from core client for 30 sec - exiting 09:24:28 (6060): No heartbeat from core client for 30 sec - exiting 09:24:29 (6060): No heartbeat from core client for 30 sec - exiting 09:24:30 (6060): No heartbeat from core client for 30 sec - exiting 09:24:31 (6060): No heartbeat from core client for 30 sec - exiting 09:24:32 (6060): No heartbeat from core client for 30 sec - exiting 09:24:33 (6060): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77795F1B read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Sep 2013 18:07:30	1087624	15991048	hadcm3n_7zfi_1980_40_008457201_0	259,200	403,348	1.5561
11 Sep 2013 20:39:37	1087624	15991048	hadcm3n_7zfi_1980_40_008457201_0	233,280	363,556	1.5585
10 Sep 2013 17:41:52	1087624	15991048	hadcm3n_7zfi_1980_40_008457201_0	207,360	323,247	1.5589
09 Sep 2013 18:13:18	1087624	15991048	hadcm3n_7zfi_1980_40_008457201_0	181,440	282,643	1.5578
06 Sep 2013 17:19:58	1087624	15991048	hadcm3n_7zfi_1980_40_008457201_0	155,520	241,964	1.5558
05 Sep 2013 17:36:31	1087624	15991048	hadcm3n_7zfi_1980_40_008457201_0	129,600	200,677	1.5484
04 Sep 2013 16:49:17	1087624	15991048	hadcm3n_7zfi_1980_40_008457201_0	103,680	159,228	1.5358
03 Sep 2013 10:46:18	1087624	15991048	hadcm3n_7zfi_1980_40_008457201_0	77,760	119,216	1.5331
02 Sep 2013 09:34:25	1087624	15991048	hadcm3n_7zfi_1980_40_008457201_0	51,840	79,391	1.5315
31 Aug 2013 21:55:40	1087624	15991048	hadcm3n_7zfi_1980_40_008457201_0	25,920	39,504	1.5241