Task 13394544

Name	hadcm3n_o1xj_1940_40_007445772_2
Workunit	7643275
Created	17 Sep 2011, 23:01:12 UTC
Sent	17 Sep 2011, 23:02:53 UTC
Report deadline	18 Dec 2011, 6:30:04 UTC
Received	30 Sep 2011, 3:22:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1164510
Run time	4 days 2 hours 32 min 29 sec
CPU time	4 days 2 hours 12 min 46 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.53 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:17:02 (1072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:08:45 (6508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:35:33 (6640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:40:51 (6404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:12:18 (4212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C87353 read attempt to address 0x403A2AF8 Engaging BOINC Windows Runtime Debugger... 01:17:44 (6640): No heartbeat from core client for 30 sec - exiting 01:17:45 (6640): No heartbeat from core client for 30 sec - exiting 01:17:46 (6640): No heartbeat from core client for 30 sec - exiting 01:17:47 (6640): No heartbeat from core client for 30 sec - exiting 01:17:48 (6640): No heartbeat from core client for 30 sec - exiting 01:17:49 (6640): No heartbeat from core client for 30 sec - exiting 01:17:50 (6640): No heartbeat from core client for 30 sec - exiting 01:17:51 (6640): No heartbeat from core client for 30 sec - exiting 01:17:52 (6640): No heartbeat from core client for 30 sec - exiting 01:17:53 (6640): No heartbeat from core client for 30 sec - exiting 01:17:54 (6640): No heartbeat from core client for 30 sec - exiting 01:17:55 (6640): No heartbeat from core client for 30 sec - exiting 01:17:56 (6640): No heartbeat from core client for 30 sec - exiting 01:17:57 (6640): No heartbeat from core client for 30 sec - exiting 01:17:58 (6640): No heartbeat from core client for 30 sec - exiting 01:17:59 (6640): No heartbeat from core client for 30 sec - exiting 01:18:00 (6640): No heartbeat from core client for 30 sec - exiting 01:18:01 (6640): No heartbeat from core client for 30 sec - exiting 01:18:02 (6640): No heartbeat from core client for 30 sec - exiting 01:18:03 (6640): No heartbeat from core client for 30 sec - exiting 01:18:04 (6640): No heartbeat from core client for 30 sec - exiting 01:18:05 (6640): No heartbeat from core client for 30 sec - exiting 01:18:06 (6640): No heartbeat from core client for 30 sec - exiting 01:18:07 (6640): No heartbeat from core client for 30 sec - exiting 01:18:08 (6640): No heartbeat from core client for 30 sec - exiting 01:18:09 (6640): No heartbeat from core client for 30 sec - exiting 01:18:10 (6640): No heartbeat from core client for 30 sec - exiting 01:18:11 (6640): No heartbeat from core client for 30 sec - exiting 01:18:12 (6640): No heartbeat from core client for 30 sec - exiting 01:18:13 (6640): No heartbeat from core client for 30 sec - exiting 01:18:14 (6640): No heartbeat from core client for 30 sec - exiting 01:18:15 (6640): No heartbeat from core client for 30 sec - exiting 01:18:16 (6640): No heartbeat from core client for 30 sec - exiting 01:18:17 (6640): No heartbeat from core client for 30 sec - exiting 01:18:18 (6640): No heartbeat from core client for 30 sec - exiting 01:18:19 (6640): No heartbeat from core client for 30 sec - exiting 01:18:20 (6640): No heartbeat from core client for 30 sec - exiting 01:18:21 (6640): No heartbeat from core client for 30 sec - exiting 01:18:22 (6640): No heartbeat from core client for 30 sec - exiting 01:18:23 (6640): No heartbeat from core client for 30 sec - exiting 01:18:24 (6640): No heartbeat from core client for 30 sec - exiting 01:18:25 (6640): No heartbeat from core client for 30 sec - exiting 01:18:26 (6640): No heartbeat from core client for 30 sec - exiting 01:18:27 (6640): No heartbeat from core client for 30 sec - exiting 01:18:28 (6640): No heartbeat from core client for 30 sec - exiting 01:18:29 (6640): No heartbeat from core client for 30 sec - exiting 01:18:30 (6640): No heartbeat from core client for 30 sec - exiting 01:18:31 (6640): No heartbeat from core client for 30 sec - exiting 01:18:32 (6640): No heartbeat from core client for 30 sec - exiting 01:18:33 (6640): No heartbeat from core client for 30 sec - exiting 01:18:34 (6640): No heartbeat from core client for 30 sec - exiting 01:18:35 (6640): No heartbeat from core client for 30 sec - exiting 01:18:36 (6640): No heartbeat from core client for 30 sec - exiting 01:18:37 (6640): No heartbeat from core client for 30 sec - exiting 01:18:38 (6640): No heartbeat from core client for 30 sec - exiting 01:18:39 (6640): No heartbeat from core client for 30 sec - exiting 01:18:40 (6640): No heartbeat from core client for 30 sec - exiting 01:18:41 (6640): No heartbeat from core client for 30 sec - exiting 01:18:42 (6640): No heartbeat from core client for 30 sec - exiting 01:18:43 (6640): No heartbeat from core client for 30 sec - exiting 01:18:44 (6640): No heartbeat from core client for 30 sec - exiting 01:18:45 (6640): No heartbeat from core client for 30 sec - exiting 01:18:46 (6640): No heartbeat from core client for 30 sec - exiting 01:18:47 (6640): No heartbeat from core client for 30 sec - exiting 01:18:48 (6640): No heartbeat from core client for 30 sec - exiting 01:18:49 (6640): No heartbeat from core client for 30 sec - exiting 01:18:50 (6640): No heartbeat from core client for 30 sec - exiting 01:18:51 (6640): No heartbeat from core client for 30 sec - exiting 01:18:52 (6640): No heartbeat from core client for 30 sec - exiting 01:18:53 (6640): No heartbeat from core client for 30 sec - exiting 01:18:54 (6640): No heartbeat from core client for 30 sec - exiting 01:18:55 (6640): No heartbeat from core client for 30 sec - exiting 01:18:56 (6640): No heartbeat from core client for 30 sec - exiting 01:18:57 (6640): No heartbeat from core client for 30 sec - exiting 01:18:58 (6640): No heartbeat from core client for 30 sec - exiting 01:18:59 (6640): No heartbeat from core client for 30 sec - exiting 01:19:00 (6640): No heartbeat from core client for 30 sec - exiting 01:19:01 (6640): No heartbeat from core client for 30 sec - exiting 01:19:02 (6640): No heartbeat from core client for 30 sec - exiting 01:19:03 (6640): No heartbeat from core client for 30 sec - exiting 01:19:04 (6640): No heartbeat from core client for 30 sec - exiting 01:19:05 (6640): No heartbeat from core client for 30 sec - exiting 01:19:06 (6640): No heartbeat from core client for 30 sec - exiting 01:19:07 (6640): No heartbeat from core client for 30 sec - exiting 01:19:08 (6640): No heartbeat from core client for 30 sec - exiting 01:19:09 (6640): No heartbeat from core client for 30 sec - exiting 01:19:10 (6640): No heartbeat from core client for 30 sec - exiting 01:19:11 (6640): No heartbeat from core client for 30 sec - exiting 01:19:12 (6640): No heartbeat from core client for 30 sec - exiting 01:19:13 (6640): No heartbeat from core client for 30 sec - exiting 01:19:14 (6640): No heartbeat from core client for 30 sec - exiting 01:19:15 (6640): No heartbeat from core client for 30 sec - exiting 01:19:16 (6640): No heartbeat from core client for 30 sec - exiting 01:19:17 (6640): No heartbeat from core client for 30 sec - exiting 01:19:18 (6640): No heartbeat from core client for 30 sec - exiting 01:19:19 (6640): No heartbeat from core client for 30 sec - exiting 01:19:20 (6640): No heartbeat from core client for 30 sec - exiting 01:19:21 (6640): No heartbeat from core client for 30 sec - exiting 01:19:22 (6640): No heartbeat from core client for 30 sec - exiting 01:19:23 (6640): No heartbeat from core client for 30 sec - exiting 01:19:24 (6640): No heartbeat from core client for 30 sec - exiting 01:19:25 (6640): No heartbeat from core client for 30 sec - exiting 01:19:26 (6640): No heartbeat from core client for 30 sec - exiting 01:19:27 (6640): No heartbeat from core client for 30 sec - exiting 01:19:28 (6640): No heartbeat from core client for 30 sec - exiting 01:19:29 (6640): No heartbeat from core client for 30 sec - exiting 01:19:30 (6640): No heartbeat from core client for 30 sec - exiting 01:19:31 (6640): No heartbeat from core client for 30 sec - exiting 01:19:32 (6640): No heartbeat from core client for 30 sec - exiting 01:19:33 (6640): No heartbeat from core client for 30 sec - exiting 01:19:34 (6640): No heartbeat from core client for 30 sec - exiting 01:19:35 (6640): No heartbeat from core client for 30 sec - exiting 01:19:36 (6640): No heartbeat from core client for 30 sec - exiting 01:19:37 (6640): No heartbeat from core client for 30 sec - exiting 01:19:38 (6640): No heartbeat from core client for 30 sec - exiting 01:19:39 (6640): No heartbeat from core client for 30 sec - exiting 01:19:40 (6640): No heartbeat from core client for 30 sec - exiting 01:19:41 (6640): No heartbeat from core client for 30 sec - exiting 01:19:42 (6640): No heartbeat from core client for 30 sec - exiting 01:19:43 (6640): No heartbeat from core client for 30 sec - exiting 01:19:44 (6640): No heartbeat from core client for 30 sec - exiting 01:19:45 (6640): No heartbeat from core client for 30 sec - exiting 01:19:46 (6640): No heartbeat from core client for 30 sec - exiting 01:19:47 (6640): No heartbeat from core client for 30 sec - exiting 01:19:48 (6640): No heartbeat from core client for 30 sec - exiting 01:19:49 (6640): No heartbeat from core client for 30 sec - exiting 01:19:50 (6640): No heartbeat from core client for 30 sec - exiting 01:19:51 (6640): No heartbeat from core client for 30 sec - exiting 01:19:52 (6640): No heartbeat from core client for 30 sec - exiting 01:19:53 (6640): No heartbeat from core client for 30 sec - exiting 01:19:54 (6640): No heartbeat from core client for 30 sec - exiting 01:19:55 (6640): No heartbeat from core client for 30 sec - exiting 01:19:56 (6640): No heartbeat from core client for 30 sec - exiting 01:19:57 (6640): No heartbeat from core client for 30 sec - exiting 01:19:58 (6640): No heartbeat from core client for 30 sec - exiting 01:19:59 (6640): No heartbeat from core client for 30 sec - exiting 01:20:00 (6640): No heartbeat from core client for 30 sec - exiting 01:20:01 (6640): No heartbeat from core client for 30 sec - exiting 01:20:02 (6640): No heartbeat from core client for 30 sec - exiting 01:20:03 (6640): No heartbeat from core client for 30 sec - exiting 01:20:04 (6640): No heartbeat from core client for 30 sec - exiting 01:20:05 (6640): No heartbeat from core client for 30 sec - exiting 01:20:06 (6640): No heartbeat from core client for 30 sec - exiting 01:20:07 (6640): No heartbeat from core client for 30 sec - exiting 01:20:08 (6640): No heartbeat from core client for 30 sec - exiting 01:20:09 (6640): No heartbeat from core client for 30 sec - exiting 01:20:10 (6640): No heartbeat from core client for 30 sec - exiting 01:20:11 (6640): No heartbeat from core client for 30 sec - exiting 01:20:12 (6640): No heartbeat from core client for 30 sec - exiting 01:20:13 (6640): No heartbeat from core client for 30 sec - exiting 01:20:14 (6640): No heartbeat from core client for 30 sec - exiting 01:20:15 (6640): No heartbeat from core client for 30 sec - exiting 01:20:16 (6640): No heartbeat from core client for 30 sec - exiting 01:20:17 (6640): No heartbeat from core client for 30 sec - exiting 01:20:18 (6640): No heartbeat from core client for 30 sec - exiting 01:20:19 (6640): No heartbeat from core client for 30 sec - exiting 01:20:20 (6640): No heartbeat from core client for 30 sec - exiting 01:20:21 (6640): No heartbeat from core client for 30 sec - exiting 01:20:22 (6640): No heartbeat from core client for 30 sec - exiting 01:20:23 (6640): No heartbeat from core client for 30 sec - exiting 01:20:24 (6640): No heartbeat from core client for 30 sec - exiting 01:20:25 (6640): No heartbeat from core client for 30 sec - exiting 01:20:26 (6640): No heartbeat from core client for 30 sec - exiting 01:20:27 (6640): No heartbeat from core client for 30 sec - exiting 01:20:28 (6640): No heartbeat from core client for 30 sec - exiting 01:20:29 (6640): No heartbeat from core client for 30 sec - exiting 01:20:30 (6640): No heartbeat from core client for 30 sec - exiting 01:20:31 (6640): No heartbeat from core client for 30 sec - exiting 01:20:32 (6640): No heartbeat from core client for 30 sec - exiting 01:20:33 (6640): No heartbeat from core client for 30 sec - exiting 01:20:34 (6640): No heartbeat from core client for 30 sec - exiting 01:20:35 (6640): No heartbeat from core client for 30 sec - exiting 01:20:36 (6640): No heartbeat from core client for 30 sec - exiting 01:20:37 (6640): No heartbeat from core client for 30 sec - exiting 01:20:38 (6640): No heartbeat from core client for 30 sec - exiting 01:20:39 (6640): No heartbeat from core client for 30 sec - exiting 01:20:40 (6640): No heartbeat from core client for 30 sec - exiting 01:20:41 (6640): No heartbeat from core client for 30 sec - exiting 01:20:42 (6640): No heartbeat from core client for 30 sec - exiting 01:20:43 (6640): No heartbeat from core client for 30 sec - exiting 01:20:44 (6640): No heartbeat from core client for 30 sec - exiting 01:20:45 (6640): No heartbeat from core client for 30 sec - exiting 01:20:46 (6640): No heartbeat from core client for 30 sec - exiting 01:20:47 (6640): No heartbeat from core client for 30 sec - exiting 01:20:48 (6640): No heartbeat from core client for 30 sec - exiting 01:20:49 (6640): No heartbeat from core client for 30 sec - exiting 01:20:50 (6640): No heartbeat from core client for 30 sec - exiting 01:20:51 (6640): No heartbeat from core client for 30 sec - exiting 01:20:52 (6640): No heartbeat from core client for 30 sec - exiting 01:20:53 (6640): No heartbeat from core client for 30 sec - exiting 01:20:54 (6640): No heartbeat from core client for 30 sec - exiting 01:20:55 (6640): No heartbeat from core client for 30 sec - exiting 01:20:56 (6640): No heartbeat from core client for 30 sec - exiting 01:20:57 (6640): No heartbeat from core client for 30 sec - exiting 01:20:58 (6640): No heartbeat from core client for 30 sec - exiting 01:20:59 (6640): No heartbeat from core client for 30 sec - exiting 01:21:00 (6640): No heartbeat from core client for 30 sec - exiting 01:21:01 (6640): No heartbeat from core client for 30 sec - exiting 01:21:02 (6640): No heartbeat from core client for 30 sec - exiting 01:21:03 (6640): No heartbeat from core client for 30 sec - exiting 01:21:04 (6640): No heartbeat from core client for 30 sec - exiting 01:21:05 (6640): No heartbeat from core client for 30 sec - exiting 01:21:06 (6640): No heartbeat from core client for 30 sec - exiting 01:21:07 (6640): No heartbeat from core client for 30 sec - exiting 01:21:08 (6640): No heartbeat from core client for 30 sec - exiting 01:21:09 (6640): No heartbeat from core client for 30 sec - exiting 01:21:10 (6640): No heartbeat from core client for 30 sec - exiting 01:21:11 (6640): No heartbeat from core client for 30 sec - exiting 01:21:12 (6640): No heartbeat from core client for 30 sec - exiting 01:21:13 (6640): No heartbeat from core client for 30 sec - exiting 01:21:14 (6640): No heartbeat from core client for 30 sec - exiting 01:21:15 (6640): No heartbeat from core client for 30 sec - exiting 01:21:16 (6640): No heartbeat from core client for 30 sec - exiting 01:21:17 (6640): No heartbeat from core client for 30 sec - exiting 01:21:18 (6640): No heartbeat from core client for 30 sec - exiting 01:21:19 (6640): No heartbeat from core client for 30 sec - exiting 01:21:20 (6640): No heartbeat from core client for 30 sec - exiting 01:21:21 (6640): No heartbeat from core client for 30 sec - exiting 01:21:22 (6640): No heartbeat from core client for 30 sec - exiting 01:21:23 (6640): No heartbeat from core client for 30 sec - exiting 01:21:24 (6640): No heartbeat from core client for 30 sec - exiting 01:21:25 (6640): No heartbeat from core client for 30 sec - exiting 01:21:26 (6640): No heartbeat from core client for 30 sec - exiting 01:21:27 (6640): No heartbeat from core client for 30 sec - exiting 01:21:28 (6640): No heartbeat from core client for 30 sec - exiting 01:21:29 (6640): No heartbeat from core client for 30 sec - exiting 01:21:30 (6640): No heartbeat from core client for 30 sec - exiting 01:21:31 (6640): No heartbeat from core client for 30 sec - exiting 01:21:32 (6640): No heartbeat from core client for 30 sec - exiting 01:21:33 (6640): No heartbeat from core client for 30 sec - exiting 01:21:34 (6640): No heartbeat from core client for 30 sec - exiting 01:21:35 (6640): No heartbeat from core client for 30 sec - exiting 01:21:36 (6640): No heartbeat from core client for 30 sec - exiting 01:21:37 (6640): No heartbeat from core client for 30 sec - exiting 01:21:38 (6640): No heartbeat from core client for 30 sec - exiting 01:21:39 (6640): No heartbeat from core client for 30 sec - exiting 01:21:40 (6640): No heartbeat from core client for 30 sec - exiting 01:21:41 (6640): No heartbeat from core client for 30 sec - exiting 01:21:42 (6640): No heartbeat from core client for 30 sec - exiting 01:21:43 (6640): No heartbeat from core client for 30 sec - exiting 01:21:44 (6640): No heartbeat from core client for 30 sec - exiting 01:21:45 (6640): No heartbeat from core client for 30 sec - exiting 01:21:46 (6640): No heartbeat from core client for 30 sec - exiting 01:21:47 (6640): No heartbeat from core client for 30 sec - exiting 01:21:48 (6640): No heartbeat from core client for 30 sec - exiting 01:21:49 (6640): No heartbeat from core client for 30 sec - exiting 01:21:50 (6640): No heartbeat from core client for 30 sec - exiting 01:21:51 (6640): No heartbeat from core client for 30 sec - exiting 01:21:52 (6640): No heartbeat from core client for 30 sec - exiting 01:21:53 (6640): No heartbeat from core client for 30 sec - exiting 01:21:54 (6640): No heartbeat from core client for 30 sec - exiting 01:21:55 (6640): No heartbeat from core client for 30 sec - exiting 01:21:56 (6640): No heartbeat from core client for 30 sec - exiting 01:21:57 (6640): No heartbeat from core client for 30 sec - exiting 01:21:58 (6640): No heartbeat from core client for 30 sec - exiting 01:21:59 (6640): No heartbeat from core client for 30 sec - exiting 01:22:00 (6640): No heartbeat from core client for 30 sec - exiting 01:22:01 (6640): No heartbeat from core client for 30 sec - exiting 01:22:02 (6640): No heartbeat from core client for 30 sec - exiting 01:22:03 (6640): No heartbeat from core client for 30 sec - exiting 01:22:04 (6640): No heartbeat from core client for 30 sec - exiting 01:22:05 (6640): No heartbeat from core client for 30 sec - exiting 01:22:06 (6640): No heartbeat from core client for 30 sec - exiting 01:22:07 (6640): No heartbeat from core client for 30 sec - exiting 01:22:08 (6640): No heartbeat from core client for 30 sec - exiting 01:22:09 (6640): No heartbeat from core client for 30 sec - exiting 01:22:10 (6640): No heartbeat from core client for 30 sec - exiting 01:22:11 (6640): No heartbeat from core client for 30 sec - exiting 01:22:12 (6640): No heartbeat from core client for 30 sec - exiting 01:22:13 (6640): No heartbeat from core client for 30 sec - exiting 04:23:07 (6640): No heartbeat from core client for 30 sec - exiting 04:23:08 (6640): No heartbeat from core client for 30 sec - exiting 04:23:09 (6640): No heartbeat from core client for 30 sec - exiting 04:23:10 (6640): No heartbeat from core client for 30 sec - exiting 04:23:11 (6640): No heartbeat from core client for 30 sec - exiting 04:23:12 (6640): No heartbeat from core client for 30 sec - exiting 04:23:13 (6640): No heartbeat from core client for 30 sec - exiting 04:23:14 (6640): No heartbeat from core client for 30 sec - exiting 04:23:15 (6640): No heartbeat from core client for 30 sec - exiting 04:23:16 (6640): No heartbeat from core client for 30 sec - exiting 04:23:17 (6640): No heartbeat from core client for 30 sec - exiting 04:23:18 (6640): No heartbeat from core client for 30 sec - exiting 04:23:19 (6640): No heartbeat from core client for 30 sec - exiting 04:23:20 (6640): No heartbeat from core client for 30 sec - exiting 04:23:21 (6640): No heartbeat from core client for 30 sec - exiting 04:23:22 (6640): No heartbeat from core client for 30 sec - exiting 04:23:23 (6640): No heartbeat from core client for 30 sec - exiting 04:23:24 (6640): No heartbeat from core client for 30 sec - exiting 04:23:25 (6640): No heartbeat from core client for 30 sec - exiting 04:23:26 (6640): No heartbeat from core client for 30 sec - exiting 04:23:27 (6640): No heartbeat from core client for 30 sec - exiting 04:23:28 (6640): No heartbeat from core client for 30 sec - exiting 04:23:29 (6640): No heartbeat from core client for 30 sec - exiting 04:23:30 (6640): No heartbeat from core client for 30 sec - exiting 04:23:31 (6640): No heartbeat from core client for 30 sec - exiting 04:23:32 (6640): No heartbeat from core client for 30 sec - exiting 04:23:33 (6640): No heartbeat from core client for 30 sec - exiting 04:23:34 (6640): No heartbeat from core client for 30 sec - exiting 04:23:35 (6640): No heartbeat from core client for 30 sec - exiting 04:23:36 (6640): No heartbeat from core client for 30 sec - exiting 04:23:37 (6640): No heartbeat from core client for 30 sec - exiting 04:23:38 (6640): No heartbeat from core client for 30 sec - exiting 04:23:39 (6640): No heartbeat from core client for 30 sec - exiting 04:23:40 (6640): No heartbeat from core client for 30 sec - exiting 04:23:41 (6640): No heartbeat from core client for 30 sec - exiting 04:23:42 (6640): No heartbeat from core client for 30 sec - exiting 04:23:43 (6640): No heartbeat from core client for 30 sec - exiting 04:23:44 (6640): No heartbeat from core client for 30 sec - exiting 04:23:45 (6640): No heartbeat from core client for 30 sec - exiting 04:23:46 (6640): No heartbeat from core client for 30 sec - exiting 04:23:47 (6640): No heartbeat from core client for 30 sec - exiting 04:23:48 (6640): No heartbeat from core client for 30 sec - exiting 04:23:49 (6640): No heartbeat from core client for 30 sec - exiting 04:23:50 (6640): No heartbeat from core client for 30 sec - exiting 04:23:51 (6640): No heartbeat from core client for 30 sec - exiting 04:23:52 (6640): No heartbeat from core client for 30 sec - exiting 04:23:53 (6640): No heartbeat from core client for 30 sec - exiting 04:23:54 (6640): No heartbeat from core client for 30 sec - exiting 04:23:55 (6640): No heartbeat from core client for 30 sec - exiting 04:23:56 (6640): No heartbeat from core client for 30 sec - exiting 04:23:57 (6640): No heartbeat from core client for 30 sec - exiting 04:23:58 (6640): No heartbeat from core client for 30 sec - exiting 04:23:59 (6640): No heartbeat from core client for 30 sec - exiting 04:24:00 (6640): No heartbeat from core client for 30 sec - exiting 04:24:01 (6640): No heartbeat from core client for 30 sec - exiting 04:24:02 (6640): No heartbeat from core client for 30 sec - exiting 04:24:03 (6640): No heartbeat from core client for 30 sec - exiting 04:24:04 (6640): No heartbeat from core client for 30 sec - exiting 04:24:05 (6640): No heartbeat from core client for 30 sec - exiting 04:24:06 (6640): No heartbeat from core client for 30 sec - exiting 04:24:07 (6640): No heartbeat from core client for 30 sec - exiting 04:24:08 (6640): No heartbeat from core client for 30 sec - exiting 04:24:09 (6640): No heartbeat from core client for 30 sec - exiting 04:24:10 (6640): No heartbeat from core client for 30 sec - exiting 04:24:11 (6640): No heartbeat from core client for 30 sec - exiting 04:24:12 (6640): No heartbeat from core client for 30 sec - exiting 04:24:13 (6640): No heartbeat from core client for 30 sec - exiting 04:24:14 (6640): No heartbeat from core client for 30 sec - exiting 04:24:15 (6640): No heartbeat from core client for 30 sec - exiting 04:24:16 (6640): No heartbeat from core client for 30 sec - exiting 04:24:17 (6640): No heartbeat from core client for 30 sec - exiting 04:24:18 (6640): No heartbeat from core client for 30 sec - exiting 04:24:19 (6640): No heartbeat from core client for 30 sec - exiting 04:24:20 (6640): No heartbeat from core client for 30 sec - exiting 04:24:21 (6640): No heartbeat from core client for 30 sec - exiting 04:24:22 (6640): No heartbeat from core client for 30 sec - exiting 04:24:23 (6640): No heartbeat from core client for 30 sec - exiting 04:24:24 (6640): No heartbeat from core client for 30 sec - exiting 04:24:25 (6640): No heartbeat from core client for 30 sec - exiting 04:24:26 (6640): No heartbeat from core client for 30 sec - exiting 04:24:27 (6640): No heartbeat from core client for 30 sec - exiting 04:24:28 (6640): No heartbeat from core client for 30 sec - exiting 04:24:29 (6640): No heartbeat from core client for 30 sec - exiting 04:24:30 (6640): No heartbeat from core client for 30 sec - exiting 04:24:31 (6640): No heartbeat from core client for 30 sec - exiting 04:24:32 (6640): No heartbeat from core client for 30 sec - exiting 04:24:33 (6640): No heartbeat from core client for 30 sec - exiting 04:24:34 (6640): No heartbeat from core client for 30 sec - exiting 04:24:35 (6640): No heartbeat from core client for 30 sec - exiting 04:24:36 (6640): No heartbeat from core client for 30 sec - exiting 04:24:37 (6640): No heartbeat from core client for 30 sec - exiting 04:24:38 (6640): No heartbeat from core client for 30 sec - exiting 04:24:39 (6640): No heartbeat from core client for 30 sec - exiting 04:24:40 (6640): No heartbeat from core client for 30 sec - exiting 04:24:41 (6640): No heartbeat from core client for 30 sec - exiting 04:24:42 (6640): No heartbeat from core client for 30 sec - exiting 04:24:43 (6640): No heartbeat from core client for 30 sec - exiting 04:24:44 (6640): No heartbeat from core client for 30 sec - exiting 04:24:45 (6640): No heartbeat from core client for 30 sec - exiting 04:24:46 (6640): No heartbeat from core client for 30 sec - exiting 04:24:47 (6640): No heartbeat from core client for 30 sec - exiting 04:24:48 (6640): No heartbeat from core client for 30 sec - exiting 04:24:49 (6640): No heartbeat from core client for 30 sec - exiting 04:24:50 (6640): No heartbeat from core client for 30 sec - exiting 04:24:51 (6640): No heartbeat from core client for 30 sec - exiting 04:24:52 (6640): No heartbeat from core client for 30 sec - exiting 04:24:53 (6640): No heartbeat from core client for 30 sec - exiting 04:24:54 (6640): No heartbeat from core client for 30 sec - exiting 04:24:55 (6640): No heartbeat from core client for 30 sec - exiting 04:24:56 (6640): No heartbeat from core client for 30 sec - exiting 04:24:57 (6640): No heartbeat from core client for 30 sec - exiting 04:24:58 (6640): No heartbeat from core client for 30 sec - exiting 04:24:59 (6640): No heartbeat from core client for 30 sec - exiting 04:25:00 (6640): No heartbeat from core client for 30 sec - exiting 04:25:01 (6640): No heartbeat from core client for 30 sec - exiting 04:25:02 (6640): No heartbeat from core client for 30 sec - exiting 04:25:03 (6640): No heartbeat from core client for 30 sec - exiting 04:25:04 (6640): No heartbeat from core client for 30 sec - exiting 04:25:05 (6640): No heartbeat from core client for 30 sec - exiting 04:25:06 (6640): No heartbeat from core client for 30 sec - exiting 04:25:07 (6640): No heartbeat from core client for 30 sec - exiting 04:25:08 (6640): No heartbeat from core client for 30 sec - exiting 04:25:09 (6640): No heartbeat from core client for 30 sec - exiting 04:25:10 (6640): No heartbeat from core client for 30 sec - exiting 04:25:11 (6640): No heartbeat from core client for 30 sec - exiting 04:25:12 (6640): No heartbeat from core client for 30 sec - exiting 04:25:13 (6640): No heartbeat from core client for 30 sec - exiting 04:25:14 (6640): No heartbeat from core client for 30 sec - exiting 04:25:15 (6640): No heartbeat from core client for 30 sec - exiting 04:25:16 (6640): No heartbeat from core client for 30 sec - exiting 04:25:17 (6640): No heartbeat from core client for 30 sec - exiting 04:25:18 (6640): No heartbeat from core client for 30 sec - exiting 04:25:19 (6640): No heartbeat from core client for 30 sec - exiting 04:25:20 (6640): No heartbeat from core client for 30 sec - exiting 04:25:21 (6640): No heartbeat from core client for 30 sec - exiting 04:25:22 (6640): No heartbeat from core client for 30 sec - exiting 04:25:23 (6640): No heartbeat from core client for 30 sec - exiting 04:25:24 (6640): No heartbeat from core client for 30 sec - exiting 04:25:25 (6640): No heartbeat from core client for 30 sec - exiting 04:25:26 (6640): No heartbeat from core client for 30 sec - exiting 04:25:27 (6640): No heartbeat from core client for 30 sec - exiting 04:25:28 (6640): No heartbeat from core client for 30 sec - exiting 04:25:29 (6640): No heartbeat from core client for 30 sec - exiting 04:25:30 (6640): No heartbeat from core client for 30 sec - exiting 04:25:31 (6640): No heartbeat from core client for 30 sec - exiting 04:25:32 (6640): No heartbeat from core client for 30 sec - exiting 04:25:33 (6640): No heartbeat from core client for 30 sec - exiting 04:25:34 (6640): No heartbeat from core client for 30 sec - exiting 04:25:35 (6640): No heartbeat from core client for 30 sec - exiting 04:25:36 (6640): No heartbeat from core client for 30 sec - exiting 04:25:37 (6640): No heartbeat from core client for 30 sec - exiting 04:25:38 (6640): No heartbeat from core client for 30 sec - exiting 04:25:39 (6640): No heartbeat from core client for 30 sec - exiting 04:25:40 (6640): No heartbeat from core client for 30 sec - exiting 04:25:41 (6640): No heartbeat from core client for 30 sec - exiting 04:25:42 (6640): No heartbeat from core client for 30 sec - exiting 04:25:43 (6640): No heartbeat from core client for 30 sec - exiting 04:25:44 (6640): No heartbeat from core client for 30 sec - exiting 04:25:45 (6640): No heartbeat from core client for 30 sec - exiting 04:25:46 (6640): No heartbeat from core client for 30 sec - exiting 04:25:47 (6640): No heartbeat from core client for 30 sec - exiting 04:25:48 (6640): No heartbeat from core client for 30 sec - exiting 04:25:49 (6640): No heartbeat from core client for 30 sec - exiting 04:25:50 (6640): No heartbeat from core client for 30 sec - exiting 04:25:51 (6640): No heartbeat from core client for 30 sec - exiting 04:25:52 (6640): No heartbeat from core client for 30 sec - exiting 04:25:53 (6640): No heartbeat from core client for 30 sec - exiting 04:25:54 (6640): No heartbeat from core client for 30 sec - exiting 04:25:55 (6640): No heartbeat from core client for 30 sec - exiting 04:25:56 (6640): No heartbeat from core client for 30 sec - exiting 04:25:57 (6640): No heartbeat from core client for 30 sec - exiting 04:25:58 (6640): No heartbeat from core client for 30 sec - exiting 04:25:59 (6640): No heartbeat from core client for 30 sec - exiting 04:26:00 (6640): No heartbeat from core client for 30 sec - exiting 04:26:01 (6640): No heartbeat from core client for 30 sec - exiting 04:26:02 (6640): No heartbeat from core client for 30 sec - exiting 04:26:03 (6640): No heartbeat from core client for 30 sec - exiting 04:26:04 (6640): No heartbeat from core client for 30 sec - exiting 04:26:05 (6640): No heartbeat from core client for 30 sec - exiting 04:26:06 (6640): No heartbeat from core client for 30 sec - exiting 04:26:07 (6640): No heartbeat from core client for 30 sec - exiting 04:26:08 (6640): No heartbeat from core client for 30 sec - exiting 04:26:09 (6640): No heartbeat from core client for 30 sec - exiting 04:26:10 (6640): No heartbeat from core client for 30 sec - exiting 04:26:11 (6640): No heartbeat from core client for 30 sec - exiting 04:26:12 (6640): No heartbeat from core client for 30 sec - exiting 04:26:13 (6640): No heartbeat from core client for 30 sec - exiting 04:26:14 (6640): No heartbeat from core client for 30 sec - exiting 04:26:15 (6640): No heartbeat from core client for 30 sec - exiting 04:26:16 (6640): No heartbeat from core client for 30 sec - exiting 04:26:17 (6640): No heartbeat from core client for 30 sec - exiting 04:26:18 (6640): No heartbeat from core client for 30 sec - exiting 04:26:19 (6640): No heartbeat from core client for 30 sec - exiting 04:26:20 (6640): No heartbeat from core client for 30 sec - exiting 04:26:21 (6640): No heartbeat from core client for 30 sec - exiting 04:26:22 (6640): No heartbeat from core client for 30 sec - exiting 04:26:23 (6640): No heartbeat from core client for 30 sec - exiting 04:26:24 (6640): No heartbeat from core client for 30 sec - exiting 04:26:25 (6640): No heartbeat from core client for 30 sec - exiting 04:26:26 (6640): No heartbeat from core client for 30 sec - exiting 04:26:27 (6640): No heartbeat from core client for 30 sec - exiting 04:26:28 (6640): No heartbeat from core client for 30 sec - exiting 04:26:29 (6640): No heartbeat from core client for 30 sec - exiting 04:26:30 (6640): No heartbeat from core client for 30 sec - exiting 04:26:31 (6640): No heartbeat from core client for 30 sec - exiting 04:26:32 (6640): No heartbeat from core client for 30 sec - exiting 04:26:33 (6640): No heartbeat from core client for 30 sec - exiting 04:26:34 (6640): No heartbeat from core client for 30 sec - exiting 04:26:35 (6640): No heartbeat from core client for 30 sec - exiting 04:26:36 (6640): No heartbeat from core client for 30 sec - exiting 04:26:37 (6640): No heartbeat from core client for 30 sec - exiting 04:26:38 (6640): No heartbeat from core client for 30 sec - exiting 04:26:39 (6640): No heartbeat from core client for 30 sec - exiting 04:26:40 (6640): No heartbeat from core client for 30 sec - exiting 04:26:41 (6640): No heartbeat from core client for 30 sec - exiting 04:26:42 (6640): No heartbeat from core client for 30 sec - exiting 04:26:43 (6640): No heartbeat from core client for 30 sec - exiting 04:26:44 (6640): No heartbeat from core client for 30 sec - exiting 04:26:45 (6640): No heartbeat from core client for 30 sec - exiting 04:26:46 (6640): No heartbeat from core client for 30 sec - exiting 04:26:47 (6640): No heartbeat from core client for 30 sec - exiting 04:26:48 (6640): No heartbeat from core client for 30 sec - exiting 04:26:49 (6640): No heartbeat from core client for 30 sec - exiting 04:26:50 (6640): No heartbeat from core client for 30 sec - exiting 04:26:51 (6640): No heartbeat from core client for 30 sec - exiting 04:26:52 (6640): No heartbeat from core client for 30 sec - exiting 04:26:53 (6640): No heartbeat from core client for 30 sec - exiting 04:26:54 (6640): No heartbeat from core client for 30 sec - exiting 04:26:55 (6640): No heartbeat from core client for 30 sec - exiting 04:26:56 (6640): No heartbeat from core client for 30 sec - exiting 04:26:57 (6640): No heartbeat from core client for 30 sec - exiting 04:26:58 (6640): No heartbeat from core client for 30 sec - exiting 04:26:59 (6640): No heartbeat from core client for 30 sec - exiting 04:27:00 (6640): No heartbeat from core client for 30 sec - exiting 04:27:01 (6640): No heartbeat from core client for 30 sec - exiting 04:27:02 (6640): No heartbeat from core client for 30 sec - exiting 04:27:03 (6640): No heartbeat from core client for 30 sec - exiting 04:27:04 (6640): No heartbeat from core client for 30 sec - exiting 04:27:05 (6640): No heartbeat from core client for 30 sec - exiting 04:27:06 (6640): No heartbeat from core client for 30 sec - exiting 04:27:07 (6640): No heartbeat from core client for 30 sec - exiting 04:27:08 (6640): No heartbeat from core client for 30 sec - exiting 04:27:09 (6640): No heartbeat from core client for 30 sec - exiting 04:27:10 (6640): No heartbeat from core client for 30 sec - exiting 04:27:11 (6640): No heartbeat from core client for 30 sec - exiting 04:27:12 (6640): No heartbeat from core client for 30 sec - exiting 04:27:13 (6640): No heartbeat from core client for 30 sec - exiting 04:27:14 (6640): No heartbeat from core client for 30 sec - exiting 04:27:15 (6640): No heartbeat from core client for 30 sec - exiting 04:27:16 (6640): No heartbeat from core client for 30 sec - exiting 04:27:17 (6640): No heartbeat from core client for 30 sec - exiting 04:27:18 (6640): No heartbeat from core client for 30 sec - exiting 04:27:19 (6640): No heartbeat from core client for 30 sec - exiting 04:27:20 (6640): No heartbeat from core client for 30 sec - exiting 04:27:21 (6640): No heartbeat from core client for 30 sec - exiting 04:27:22 (6640): No heartbeat from core client for 30 sec - exiting 04:27:23 (6640): No heartbeat from core client for 30 sec - exiting 04:27:24 (6640): No heartbeat from core client for 30 sec - exiting 04:27:25 (6640): No heartbeat from core client for 30 sec - exiting 04:27:26 (6640): No heartbeat from core client for 30 sec - exiting 04:27:27 (6640): No heartbeat from core client for 30 sec - exiting 04:27:28 (6640): No heartbeat from core client for 30 sec - exiting 04:27:29 (6640): No heartbeat from core client for 30 sec - exiting 04:27:30 (6640): No heartbeat from core client for 30 sec - exiting 04:27:31 (6640): No heartbeat from core client for 30 sec - exiting 04:27:32 (6640): No heartbeat from core client for 30 sec - exiting 04:27:33 (6640): No heartbeat from core client for 30 sec - exiting 04:27:34 (6640): No heartbeat from core client for 30 sec - exiting 04:27:35 (6640): No heartbeat from core client for 30 sec - exiting 04:27:36 (6640): No heartbeat from core client for 30 sec - exiting 04:27:37 (6640): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1972, selfPID=1972, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C83A93 read attempt to address 0x403A2B00 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1xj_1940_40_007445772/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Sep 2011 21:56:02	1164510	13394544	hadcm3n_o1xj_1940_40_007445772_2	259,200	334,883	1.2920
26 Sep 2011 23:42:03	1164510	13394544	hadcm3n_o1xj_1940_40_007445772_2	233,280	304,758	1.3064
26 Sep 2011 05:22:39	1164510	13394544	hadcm3n_o1xj_1940_40_007445772_2	207,360	275,693	1.3295
25 Sep 2011 00:55:28	1164510	13394544	hadcm3n_o1xj_1940_40_007445772_2	181,440	253,073	1.3948
24 Sep 2011 18:38:36	1164510	13394544	hadcm3n_o1xj_1940_40_007445772_2	155,520	230,428	1.4817
24 Sep 2011 12:18:44	1164510	13394544	hadcm3n_o1xj_1940_40_007445772_2	129,600	207,825	1.6036
24 Sep 2011 05:59:54	1164510	13394544	hadcm3n_o1xj_1940_40_007445772_2	103,680	185,113	1.7854
23 Sep 2011 23:20:14	1164510	13394544	hadcm3n_o1xj_1940_40_007445772_2	77,760	161,273	2.0740
18 Sep 2011 20:17:46	1164510	13394544	hadcm3n_o1xj_1940_40_007445772_2	51,840	68,870	1.3285
18 Sep 2011 10:13:16	1164510	13394544	hadcm3n_o1xj_1940_40_007445772_2	25,920	35,321	1.3627