Task 13294633

Name	hadcm3n_o6x1_1980_40_007422913_0
Workunit	7620548
Created	25 Aug 2011, 7:30:17 UTC
Sent	25 Aug 2011, 11:25:35 UTC
Report deadline	24 Nov 2011, 18:52:46 UTC
Received	6 Nov 2011, 21:22:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1064350
Run time	29 days 0 hours 55 min 3 sec
CPU time	22 days 7 hours 46 min
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	1.54 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:46:11 (14492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:17:47 (6248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:17:48 (6248): No heartbeat from core client for 30 sec - exiting 08:17:49 (6248): No heartbeat from core client for 30 sec - exiting 08:17:50 (6248): No heartbeat from core client for 30 sec - exiting 08:30:57 (7064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:30:58 (7064): No heartbeat from core client for 30 sec - exiting 08:34:49 (7452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:11 (8712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:21:48 (8408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:34:22 (9336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:38:27 (8748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6628, iMonCtr=1 Model crash detected, will try to restart... 16:00:36 (5616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:00:37 (5616): No heartbeat from core client for 30 sec - exiting 16:00:38 (5616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:29:21 (6308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:22 (6308): No heartbeat from core client for 30 sec - exiting 11:29:58 (9900): No heartbeat from core client for 30 sec - exiting 11:29:59 (9900): No heartbeat from core client for 30 sec - exiting 11:30:00 (9900): No heartbeat from core client for 30 sec - exiting 11:30:01 (9900): No heartbeat from core client for 30 sec - exiting 11:30:02 (9900): No heartbeat from core client for 30 sec - exiting 11:30:03 (9900): No heartbeat from core client for 30 sec - exiting 11:30:04 (9900): No heartbeat from core client for 30 sec - exiting 11:30:05 (9900): No heartbeat from core client for 30 sec - exiting 11:30:06 (9900): No heartbeat from core client for 30 sec - exiting 11:30:07 (9900): No heartbeat from core client for 30 sec - exiting 11:30:08 (9900): No heartbeat from core client for 30 sec - exiting 11:30:09 (9900): No heartbeat from core client for 30 sec - exiting 11:30:10 (9900): No heartbeat from core client for 30 sec - exiting 11:30:11 (9900): No heartbeat from core client for 30 sec - exiting 11:30:12 (9900): No heartbeat from core client for 30 sec - exiting 11:30:13 (9900): No heartbeat from core client for 30 sec - exiting 11:30:14 (9900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:38:13 (7652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:38:14 (7652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7924, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 21:21:01 (7992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:03 (7992): No heartbeat from core client for 30 sec - exiting 21:21:04 (7992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:38:03 (7756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:39:43 (7236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8316, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:53:06 (6060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:07:57 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:29:27 (4640): No heartbeat from core client for 30 sec - exiting 09:29:28 (4640): No heartbeat from core client for 30 sec - exiting 09:29:29 (4640): No heartbeat from core client for 30 sec - exiting 09:29:30 (4640): No heartbeat from core client for 30 sec - exiting 09:29:31 (4640): No heartbeat from core client for 30 sec - exiting 09:29:32 (4640): No heartbeat from core client for 30 sec - exiting 09:29:33 (4640): No heartbeat from core client for 30 sec - exiting 09:29:34 (4640): No heartbeat from core client for 30 sec - exiting 09:29:35 (4640): No heartbeat from core client for 30 sec - exiting 09:29:36 (4640): No heartbeat from core client for 30 sec - exiting 09:29:37 (4640): No heartbeat from core client for 30 sec - exiting 09:29:38 (4640): No heartbeat from core client for 30 sec - exiting 09:29:39 (4640): No heartbeat from core client for 30 sec - exiting 09:29:40 (4640): No heartbeat from core client for 30 sec - exiting 09:29:41 (4640): No heartbeat from core client for 30 sec - exiting 09:29:42 (4640): No heartbeat from core client for 30 sec - exiting 09:29:43 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:35:54 (6800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:23:47 (1940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:42:50 (9172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15696, iMonCtr=1 Model crash detected, will try to restart... 08:05:01 (8116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:14:51 (10088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:34:22 (5828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:57:06 (6164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:06:57 (6972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:01:32 (14060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:53:06 (12272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:53:07 (12272): No heartbeat from core client for 30 sec - exiting 15:53:08 (12272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 17:10:35 (3064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:54:05 (6628): No heartbeat from core client for 30 sec - exiting 08:54:06 (6628): No heartbeat from core client for 30 sec - exiting 08:54:07 (6628): No heartbeat from core client for 30 sec - exiting 08:54:08 (6628): No heartbeat from core client for 30 sec - exiting 08:54:09 (6628): No heartbeat from core client for 30 sec - exiting 08:54:10 (6628): No heartbeat from core client for 30 sec - exiting 08:54:11 (6628): No heartbeat from core client for 30 sec - exiting 08:54:12 (6628): No heartbeat from core client for 30 sec - exiting 08:54:13 (6628): No heartbeat from core client for 30 sec - exiting 08:54:14 (6628): No heartbeat from core client for 30 sec - exiting 08:54:15 (6628): No heartbeat from core client for 30 sec - exiting 08:54:16 (6628): No heartbeat from core client for 30 sec - exiting 08:54:17 (6628): No heartbeat from core client for 30 sec - exiting 08:54:18 (6628): No heartbeat from core client for 30 sec - exiting 08:54:19 (6628): No heartbeat from core client for 30 sec - exiting 08:54:20 (6628): No heartbeat from core client for 30 sec - exiting 08:54:21 (6628): No heartbeat from core client for 30 sec - exiting 08:54:22 (6628): No heartbeat from core client for 30 sec - exiting 08:54:23 (6628): No heartbeat from core client for 30 sec - exiting 08:54:24 (6628): No heartbeat from core client for 30 sec - exiting 08:54:25 (6628): No heartbeat from core client for 30 sec - exiting 08:54:26 (6628): No heartbeat from core client for 30 sec - exiting 08:54:27 (6628): No heartbeat from core client for 30 sec - exiting 08:54:28 (6628): No heartbeat from core client for 30 sec - exiting 08:54:29 (6628): No heartbeat from core client for 30 sec - exiting 08:54:30 (6628): No heartbeat from core client for 30 sec - exiting 08:54:31 (6628): No heartbeat from core client for 30 sec - exiting 08:54:32 (6628): No heartbeat from core client for 30 sec - exiting 08:54:33 (6628): No heartbeat from core client for 30 sec - exiting 08:54:34 (6628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:35 (6628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:37:48 (6488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:37 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:10:32 (7356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:52:22 (12912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:01:50 (7248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11536, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:59:33 (7792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:47:34 (11196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6976, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:00:29 (2216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... 19:28:14 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:54 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:11:06 (2524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:11:07 (2524): No heartbeat from core client for 30 sec - exiting 14:11:08 (2524): No heartbeat from core client for 30 sec - exiting 14:11:09 (2524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:58:15 (8064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6908, iMonCtr=1 Model crash detected, will try to restart... 09:02:05 (8080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:02:06 (8080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 12:55:31 (6548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:16:19 (3236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:03:24 (7416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:25 (7416): No heartbeat from core client for 30 sec - exiting 22:03:26 (7416): No heartbeat from core client for 30 sec - exiting 22:03:27 (7416): No heartbeat from core client for 30 sec - exiting 22:03:28 (7416): No heartbeat from core client for 30 sec - exiting 07:27:47 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:49:49 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:41:50 (4056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:52:27 (6780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4920, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:37:31 (1668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:37:33 (1668): No heartbeat from core client for 30 sec - exiting 22:37:34 (1668): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:38:57 (6160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772C743F read attempt to address 0x00000006 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o6x1_1980_40_007422913/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Nov 2011 20:42:53	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	777,600	1,928,745	2.4804
04 Nov 2011 07:23:14	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	751,680	1,863,782	2.4795
01 Nov 2011 22:30:18	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	725,760	1,799,206	2.4791
31 Oct 2011 19:37:45	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	699,840	1,735,016	2.4792
31 Oct 2011 17:17:36	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	673,920	1,670,497	2.4788
31 Oct 2011 15:14:54	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	648,000	1,605,995	2.4784
31 Oct 2011 14:58:37	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	622,080	1,541,885	2.4786
31 Oct 2011 14:58:37	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	596,160	1,477,340	2.4781
17 Oct 2011 12:19:53	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	570,240	1,411,900	2.4760
14 Oct 2011 18:26:54	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	544,320	1,347,507	2.4756
12 Oct 2011 18:46:30	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	518,400	1,282,829	2.4746
11 Oct 2011 08:15:43	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	492,480	1,218,383	2.4740
08 Oct 2011 16:37:55	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	466,560	1,153,807	2.4730
06 Oct 2011 17:04:21	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	440,640	1,089,461	2.4725
04 Oct 2011 10:13:03	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	414,720	1,025,348	2.4724
30 Sep 2011 10:17:36	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	388,800	961,530	2.4731
27 Sep 2011 21:46:04	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	362,880	896,968	2.4718
24 Sep 2011 13:14:36	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	336,960	832,442	2.4704
22 Sep 2011 21:10:18	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	311,040	769,041	2.4725
20 Sep 2011 16:53:23	1064350	13294633	hadcm3n_o6x1_1980_40_007422913_0	285,120	704,509	2.4709