Task 14105571

Name	hadcm3n_y8eh_1940_40_007753083_2
Workunit	7908192
Created	17 Feb 2012, 13:52:31 UTC
Sent	17 Feb 2012, 13:53:30 UTC
Report deadline	18 May 2012, 21:20:41 UTC
Received	28 Mar 2012, 5:48:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1117964
Run time	15 days 1 hours 0 min 53 sec
CPU time	13 days 17 hours 53 min 26 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.30 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 19:03:53 (5320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:03:55 (5320): No heartbeat from core client for 30 sec - exiting 19:03:56 (5320): No heartbeat from core client for 30 sec - exiting 19:03:57 (5320): No heartbeat from core client for 30 sec - exiting 19:03:58 (5320): No heartbeat from core client for 30 sec - exiting 19:03:59 (5320): No heartbeat from core client for 30 sec - exiting 19:04:00 (5320): No heartbeat from core client for 30 sec - exiting 19:04:01 (5320): No heartbeat from core client for 30 sec - exiting 19:04:02 (5320): No heartbeat from core client for 30 sec - exiting 19:04:03 (5320): No heartbeat from core client for 30 sec - exiting 19:14:38 (516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:43 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:18 (6332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:15 (6648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:16 (6648): No heartbeat from core client for 30 sec - exiting 19:27:17 (6648): No heartbeat from core client for 30 sec - exiting 19:27:18 (6648): No heartbeat from core client for 30 sec - exiting 19:27:19 (6648): No heartbeat from core client for 30 sec - exiting 19:27:20 (6648): No heartbeat from core client for 30 sec - exiting 19:27:22 (6648): No heartbeat from core client for 30 sec - exiting 19:27:23 (6648): No heartbeat from core client for 30 sec - exiting 19:27:24 (6648): No heartbeat from core client for 30 sec - exiting 19:27:25 (6648): No heartbeat from core client for 30 sec - exiting 19:27:26 (6648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3448, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:04:03 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:39 (9080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:15 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:23:37 (7480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:23:38 (7480): No heartbeat from core client for 30 sec - exiting 09:23:39 (7480): No heartbeat from core client for 30 sec - exiting 09:23:40 (7480): No heartbeat from core client for 30 sec - exiting 09:23:41 (7480): No heartbeat from core client for 30 sec - exiting 09:23:42 (7480): No heartbeat from core client for 30 sec - exiting 09:23:43 (7480): No heartbeat from core client for 30 sec - exiting 09:23:44 (7480): No heartbeat from core client for 30 sec - exiting 09:23:46 (7480): No heartbeat from core client for 30 sec - exiting 09:23:47 (7480): No heartbeat from core client for 30 sec - exiting 09:23:48 (7480): No heartbeat from core client for 30 sec - exiting 09:28:28 (7004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:28:29 (7004): No heartbeat from core client for 30 sec - exiting 09:28:30 (7004): No heartbeat from core client for 30 sec - exiting 09:28:31 (7004): No heartbeat from core client for 30 sec - exiting 09:28:33 (7004): No heartbeat from core client for 30 sec - exiting 09:28:34 (7004): No heartbeat from core client for 30 sec - exiting 09:28:35 (7004): No heartbeat from core client for 30 sec - exiting 09:28:36 (7004): No heartbeat from core client for 30 sec - exiting 09:28:37 (7004): No heartbeat from core client for 30 sec - exiting 09:28:38 (7004): No heartbeat from core client for 30 sec - exiting 09:28:39 (7004): No heartbeat from core client for 30 sec - exiting 09:32:56 (6364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:32:57 (6364): No heartbeat from core client for 30 sec - exiting 09:32:58 (6364): No heartbeat from core client for 30 sec - exiting 09:32:59 (6364): No heartbeat from core client for 30 sec - exiting 09:33:00 (6364): No heartbeat from core client for 30 sec - exiting 09:33:01 (6364): No heartbeat from core client for 30 sec - exiting 09:33:02 (6364): No heartbeat from core client for 30 sec - exiting 09:33:03 (6364): No heartbeat from core client for 30 sec - exiting 09:33:05 (6364): No heartbeat from core client for 30 sec - exiting 09:33:06 (6364): No heartbeat from core client for 30 sec - exiting 09:33:07 (6364): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8448, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 17:40:24 (7412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:40:25 (7412): No heartbeat from core client for 30 sec - exiting 17:40:26 (7412): No heartbeat from core client for 30 sec - exiting 17:40:27 (7412): No heartbeat from core client for 30 sec - exiting 17:40:28 (7412): No heartbeat from core client for 30 sec - exiting 17:40:29 (7412): No heartbeat from core client for 30 sec - exiting 17:40:30 (7412): No heartbeat from core client for 30 sec - exiting 17:40:31 (7412): No heartbeat from core client for 30 sec - exiting 17:40:32 (7412): No heartbeat from core client for 30 sec - exiting 17:40:33 (7412): No heartbeat from core client for 30 sec - exiting 17:40:34 (7412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2104, selfPID=2104, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:28:15 (7308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:28:16 (7308): No heartbeat from core client for 30 sec - exiting 10:28:17 (7308): No heartbeat from core client for 30 sec - exiting 10:28:18 (7308): No heartbeat from core client for 30 sec - exiting 10:28:19 (7308): No heartbeat from core client for 30 sec - exiting 10:28:20 (7308): No heartbeat from core client for 30 sec - exiting 10:28:21 (7308): No heartbeat from core client for 30 sec - exiting 10:28:22 (7308): No heartbeat from core client for 30 sec - exiting 10:28:23 (7308): No heartbeat from core client for 30 sec - exiting 10:28:24 (7308): No heartbeat from core client for 30 sec - exiting 10:28:25 (7308): No heartbeat from core client for 30 sec - exiting 10:31:37 (7644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:43:28 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:33 (6300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:48:02 (6656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:03 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:04 (4568): No heartbeat from core client for 30 sec - exiting 10:50:05 (4568): No heartbeat from core client for 30 sec - exiting 10:50:06 (4568): No heartbeat from core client for 30 sec - exiting 10:50:07 (4568): No heartbeat from core client for 30 sec - exiting 10:50:08 (4568): No heartbeat from core client for 30 sec - exiting 10:50:09 (4568): No heartbeat from core client for 30 sec - exiting 10:50:10 (4568): No heartbeat from core client for 30 sec - exiting 10:50:11 (4568): No heartbeat from core client for 30 sec - exiting 10:50:12 (4568): No heartbeat from core client for 30 sec - exiting 10:50:13 (4568): No heartbeat from core client for 30 sec - exiting 10:50:14 (4568): No heartbeat from core client for 30 sec - exiting 10:50:15 (4568): No heartbeat from core client for 30 sec - exiting 10:50:16 (4568): No heartbeat from core client for 30 sec - exiting 10:50:17 (4568): No heartbeat from core client for 30 sec - exiting 10:50:18 (4568): No heartbeat from core client for 30 sec - exiting 10:50:19 (4568): No heartbeat from core client for 30 sec - exiting 10:50:20 (4568): No heartbeat from core client for 30 sec - exiting 10:50:21 (4568): No heartbeat from core client for 30 sec - exiting 10:50:22 (4568): No heartbeat from core client for 30 sec - exiting 10:50:23 (4568): No heartbeat from core client for 30 sec - exiting 10:50:24 (4568): No heartbeat from core client for 30 sec - exiting 10:50:25 (4568): No heartbeat from core client for 30 sec - exiting 10:50:26 (4568): No heartbeat from core client for 30 sec - exiting 10:50:27 (4568): No heartbeat from core client for 30 sec - exiting 10:50:28 (4568): No heartbeat from core client for 30 sec - exiting 10:50:29 (4568): No heartbeat from core client for 30 sec - exiting 10:50:30 (4568): No heartbeat from core client for 30 sec - exiting 10:50:31 (4568): No heartbeat from core client for 30 sec - exiting 10:50:32 (4568): No heartbeat from core client for 30 sec - exiting 10:50:33 (4568): No heartbeat from core client for 30 sec - exiting 10:50:34 (4568): No heartbeat from core client for 30 sec - exiting 10:50:35 (4568): No heartbeat from core client for 30 sec - exiting 10:50:36 (4568): No heartbeat from core client for 30 sec - exiting 10:50:37 (4568): No heartbeat from core client for 30 sec - exiting 10:50:38 (4568): No heartbeat from core client for 30 sec - exiting 10:50:39 (4568): No heartbeat from core client for 30 sec - exiting 10:50:40 (4568): No heartbeat from core client for 30 sec - exiting 10:50:41 (4568): No heartbeat from core client for 30 sec - exiting 10:50:42 (4568): No heartbeat from core client for 30 sec - exiting 10:50:43 (4568): No heartbeat from core client for 30 sec - exiting 10:50:44 (4568): No heartbeat from core client for 30 sec - exiting 10:50:45 (4568): No heartbeat from core client for 30 sec - exiting 10:50:46 (4568): No heartbeat from core client for 30 sec - exiting 10:50:47 (4568): No heartbeat from core client for 30 sec - exiting 10:50:48 (4568): No heartbeat from core client for 30 sec - exiting 10:50:49 (4568): No heartbeat from core client for 30 sec - exiting 10:50:50 (4568): No heartbeat from core client for 30 sec - exiting 10:50:51 (4568): No heartbeat from core client for 30 sec - exiting 10:50:52 (4568): No heartbeat from core client for 30 sec - exiting 10:50:53 (4568): No heartbeat from core client for 30 sec - exiting 10:50:54 (4568): No heartbeat from core client for 30 sec - exiting 10:50:55 (4568): No heartbeat from core client for 30 sec - exiting 10:50:56 (4568): No heartbeat from core client for 30 sec - exiting 10:50:57 (4568): No heartbeat from core client for 30 sec - exiting 10:53:10 (2432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:56:05 (724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:33 (1040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:38 (1524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:47 (1524): No heartbeat from core client for 30 sec - exiting 12:24:48 (1524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:15:20 (1224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:21:42 (1040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:36:42 (6208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:41:13 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:41:14 (6052): No heartbeat from core client for 30 sec - exiting 15:41:15 (6052): No heartbeat from core client for 30 sec - exiting 15:41:16 (6052): No heartbeat from core client for 30 sec - exiting 15:41:17 (6052): No heartbeat from core client for 30 sec - exiting 15:41:18 (6052): No heartbeat from core client for 30 sec - exiting 15:41:19 (6052): No heartbeat from core client for 30 sec - exiting 15:41:20 (6052): No heartbeat from core client for 30 sec - exiting 15:41:21 (6052): No heartbeat from core client for 30 sec - exiting 15:41:22 (6052): No heartbeat from core client for 30 sec - exiting 15:41:24 (6052): No heartbeat from core client for 30 sec - exiting 15:44:50 (7044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:55 (3352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:51:50 (7188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:11:50 (7544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:46:53 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:46:54 (4916): No heartbeat from core client for 30 sec - exiting 20:46:55 (4916): No heartbeat from core client for 30 sec - exiting 20:46:56 (4916): No heartbeat from core client for 30 sec - exiting 20:46:57 (4916): No heartbeat from core client for 30 sec - exiting 20:46:58 (4916): No heartbeat from core client for 30 sec - exiting 20:46:59 (4916): No heartbeat from core client for 30 sec - exiting 20:47:00 (4916): No heartbeat from core client for 30 sec - exiting 20:47:02 (4916): No heartbeat from core client for 30 sec - exiting 20:47:03 (4916): No heartbeat from core client for 30 sec - exiting 20:47:04 (4916): No heartbeat from core client for 30 sec - exiting 20:54:35 (1304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:52 (2972): Can't acquire lockfile (32) - waiting 35s 21:01:17 (2972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:18 (2972): No heartbeat from core client for 30 sec - exiting 21:01:19 (2972): No heartbeat from core client for 30 sec - exiting 21:01:20 (2972): No heartbeat from core client for 30 sec - exiting 21:01:21 (2972): No heartbeat from core client for 30 sec - exiting 21:01:22 (2972): No heartbeat from core client for 30 sec - exiting 21:01:23 (2972): No heartbeat from core client for 30 sec - exiting 21:01:24 (2972): No heartbeat from core client for 30 sec - exiting 21:01:25 (2972): No heartbeat from core client for 30 sec - exiting 21:01:26 (2972): No heartbeat from core client for 30 sec - exiting 21:01:27 (2972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:16:14 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:16:15 (6044): No heartbeat from core client for 30 sec - exiting 11:16:16 (6044): No heartbeat from core client for 30 sec - exiting 11:16:17 (6044): No heartbeat from core client for 30 sec - exiting 11:16:18 (6044): No heartbeat from core client for 30 sec - exiting 11:16:19 (6044): No heartbeat from core client for 30 sec - exiting 11:16:20 (6044): No heartbeat from core client for 30 sec - exiting 11:16:21 (6044): No heartbeat from core client for 30 sec - exiting 11:16:22 (6044): No heartbeat from core client for 30 sec - exiting 11:16:23 (6044): No heartbeat from core client for 30 sec - exiting 11:16:24 (6044): No heartbeat from core client for 30 sec - exiting 11:26:53 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:28:31 (7092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:33 (7176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:35 (4856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:34:32 (5912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:35:14 (3348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:04 (7384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:39:18 (576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:39:19 (576): No heartbeat from core client for 30 sec - exiting 11:39:20 (576): No heartbeat from core client for 30 sec - exiting 11:39:21 (576): No heartbeat from core client for 30 sec - exiting 11:39:22 (576): No heartbeat from core client for 30 sec - exiting 11:39:23 (576): No heartbeat from core client for 30 sec - exiting 11:39:24 (576): No heartbeat from core client for 30 sec - exiting 11:39:25 (576): No heartbeat from core client for 30 sec - exiting 11:39:26 (576): No heartbeat from core client for 30 sec - exiting 11:39:27 (576): No heartbeat from core client for 30 sec - exiting 11:39:28 (576): No heartbeat from core client for 30 sec - exiting 11:43:48 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:43:49 (4172): No heartbeat from core client for 30 sec - exiting 11:43:50 (4172): No heartbeat from core client for 30 sec - exiting 11:43:51 (4172): No heartbeat from core client for 30 sec - exiting 11:43:52 (4172): No heartbeat from core client for 30 sec - exiting 11:43:53 (4172): No heartbeat from core client for 30 sec - exiting 11:43:54 (4172): No heartbeat from core client for 30 sec - exiting 11:43:55 (4172): No heartbeat from core client for 30 sec - exiting 11:43:56 (4172): No heartbeat from core client for 30 sec - exiting 11:43:57 (4172): No heartbeat from core client for 30 sec - exiting 11:43:58 (4172): No heartbeat from core client for 30 sec - exiting 11:47:18 (4156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:45 (6532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:51:31 (6836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:51:32 (6836): No heartbeat from core client for 30 sec - exiting 11:51:33 (6836): No heartbeat from core client for 30 sec - exiting 11:51:34 (6836): No heartbeat from core client for 30 sec - exiting 11:51:35 (6836): No heartbeat from core client for 30 sec - exiting 11:51:36 (6836): No heartbeat from core client for 30 sec - exiting 11:51:37 (6836): No heartbeat from core client for 30 sec - exiting 11:51:38 (6836): No heartbeat from core client for 30 sec - exiting 11:51:39 (6836): No heartbeat from core client for 30 sec - exiting 11:51:40 (6836): No heartbeat from core client for 30 sec - exiting 11:51:41 (6836): No heartbeat from core client for 30 sec - exiting 11:53:38 (6552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:55:50 (6892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:55:51 (6892): No heartbeat from core client for 30 sec - exiting 11:55:52 (6892): No heartbeat from core client for 30 sec - exiting 11:55:53 (6892): No heartbeat from core client for 30 sec - exiting 11:55:54 (6892): No heartbeat from core client for 30 sec - exiting 11:55:55 (6892): No heartbeat from core client for 30 sec - exiting 11:55:56 (6892): No heartbeat from core client for 30 sec - exiting 11:55:57 (6892): No heartbeat from core client for 30 sec - exiting 12:02:05 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:24 (6500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:06:50 (6932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:07:54 (6808): No heartbeat from core client for 30 sec - exiting 12:07:55 (6808): No heartbeat from core client for 30 sec - exiting 12:07:56 (6808): No heartbeat from core client for 30 sec - exiting 12:07:57 (6808): No heartbeat from core client for 30 sec - exiting 12:07:58 (6808): No heartbeat from core client for 30 sec - exiting 12:07:59 (6808): No heartbeat from core client for 30 sec - exiting 12:08:00 (6808): No heartbeat from core client for 30 sec - exiting 12:08:01 (6808): No heartbeat from core client for 30 sec - exiting 12:08:02 (6808): No heartbeat from core client for 30 sec - exiting 12:08:03 (6808): No heartbeat from core client for 30 sec - exiting 12:08:04 (6808): No heartbeat from core client for 30 sec - exiting 12:08:05 (6808): No heartbeat from core client for 30 sec - exiting 12:08:06 (6808): No heartbeat from core client for 30 sec - exiting 12:08:07 (6808): No heartbeat from core client for 30 sec - exiting 12:08:08 (6808): No heartbeat from core client for 30 sec - exiting 12:08:09 (6808): No heartbeat from core client for 30 sec - exiting 12:08:10 (6808): No heartbeat from core client for 30 sec - exiting 12:08:11 (6808): No heartbeat from core client for 30 sec - exiting 12:08:12 (6808): No heartbeat from core client for 30 sec - exiting 12:08:13 (6808): No heartbeat from core client for 30 sec - exiting 12:08:14 (6808): No heartbeat from core client for 30 sec - exiting 12:08:15 (6808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:16 (6808): No heartbeat from core client for 30 sec - exiting 12:08:17 (6808): No heartbeat from core client for 30 sec - exiting 12:08:18 (6808): No heartbeat from core client for 30 sec - exiting 12:08:19 (6808): No heartbeat from core client for 30 sec - exiting 12:08:20 (6808): No heartbeat from core client for 30 sec - exiting 12:08:21 (6808): No heartbeat from core client for 30 sec - exiting 12:08:22 (6808): No heartbeat from core client for 30 sec - exiting 12:09:46 (8084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:47 (6148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:48 (6148): No heartbeat from core client for 30 sec - exiting 12:13:49 (6148): No heartbeat from core client for 30 sec - exiting 12:13:50 (6148): No heartbeat from core client for 30 sec - exiting 12:13:51 (6148): No heartbeat from core client for 30 sec - exiting 12:13:52 (6148): No heartbeat from core client for 30 sec - exiting 12:13:53 (6148):12:15:14 (7816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:32 (724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:33 (724): No heartbeat from core client for 30 sec - exiting 12:52:34 (724): No heartbeat from core client for 30 sec - exiting 12:52:35 (724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:59:28 (7620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:29 (7620): No heartbeat from core client for 30 sec - exiting 18:59:30 (7620): No heartbeat from core client for 30 sec - exiting 18:59:31 (7620): No heartbeat from core client for 30 sec - exiting 18:59:32 (7620): No heartbeat from core client for 30 sec - exiting 18:59:33 (7620): No heartbeat from core client for 30 sec - exiting 18:59:34 (7620): No heartbeat from core client for 30 sec - exiting 18:59:35 (7620): No heartbeat from core client for 30 sec - exiting 18:59:36 (7620): No heartbeat from core client for 30 sec - exiting 18:59:37 (7620): No heartbeat from core client for 30 sec - exiting 18:59:38 (7620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:14:10 (8600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:31:17 (12284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:31:18 (12284): No heartbeat from core client for 30 sec - exiting 09:36:25 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:36:26 (3152): No heartbeat from core client for 30 sec - exiting 09:37:09 (9372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:21 (8236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:56:34 (11328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:26:01 (2924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:02 (2924): No heartbeat from core client for 30 sec - exiting 10:26:03 (2924): No heartbeat from core client for 30 sec - exiting 10:26:04 (2924): No heartbeat from core client for 30 sec - exiting 10:26:05 (2924): No heartbeat from core client for 30 sec - exiting 10:26:06 (2924): No heartbeat from core client for 30 sec - exiting 10:26:07 (2924): No heartbeat from core client for 30 sec - exiting 10:26:08 (2924): No heartbeat from core client for 30 sec - exiting 10:26:10 (2924): No heartbeat from core client for 30 sec - exiting 10:26:11 (2924): No heartbeat from core client for 30 sec - exiting 10:26:12 (2924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:53:24 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:25 (4968): No heartbeat from core client for 30 sec - exiting 17:53:26 (4968): No heartbeat from core client for 30 sec - exiting 17:53:27 (4968): No heartbeat from core client for 30 sec - exiting 17:53:28 (4968): No heartbeat from core client for 30 sec - exiting 17:53:29 (4968): No heartbeat from core client for 30 sec - exiting 17:53:30 (4968): No heartbeat from core client for 30 sec - exiting 17:53:31 (4968): No heartbeat from core client for 30 sec - exiting 17:53:32 (4968): No heartbeat from core client for 30 sec - exiting 17:53:33 (4968): No heartbeat from core client for 30 sec - exiting 17:53:34 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 20:17:05 (7120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:02:01 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:12:30 (5112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:14:16 (6400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:14:18 (6400): No heartbeat from core client for 30 sec - exiting 21:14:19 (6400): No heartbeat from core client for 30 sec - exiting 21:14:20 (6400): No heartbeat from core client for 30 sec - exiting 21:14:21 (6400): No heartbeat from core client for 30 sec - exiting 21:14:22 (6400): No heartbeat from core client for 30 sec - exiting 21:14:23 (6400): No heartbeat from core client for 30 sec - exiting 21:14:24 (6400): No heartbeat from core client for 30 sec - exiting 21:14:25 (6400): No heartbeat from core client for 30 sec - exiting 21:14:26 (6400): No heartbeat from core client for 30 sec - exiting 21:14:27 (6400): No heartbeat from core client for 30 sec - exiting 21:15:40 (584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:20 (6368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:53 (7944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:15 (3368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:25:47 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:27:13 (2508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:43:55 (7996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:43:57 (7996): No heartbeat from core client for 30 sec - exiting 09:43:58 (7996): No heartbeat from core client for 30 sec - exiting 09:44:47 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:48 (5460): No heartbeat from core client for 30 sec - exiting 09:44:49 (5460): No heartbeat from core client for 30 sec - exiting 09:44:50 (5460): No heartbeat from core client for 30 sec - exiting 09:44:51 (5460): No heartbeat from core client for 30 sec - exiting 09:44:52 (5460): No heartbeat from core client for 30 sec - exiting 09:44:53 (5460): No heartbeat from core client for 30 sec - exiting 09:44:55 (5460): No heartbeat from core client for 30 sec - exiting 09:44:56 (5460): No heartbeat from core client for 30 sec - exiting 09:44:57 (5460): No heartbeat from core client for 30 sec - exiting 09:44:58 (5460): No heartbeat from core client for 30 sec - exiting 09:50:12 (7320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:56:24 (8168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:06:25 (4980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:38:34 (3368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Mar 2012 02:09:41	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	518,400	1,187,453	2.2906
27 Mar 2012 02:21:51	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	492,480	1,121,410	2.2771
25 Mar 2012 11:43:29	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	466,560	1,012,461	2.1701
22 Mar 2012 14:32:40	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	440,640	934,844	2.1216
21 Mar 2012 16:30:00	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	414,720	879,537	2.1208
20 Mar 2012 21:10:22	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	388,800	825,569	2.1234
19 Mar 2012 22:42:38	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	362,880	771,187	2.1252
19 Mar 2012 06:12:23	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	336,960	709,468	2.1055
17 Mar 2012 12:17:59	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	311,040	649,722	2.0889
16 Mar 2012 13:50:45	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	285,120	587,167	2.0594
15 Mar 2012 11:23:57	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	259,200	528,210	2.0378
14 Mar 2012 16:53:24	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	233,280	473,281	2.0288
14 Mar 2012 05:46:09	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	207,360	418,360	2.0176
12 Mar 2012 23:48:40	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	181,440	363,995	2.0061
12 Mar 2012 06:38:39	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	155,520	310,090	1.9939
11 Mar 2012 14:06:01	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	129,600	255,932	1.9748
20 Feb 2012 08:58:11	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	103,680	194,937	1.8802
20 Feb 2012 08:58:11	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	77,760	152,385	1.9597
20 Feb 2012 08:58:11	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	51,840	110,305	2.1278
20 Feb 2012 08:58:11	1117964	14105571	hadcm3n_y8eh_1940_40_007753083_2	25,920	57,310	2.2110