Task 13659068

Name	hadcm3n_o6qq_1980_40_007422905_2
Workunit	7620540
Created	24 Nov 2011, 15:00:22 UTC
Sent	24 Nov 2011, 15:03:25 UTC
Report deadline	23 Feb 2012, 22:30:36 UTC
Received	11 Feb 2012, 6:30:32 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1021113
Run time	25 days 1 hours 13 min 16 sec
CPU time	23 days 18 hours 11 min 35 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.53 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6856, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5696, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:09:42 (5000): No heartbeat from core client for 30 sec - exiting 09:09:43 (5000): No heartbeat from core client for 30 sec - exiting 09:09:44 (5000): No heartbeat from core client for 30 sec - exiting 09:09:45 (5000): No heartbeat from core client for 30 sec - exiting 09:09:46 (5000): No heartbeat from core client for 30 sec - exiting 09:09:47 (5000): No heartbeat from core client for 30 sec - exiting 09:09:48 (5000): No heartbeat from core client for 30 sec - exiting 09:09:49 (5000): No heartbeat from core client for 30 sec - exiting 09:09:50 (5000): No heartbeat from core client for 30 sec - exiting 09:09:51 (5000): No heartbeat from core client for 30 sec - exiting 09:09:52 (5000): No heartbeat from core client for 30 sec - exiting 09:09:53 (5000): No heartbeat from core client for 30 sec - exiting 09:09:54 (5000): No heartbeat from core client for 30 sec - exiting 09:09:55 (5000): No heartbeat from core client for 30 sec - exiting 09:09:56 (5000): No heartbeat from core client for 30 sec - exiting 09:09:57 (5000): No heartbeat from core client for 30 sec - exiting 09:09:58 (5000): No heartbeat from core client for 30 sec - exiting 09:09:59 (5000): No heartbeat from core client for 30 sec - exiting 09:10:00 (5000): No heartbeat from core client for 30 sec - exiting 09:10:01 (5000): No heartbeat from core client for 30 sec - exiting 09:10:02 (5000): No heartbeat from core client for 30 sec - exiting 09:10:03 (5000): No heartbeat from core client for 30 sec - exiting 09:10:04 (5000): No heartbeat from core client for 30 sec - exiting 09:10:05 (5000): No heartbeat from core client for 30 sec - exiting 09:10:06 (5000): No heartbeat from core client for 30 sec - exiting 09:10:07 (5000): No heartbeat from core client for 30 sec - exiting 09:10:08 (5000): No heartbeat from core client for 30 sec - exiting 09:10:09 (5000): No heartbeat from core client for 30 sec - exiting 09:10:10 (5000): No heartbeat from core client for 30 sec - exiting 09:10:11 (5000): No heartbeat from core client for 30 sec - exiting 09:10:12 (5000): No heartbeat from core client for 30 sec - exiting 09:10:13 (5000): No heartbeat from core client for 30 sec - exiting 09:10:14 (5000): No heartbeat from core client for 30 sec - exiting 09:10:15 (5000): No heartbeat from core client for 30 sec - exiting 09:10:16 (5000): No heartbeat from core client for 30 sec - exiting 09:10:17 (5000): No heartbeat from core client for 30 sec - exiting 09:10:18 (5000): No heartbeat from core client for 30 sec - exiting 09:10:19 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4452, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:13:05 (5788): No heartbeat from core client for 30 sec - exiting 10:13:06 (5788): No heartbeat from core client for 30 sec - exiting 10:13:07 (5788): No heartbeat from core client for 30 sec - exiting 10:13:08 (5788): No heartbeat from core client for 30 sec - exiting 10:13:09 (5788): No heartbeat from core client for 30 sec - exiting 10:13:10 (5788): No heartbeat from core client for 30 sec - exiting 10:13:11 (5788): No heartbeat from core client for 30 sec - exiting 10:13:12 (5788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6460, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5716, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5644, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2524, iMonCtr=1 Model crash detected, will try to restart... 16:16:56 (5804): No heartbeat from core client for 30 sec - exiting 16:16:57 (5804): No heartbeat from core client for 30 sec - exiting 16:16:58 (5804): No heartbeat from core client for 30 sec - exiting 16:16:59 (5804): No heartbeat from core client for 30 sec - exiting 16:17:00 (5804): No heartbeat from core client for 30 sec - exiting 16:17:01 (5804): No heartbeat from core client for 30 sec - exiting 16:17:02 (5804): No heartbeat from core client for 30 sec - exiting 16:17:03 (5804): No heartbeat from core client for 30 sec - exiting 16:17:04 (5804): No heartbeat from core client for 30 sec - exiting 16:17:05 (5804): No heartbeat from core client for 30 sec - exiting 16:17:06 (5804): No heartbeat from core client for 30 sec - exiting 16:17:07 (5804): No heartbeat from core client for 30 sec - exiting 16:17:08 (5804): No heartbeat from core client for 30 sec - exiting 16:17:09 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6664, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4184, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4184, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4184, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4892, iMonCtr=1 Model crash detected, will try to restart... 12:33:44 (5228): No heartbeat from core client for 30 sec - exiting 12:33:45 (5228): No heartbeat from core client for 30 sec - exiting 12:33:46 (5228): No heartbeat from core client for 30 sec - exiting 12:33:47 (5228): No heartbeat from core client for 30 sec - exiting 12:33:48 (5228): No heartbeat from core client for 30 sec - exiting 12:33:49 (5228): No heartbeat from core client for 30 sec - exiting 12:33:50 (5228): No heartbeat from core client for 30 sec - exiting 12:33:51 (5228): No heartbeat from core client for 30 sec - exiting 12:33:52 (5228): No heartbeat from core client for 30 sec - exiting 12:33:53 (5228): No heartbeat from core client for 30 sec - exiting 12:33:54 (5228): No heartbeat from core client for 30 sec - exiting 12:33:55 (5228): No heartbeat from core client for 30 sec - exiting 12:33:56 (5228): No heartbeat from core client for 30 sec - exiting 12:33:57 (5228): No heartbeat from core client for 30 sec - exiting 12:33:58 (5228): No heartbeat from core client for 30 sec - exiting 12:33:59 (5228): No heartbeat from core client for 30 sec - exiting 12:34:00 (5228): No heartbeat from core client for 30 sec - exiting 12:34:01 (5228): No heartbeat from core client for 30 sec - exiting 12:34:02 (5228): No heartbeat from core client for 30 sec - exiting 12:34:03 (5228): No heartbeat from core client for 30 sec - exiting 12:34:04 (5228): No heartbeat from core client for 30 sec - exiting 12:34:05 (5228): No heartbeat from core client for 30 sec - exiting 12:34:06 (5228): No heartbeat from core client for 30 sec - exiting 12:34:07 (5228): No heartbeat from core client for 30 sec - exiting 12:34:08 (5228): No heartbeat from core client for 30 sec - exiting 12:34:09 (5228): No heartbeat from core client for 30 sec - exiting 12:34:10 (5228): No heartbeat from core client for 30 sec - exiting 12:34:11 (5228): No heartbeat from core client for 30 sec - exiting 12:34:12 (5228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:40:34 (5724): No heartbeat from core client for 30 sec - exiting 10:40:35 (5724): No heartbeat from core client for 30 sec - exiting 10:40:36 (5724): No heartbeat from core client for 30 sec - exiting 10:40:37 (5724): No heartbeat from core client for 30 sec - exiting 10:40:38 (5724): No heartbeat from core client for 30 sec - exiting 10:40:39 (5724): No heartbeat from core client for 30 sec - exiting 10:40:40 (5724): No heartbeat from core client for 30 sec - exiting 10:40:41 (5724): No heartbeat from core client for 30 sec - exiting 10:40:42 (5724): No heartbeat from core client for 30 sec - exiting 10:40:43 (5724): No heartbeat from core client for 30 sec - exiting 10:40:44 (5724): No heartbeat from core client for 30 sec - exiting 10:40:45 (5724): No heartbeat from core client for 30 sec - exiting 10:40:46 (5724): No heartbeat from core client for 30 sec - exiting 10:40:47 (5724): No heartbeat from core client for 30 sec - exiting 10:40:48 (5724): No heartbeat from core client for 30 sec - exiting 10:40:49 (5724): No heartbeat from core client for 30 sec - exiting 10:40:50 (5724): No heartbeat from core client for 30 sec - exiting 10:40:51 (5724): No heartbeat from core client for 30 sec - exiting 10:40:52 (5724): No heartbeat from core client for 30 sec - exiting 10:40:53 (5724): No heartbeat from core client for 30 sec - exiting 10:40:54 (5724): No heartbeat from core client for 30 sec - exiting 10:40:55 (5724): No heartbeat from core client for 30 sec - exiting 10:40:56 (5724): No heartbeat from core client for 30 sec - exiting 10:40:57 (5724): No heartbeat from core client for 30 sec - exiting 10:40:58 (5724): No heartbeat from core client for 30 sec - exiting 10:40:59 (5724): No heartbeat from core client for 30 sec - exiting 10:41:00 (5724): No heartbeat from core client for 30 sec - exiting 10:41:01 (5724): No heartbeat from core client for 30 sec - exiting 10:41:02 (5724): No heartbeat from core client for 30 sec - exiting 10:41:03 (5724): No heartbeat from core client for 30 sec - exiting 10:41:04 (5724): No heartbeat from core client for 30 sec - exiting 10:41:05 (5724): No heartbeat from core client for 30 sec - exiting 10:41:06 (5724): No heartbeat from core client for 30 sec - exiting 10:41:07 (5724): No heartbeat from core client for 30 sec - exiting 10:41:08 (5724): No heartbeat from core client for 30 sec - exiting 10:41:09 (5724): No heartbeat from core client for 30 sec - exiting 10:41:10 (5724): No heartbeat from core client for 30 sec - exiting 10:41:11 (5724): No heartbeat from core client for 30 sec - exiting 10:41:12 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2776, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:33:05 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5340, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6836, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5136, iMonCtr=1 Model crash detected, will try to restart... 10:03:08 (5748): No heartbeat from core client for 30 sec - exiting 10:03:09 (5748): No heartbeat from core client for 30 sec - exiting 10:03:10 (5748): No heartbeat from core client for 30 sec - exiting 10:03:11 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4412, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1488, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5228, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5816, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6376, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4284, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4508, iMonCtr=1 Model crash detected, will try to restart... 16:08:17 (6076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5404, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6040, iMonCtr=1 Model crash detected, will try to restart... 09:42:59 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5644, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4212, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6460, iMonCtr=1 Model crash detected, will try to restart... 16:54:57 (6060): No heartbeat from core client for 30 sec - exiting 16:54:58 (6060): No heartbeat from core client for 30 sec - exiting 16:54:59 (6060): No heartbeat from core client for 30 sec - exiting 16:55:00 (6060): No heartbeat from core client for 30 sec - exiting 16:55:01 (6060): No heartbeat from core client for 30 sec - exiting 16:55:02 (6060): No heartbeat from core client for 30 sec - exiting 16:55:03 (6060): No heartbeat from core client for 30 sec - exiting 16:55:04 (6060): No heartbeat from core client for 30 sec - exiting 16:55:05 (6060): No heartbeat from core client for 30 sec - exiting 16:55:06 (6060): No heartbeat from core client for 30 sec - exiting 16:55:07 (6060): No heartbeat from core client for 30 sec - exiting 16:55:08 (6060): No heartbeat from core client for 30 sec - exiting 16:55:09 (6060): No heartbeat from core client for 30 sec - exiting 16:55:10 (6060): No heartbeat from core client for 30 sec - exiting 16:55:11 (6060): No heartbeat from core client for 30 sec - exiting 16:55:12 (6060): No heartbeat from core client for 30 sec - exiting 16:55:13 (6060): No heartbeat from core client for 30 sec - exiting 16:55:14 (6060): No heartbeat from core client for 30 sec - exiting 16:55:15 (6060): No heartbeat from core client for 30 sec - exiting 16:55:16 (6060): No heartbeat from core client for 30 sec - exiting 16:55:17 (6060): No heartbeat from core client for 30 sec - exiting 16:55:18 (6060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6856, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4164, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4356, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7052, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5388, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3896, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Feb 2012 20:28:27	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	1,036,800	2,051,994	1.9792
09 Feb 2012 12:34:52	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	1,010,880	2,001,568	1.9800
07 Feb 2012 20:22:52	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	984,960	1,951,127	1.9809
06 Feb 2012 16:30:24	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	959,040	1,900,965	1.9822
04 Feb 2012 20:21:11	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	933,120	1,850,776	1.9834
03 Feb 2012 19:35:34	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	907,200	1,800,046	1.9842
30 Jan 2012 17:41:26	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	881,280	1,749,319	1.9850
29 Jan 2012 09:08:23	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	855,360	1,699,500	1.9869
28 Jan 2012 07:51:54	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	829,440	1,648,869	1.9879
25 Jan 2012 18:19:15	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	803,520	1,598,359	1.9892
24 Jan 2012 08:38:18	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	777,600	1,545,656	1.9877
21 Jan 2012 20:28:03	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	751,680	1,495,312	1.9893
20 Jan 2012 16:01:32	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	725,760	1,444,928	1.9909
17 Jan 2012 18:44:37	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	699,840	1,394,549	1.9927
15 Jan 2012 12:46:16	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	673,920	1,344,155	1.9945
14 Jan 2012 10:07:27	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	648,000	1,294,368	1.9975
13 Jan 2012 15:14:03	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	622,080	1,243,638	1.9992
09 Jan 2012 17:10:33	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	596,160	1,191,468	1.9986
07 Jan 2012 20:47:01	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	570,240	1,138,752	1.9970
06 Jan 2012 12:54:05	1021113	13659068	hadcm3n_o6qq_1980_40_007422905_2	544,320	1,088,374	1.9995