Task 14076320

Name	hadam3p_pnw_8ql5_2009_1_007707413_1
Workunit	7862521
Created	8 Feb 2012, 3:16:19 UTC
Sent	8 Feb 2012, 3:51:53 UTC
Report deadline	20 Jan 2013, 9:11:53 UTC
Received	2 Apr 2012, 3:40:28 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1172255
Run time	2 days 22 hours 33 min 21 sec
CPU time	2 days 21 hours 21 min 36 sec
Validate state	Workunit error - check skipped
Credit	3,006.22
Device peak FLOPS	3.33 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> 16:35:51 (5872): No heartbeat from core client for 30 sec - exiting 16:35:52 (5872): No heartbeat from core client for 30 sec - exiting 16:35:53 (5872): No heartbeat from core client for 30 sec - exiting 16:35:54 (5872): No heartbeat from core client for 30 sec - exiting 16:35:55 (5872): No heartbeat from core client for 30 sec - exiting 16:35:56 (5872): No heartbeat from core client for 30 sec - exiting 16:35:57 (5872): No heartbeat from core client for 30 sec - exiting 16:35:58 (5872): No heartbeat from core client for 30 sec - exiting 16:35:59 (5872): No heartbeat from core client for 30 sec - exiting 16:36:00 (5872): No heartbeat from core client for 30 sec - exiting 16:36:01 (5872): No heartbeat from core client for 30 sec - exiting 16:36:02 (5872): No heartbeat from core client for 30 sec - exiting 16:36:03 (5872): No heartbeat from core client for 30 sec - exiting 16:36:04 (5872): No heartbeat from core client for 30 sec - exiting 16:36:05 (5872): No heartbeat from core client for 30 sec - exiting 16:36:06 (5872): No heartbeat from core client for 30 sec - exiting 16:36:07 (5872): No heartbeat from core client for 30 sec - exiting 16:36:08 (5872): No heartbeat from core client for 30 sec - exiting 16:36:09 (5872): No heartbeat from core client for 30 sec - exiting 16:36:10 (5872): No heartbeat from core client for 30 sec - exiting 16:36:11 (5872): No heartbeat from core client for 30 sec - exiting 16:36:12 (5872): No heartbeat from core client for 30 sec - exiting 16:36:13 (5872): No heartbeat from core client for 30 sec - exiting 16:36:14 (5872): No heartbeat from core client for 30 sec - exiting 16:36:15 (5872): No heartbeat from core client for 30 sec - exiting 16:36:16 (5872): No heartbeat from core client for 30 sec - exiting 16:36:17 (5872): No heartbeat from core client for 30 sec - exiting 16:36:18 (5872): No heartbeat from core client for 30 sec - exiting 16:36:19 (5872): No heartbeat from core client for 30 sec - exiting 16:36:20 (5872): No heartbeat from core client for 30 sec - exiting 16:36:21 (5872): No heartbeat from core client for 30 sec - exiting 16:36:22 (5872): No heartbeat from core client for 30 sec - exiting 16:36:23 (5872): No heartbeat from core client for 30 sec - exiting 16:36:24 (5872): No heartbeat from core client for 30 sec - exiting 16:36:25 (5872): No heartbeat from core client for 30 sec - exiting 16:36:26 (5872): No heartbeat from core client for 30 sec - exiting 16:36:27 (5872): No heartbeat from core client for 30 sec - exiting 16:36:28 (5872): No heartbeat from core client for 30 sec - exiting 16:36:29 (5872): No heartbeat from core client for 30 sec - exiting 16:36:30 (5872): No heartbeat from core client for 30 sec - exiting 16:36:31 (5872): No heartbeat from core client for 30 sec - exiting 16:36:32 (5872): No heartbeat from core client for 30 sec - exiting 16:36:33 (5872): No heartbeat from core client for 30 sec - exiting 16:36:34 (5872): No heartbeat from core client for 30 sec - exiting 16:36:35 (5872): No heartbeat from core client for 30 sec - exiting 16:36:36 (5872): No heartbeat from core client for 30 sec - exiting 16:36:37 (5872): No heartbeat from core client for 30 sec - exiting 16:36:38 (5872): No heartbeat from core client for 30 sec - exiting 16:36:39 (5872): No heartbeat from core client for 30 sec - exiting 16:36:40 (5872): No heartbeat from core client for 30 sec - exiting 16:36:41 (5872): No heartbeat from core client for 30 sec - exiting 16:36:42 (5872): No heartbeat from core client for 30 sec - exiting 16:36:43 (5872): No heartbeat from core client for 30 sec - exiting 16:36:44 (5872): No heartbeat from core client for 30 sec - exiting 16:36:45 (5872): No heartbeat from core client for 30 sec - exiting 16:36:46 (5872): No heartbeat from core client for 30 sec - exiting 16:36:47 (5872): No heartbeat from core client for 30 sec - exiting 16:36:48 (5872): No heartbeat from core client for 30 sec - exiting 16:36:49 (5872): No heartbeat from core client for 30 sec - exiting 16:36:50 (5872): No heartbeat from core client for 30 sec - exiting 16:36:51 (5872): No heartbeat from core client for 30 sec - exiting 16:36:52 (5872): No heartbeat from core client for 30 sec - exiting 16:36:53 (5872): No heartbeat from core client for 30 sec - exiting 16:36:54 (5872): No heartbeat from core client for 30 sec - exiting 16:36:55 (5872): No heartbeat from core client for 30 sec - exiting 16:36:56 (5872): No heartbeat from core client for 30 sec - exiting 16:36:57 (5872): No heartbeat from core client for 30 sec - exiting 16:36:58 (5872): No heartbeat from core client for 30 sec - exiting 16:36:59 (5872): No heartbeat from core client for 30 sec - exiting 16:37:00 (5872): No heartbeat from core client for 30 sec - exiting 16:37:01 (5872): No heartbeat from core client for 30 sec - exiting 16:37:02 (5872): No heartbeat from core client for 30 sec - exiting 16:37:03 (5872): No heartbeat from core client for 30 sec - exiting 16:37:04 (5872): No heartbeat from core client for 30 sec - exiting 16:37:05 (5872): No heartbeat from core client for 30 sec - exiting 16:37:06 (5872): No heartbeat from core client for 30 sec - exiting 16:37:07 (5872): No heartbeat from core client for 30 sec - exiting 16:37:08 (5872): No heartbeat from core client for 30 sec - exiting 16:37:09 (5872): No heartbeat from core client for 30 sec - exiting 16:37:10 (5872): No heartbeat from core client for 30 sec - exiting 16:37:11 (5872): No heartbeat from core client for 30 sec - exiting 16:37:12 (5872): No heartbeat from core client for 30 sec - exiting 16:37:13 (5872): No heartbeat from core client for 30 sec - exiting 16:37:14 (5872): No heartbeat from core client for 30 sec - exiting 16:37:15 (5872): No heartbeat from core client for 30 sec - exiting 16:37:16 (5872): No heartbeat from core client for 30 sec - exiting 16:37:17 (5872): No heartbeat from core client for 30 sec - exiting 16:37:18 (5872): No heartbeat from core client for 30 sec - exiting 16:37:19 (5872): No heartbeat from core client for 30 sec - exiting 16:37:20 (5872): No heartbeat from core client for 30 sec - exiting 16:37:21 (5872): No heartbeat from core client for 30 sec - exiting 16:37:22 (5872): No heartbeat from core client for 30 sec - exiting 16:37:23 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 05:57:57 (6812): No heartbeat from core client for 30 sec - exiting 05:57:58 (6812): No heartbeat from core client for 30 sec - exiting 05:57:59 (6812): No heartbeat from core client for 30 sec - exiting 05:58:00 (6812): No heartbeat from core client for 30 sec - exiting 05:58:01 (6812): No heartbeat from core client for 30 sec - exiting 05:58:02 (6812): No heartbeat from core client for 30 sec - exiting 05:58:03 (6812): No heartbeat from core client for 30 sec - exiting 05:58:04 (6812): No heartbeat from core client for 30 sec - exiting 05:58:05 (6812): No heartbeat from core client for 30 sec - exiting 05:58:06 (6812): No heartbeat from core client for 30 sec - exiting 05:58:07 (6812): No heartbeat from core client for 30 sec - exiting 05:58:08 (6812): No heartbeat from core client for 30 sec - exiting 05:58:09 (6812): No heartbeat from core client for 30 sec - exiting 05:58:10 (6812): No heartbeat from core client for 30 sec - exiting 05:58:11 (6812): No heartbeat from core client for 30 sec - exiting 05:58:12 (6812): No heartbeat from core client for 30 sec - exiting 05:58:13 (6812): No heartbeat from core client for 30 sec - exiting 05:58:14 (6812): No heartbeat from core client for 30 sec - exiting 05:58:15 (6812): No heartbeat from core client for 30 sec - exiting 05:58:16 (6812): No heartbeat from core client for 30 sec - exiting 05:58:17 (6812): No heartbeat from core client for 30 sec - exiting 05:58:18 (6812): No heartbeat from core client for 30 sec - exiting 05:58:19 (6812): No heartbeat from core client for 30 sec - exiting 05:58:20 (6812): No heartbeat from core client for 30 sec - exiting 05:58:21 (6812): No heartbeat from core client for 30 sec - exiting 05:58:22 (6812): No heartbeat from core client for 30 sec - exiting 05:58:23 (6812): No heartbeat from core client for 30 sec - exiting 05:58:24 (6812): No heartbeat from core client for 30 sec - exiting 05:58:25 (6812): No heartbeat from core client for 30 sec - exiting 05:58:26 (6812): No heartbeat from core client for 30 sec - exiting 05:58:27 (6812): No heartbeat from core client for 30 sec - exiting 05:58:28 (6812): No heartbeat from core client for 30 sec - exiting 05:58:29 (6812): No heartbeat from core client for 30 sec - exiting 05:58:30 (6812): No heartbeat from core client for 30 sec - exiting 05:58:31 (6812): No heartbeat from core client for 30 sec - exiting 05:58:32 (6812): No heartbeat from core client for 30 sec - exiting 05:58:33 (6812): No heartbeat from core client for 30 sec - exiting 05:58:34 (6812): No heartbeat from core client for 30 sec - exiting 05:58:35 (6812): No heartbeat from core client for 30 sec - exiting 05:58:36 (6812): No heartbeat from core client for 30 sec - exiting 05:58:37 (6812): No heartbeat from core client for 30 sec - exiting 05:58:38 (6812): No heartbeat from core client for 30 sec - exiting 05:58:39 (6812): No heartbeat from core client for 30 sec - exiting 05:58:40 (6812): No heartbeat from core client for 30 sec - exiting 05:58:41 (6812): No heartbeat from core client for 30 sec - exiting 05:58:42 (6812): No heartbeat from core client for 30 sec - exiting 05:58:43 (6812): No heartbeat from core client for 30 sec - exiting 05:58:44 (6812): No heartbeat from core client for 30 sec - exiting 05:58:45 (6812): No heartbeat from core client for 30 sec - exiting 05:58:46 (6812): No heartbeat from core client for 30 sec - exiting 05:58:47 (6812): No heartbeat from core client for 30 sec - exiting 05:58:48 (6812): No heartbeat from core client for 30 sec - exiting 05:58:49 (6812): No heartbeat from core client for 30 sec - exiting 05:58:50 (6812): No heartbeat from core client for 30 sec - exiting 05:58:51 (6812): No heartbeat from core client for 30 sec - exiting 05:58:52 (6812): No heartbeat from core client for 30 sec - exiting 05:58:53 (6812): No heartbeat from core client for 30 sec - exiting 05:58:54 (6812): No heartbeat from core client for 30 sec - exiting 05:58:55 (6812): No heartbeat from core client for 30 sec - exiting 05:58:56 (6812): No heartbeat from core client for 30 sec - exiting 05:58:57 (6812): No heartbeat from core client for 30 sec - exiting 05:58:58 (6812): No heartbeat from core client for 30 sec - exiting 05:58:59 (6812): No heartbeat from core client for 30 sec - exiting 05:59:00 (6812): No heartbeat from core client for 30 sec - exiting 05:59:01 (6812): No heartbeat from core client for 30 sec - exiting 05:59:02 (6812): No heartbeat from core client for 30 sec - exiting 05:59:03 (6812): No heartbeat from core client for 30 sec - exiting 05:59:04 (6812): No heartbeat from core client for 30 sec - exiting 05:59:05 (6812): No heartbeat from core client for 30 sec - exiting 05:59:06 (6812): No heartbeat from core client for 30 sec - exiting 05:59:07 (6812): No heartbeat from core client for 30 sec - exiting 05:59:08 (6812): No heartbeat from core client for 30 sec - exiting 05:59:09 (6812): No heartbeat from core client for 30 sec - exiting 05:59:10 (6812): No heartbeat from core client for 30 sec - exiting 05:59:11 (6812): No heartbeat from core client for 30 sec - exiting 05:59:12 (6812): No heartbeat from core client for 30 sec - exiting 05:59:13 (6812): No heartbeat from core client for 30 sec - exiting 05:59:14 (6812): No heartbeat from core client for 30 sec - exiting 05:59:15 (6812): No heartbeat from core client for 30 sec - exiting 05:59:16 (6812): No heartbeat from core client for 30 sec - exiting 05:59:17 (6812): No heartbeat from core client for 30 sec - exiting 05:59:18 (6812): No heartbeat from core client for 30 sec - exiting 05:59:19 (6812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:59:20 (6812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6128, selfPID=2852, iMonCtr=1 Model crash detected, will try to restart... 19:15:03 (6060): No heartbeat from core client for 30 sec - exiting 19:15:04 (6060): No heartbeat from core client for 30 sec - exiting 19:15:05 (6060): No heartbeat from core client for 30 sec - exiting 19:15:06 (6060): No heartbeat from core client for 30 sec - exiting 19:15:07 (6060): No heartbeat from core client for 30 sec - exiting 19:15:08 (6060): No heartbeat from core client for 30 sec - exiting 19:15:09 (6060): No heartbeat from core client for 30 sec - exiting 19:15:10 (6060): No heartbeat from core client for 30 sec - exiting 19:15:11 (6060): No heartbeat from core client for 30 sec - exiting 19:15:12 (6060): No heartbeat from core client for 30 sec - exiting 19:15:13 (6060): No heartbeat from core client for 30 sec - exiting 19:15:14 (6060): No heartbeat from core client for 30 sec - exiting 19:15:15 (6060): No heartbeat from core client for 30 sec - exiting 19:15:16 (6060): No heartbeat from core client for 30 sec - exiting 19:15:17 (6060): No heartbeat from core client for 30 sec - exiting 19:15:18 (6060): No heartbeat from core client for 30 sec - exiting 19:15:19 (6060): No heartbeat from core client for 30 sec - exiting 19:15:20 (6060): No heartbeat from core client for 30 sec - exiting 19:15:21 (6060): No heartbeat from core client for 30 sec - exiting 19:15:22 (6060): No heartbeat from core client for 30 sec - exiting 19:15:23 (6060): No heartbeat from core client for 30 sec - exiting 19:15:24 (6060): No heartbeat from core client for 30 sec - exiting 19:15:25 (6060): No heartbeat from core client for 30 sec - exiting 19:15:26 (6060): No heartbeat from core client for 30 sec - exiting 19:15:27 (6060): No heartbeat from core client for 30 sec - exiting 19:15:28 (6060): No heartbeat from core client for 30 sec - exiting 19:15:29 (6060): No heartbeat from core client for 30 sec - exiting 19:15:30 (6060): No heartbeat from core client for 30 sec - exiting 19:15:31 (6060): No heartbeat from core client for 30 sec - exiting 19:15:32 (6060): No heartbeat from core client for 30 sec - exiting 19:15:33 (6060): No heartbeat from core client for 30 sec - exiting 19:15:34 (6060): No heartbeat from core client for 30 sec - exiting 19:15:35 (6060): No heartbeat from core client for 30 sec - exiting 19:15:36 (6060): No heartbeat from core client for 30 sec - exiting 19:15:37 (6060): No heartbeat from core client for 30 sec - exiting 19:15:38 (6060): No heartbeat from core client for 30 sec - exiting 19:15:39 (6060): No heartbeat from core client for 30 sec - exiting 19:15:40 (6060): No heartbeat from core client for 30 sec - exiting 19:15:41 (6060): No heartbeat from core client for 30 sec - exiting 19:15:42 (6060): No heartbeat from core client for 30 sec - exiting 19:15:43 (6060): No heartbeat from core client for 30 sec - exiting 19:15:44 (6060): No heartbeat from core client for 30 sec - exiting 19:15:45 (6060): No heartbeat from core client for 30 sec - exiting 19:15:46 (6060): No heartbeat from core client for 30 sec - exiting 19:15:47 (6060): No heartbeat from core client for 30 sec - exiting 19:15:48 (6060): No heartbeat from core client for 30 sec - exiting 19:15:49 (6060): No heartbeat from core client for 30 sec - exiting 19:15:50 (6060): No heartbeat from core client for 30 sec - exiting 19:15:51 (6060): No heartbeat from core client for 30 sec - exiting 19:15:52 (6060): No heartbeat from core client for 30 sec - exiting 19:15:53 (6060): No heartbeat from core client for 30 sec - exiting 19:15:54 (6060): No heartbeat from core client for 30 sec - exiting 19:15:55 (6060): No heartbeat from core client for 30 sec - exiting 19:15:56 (6060): No heartbeat from core client for 30 sec - exiting 19:15:57 (6060): No heartbeat from core client for 30 sec - exiting 19:15:58 (6060): No heartbeat from core client for 30 sec - exiting 19:15:59 (6060): No heartbeat from core client for 30 sec - exiting 19:16:00 (6060): No heartbeat from core client for 30 sec - exiting 19:16:01 (6060): No heartbeat from core client for 30 sec - exiting 19:16:02 (6060): No heartbeat from core client for 30 sec - exiting 19:16:03 (6060): No heartbeat from core client for 30 sec - exiting 19:16:04 (6060): No heartbeat from core client for 30 sec - exiting 19:16:05 (6060): No heartbeat from core client for 30 sec - exiting 19:16:06 (6060): No heartbeat from core client for 30 sec - exiting 19:16:07 (6060): No heartbeat from core client for 30 sec - exiting 19:16:08 (6060): No heartbeat from core client for 30 sec - exiting 19:16:09 (6060): No heartbeat from core client for 30 sec - exiting 19:16:10 (6060): No heartbeat from core client for 30 sec - exiting 19:16:11 (6060): No heartbeat from core client for 30 sec - exiting 19:16:12 (6060): No heartbeat from core client for 30 sec - exiting 19:16:13 (6060): No heartbeat from core client for 30 sec - exiting 19:16:14 (6060): No heartbeat from core client for 30 sec - exiting 19:16:15 (6060): No heartbeat from core client for 30 sec - exiting 19:16:16 (6060): No heartbeat from core client for 30 sec - exiting 19:16:17 (6060): No heartbeat from core client for 30 sec - exiting 19:16:18 (6060): No heartbeat from core client for 30 sec - exiting 19:16:19 (6060): No heartbeat from core client for 30 sec - exiting 19:16:20 (6060): No heartbeat from core client for 30 sec - exiting 19:16:21 (6060): No heartbeat from core client for 30 sec - exiting 19:16:22 (6060): No heartbeat from core client for 30 sec - exiting 19:16:23 (6060): No heartbeat from core client for 30 sec - exiting 19:16:24 (6060): No heartbeat from core client for 30 sec - exiting 19:16:25 (6060): No heartbeat from core client for 30 sec - exiting 19:16:26 (6060): No heartbeat from core client for 30 sec - exiting 19:16:27 (6060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5676, selfPID=5676, iMonCtr=2 17:44:49 (6996): No heartbeat from core client for 30 sec - exiting 17:44:50 (6996): No heartbeat from core client for 30 sec - exiting 17:44:51 (6996): No heartbeat from core client for 30 sec - exiting 17:44:52 (6996): No heartbeat from core client for 30 sec - exiting 17:44:53 (6996): No heartbeat from core client for 30 sec - exiting 17:44:54 (6996): No heartbeat from core client for 30 sec - exiting 17:44:55 (6996): No heartbeat from core client for 30 sec - exiting 17:44:56 (6996): No heartbeat from core client for 30 sec - exiting 17:44:57 (6996): No heartbeat from core client for 30 sec - exiting 17:44:58 (6996): No heartbeat from core client for 30 sec - exiting 17:44:59 (6996): No heartbeat from core client for 30 sec - exiting 17:45:00 (6996): No heartbeat from core client for 30 sec - exiting 17:45:01 (6996): No heartbeat from core client for 30 sec - exiting 17:45:02 (6996): No heartbeat from core client for 30 sec - exiting 17:45:03 (6996): No heartbeat from core client for 30 sec - exiting 17:45:04 (6996): No heartbeat from core client for 30 sec - exiting 17:45:05 (6996): No heartbeat from core client for 30 sec - exiting 17:45:06 (6996): No heartbeat from core client for 30 sec - exiting 17:45:07 (6996): No heartbeat from core client for 30 sec - exiting 17:45:08 (6996): No heartbeat from core client for 30 sec - exiting 17:45:09 (6996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5876, selfPID=5876, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5644, selfPID=5644, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7096, selfPID=7096, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5492, selfPID=5492, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5856, selfPID=5856, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=456, selfPID=456, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6024, selfPID=6024, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3340, selfPID=3340, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3732, selfPID=3732, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2900, selfPID=2900, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:19:26 (6032): No heartbeat from core client for 30 sec - exiting 06:19:27 (6032): No heartbeat from core client for 30 sec - exiting 06:19:28 (6032): No heartbeat from core client for 30 sec - exiting 06:19:29 (6032): No heartbeat from core client for 30 sec - exiting 06:19:30 (6032): No heartbeat from core client for 30 sec - exiting 06:19:31 (6032): No heartbeat from core client for 30 sec - exiting 06:19:32 (6032): No heartbeat from core client for 30 sec - exiting 06:19:33 (6032): No heartbeat from core client for 30 sec - exiting 06:19:34 (6032): No heartbeat from core client for 30 sec - exiting 06:19:35 (6032): No heartbeat from core client for 30 sec - exiting 06:19:36 (6032): No heartbeat from core client for 30 sec - exiting 06:19:37 (6032): No heartbeat from core client for 30 sec - exiting 06:19:38 (6032): No heartbeat from core client for 30 sec - exiting 06:19:39 (6032): No heartbeat from core client for 30 sec - exiting 06:19:40 (6032): No heartbeat from core client for 30 sec - exiting 06:19:41 (6032): No heartbeat from core client for 30 sec - exiting 06:19:42 (6032): No heartbeat from core client for 30 sec - exiting 06:19:43 (6032): No heartbeat from core client for 30 sec - exiting 06:19:44 (6032): No heartbeat from core client for 30 sec - exiting 06:19:45 (6032): No heartbeat from core client for 30 sec - exiting 06:19:46 (6032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=160, selfPID=160, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1476, selfPID=1476, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5664, selfPID=5664, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3560, selfPID=2120, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2436, selfPID=2436, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5436, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4364, selfPID=4364, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1412, selfPID=1412, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4320, selfPID=1180, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5748, selfPID=5748, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Apr 2012 03:43:22	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	138,352	249,324	1.8021
02 Apr 2012 03:43:22	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	138,343	249,054	1.8003
01 Apr 2012 18:14:42	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	138,341	248,783	1.7983
01 Apr 2012 10:00:51	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	138,336	248,529	1.7966
31 Mar 2012 02:28:21	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	126,816	229,642	1.8108
30 Mar 2012 05:12:32	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	115,296	210,710	1.8276
28 Mar 2012 01:54:28	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	103,776	192,235	1.8524
27 Mar 2012 03:28:03	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	92,265	173,804	1.8837
27 Mar 2012 03:28:03	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	92,257	173,541	1.8811
26 Mar 2012 16:59:25	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	92,256	173,285	1.8783
26 Mar 2012 03:30:11	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	80,736	155,068	1.9207
25 Mar 2012 04:19:52	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	69,216	137,482	1.9863
21 Mar 2012 08:14:11	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	57,696	120,035	2.0805
19 Mar 2012 05:41:45	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	46,176	102,734	2.2248
17 Mar 2012 20:12:17	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	34,656	85,245	2.4597
17 Mar 2012 01:57:01	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	23,136	67,514	2.9181
17 Feb 2012 09:15:47	1172255	14076320	hadam3p_pnw_8ql5_2009_1_007707413_1	11,616	38,026	3.2736