Task 14449039

Name	hadam3p_pnw_bie4_1995_1_007910139_0
Workunit	8065251
Created	17 Apr 2012, 19:27:37 UTC
Sent	8 May 2012, 11:41:30 UTC
Report deadline	20 Apr 2013, 17:01:30 UTC
Received	13 Aug 2012, 4:42:47 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1306963
Run time	32 days 7 hours 56 min 4 sec
CPU time	26 days 10 hours 32 min 27 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	0.68 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.33</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10008, selfPID=10008, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:17:26 (3920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:17:28 (3920): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4340, selfPID=5392, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 09:14:44 (7112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:10:37 (6216): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:00:08 (5556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5304, selfPID=6716, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3804, selfPID=5328, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6808, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:17:02 (1700): No heartbeat from core client for 30 sec - exiting 16:17:03 (1700): No heartbeat from core client for 30 sec - exiting 16:17:04 (1700): No heartbeat from core client for 30 sec - exiting 16:17:05 (1700): No heartbeat from core client for 30 sec - exiting 16:17:06 (1700): No heartbeat from core client for 30 sec - exiting 16:17:07 (1700): No heartbeat from core client for 30 sec - exiting 16:17:08 (1700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:44:57 (6968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:44:58 (6968): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:18:55 (8092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:18:56 (8092): No heartbeat from core client for 30 sec - exiting 03:18:57 (8092): No heartbeat from core client for 30 sec - exiting 03:18:58 (8092): No heartbeat from core client for 30 sec - exiting 03:18:59 (8092): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7136, selfPID=7136, iMonCtr=2 03:19:00 (8092): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:07:42 (4120): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2112, selfPID=6288, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6064, selfPID=7056, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 19:51:11 (6616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7636, selfPID=7636, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6148, selfPID=6148, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 CPDN Monitor - Quit request from BOINC... 02:11:51 (4780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:13:15 (6236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8052, selfPID=8052, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:05:45 (6100): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:55:22 (2848): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:55:23 (2848): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:58:57 (6680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:40:59 (3180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:41:00 (3180): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exitin2:41:01 (3180): No heartbeat from core client for 30 sec - exiting g, bRetVal = 1, checkPID=8128, selfPID=8128, iMonCtr=2 02:41:02 (3180): No heartbeat from core client for 30 sec - exiting 02:41:03 (3180): No heartbeat from core client for 30 sec - exiting 02:41:04 (3180): No heartbeat from core client for 30 sec - exiting 02:41:05 (3180): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:54:52 (5956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:18:38 (8756): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:18:39 (8756): No heartbeat from core client for 30 sec - exiting 22:18:40 (8756): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6628, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6652, selfPID=5924, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2292, selfPID=3236, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 09:43:08 (4432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3784, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5120, selfPID=5908, iMonCtr=1 Model crash detected, will try to restart... 10:29:00 (5124): No heartbeat from core client for 30 sec - exiting 10:29:01 (5124): No heartbeat from core client for 30 sec - exiting 10:29:02 (5124): No heartbeat from core client for 30 sec - exiting 10:29:03 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:33:39 (2356): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:33:10 (6396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:28:09 (5436): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:39:34 (7524): No heartbeat from core client for 30 sec - exiting 16:39:36 (7524): No heartbeat from core client for 30 sec - exiting 16:40:12 (7524): No heartbeat from core client for 30 sec - exiting 16:40:13 (7524): No heartbeat from core client for 30 sec - exiting 16:40:14 (7524): No heartbeat from core client for 30 sec - exiting 16:40:15 (7524): No heartbeat from core client for 30 sec - exiting 16:40:16 (7524): No heartbeat from core client for 30 sec - exiting 16:40:17 (7524): No heartbeat from core client for 30 sec - exiting 16:40:19 (7524): No heartbeat from core client for 30 sec - exiting 16:40:20 (7524): No heartbeat from core client for 30 sec - exiting 16:40:21 (7524): No heartbeat from core client for 30 sec - exiting 16:40:22 (7524): No heartbeat from core client for 30 sec - exiting 16:40:23 (7524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:54:01 (4228): No heartbeat from core client for 30 sec - exiting 16:54:03 (4228): No heartbeat from core client for 30 sec - exiting 16:54:04 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:20 (6208): No heartbeat from core client for 30 sec - exiting 17:33:54 (6208): No heartbeat from core client for 30 sec - exiting 17:33:55 (6208): No heartbeat from core client for 30 sec - exiting 17:33:56 (6208): No heartbeat from core client for 30 sec - exiting 17:33:57 (6208): No heartbeat from core client for 30 sec - exiting 17:33:58 (6208): No heartbeat from core client for 30 sec - exiting 17:34:00 (6208): No heartbeat from core client for 30 sec - exiting 17:34:01 (6208): No heartbeat from core client for 30 sec - exiting 17:34:02 (6208): No heartbeat from core client for 30 sec - exiting 17:34:03 (6208): No heartbeat from core client for 30 sec - exiting 17:34:04 (6208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:48:50 (6912): No heartbeat from core client for 30 sec - exiting 22:48:51 (6912): No heartbeat from core client for 30 sec - exiting 22:48:52 (6912): No heartbeat from core client for 30 sec - exiting 22:48:54 (6912): No heartbeat from core client for 30 sec - exiting 22:48:55 (6912): No heartbeat from core client for 30 sec - exiting 22:48:56 (6912): No heartbeat from core client for 30 sec - exiting 22:48:57 (6912): No heartbeat from core client for 30 sec - exiting 22:48:58 (6912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:14 (6376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:04:49 (4772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:50 (4772): No heartbeat from core client for 30 sec - exiting 06:04:51 (4772): No heartbeat from core client for 30 sec - exiting 06:04:52 (4772): No heartbeat from core client for 30 sec - exiting 06:04:53 (4772): No heartbeat from core client for 30 sec - exiting 06:04:54 (4772): No heartbeat from core client for 30 sec - exiting 06:04:55 (4772): No heartbeat from core client for 30 sec - exiting 22:26:04 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:06 (3376): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:14:09 (3400): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:28:49 (7280): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3596, selfPID=3596, iMonCtr=2 12:23:12 (7724): No heartbeat from core client for 30 sec - exiting 12:23:13 (7724): No heartbeat from core client for 30 sec - exiting 12:23:14 (7724): No heartbeat from core client for 30 sec - exiting 12:23:15 (7724): No heartbeat from core client for 30 sec - exiting 12:23:16 (7724): No heartbeat from core client for 30 sec - exiting 12:23:17 (7724): No heartbeat from core client for 30 sec - exiting 12:23:18 (7724): No heartbeat from core client for 30 sec - exiting 12:23:19 (7724): No heartbeat from core client for 30 sec - exiting 12:23:20 (7724): No heartbeat from core client for 30 sec - exiting 12:23:21 (7724): No heartbeat from core client for 30 sec - exiting 12:23:24 (7724): No heartbeat from core client for 30 sec - exiting 12:23:25 (7724): No heartbeat from core client for 30 sec - exiting 12:23:26 (7724): No heartbeat from core client for 30 sec - exiting 12:23:27 (7724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:37:58 (7952): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:37:59 (7952): No heartbeat from core client for 30 sec - exiting 12:38:00 (7952): No heartbeat from core client for 30 sec - exiting 12:38:01 (7952): No heartbeat from core client for 30 sec - exiting 12:38:02 (7952): No heartbeat from core client for 30 sec - exiting 12:38:03 (7952): No heartbeat from core client for 30 sec - exiting 12:38:04 (7952): No heartbeat from core client for 30 sec - exiting 19:14:47 (7824): No heartbeat from core client for 30 sec - exiting 19:14:48 (7824): No heartbeat from core client for 30 sec - exiting 19:14:49 (7824): No heartbeat from core client for 30 sec - exiting 19:14:50 (7824): No heartbeat from core client for 30 sec - exiting 19:14:51 (7824): No heartbeat from core client for 30 sec - exiting 19:14:52 (7824): No heartbeat from core client for 30 sec - exiting 19:14:53 (7824): No heartbeat from core client for 30 sec - exiting 19:14:54 (7824): No heartbeat from core client for 30 sec - exiting 19:14:55 (7824): No heartbeat from core client for 30 sec - exiting 19:14:56 (7824): No heartbeat from core client for 30 sec - exiting 19:14:57 (7824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:09 (3396): No heartbeat from core client for 30 sec - exiting 22:00:10 (3396): No heartbeat from core client for 30 sec - exiting 22:00:11 (3396): No heartbeat from core client for 30 sec - exiting 22:00:12 (3396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:51:50 (6612): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:24:43 (6048): No heartbeat from core client for 30 sec - exiting 14:24:44 (6048): No heartbeat from core client for 30 sec - exiting 14:24:45 (6048): No heartbeat from core client for 30 sec - exiting 14:24:46 (6048): No heartbeat from core client for 30 sec - exiting 14:24:47 (6048): No heartbeat from core client for 30 sec - exiting 14:24:48 (6048): No heartbeat from core client for 30 sec - exiting 14:24:49 (6048): No heartbeat from core client for 30 sec - exiting 14:24:50 (6048): No heartbeat from core client for 30 sec - exiting 14:24:52 (6048): No heartbeat from core client for 30 sec - exiting 14:24:53 (6048): No heartbeat from core client for 30 sec - exiting 14:24:54 (6048): No heartbeat from core client for 30 sec - exiting 14:24:55 (6048): No heartbeat from core client for 30 sec - exiting 14:24:56 (6048): No heartbeat from core client for 30 sec - exiting 14:24:57 (6048): No heartbeat from core client for 30 sec - exiting 14:24:58 (6048): No heartbeat from core client for 30 sec - exiting 14:24:59 (6048): No heartbeat from core client for 30 sec - exiting 14:25:00 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:52:15 (7120): No heartbeat from core client for 30 sec - exiting 16:52:16 (7120): No heartbeat from core client for 30 sec - exiting 16:52:17 (7120): No heartbeat from core client for 30 sec - exiting 16:52:18 (7120): No heartbeat from core client for 30 sec - exiting 16:52:19 (7120): No heartbeat from core client for 30 sec - exiting 16:52:25 (7120): No heartbeat from core client for 30 sec - exiting 16:52:26 (7120): No heartbeat from core client for 30 sec - exiting 16:52:27 (7120): No heartbeat from core client for 30 sec - exiting 16:52:28 (7120): No heartbeat from core client for 30 sec - exiting 16:52:29 (7120): No heartbeat from core client for 30 sec - exiting 16:52:31 (7120): No heartbeat from core client for 30 sec - exiting 16:52:32 (7120): No heartbeat from core client for 30 sec - exiting 16:52:33 (7120): No heartbeat from core client for 30 sec - exiting 16:52:34 (7120): No heartbeat from core client for 30 sec - exiting 16:52:35 (7120): No heartbeat from core client for 30 sec - exiting 16:52:36 (7120): No heartbeat from core client for 30 sec - exiting 16:52:37 (7120): No heartbeat from core client for 30 sec - exiting 16:52:38 (7120): No heartbeat from core client for 30 sec - exiting 16:52:39 (7120): No heartbeat from core client for 30 sec - exiting 16:52:41 (7120): No heartbeat from core client for 30 sec - exiting 16:52:42 (7120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:27:44 (2384): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:33:29 (5996): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:33:30 (5996): No heartbeat from core client for 30 sec - exiting 20:33:31 (5996): No heartbeat from core client for 30 sec - exiting 20:33:32 (5996): No heartbeat from core client for 30 sec - exiting 20:33:33 (5996): No heartbeat from core client for 30 sec - exiting 20:33:34 (5996): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3656, iMonCtr=2 11:10:04 (7184): No heartbeat from core client for 30 sec - exiting 11:10:05 (7184): No heartbeat from core client for 30 sec - exiting 11:10:06 (7184): No heartbeat from core client for 30 sec - exiting 11:10:07 (7184): No heartbeat from core client for 30 sec - exiting 11:10:09 (7184): No heartbeat from core client for 30 sec - exiting 11:10:10 (7184): No heartbeat from core client for 30 sec - exiting 11:10:11 (7184): No heartbeat from core client for 30 sec - exiting 11:10:12 (7184): No heartbeat from core client for 30 sec - exiting 11:10:13 (7184): No heartbeat from core client for 30 sec - exiting 11:10:14 (7184): No heartbeat from core client for 30 sec - exiting 11:10:15 (7184): No heartbeat from core client for 30 sec - exiting 11:10:16 (7184): No heartbeat from core client for 30 sec - exiting 11:10:17 (7184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:45:43 (6652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:59:43 (8120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:17 (4468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6376, selfPID=6376, iMonCtr=2 13:13:15 (8104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6948, selfPID=6184, iMonCtr=1 Model crash detected, will try to restart... 13:43:30 (7924): No heartbeat from core client for 30 sec - exiting 13:43:31 (7924): No heartbeat from core client for 30 sec - exiting 13:43:32 (7924): No heartbeat from core client for 30 sec - exiting 13:43:34 (7924): No heartbeat from core client for 30 sec - exiting 13:43:35 (7924): No heartbeat from core client for 30 sec - exiting 13:43:36 (7924): No heartbeat from core client for 30 sec - exiting 13:43:37 (7924): No heartbeat from core client for 30 sec - exiting 13:43:38 (7924): No heartbeat from core client for 30 sec - exiting 13:43:39 (7924): No heartbeat from core client for 30 sec - exiting 13:43:40 (7924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:33 (7364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:34 (7364): No heartbeat from core client for 30 sec - exiting 15:43:35 (7364): No heartbeat from core client for 30 sec - exiting 15:43:36 (7364): No heartbeat from core client for 30 sec - exiting 15:43:38 (7364): No heartbeat from core client for 30 sec - exiting 15:43:39 (7364): No heartbeat from core client for 30 sec - exiting 18:59:38 (3332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:38:36 (8064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:45:35 (5420): No heartbeat from core client for 30 sec - exiting 21:45:36 (5420): No heartbeat from core client for 30 sec - exiting 21:45:37 (5420): No heartbeat from core client for 30 sec - exiting 21:45:38 (5420): No heartbeat from core client for 30 sec - exiting 21:45:39 (5420): No heartbeat from core client for 30 sec - exiting 21:45:40 (5420): No heartbeat from core client for 30 sec - exiting 21:45:41 (5420): No heartbeat from core client for 30 sec - exiting 21:45:42 (5420): No heartbeat from core client for 30 sec - exiting 21:45:43 (5420): No heartbeat from core client for 30 sec - exiting 21:45:45 (5420): No heartbeat from core client for 30 sec - exiting 21:45:46 (5420): No heartbeat from core client for 30 sec - exiting 21:45:47 (5420): No heartbeat from core client for 30 sec - exiting 21:45:48 (5420): No heartbeat from core client for 30 sec - exiting 21:45:49 (5420): No heartbeat from core client for 30 sec - exiting 21:45:50 (5420): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 22:16:18 (5568): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:04:31 (1140): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:04:32 (1140): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:58:43 (7608): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:58:44 (7608): No heartbeat from core client for 30 sec - exiting 20:58:45 (7608): No heartbeat from core client for 30 sec - exiting 20:58:46 (7608): No heartbeat from core client for 30 sec - exiting 20:58:47 (7608): No heartbeat from core client for 30 sec - exiting 20:58:48 (7608): No heartbeat from core client for 30 sec - exiting 20:58:49 (7608): No heartbeat from core client for 30 sec - exiting 20:58:50 (7608): No heartbeat from core client for 30 sec - exiting 20:58:51 (7608): No heartbeat from core client for 30 sec - exiting 21:48:34 (6384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7988, selfPID=7988, iMonCtr=2 21:48:35 (6384): No heartbeat from core client for 30 sec - exiting 03:50:37 (7744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:58:52 (1392): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:06:15 (7884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:08:33 (808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:45:58 (4664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:50:23 (5044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:42:42 (9404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:42:43 (9404): No heartbeat from core client for 30 sec - exiting 05:44:57 (9964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:44:58 (9964): No heartbeat from core client for 30 sec - exiting 05:44:59 (9964): No heartbeat from core client for 30 sec - exiting 05:45:00 (9964): No heartbeat from core client for 30 sec - exiting 05:45:02 (9964): No heartbeat from core client for 30 sec - exiting 23:50:06 (2572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:50:07 (2572): No heartbeat from core client for 30 sec - exiting 05:52:13 (9388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:23:31 (9476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:23:33 (9476): No heartbeat from core client for 30 sec - exiting 21:23:34 (9476): No heartbeat from core client for 30 sec - exiting 21:23:35 (9476): No heartbeat from core client for 30 sec - exiting 21:23:36 (9476): No heartbeat from core client for 30 sec - exiting 21:23:37 (9476): No heartbeat from core client for 30 sec - exiting 21:23:38 (9476): No heartbeat from core client for 30 sec - exiting 06:27:06 (6968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:27:08 (6968): No heartbeat from core client for 30 sec - exiting 06:27:09 (6968): No heartbeat from core client for 30 sec - exiting 06:27:10 (6968): No heartbeat from core client for 30 sec - exiting 06:27:11 (6968): No heartbeat from core client for 30 sec - exiting 06:27:12 (6968): No heartbeat from core client for 30 sec - exiting 00:35:25 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:35:26 (4024): No heartbeat from core client for 30 sec - exiting 06:37:34 (9504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:52 (9800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:16:24 (9332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=380, selfPID=380, iMonCtr=2 23:16:25 (9332): No heartbeat from core client for 30 sec - exiting 05:20:43 (9260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:53:40 (8120): No heartbeat from core client for 30 sec - exiting 19:53:41 (8120): No heartbeat from core client for 30 sec - exiting 19:53:43 (8120): No heartbeat from core client for 30 sec - exiting 19:53:44 (8120): No heartbeat from core client for 30 sec - exiting 19:53:45 (8120): No heartbeat from core client for 30 sec - exiting 19:53:46 (8120): No heartbeat from core client for 30 sec - exiting 19:53:47 (8120): No heartbeat from core client for 30 sec - exiting 19:53:48 (8120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:45:57 (6808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:23:15 (7168): No heartbeat from core client for 30 sec - exiting 15:23:16 (7168): No heartbeat from core client for 30 sec - exiting 15:23:17 (7168): No heartbeat from core client for 30 sec - exiting 15:23:18 (7168): No heartbeat from core client for 30 sec - exiting 15:23:19 (7168): No heartbeat from core client for 30 sec - exiting 15:23:20 (7168): No heartbeat from core client for 30 sec - exiting 15:23:22 (7168): No heartbeat from core client for 30 sec - exiting 15:23:23 (7168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:12:22 (7368): No heartbeat from core client for 30 sec - exiting 16:12:23 (7368): No heartbeat from core client for 30 sec - exiting 16:12:24 (7368): No heartbeat from core client for 30 sec - exiting 16:12:25 (7368): No heartbeat from core client for 30 sec - exiting 16:12:26 (7368): No heartbeat from core client for 30 sec - exiting 16:12:27 (7368): No heartbeat from core client for 30 sec - exiting 16:12:29 (7368): No heartbeat from core client for 30 sec - exiting 16:12:30 (7368): No heartbeat from core client for 30 sec - exiting 16:12:32 (7368): No heartbeat from core client for 30 sec - exiting 16:12:33 (7368): No heartbeat from core client for 30 sec - exiting 16:12:34 (7368): No heartbeat from core client for 30 sec - exiting 16:12:35 (7368): No heartbeat from core client for 30 sec - exiting 16:12:37 (7368): No heartbeat from core client for 30 sec - exiting 16:12:38 (7368): No heartbeat from core client for 30 sec - exiting 16:12:39 (7368): No heartbeat from core client for 30 sec - exiting 16:12:40 (7368): No heartbeat from core client for 30 sec - exiting 16:12:41 (7368): No heartbeat from core client for 30 sec - exiting 16:12:42 (7368): No heartbeat from core client for 30 sec - exiting 16:12:43 (7368): No heartbeat from core client for 30 sec - exiting 16:12:44 (7368): No heartbeat from core client for 30 sec - exiting 16:12:45 (7368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:43 (6616): No heartbeat from core client for 30 sec - exiting 19:10:44 (6616): No heartbeat from core client for 30 sec - exiting 19:10:46 (6616): No heartbeat from core client for 30 sec - exiting 19:10:47 (6616): No heartbeat from core client for 30 sec - exiting 19:10:48 (6616): No heartbeat from core client for 30 sec - exiting 19:10:49 (6616): No heartbeat from core client for 30 sec - exiting 19:10:50 (6616): No heartbeat from core client for 30 sec - exiting 19:10:51 (6616): No heartbeat from core client for 30 sec - exiting 19:10:52 (6616): No heartbeat from core client for 30 sec - exiting 19:10:54 (6616): No heartbeat from core client for 30 sec - exiting 19:10:55 (6616): No heartbeat from core client for 30 sec - exiting 19:10:56 (6616): No heartbeat from core client for 30 sec - exiting 19:10:57 (6616): No heartbeat from core client for 30 sec - exiting 19:10:58 (6616): No heartbeat from core client for 30 sec - exiting 19:10:59 (6616): No heartbeat from core client for 30 sec - exiting 19:11:00 (6616): No heartbeat from core client for 30 sec - exiting 19:11:01 (6616): No heartbeat from core client for 30 sec - exiting 19:11:02 (6616): No heartbeat from core client for 30 sec - exiting 19:11:04 (6616): No heartbeat from core client for 30 sec - exiting 19:11:05 (6616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:48:20 (3508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:01 (8180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:10:35 (7720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:10:37 (7720): No heartbeat from core client for 30 sec - exiting 11:12:58 (752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:59 (752): No heartbeat from core client for 30 sec - exiting 11:13:00 (752): No heartbeat from core client for 30 sec - exiting 11:13:01 (752): No heartbeat from core client for 30 sec - exiting 11:13:02 (752): No heartbeat from core client for 30 sec - exiting 11:13:03 (752): No heartbeat from core client for 30 sec - exiting 11:13:04 (752): No heartbeat from core client for 30 sec - exiting 12:12:21 (2628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:27 (7144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:28 (7144): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5028, selfPID=5028, iMonCtr=2 12:39:46 (6456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:36 (1568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4044, selfPID=4044, iMonCtr=2 17:19:37 (1568): No heartbeat from core client for 30 sec - exiting 17:19:39 (1568): No heartbeat from core client for 30 sec - exiting 17:58:37 (5956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1912, selfPID=1912, iMonCtr=2 18:04:40 (7812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:04:41 (7812): No heartbeat from core client for 30 sec - exiting 18:04:42 (7812): No heartbeat from core client for 30 sec - exiting 18:47:35 (4308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:16 (1516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7520, selfPID=7520, iMonCtr=2 20:20:15 (3308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:37 (6624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:10:30 (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:10:31 (4224): No heartbeat from core client for 30 sec - exiting 03:10:32 (4224): No heartbeat from core client for 30 sec - exiting 03:10:33 (4224): No heartbeat from core client for 30 sec - exiting 03:21:18 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1568, selfPID=1568, iMonCtr=2 03:21:19 (7040): No heartbeat from core client for 30 sec - exiting 03:21:20 (7040): No heartbeat from core client for 30 sec - exiting 03:21:21 (7040): No heartbeat from core client for 30 sec - exiting 03:21:22 (7040): No heartbeat from core client for 30 sec - exiting 03:21:23 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7164, selfPID=6472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1912, selfPID=5624, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5136, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5860, selfPID=5520, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2056, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4648, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5352, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2492, selfPID=4548, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4440, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Suspended CPDN Monitor - Suspend request from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=204, selfPID=4584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5336, selfPID=4596, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1724, selfPID=4640, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5136, selfPID=5144, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5208, selfPID=4660, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1100, selfPID=4352, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6032, selfPID=4492, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3508, selfPID=4884, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4660, selfPID=5252, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6028, selfPID=4744, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=184, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3604, selfPID=3600, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 CPDN Monitor - Quit request from BOINC... 01:41:38 (4756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... GlController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4632, selfPID=3784, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5900, iMonCtr=2 Model crash detected, will try to restart... 11:00:04 (5424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Aug 2012 23:42:24	1206098	14449039	hadam3p_pnw_bie4_1995_1_007910139_0	138,336	2,280,391	16.4844
07 Aug 2012 01:23:22	1206098	14449039	hadam3p_pnw_bie4_1995_1_007910139_0	126,816	2,096,244	16.5298
02 Aug 2012 05:21:18	1206098	14449039	hadam3p_pnw_bie4_1995_1_007910139_0	115,296	1,906,778	16.5381
29 Jul 2012 06:44:01	1206098	14449039	hadam3p_pnw_bie4_1995_1_007910139_0	103,776	1,721,942	16.5929
25 Jul 2012 13:28:12	1206098	14449039	hadam3p_pnw_bie4_1995_1_007910139_0	92,256	1,529,111	16.5747
21 Jul 2012 09:51:30	1206098	14449039	hadam3p_pnw_bie4_1995_1_007910139_0	80,736	1,336,420	16.5530
18 Jul 2012 05:18:26	1206098	14449039	hadam3p_pnw_bie4_1995_1_007910139_0	69,216	1,140,662	16.4797
15 Jun 2012 05:10:19	1206098	14449039	hadam3p_pnw_bie4_1995_1_007910139_0	57,696	947,351	16.4197
10 Jun 2012 20:10:23	1206098	14449039	hadam3p_pnw_bie4_1995_1_007910139_0	46,176	754,927	16.3489
28 May 2012 01:38:14	1206098	14449039	hadam3p_pnw_bie4_1995_1_007910139_0	34,656	563,622	16.2633
21 May 2012 09:39:49	1206098	14449039	hadam3p_pnw_bie4_1995_1_007910139_0	23,136	375,387	16.2252
16 May 2012 15:45:54	1206098	14449039	hadam3p_pnw_bie4_1995_1_007910139_0	11,616	192,583	16.5791