Task 14700220

Name	hadam3p_eu_cj90_2009_1_007983093_0
Workunit	8138207
Created	17 May 2012, 9:22:02 UTC
Sent	27 May 2012, 3:14:53 UTC
Report deadline	9 May 2013, 8:34:53 UTC
Received	7 Aug 2012, 5:13:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1030577
Run time	2 days 13 hours 15 min 9 sec
CPU time	2 days 5 hours 51 min 17 sec
Validate state	Invalid
Credit	1,392.75
Device peak FLOPS	2.63 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8136, selfPID=8136, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5740, selfPID=5740, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2080, selfPID=2080, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:13:36 (2800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:33 (1396): No heartbeat from core client for 30 sec - exiting 20:57:34 (1396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:02:57 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4628, selfPID=4628, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7532, selfPID=7532, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=752, selfPID=752, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2816, selfPID=2816, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5664, selfPID=5664, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:55:21 (4328): No heartbeat from core client for 30 sec - exiting 14:55:22 (4328): No heartbeat from core client for 30 sec - exiting 14:55:23 (4328): No heartbeat from core client for 30 sec - exiting 14:55:24 (4328): No heartbeat from core client for 30 sec - exiting 14:55:25 (4328): No heartbeat from core client for 30 sec - exiting 14:55:26 (4328): No heartbeat from core client for 30 sec - exiting 14:55:27 (4328): No heartbeat from core client for 30 sec - exiting 14:55:28 (4328): No heartbeat from core client for 30 sec - exiting 14:55:29 (4328): No heartbeat from core client for 30 sec - exiting 14:55:30 (4328): No heartbeat from core client for 30 sec - exiting 14:55:31 (4328): No heartbeat from core client for 30 sec - exiting 14:55:32 (4328): No heartbeat from core client for 30 sec - exiting 14:55:33 (4328): No heartbeat from core client for 30 sec - exiting 14:55:34 (4328): No heartbeat from core client for 30 sec - exiting 14:55:35 (4328): No heartbeat from core client for 30 sec - exiting 14:55:36 (4328): No heartbeat from core client for 30 sec - exiting 14:55:37 (4328): No heartbeat from core client for 30 sec - exiting 14:55:38 (4328): No heartbeat from core client for 30 sec - exiting 14:55:39 (4328): No heartbeat from core client for 30 sec - exiting 14:55:40 (4328): No heartbeat from core client for 30 sec - exiting 14:55:41 (4328): No heartbeat from core client for 30 sec - exiting 14:55:42 (4328): No heartbeat from core client for 30 sec - exiting 14:55:43 (4328): No heartbeat from core client for 30 sec - exiting 14:55:44 (4328): No heartbeat from core client for 30 sec - exiting 14:55:45 (4328): No heartbeat from core client for 30 sec - exiting 14:55:46 (4328): No heartbeat from core client for 30 sec - exiting 14:55:47 (4328): No heartbeat from core client for 30 sec - exiting 14:55:48 (4328): No heartbeat from core client for 30 sec - exiting 14:55:49 (4328): No heartbeat from core client for 30 sec - exiting 14:55:50 (4328): No heartbeat from core client for 30 sec - exiting 14:55:51 (4328): No heartbeat from core client for 30 sec - exiting 14:55:52 (4328): No heartbeat from core client for 30 sec - exiting 14:55:53 (4328): No heartbeat from core client for 30 sec - exiting 14:55:54 (4328): No heartbeat from core client for 30 sec - exiting 14:55:55 (4328): No heartbeat from core client for 30 sec - exiting 14:55:56 (4328): No heartbeat from core client for 30 sec - exiting 14:55:57 (4328): No heartbeat from core client for 30 sec - exiting 14:55:58 (4328): No heartbeat from core client for 30 sec - exiting 14:55:59 (4328): No heartbeat from core client for 30 sec - exiting 14:56:00 (4328): No heartbeat from core client for 30 sec - exiting 14:56:01 (4328): No heartbeat from core client for 30 sec - exiting 14:56:02 (4328): No heartbeat from core client for 30 sec - exiting 14:56:03 (4328): No heartbeat from core client for 30 sec - exiting 14:56:04 (4328): No heartbeat from core client for 30 sec - exiting 14:56:05 (4328): No heartbeat from core client for 30 sec - exiting 14:56:06 (4328): No heartbeat from core client for 30 sec - exiting 14:56:07 (4328): No heartbeat from core client for 30 sec - exiting 14:56:08 (4328): No heartbeat from core client for 30 sec - exiting 14:56:09 (4328): No heartbeat from core client for 30 sec - exiting 14:56:10 (4328): No heartbeat from core client for 30 sec - exiting 14:56:11 (4328): No heartbeat from core client for 30 sec - exiting 14:56:12 (4328): No heartbeat from core client for 30 sec - exiting 14:56:13 (4328): No heartbeat from core client for 30 sec - exiting 14:57:29 (4328): No heartbeat from core client for 30 sec - exiting 14:57:30 (4328): No heartbeat from core client for 30 sec - exiting 14:57:31 (4328): No heartbeat from core client for 30 sec - exiting 14:57:32 (4328): No heartbeat from core client for 30 sec - exiting 14:57:33 (4328): No heartbeat from core client for 30 sec - exiting 14:57:34 (4328): No heartbeat from core client for 30 sec - exiting 14:57:35 (4328): No heartbeat from core client for 30 sec - exiting 14:57:36 (4328): No heartbeat from core client for 30 sec - exiting 14:57:37 (4328): No heartbeat from core client for 30 sec - exiting 14:57:38 (4328): No heartbeat from core client for 30 sec - exiting 14:57:39 (4328): No heartbeat from core client for 30 sec - exiting 14:57:40 (4328): No heartbeat from core client for 30 sec - exiting 14:57:41 (4328): No heartbeat from core client for 30 sec - exiting 14:57:42 (4328): No heartbeat from core client for 30 sec - exiting 14:57:43 (4328): No heartbeat from core client for 30 sec - exiting 14:57:44 (4328): No heartbeat from core client for 30 sec - exiting 14:57:45 (4328): No heartbeat from core client for 30 sec - exiting 14:57:46 (4328): No heartbeat from core client for 30 sec - exiting 14:57:47 (4328): No heartbeat from core client for 30 sec - exiting 14:57:48 (4328): No heartbeat from core client for 30 sec - exiting 14:57:49 (4328): No heartbeat from core client for 30 sec - exiting 14:57:50 (4328): No heartbeat from core client for 30 sec - exiting 14:57:51 (4328): No heartbeat from core client for 30 sec - exiting 14:57:52 (4328): No heartbeat from core client for 30 sec - exiting 14:57:53 (4328): No heartbeat from core client for 30 sec - exiting 14:57:54 (4328): No heartbeat from core client for 30 sec - exiting 14:57:55 (4328): No heartbeat from core client for 30 sec - exiting 14:57:56 (4328): No heartbeat from core client for 30 sec - exiting 14:57:57 (4328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1304, selfPID=1304, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6008, selfPID=6008, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN processCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2252, selfPID=2252, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5996, selfPID=5996, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3812, selfPID=3812, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6960, selfPID=6960, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3216, selfPID=3216, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:33:52 (8156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6584, selfPID=6584, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5276, selfPID=5276, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8360, selfPID=8360, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6224, selfPID=6224, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1516, selfPID=1516, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6108, selfPID=6108, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7780, selfPID=7780, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6380, selfPID=6380, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:14:01 (6976): No heartbeat from core client for 30 sec - exiting 12:14:02 (6976): No heartbeat from core client for 30 sec - exiting 12:14:03 (6976): No heartbeat from core client for 30 sec - exiting 12:14:04 (6976): No heartbeat from core client for 30 sec - exiting 12:14:05 (6976): No heartbeat from core client for 30 sec - exiting 12:14:06 (6976): No heartbeat from core client for 30 sec - exiting 12:14:07 (6976): No heartbeat from core client for 30 sec - exiting 12:14:08 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:14:09 (6976): No heartbeat from core client for 30 sec - exiting 12:14:53 (7668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1896, selfPID=1896, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8356, selfPID=8356, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4424, selfPID=4424, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9628, selfPID=9628, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7180, selfPID=7180, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11792, selfPID=11792, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13128, selfPID=14000, iMonCtr=1 Model crash detected, will try to restart... 13:29:44 (4524): No heartbeat from core client for 30 sec - exiting 13:29:45 (4524): No heartbeat from core client for 30 sec - exiting 13:29:46 (4524): No heartbeat from core client for 30 sec - exiting 13:29:47 (4524): No heartbeat from core client for 30 sec - exiting 13:29:48 (4524): No heartbeat from core client for 30 sec - exiting 13:29:49 (4524): No heartbeat from core client for 30 sec - exiting 13:29:50 (4524): No heartbeat from core client for 30 sec - exiting 13:29:51 (4524): No heartbeat from core client for 30 sec - exiting 13:29:52 (4524): No heartbeat from core client for 30 sec - exiting 13:29:53 (4524): No heartbeat from core client for 30 sec - exiting 13:29:54 (4524): No heartbeat from core client for 30 sec - exiting 13:29:55 (4524): No heartbeat from core client for 30 sec - exiting 13:29:56 (4524): No heartbeat from core client for 30 sec - exiting 13:29:57 (4524): No heartbeat from core client for 30 sec - exiting 13:29:58 (4524): No heartbeat from core client for 30 sec - exiting 13:29:59 (4524): No heartbeat from core client for 30 sec - exiting 13:30:00 (4524): No heartbeat from core client for 30 sec - exiting 13:30:01 (4524): No heartbeat from core client for 30 sec - exiting 13:30:02 (4524): No heartbeat from core client for 30 sec - exiting 13:30:03 (4524): No heartbeat from core client for 30 sec - exiting 13:30:04 (4524): No heartbeat from core client for 30 sec - exiting 13:30:05 (4524): No heartbeat from core client for 30 sec - exiting 13:30:06 (4524): No heartbeat from core client for 30 sec - exiting 13:30:07 (4524): No heartbeat from core client for 30 sec - exiting 13:30:08 (4524): No heartbeat from core client for 30 sec - exiting 13:30:09 (4524): No heartbeat from core client for 30 sec - exiting 13:30:10 (4524): No heartbeat from core client for 30 sec - exiting 13:30:11 (4524): No heartbeat from core client for 30 sec - exiting 13:30:12 (4524): No heartbeat from core client for 30 sec - exiting 13:30:13 (4524): No heartbeat from core client for 30 sec - exiting 13:30:14 (4524): No heartbeat from core client for 30 sec - exiting 13:30:15 (4524): No heartbeat from core client for 30 sec - exiting 13:30:16 (4524): No heartbeat from core client for 30 sec - exiting 13:30:17 (4524): No heartbeat from core client for 30 sec - exiting 13:30:18 (4524): No heartbeat from core client for 30 sec - exiting 13:30:19 (4524): No heartbeat from core client for 30 sec - exiting 13:30:20 (4524): No heartbeat from core client for 30 sec - exiting 13:30:21 (4524): No heartbeat from core client for 30 sec - exiting 13:30:22 (4524): No heartbeat from core client for 30 sec - exiting 13:30:23 (4524): No heartbeat from core client for 30 sec - exiting 13:30:24 (4524): No heartbeat from core client for 30 sec - exiting 13:30:25 (4524): No heartbeat from core client for 30 sec - exiting 13:30:26 (4524): No heartbeat from core client for 30 sec - exiting 13:30:27 (4524): No heartbeat from core client for 30 sec - exiting 13:30:28 (4524): No heartbeat from core client for 30 sec - exiting 13:30:29 (4524): No heartbeat from core client for 30 sec - exiting 13:30:30 (4524): No heartbeat from core client for 30 sec - exiting 13:31:22 (4524): No heartbeat from core client for 30 sec - exiting 13:31:23 (4524): No heartbeat from core client for 30 sec - exiting 13:31:24 (4524): No heartbeat from core client for 30 sec - exiting 13:31:25 (4524): No heartbeat from core client for 30 sec - exiting 13:31:26 (4524): No heartbeat from core client for 30 sec - exiting 13:31:27 (4524): No heartbeat from core client for 30 sec - exiting 13:31:28 (4524): No heartbeat from core client for 30 sec - exiting 13:31:29 (4524): No heartbeat from core client for 30 sec - exiting 13:31:30 (4524): No heartbeat from core client for 30 sec - exiting 13:31:31 (4524): No heartbeat from core client for 30 sec - exiting 13:31:32 (4524): No heartbeat from core client for 30 sec - exiting 13:31:33 (4524): No heartbeat from core client for 30 sec - exiting 13:31:34 (4524): No heartbeat from core client for 30 sec - exiting 13:31:35 (4524): No heartbeat from core client for 30 sec - exiting 13:31:36 (4524): No heartbeat from core client for 30 sec - exiting 13:31:37 (4524): No heartbeat from core client for 30 sec - exiting 13:31:38 (4524): No heartbeat from core client for 30 sec - exiting 13:31:39 (4524): No heartbeat from core client for 30 sec - exiting 13:31:40 (4524): No heartbeat from core client for 30 sec - exiting 13:31:41 (4524): No heartbeat from core client for 30 sec - exiting 13:31:42 (4524): No heartbeat from core client for 30 sec - exiting 13:31:43 (4524): No heartbeat from core client for 30 sec - exiting 13:31:44 (4524): No heartbeat from core client for 30 sec - exiting 13:31:45 (4524): No heartbeat from core client for 30 sec - exiting 13:31:46 (4524): No heartbeat from core client for 30 sec - exiting 13:31:47 (4524): No heartbeat from core client for 30 sec - exiting 13:31:48 (4524): No heartbeat from core client for 30 sec - exiting 13:31:49 (4524): No heartbeat from core client for 30 sec - exiting 13:31:50 (4524): No heartbeat from core client for 30 sec - exiting 13:31:51 (4524): No heartbeat from core client for 30 sec - exiting 13:31:52 (4524): No heartbeat from core client for 30 sec - exiting 13:31:53 (4524): No heartbeat from core client for 30 sec - exiting 13:31:54 (4524): No heartbeat from core client for 30 sec - exiting 13:31:55 (4524): No heartbeat from core client for 30 sec - exiting 13:31:56 (4524): No heartbeat from core client for 30 sec - exiting 13:31:57 (4524): No heartbeat from core client for 30 sec - exiting 13:31:58 (4524): No heartbeat from core client for 30 sec - exiting 13:31:59 (4524): No heartbeat from core client for 30 sec - exiting 13:32:00 (4524): No heartbeat from core client for 30 sec - exiting 13:32:01 (4524): No heartbeat from core client for 30 sec - exiting 13:32:02 (4524): No heartbeat from core client for 30 sec - exiting 13:32:03 (4524): No heartbeat from core client for 30 sec - exiting 13:32:04 (4524): No heartbeat from core client for 30 sec - exiting 13:32:05 (4524): No heartbeat from core client for 30 sec - exiting 13:32:06 (4524): No heartbeat from core client for 30 sec - exiting 13:32:07 (4524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:32:08 (4524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 14:55:03 (5528): No heartbeat from core client for 30 sec - exiting 14:55:04 (5528): No heartbeat from core client for 30 sec - exiting 14:55:05 (5528): No heartbeat from core client for 30 sec - exiting 14:55:06 (5528): No heartbeat from core client for 30 sec - exiting 14:55:07 (5528): No heartbeat from core client for 30 sec - exiting 14:55:08 (5528): No heartbeat from core client for 30 sec - exiting 14:55:09 (5528): No heartbeat from core client for 30 sec - exiting 14:55:10 (5528): No heartbeat from core client for 30 sec - exiting 14:55:11 (5528): No heartbeat from core client for 30 sec - exiting 14:55:12 (5528): No heartbeat from core client for 30 sec - exiting 14:55:13 (5528): No heartbeat from core client for 30 sec - exiting 14:55:14 (5528): No heartbeat from core client for 30 sec - exiting 14:55:15 (5528): No heartbeat from core client for 30 sec - exiting 14:55:16 (5528): No heartbeat from core client for 30 sec - exiting 14:55:17 (5528): No heartbeat from core client for 30 sec - exiting 14:55:18 (5528): No heartbeat from core client for 30 sec - exiting 14:55:19 (5528): No heartbeat from core client for 30 sec - exiting 14:55:20 (5528): No heartbeat from core client for 30 sec - exiting 14:55:21 (5528): No heartbeat from core client for 30 sec - exiting 14:55:22 (5528): No heartbeat from core client for 30 sec - exiting 14:55:23 (5528): No heartbeat from core client for 30 sec - exiting 14:55:24 (5528): No heartbeat from core client for 30 sec - exiting 14:55:25 (5528): No heartbeat from core client for 30 sec - exiting 14:55:26 (5528): No heartbeat from core client for 30 sec - exiting 14:55:27 (5528): No heartbeat from core client for 30 sec - exiting 14:55:28 (5528): No heartbeat from core client for 30 sec - exiting 14:55:29 (5528): No heartbeat from core client for 30 sec - exiting 14:55:30 (5528): No heartbeat from core client for 30 sec - exiting 14:55:31 (5528): No heartbeat from core client for 30 sec - exiting 14:55:32 (5528): No heartbeat from core client for 30 sec - exiting 14:55:33 (5528): No heartbeat from core client for 30 sec - exiting 14:55:34 (5528): No heartbeat from core client for 30 sec - exiting 14:55:35 (5528): No heartbeat from core client for 30 sec - exiting 14:55:36 (5528): No heartbeat from core client for 30 sec - exiting 14:55:37 (5528): No heartbeat from core client for 30 sec - exiting 14:55:38 (5528): No heartbeat from core client for 30 sec - exiting 14:55:39 (5528): No heartbeat from core client for 30 sec - exiting 14:55:40 (5528): No heartbeat from core client for 30 sec - exiting 14:55:41 (5528): No heartbeat from core client for 30 sec - exiting 14:55:42 (5528): No heartbeat from core client for 30 sec - exiting 14:55:43 (5528): No heartbeat from core client for 30 sec - exiting 14:55:44 (5528): No heartbeat from core client for 30 sec - exiting 14:55:45 (5528): No heartbeat from core client for 30 sec - exiting 14:55:46 (5528): No heartbeat from core client for 30 sec - exiting 14:55:47 (5528): No heartbeat from core client for 30 sec - exiting 14:55:48 (5528): No heartbeat from core client for 30 sec - exiting 14:55:49 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:11:18 (4736): No heartbeat from core client for 30 sec - exiting 15:11:19 (4736): No heartbeat from core client for 30 sec - exiting 15:11:20 (4736): No heartbeat from core client for 30 sec - exiting 15:11:21 (4736): No heartbeat from core client for 30 sec - exiting 15:11:22 (4736): No heartbeat from core client for 30 sec - exiting 15:11:23 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:38 (4856): No heartbeat from core client for 30 sec - exiting 15:55:40 (4856): No heartbeat from core client for 30 sec - exiting 15:55:41 (4856): No heartbeat from core client for 30 sec - exiting 15:55:42 (4856): No heartbeat from core client for 30 sec - exiting 15:55:43 (4856): No heartbeat from core client for 30 sec - exiting 15:55:44 (4856): No heartbeat from core client for 30 sec - exiting 15:55:45 (4856): No heartbeat from core client for 30 sec - exiting 15:55:46 (4856): No heartbeat from core client for 30 sec - exiting 15:55:47 (4856): No heartbeat from core client for 30 sec - exiting 15:55:48 (4856): No heartbeat from core client for 30 sec - exiting 15:55:49 (4856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_cj90_2009_1_007983093_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cj90_2009_1_007983093_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cj90_2009_1_007983093_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cj90_2009_1_007983093_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cj90_2009_1_007983093_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Jul 2012 13:05:07	1030577	14700220	hadam3p_eu_cj90_2009_1_007983093_0	80,736	182,646	2.2623
23 Jul 2012 16:50:55	1030577	14700220	hadam3p_eu_cj90_2009_1_007983093_0	69,216	154,543	2.2328
20 Jul 2012 10:17:20	1030577	14700220	hadam3p_eu_cj90_2009_1_007983093_0	57,696	129,133	2.2382
04 Jul 2012 09:11:54	1030577	14700220	hadam3p_eu_cj90_2009_1_007983093_0	46,180	102,421	2.2179
02 Jul 2012 11:45:15	1030577	14700220	hadam3p_eu_cj90_2009_1_007983093_0	46,176	102,095	2.2110
16 Jun 2012 05:21:34	1030577	14700220	hadam3p_eu_cj90_2009_1_007983093_0	34,656	77,280	2.2299
10 Jun 2012 05:03:56	1030577	14700220	hadam3p_eu_cj90_2009_1_007983093_0	23,136	51,104	2.2089
03 Jun 2012 16:30:09	1030577	14700220	hadam3p_eu_cj90_2009_1_007983093_0	11,616	25,555	2.2000