Task 15724182

Name	hadcm3n_o0q5_2140_40_008269539_3
Workunit	8424663
Created	14 Apr 2013, 7:43:57 UTC
Sent	14 Apr 2013, 7:44:37 UTC
Report deadline	14 Jul 2013, 15:11:48 UTC
Received	27 Apr 2013, 10:34:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1159304
Run time	11 days 3 hours 39 min 24 sec
CPU time	9 days 23 hours 53 min 59 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.26 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> ing, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 04:23:08 (7528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:01:08 (5176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:01:15 (5176): No heartbeat from core client for 30 sec - exiting 05:01:17 (5176): No heartbeat from core client for 30 sec - exiting 05:01:18 (5176): No heartbeat from core client for 30 sec - exiting 05:01:19 (5176): No heartbeat from core client for 30 sec - exiting 05:01:20 (5176): No heartbeat from core client for 30 sec - exiting 05:01:21 (5176): No heartbeat from core client for 30 sec - exiting 05:01:22 (5176): No heartbeat from core client for 30 sec - exiting 05:01:23 (5176): No heartbeat from core client for 30 sec - exiting 05:01:24 (5176): No heartbeat from core client for 30 sec - exiting 05:01:25 (5176): No heartbeat from core client for 30 sec - exiting 05:01:26 (5176): No heartbeat from core client for 30 sec - exiting 05:01:27 (5176): No heartbeat from core client for 30 sec - exiting 05:38:14 (7048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:20 (7048): No heartbeat from core client for 30 sec - exiting 05:38:21 (7048): No heartbeat from core client for 30 sec - exiting 05:38:22 (7048): No heartbeat from core client for 30 sec - exiting 05:38:23 (7048): No heartbeat from core client for 30 sec - exiting 05:38:24 (7048): No heartbeat from core client for 30 sec - exiting 05:38:25 (7048): No heartbeat from core client for 30 sec - exiting 05:38:26 (7048): No heartbeat from core client for 30 sec - exiting 05:38:28 (7048): No heartbeat from core client for 30 sec - exiting 05:38:29 (7048): No heartbeat from core client for 30 sec - exiting 05:38:30 (7048): No heartbeat from core client for 30 sec - exiting 05:38:31 (7048): No heartbeat from core client for 30 sec - exiting 05:38:32 (7048): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 05:53:24 (4988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:53:28 (4988): No heartbeat from core client for 30 sec - exiting 05:53:30 (4988): No heartbeat from core client for 30 sec - exiting 05:53:31 (4988): No heartbeat from core client for 30 sec - exiting 05:56:10 (10008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:07:58 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:08:17 (5192): No heartbeat from core client for 30 sec - exiting 06:08:18 (5192): No heartbeat from core client for 30 sec - exiting 06:08:19 (5192): No heartbeat from core client for 30 sec - exiting 06:08:20 (5192): No heartbeat from core client for 30 sec - exiting 06:08:21 (5192): No heartbeat from core client for 30 sec - exiting 06:08:23 (5192):06:22:17 (6760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:22:36 (6760): No heartbeat from core client for 30 sec - exiting 06:22:37 (6760): No heartbeat from core client for 30 sec - exiting 06:22:38 (6760): No heartbeat from core client for 30 sec - exiting 06:22:39 (6760): No heartbeat from core client for 30 sec - exiting 06:22:40 (6760): No heartbeat from core client for 30 sec - exiting 06:22:41 (6760): No heartbeat from core client for 30 sec - exiting 06:22:42 (6760): No heartbeat from core client for 30 sec - exiting 06:22:44 (6760): No heartbeat from core client for 30 sec - exiting 06:22:45 (6760): No heartbeat from core client for 30 sec - exiting 06:22:46 (6760): No heartbeat from core client for 30 sec - exiting 06:22:47 (6760): No heartbeat from core client for 30 sec - exiting 06:25:09 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:10 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:14 (3096): No heartbeat from core client for 30 sec - exiting 06:52:35 (8240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:52:39 (8240): No heartbeat from core client for 30 sec - exiting 06:52:40 (8240): No heartbeat from core client for 30 sec - exiting 06:52:41 (8240): No heartbeat from core client for 30 sec - exiting 06:52:42 (8240): No heartbeat from core client for 30 sec - exiting 06:52:44 (8240): No heartbeat from core client for 30 sec - exiting 06:52:46 (8240): No heartbeat from core client for 30 sec - exiting 06:54:36 (3360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:54:37 (3360): No heartbeat from core client for 30 sec - exiting 06:54:38 (3360): No heartbeat from core client for 30 sec - exiting 06:54:39 (3360): No heartbeat from core client for 30 sec - exiting 06:54:40 (3360): No heartbeat from core client for 30 sec - exiting 06:54:41 (3360): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 07:27:29 (6968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:27:45 (6968): No heartbeat from core client for 30 sec - exiting 07:27:46 (6968): No heartbeat from core client for 30 sec - exiting 07:27:48 (6968): No heartbeat from core client for 30 sec - exiting 07:27:49 (6968): No heartbeat from core client for 30 sec - exiting 07:27:50 (6968): No heartbeat from core client for 30 sec - exiting 07:27:52 (6968): No heartbeat from core client for 30 sec - exiting 07:27:53 (6968): No heartbeat from core client for 30 sec - exiting 07:27:54 (6968): No heartbeat from core client for 30 sec - exiting 07:27:55 (6968): No heartbeat from core client for 30 sec - exiting 07:27:56 (6968): No heartbeat from core client for 30 sec - exiting 07:27:57 (6968): No heartbeat from core client for 30 sec - exiting 07:27:58 (6968): No heartbeat from core client for 30 sec - exiting 07:27:59 (6968): No heartbeat from core client for 30 sec - exiting 07:28:00 (6968): No heartbeat from core client for 30 sec - exiting 07:28:02 (6968): No heartbeat from core client for 30 sec - exiting 07:28:03 (6968): No heartbeat from core client for 30 sec - exiting 07:28:04 (6968): No heartbeat from core client for 30 sec - exiting 07:28:05 (6968): No heartbeat from core client for 30 sec - exiting 07:28:06 (6968): No heartbeat from core client for 30 sec - exiting 07:43:20 (10548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:53 (9480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:54 (9480): No heartbeat from core client for 30 sec - exiting 07:46:55 (9480): No heartbeat from core client for 30 sec - exiting 07:46:57 (9480): No heartbeat from core client for 30 sec - exiting 07:58:25 (2000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:58:40 (2000): No heartbeat from core client for 30 sec - exiting 07:58:41 (2000): No heartbeat from core client for 30 sec - exiting 07:58:42 (2000): No heartbeat from core client for 30 sec - exiting 07:58:43 (2000): No heartbeat from core client for 30 sec - exiting 07:58:45 (2000): No heartbeat from core client for 30 sec - exiting 08:35:45 (9316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:53 (9316): No heartbeat from core client for 30 sec - exiting 08:35:55 (9316): No heartbeat from core client for 30 sec - exiting 08:35:56 (9316): No heartbeat from core client for 30 sec - exiting 08:35:57 (9316): No heartbeat from core client for 30 sec - exiting 08:35:58 (9316): No heartbeat from core client for 30 sec - exiting 08:35:59 (9316): No heartbeat from core client for 30 sec - exiting 08:36:00 (9316): No heartbeat from core client for 30 sec - exiting 08:36:01 (9316): No heartbeat from core client for 30 sec - exiting 08:36:02 (9316): No heartbeat from core client for 30 sec - exiting 08:36:03 (9316): No heartbeat from core client for 30 sec - exiting 08:36:04 (9316): No heartbeat from core client for 30 sec - exiting 08:36:06 (9316): No heartbeat from core client for 30 sec - exiting 08:36:07 (9316): No heartbeat from core client for 30 sec - exiting 08:36:08 (9316): No heartbeat from core client for 30 sec - exiting 08:37:48 (8544): No heartbeat from core client for 30 sec - exiting 08:37:49 (8544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:05 (7228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:12 (7228): No heartbeat from core client for 30 sec - exiting 09:11:13 (7228): No heartbeat from core client for 30 sec - exiting 09:11:15 (7228): No heartbeat from core client for 30 sec - exiting 09:11:16 (7228): No heartbeat from core client for 30 sec - exiting 09:11:17 (7228): No heartbeat from core client for 30 sec - exiting 09:11:18 (7228): No heartbeat from core client for 30 sec - exiting 09:11:19 (7228): No heartbeat from core client for 30 sec - exiting 09:11:20 (7228): No heartbeat from core client for 30 sec - exiting 09:11:21 (7228): No heartbeat from core client for 30 sec - exiting 09:11:22 (7228): No heartbeat from core client for 30 sec - exiting 09:11:23 (7228): No heartbeat from core client for 30 sec - exiting 09:11:24 (7228): No heartbeat from core client for 30 sec - exiting 09:48:39 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:48:44 (4592): No heartbeat from core client for 30 sec - exiting 09:48:45 (4592): No heartbeat from core client for 30 sec - exiting 09:48:46 (4592): No heartbeat from core client for 30 sec - exiting 09:48:47 (4592): No heartbeat from core client for 30 sec - exiting 09:48:48 (4592): No heartbeat from core client for 30 sec - exiting 09:48:49 (4592): No heartbeat from core client for 30 sec - exiting 09:48:50 (4592): No heartbeat from core client for 30 sec - exiting 09:50:06 (3360): No heartbeat from core client for 30 sec - exiting 09:50:07 (3360): No heartbeat from core client for 30 sec - exiting 09:50:08 (3360): No heartbeat from core client for 30 sec - exiting 09:50:09 (3360): No heartbeat from core client for 30 sec - exiting 09:50:10 (3360): No heartbeat from core client for 30 sec - exiting 09:50:11 (3360): No heartbeat from core client for 30 sec - exiting 09:50:12 (3360): No heartbeat from core client for 30 sec - exiting 09:50:13 (3360): No heartbeat from core client for 30 sec - exiting 09:50:15 (3360): No heartbeat from core client for 30 sec - exiting 09:50:16 (3360): No heartbeat from core client for 30 sec - exiting 09:50:17 (3360): No heartbeat from core client for 30 sec - exiting 09:50:18 (3360): No heartbeat from core client for 30 sec - exiting 09:50:19 (3360): No heartbeat from core client for 30 sec - exiting 09:50:20 (3360): No heartbeat from core client for 30 sec - exiting 09:50:21 (3360): No heartbeat from core client for 30 sec - exiting 09:50:22 (3360): No heartbeat from core client for 30 sec - exiting 09:50:23 (3360): No heartbeat from core client for 30 sec - exiting 09:50:24 (3360): No heartbeat from core client for 30 sec - exiting 09:50:25 (3360): No heartbeat from core client for 30 sec - exiting 09:50:27 (3360): No heartbeat from core client for 30 sec - exiting 09:50:28 (3360): No heartbeat from core client for 30 sec - exiting 09:50:29 (3360): No heartbeat from core client for 30 sec - exiting 09:50:30 (3360): No heartbeat from core client for 30 sec - exiting 09:50:31 (3360): No heartbeat from core client for 30 sec - exiting 09:50:32 (3360): No heartbeat from core client for 30 sec - exiting 09:50:33 (3360): No heartbeat from core client for 30 sec - exiting 09:50:34 (3360): No heartbeat from core client for 30 sec - exiting 09:50:35 (3360): No heartbeat from core client for 30 sec - exiting 09:50:36 (3360): No heartbeat from core client for 30 sec - exiting 09:50:37 (3360): No heartbeat from core client for 30 sec - exiting 09:50:39 (3360): No heartbeat from core client for 30 sec - exiting 09:50:40 (3360): No heartbeat from core client for 30 sec - exiting 09:50:41 (3360): No heartbeat from core client for 30 sec - exiting 09:50:42 (3360): No heartbeat from core client for 30 sec - exiting 09:50:43 (3360): No heartbeat from core client for 30 sec - exiting 09:50:44 (3360): No heartbeat from core client for 30 sec - exiting 09:50:45 (3360): No heartbeat from core client for 30 sec - exiting 09:50:46 (3360): No heartbeat from core client for 30 sec - exiting 09:50:47 (3360): No heartbeat from core client for 30 sec - exiting 09:50:48 (3360): No heartbeat from core client for 30 sec - exiting 09:50:49 (3360): No heartbeat from core client for 30 sec - exiting 09:50:51 (3360): No heartbeat from core client for 30 sec - exiting 09:50:52 (3360): No heartbeat from core client for 30 sec - exiting 09:50:53 (3360): No heartbeat from core client for 30 sec - exiting 09:50:54 (3360): No heartbeat from core client for 30 sec - exiting 09:50:55 (3360): No heartbeat from core client for 30 sec - exiting 09:50:56 (3360): No heartbeat from core client for 30 sec - exiting 09:50:57 (3360): No heartbeat from core client for 30 sec - exiting 09:50:58 (3360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:50:59 (3360): No heartbeat from core client for 30 sec - exiting 10:03:40 (7752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:44 (7752): No heartbeat from core client for 30 sec - exiting 10:03:45 (7752): No heartbeat from core client for 30 sec - exiting 10:03:46 (7752): No heartbeat from core client for 30 sec - exiting 10:03:47 (7752): No heartbeat from core client for 30 sec - exiting 10:03:48 (7752): No heartbeat from core client for 30 sec - exiting 10:03:49 (7752): No heartbeat from core client for 30 sec - exiting 10:03:50 (7752): No heartbeat from core client for 30 sec - exiting 10:05:02 (10156): No heartbeat from core client for 30 sec - exiting 10:05:03 (10156): No heartbeat from core client for 30 sec - exiting 10:05:04 (10156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:38:44 (7176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:38:51 (7176): No heartbeat from core client for 30 sec - exiting 10:38:52 (7176): No heartbeat from core client for 30 sec - exiting 10:38:53 (7176): No heartbeat from core client for 30 sec - exiting 10:38:55 (7176): No heartbeat from core client for 30 sec - exiting 10:38:56 (7176): No heartbeat from core client for 30 sec - exiting 10:38:57 (7176): No heartbeat from core client for 30 sec - exiting 10:38:58 (7176): No heartbeat from core client for 30 sec - exiting 10:38:59 (7176): No heartbeat from core client for 30 sec - exiting 10:39:00 (7176): No heartbeat from core client for 30 sec - exiting 10:39:01 (7176): No heartbeat from core client for 30 sec - exiting 10:39:02 (7176): No heartbeat from core client for 30 sec - exiting 10:39:03 (7176): No heartbeat from core client for 30 sec - exiting 10:39:04 (7176): No heartbeat from core client for 30 sec - exiting 10:39:06 (7176): No heartbeat from core client for 30 sec - exiting 10:42:27 (9804): No heartbeat from core client for 30 sec - exiting 10:42:28 (9804): No heartbeat from core client for 30 sec - exiting 10:42:29 (9804): No heartbeat from core client for 30 sec - exiting 10:42:30 (9804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:53:56 (6288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:53:58 (6288): No heartbeat from core client for 30 sec - exiting 10:53:59 (6288): No heartbeat from core client for 30 sec - exiting 10:54:00 (6288): No heartbeat from core client for 30 sec - exiting 11:06:32 (1640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:06:51 (1640): No heartbeat from core client for 30 sec - exiting 11:06:53 (1640): No heartbeat from core client for 30 sec - exiting 11:06:55 (1640): No heartbeat from core client for 30 sec - exiting 11:21:16 (10900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:41 (7236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:44 (7236): No heartbeat from core client for 30 sec - exiting 12:04:45 (7236): No heartbeat from core client for 30 sec - exiting 12:04:46 (7236): No heartbeat from core client for 30 sec - exiting 12:04:47 (7236): No heartbeat from core client for 30 sec - exiting 12:04:48 (7236): No heartbeat from core client for 30 sec - exiting 12:04:49 (7236): No heartbeat from core client for 30 sec - exiting 12:16:24 (9900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:49 (10220): No heartbeat from core client for 30 sec - exiting 12:19:50 (10220): No heartbeat from core client for 30 sec - exiting 12:19:51 (10220): No heartbeat from core client for 30 sec - exiting 12:19:52 (10220): No heartbeat from core client for 30 sec - exiting 12:19:53 (10220): No heartbeat from core client for 30 sec - exiting 12:19:54 (10220): No heartbeat from core client for 30 sec - exiting 12:19:55 (10220): No heartbeat from core client for 30 sec - exiting 12:19:56 (10220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:30:35 (9404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:41 (5516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:53 (5516): No heartbeat from core client for 30 sec - exiting 12:44:55 (5516): No heartbeat from core client for 30 sec - exiting 12:44:56 (5516): No heartbeat from core client for 30 sec - exiting 12:44:57 (5516): No heartbeat from core client for 30 sec - exiting 12:44:58 (5516): No heartbeat from core client for 30 sec - exiting 12:44:59 (5516): No heartbeat from core client for 30 sec - exiting 12:45:00 (5516): No heartbeat from core client for 30 sec - exiting 12:45:01 (5516): No heartbeat from core client for 30 sec - exiting 12:45:03 (5516): No heartbeat from core client for 30 sec - exiting 13:14:55 (5388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:15:06 (5388): No heartbeat from core client for 30 sec - exiting 13:15:07 (5388): No heartbeat from core client for 30 sec - exiting 13:15:08 (5388): No heartbeat from core client for 30 sec - exiting 13:15:09 (5388): No heartbeat from core client for 30 sec - exiting 13:15:10 (5388): No heartbeat from core client for 30 sec - exiting 13:15:12 (5388): No heartbeat from core client for 30 sec - exiting 13:15:13 (5388): No heartbeat from core client for 30 sec - exiting 13:15:14 (5388): No heartbeat from core client for 30 sec - exiting 13:15:15 (5388): No heartbeat from core client for 30 sec - exiting 13:15:16 (5388): No heartbeat from core client for 30 sec - exiting 13:17:18 (3916): No heartbeat from core client for 30 sec - exiting 13:17:19 (3916): No heartbeat from core client for 30 sec - exiting 13:17:20 (3916): No heartbeat from core client for 30 sec - exiting 13:17:21 (3916): No heartbeat from core client for 30 sec - exiting 13:17:22 (3916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:45:10 (8624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:45:14 (8624): No heartbeat from core client for 30 sec - exiting 13:45:15 (8624): No heartbeat from core client for 30 sec - exiting 13:45:17 (8624): No heartbeat from core client for 30 sec - exiting 13:45:18 (8624): No heartbeat from core client for 30 sec - exiting 13:45:19 (8624): No heartbeat from core client for 30 sec - exiting 13:45:20 (8624): No heartbeat from core client for 30 sec - exiting 13:45:21 (8624): No heartbeat from core client for 30 sec - exiting 13:45:22 (8624): No heartbeat from core client for 30 sec - exiting 13:45:23 (8624): No heartbeat from core client for 30 sec - exiting 14:13:39 (2224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:46 (2224): No heartbeat from core client for 30 sec - exiting 14:13:47 (2224): No heartbeat from core client for 30 sec - exiting 14:13:49 (2224): No heartbeat from core client for 30 sec - exiting 14:13:50 (2224): No heartbeat from core client for 30 sec - exiting 14:13:51 (2224): No heartbeat from core client for 30 sec - exiting 14:13:52 (2224): No heartbeat from core client for 30 sec - exiting 14:13:53 (2224): No heartbeat from core client for 30 sec - exiting 14:13:54 (2224): No heartbeat from core client for 30 sec - exiting 14:15:48 (3720): No heartbeat from core client for 30 sec - exiting 14:15:49 (3720): No heartbeat from core client for 30 sec - exiting 14:15:51 (3720): No heartbeat from core client for 30 sec - exiting 14:15:52 (3720): No heartbeat from core client for 30 sec - exiting 14:15:53 (3720): No heartbeat from core client for 30 sec - exiting 14:15:54 (3720): No heartbeat from core client for 30 sec - exiting 14:15:55 (3720): No heartbeat from core client for 30 sec - exiting 14:15:56 (3720): No heartbeat from core client for 30 sec - exiting 14:15:57 (3720): No heartbeat from core client for 30 sec - exiting 14:15:58 (3720): No heartbeat from core client for 30 sec - exiting 14:15:59 (3720): No heartbeat from core client for 30 sec - exiting 14:16:00 (3720): No heartbeat from core client for 30 sec - exiting 14:16:01 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:42:58 (6332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:43:02 (6332): No heartbeat from core client for 30 sec - exiting 14:43:04 (6332): No heartbeat from core client for 30 sec - exiting 14:43:05 (6332): No heartbeat from core client for 30 sec - exiting 14:43:07 (6332): No heartbeat from core client for 30 sec - exiting 14:43:08 (6332): No heartbeat from core client for 30 sec - exiting 14:43:09 (6332): No heartbeat from core client for 30 sec - exiting 14:43:10 (6332): No heartbeat from core client for 30 sec - exiting 15:13:47 (9552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:13:57 (9552): No heartbeat from core client for 30 sec - exiting 15:13:59 (9552): No heartbeat from core client for 30 sec - exiting 15:14:00 (9552): No heartbeat from core client for 30 sec - exiting 15:14:01 (9552): No heartbeat from core client for 30 sec - exiting 15:14:02 (9552): No heartbeat from core client for 30 sec - exiting 15:14:04 (9552): No heartbeat from core client for 30 sec - exiting 15:14:05 (9552): No heartbeat from core client for 30 sec - exiting 15:14:06 (9552): No heartbeat from core client for 30 sec - exiting 15:14:07 (9552): No heartbeat from core client for 30 sec - exiting 15:14:08 (9552): No heartbeat from core client for 30 sec - exiting 15:14:09 (9552): No heartbeat from core client for 30 sec - exiting 15:14:10 (9552): No heartbeat from core client for 30 sec - exiting 15:14:11 (9552): No heartbeat from core client for 30 sec - exiting 15:43:41 (8344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:46 (8344): No heartbeat from core client for 30 sec - exiting 15:43:47 (8344): No heartbeat from core client for 30 sec - exiting 15:43:48 (8344): No heartbeat from core client for 30 sec - exiting 15:43:49 (8344): No heartbeat from core client for 30 sec - exiting 15:43:50 (8344): No heartbeat from core client for 30 sec - exiting 15:43:52 (8344): No heartbeat from core client for 30 sec - exiting 15:43:53 (8344): No heartbeat from core client for 30 sec - exiting 15:43:54 (8344): No heartbeat from core client for 30 sec - exiting 15:43:55 (8344): No heartbeat from core client for 30 sec - exiting 15:43:56 (8344): No heartbeat from core client for 30 sec - exiting 16:15:25 (9436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:15:30 (9436): No heartbeat from core client for 30 sec - exiting 16:15:31 (9436): No heartbeat from core client for 30 sec - exiting 16:15:32 (9436): No heartbeat from core client for 30 sec - exiting 16:15:34 (9436): No heartbeat from core client for 30 sec - exiting 16:15:35 (9436): No heartbeat from core client for 30 sec - exiting 16:15:36 (9436): No heartbeat from core client for 30 sec - exiting 16:15:37 (9436): No heartbeat from core client for 30 sec - exiting 16:15:38 (9436): No heartbeat from core client for 30 sec - exiting 16:15:39 (9436): No heartbeat from core client for 30 sec - exiting 16:15:40 (9436): No heartbeat from core client for 30 sec - exiting 16:15:41 (9436): No heartbeat from core client for 30 sec - exiting 16:15:42 (9436): No heartbeat from core client for 30 sec - exiting 16:49:12 (9892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:49:19 (9892): No heartbeat from core client for 30 sec - exiting 16:49:21 (9892): No heartbeat from core client for 30 sec - exiting 16:49:23 (9892): No heartbeat from core client for 30 sec - exiting 16:49:24 (9892): No heartbeat from core client for 30 sec - exiting 16:49:25 (9892): No heartbeat from core client for 30 sec - exiting 16:49:26 (9892): No heartbeat from core client for 30 sec - exiting 16:49:27 (9892): No heartbeat from core client for 30 sec - exiting 16:49:28 (9892): No heartbeat from core client for 30 sec - exiting 16:49:29 (9892): No heartbeat from core client for 30 sec - exiting 16:49:30 (9892): No heartbeat from core client for 30 sec - exiting 16:49:31 (9892): No heartbeat from core client for 30 sec - exiting 16:49:32 (9892): No heartbeat from core client for 30 sec - exiting 16:49:34 (9892): No heartbeat from core client for 30 sec - exiting 16:49:35 (9892): No heartbeat from core client for 30 sec - exiting 16:49:36 (9892): No heartbeat from core client for 30 sec - exiting 16:49:37 (9892): No heartbeat from core client for 30 sec - exiting 16:49:38 (9892): No heartbeat from core client for 30 sec - exiting 16:49:39 (9892): No heartbeat from core client for 30 sec - exiting 16:49:40 (9892): No heartbeat from core client for 30 sec - exiting 16:52:37 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:44 (7372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:52 (7372): No heartbeat from core client for 30 sec - exiting 17:20:55 (7372): No heartbeat from core client for 30 sec - exiting 17:20:56 (7372): No heartbeat from core client for 30 sec - exiting 17:20:57 (7372): No heartbeat from core client for 30 sec - exiting 17:20:59 (7372): No heartbeat from core client for 30 sec - exiting 17:21:00 (7372): No heartbeat from core client for 30 sec - exiting 17:21:01 (7372): No heartbeat from core client for 30 sec - exiting 17:21:02 (7372): No heartbeat from core client for 30 sec - exiting 17:51:21 (10852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:51:27 (10852): No heartbeat from core client for 30 sec - exiting 17:51:28 (10852): No heartbeat from core client for 30 sec - exiting 17:51:29 (10852): No heartbeat from core client for 30 sec - exiting 17:51:31 (10852): No heartbeat from core client for 30 sec - exiting 17:51:32 (10852): No heartbeat from core client for 30 sec - exiting 17:51:33 (10852): No heartbeat from core client for 30 sec - exiting 17:51:34 (10852): No heartbeat from core client for 30 sec - exiting 17:51:35 (10852): No heartbeat from core client for 30 sec - exiting 17:51:36 (10852): No heartbeat from core client for 30 sec - exiting 17:51:37 (10852): No heartbeat from core client for 30 sec - exiting 17:51:38 (10852): No heartbeat from core client for 30 sec - exiting 17:51:39 (10852): No heartbeat from core client for 30 sec - exiting 17:53:07 (4676): No heartbeat from core client for 30 sec - exiting 17:53:08 (4676): No heartbeat from core client for 30 sec - exiting 17:53:09 (4676): No heartbeat from core client for 30 sec - exiting 17:53:10 (4676): No heartbeat from core client for 30 sec - exiting 17:53:11 (4676): No heartbeat from core client for 30 sec - exiting 17:53:13 (4676): No heartbeat from core client for 30 sec - exiting 17:53:14 (4676): No heartbeat from core client for 30 sec - exiting 17:53:15 (4676): No heartbeat from core client for 30 sec - exiting 17:53:16 (4676): No heartbeat from core client for 30 sec - exiting 17:53:17 (4676): No heartbeat from core client for 30 sec - exiting 17:53:18 (4676): No heartbeat from core client for 30 sec - exiting 17:53:19 (4676): No heartbeat from core client for 30 sec - exiting 17:53:20 (4676): No heartbeat from core client for 30 sec - exiting 17:53:21 (4676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:29 (7756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:19:09 (7756): No heartbeat from core client for 30 sec - exiting 18:19:35 (7756): No heartbeat from core client for 30 sec - exiting 18:49:22 (9272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:07 (9272): No heartbeat from core client for 30 sec - exiting 18:50:29 (9272): No heartbeat from core client for 30 sec - exiting 18:51:09 (9272): No heartbeat from core client for 30 sec - exiting 18:51:10 (9272): No heartbeat from core client for 30 sec - exiting 18:51:11 (9272): No heartbeat from core client for 30 sec - exiting 18:51:17 (9272): No heartbeat from core client for 30 sec - exiting 19:20:10 (3136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:21:00 (3136): No heartbeat from core client for 30 sec - exiting 19:21:57 (3136): No heartbeat from core client for 30 sec - exiting 19:22:39 (3136): No heartbeat from core client for 30 sec - exiting 19:22:40 (3136): No heartbeat from core client for 30 sec - exiting 19:22:43 (3136): No heartbeat from core client for 30 sec - exiting 19:23:37 (3136): No heartbeat from core client for 30 sec - exiting 19:53:44 (9348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:46 (9348): No heartbeat from core client for 30 sec - exiting 19:55:03 (9348): No heartbeat from core client for 30 sec - exiting 19:55:05 (9348): No heartbeat from core client for 30 sec - exiting 19:55:06 (9348): No heartbeat from core client for 30 sec - exiting 19:55:08 (9348): No heartbeat from core client for 30 sec - exiting 19:55:09 (9348): No heartbeat from core client for 30 sec - exiting 19:55:10 (9348): No heartbeat from core client for 30 sec - exiting 19:55:12 (9348): No heartbeat from core client for 30 sec - exiting 19:55:15 (9348): No heartbeat from core client for 30 sec - exiting 19:55:47 (9348): No heartbeat from core client for 30 sec - exiting 19:55:49 (9348): No heartbeat from core client for 30 sec - exiting 19:55:50 (9348): No heartbeat from core client for 30 sec - exiting 19:55:52 (9348): No heartbeat from core client for 30 sec - exiting 20:26:28 (7432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:27:33 (7432): No heartbeat from core client for 30 sec - exiting 20:27:48 (7432): No heartbeat from core client for 30 sec - exiting 20:27:50 (7432): No heartbeat from core client for 30 sec - exiting 20:28:11 (7432): No heartbeat from core client for 30 sec - exiting 20:28:27 (7432): No heartbeat from core client for 30 sec - exiting 20:28:28 (7432): No heartbeat from core client for 30 sec - exiting 20:28:34 (7432): No heartbeat from core client for 30 sec - exiting 20:29:02 (7432): No heartbeat from core client for 30 sec - exiting 20:29:04 (7432): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:40:39 (7852): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:39:19 (8152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:12 (8996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 07:26:03 PM No files match the supplied pattern. MainError: 07:26:03 PM No files match the supplied pattern. 19:25:41 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 04:15:42 AM No files match the supplied pattern. MainError: 04:15:42 AM No files match the supplied pattern. 05:48:12 (5432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 01:06:36 PM No files match the supplied pattern. MainError: 01:06:36 PM No files match the supplied pattern. MainError: 09:51:18 PM No files match the supplied pattern. MainError: 09:51:18 PM No files match the supplied pattern. MainError: 06:20:03 AM No files match the supplied pattern. MainError: 06:20:03 AM No files match the supplied pattern. 07:39:26 (9572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 02:41:14 PM No files match the supplied pattern. MainError: 02:41:14 PM No files match the supplied pattern. 18:51:32 (11168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 11:04:30 PM No files match the supplied pattern. MainError: 11:04:30 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... 23:11:26 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 09:50:55 AM No files match the supplied pattern. MainError: 09:50:55 AM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... 08:28:28 (2196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 07:59:15 PM No files match the supplied pattern. MainError: 07:59:15 PM No files match the supplied pattern. MainError: 08:32:49 AM No files match the supplied pattern. MainError: 08:32:49 AM No files match the supplied pattern. 09:01:36 (4792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Error converting file to netcdf: dataout/o0q5ka.ph11c10 Error converting file to netcdf: dataout/o0q5ka.pg11c10 Error converting file to netcdf: dataout/o0q5ka.pe11c10 MainError: 07:23:54 PM No files match the supplied pattern. MainError: 07:23:54 PM No files match the supplied pattern. BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Apr 2013 19:26:07	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	777,600	880,920	1.1329
26 Apr 2013 08:42:55	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	751,680	851,911	1.1333
25 Apr 2013 20:02:16	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	725,760	823,128	1.1342
25 Apr 2013 09:52:22	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	699,840	794,216	1.1349
25 Apr 2013 00:29:15	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	673,920	764,897	1.1350
24 Apr 2013 14:45:32	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	648,000	736,030	1.1358
24 Apr 2013 06:24:19	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	622,080	707,127	1.1367
23 Apr 2013 21:56:00	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	596,160	678,087	1.1374
23 Apr 2013 13:10:32	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	570,240	648,122	1.1366
23 Apr 2013 04:17:33	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	544,320	618,169	1.1357
22 Apr 2013 19:26:58	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	518,400	588,207	1.1347
22 Apr 2013 11:09:42	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	492,480	559,615	1.1363
22 Apr 2013 02:51:46	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	466,560	531,041	1.1382
21 Apr 2013 18:45:22	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	440,640	502,594	1.1406
21 Apr 2013 10:27:34	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	414,720	474,166	1.1433
20 Apr 2013 20:47:48	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	388,800	445,045	1.1447
20 Apr 2013 08:18:47	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	362,880	412,509	1.1368
19 Apr 2013 17:57:06	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	336,960	380,399	1.1289
19 Apr 2013 06:22:50	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	311,040	348,793	1.1214
18 Apr 2013 21:24:37	1159304	15724182	hadcm3n_o0q5_2140_40_008269539_3	285,120	318,926	1.1186