Task 13899404

Name	hadam3p_pnw_775c_2003_1_007674285_1
Workunit	7829372
Created	11 Jan 2012, 22:51:22 UTC
Sent	11 Jan 2012, 22:52:59 UTC
Report deadline	24 Dec 2012, 4:12:59 UTC
Received	8 Feb 2012, 0:42:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1097837
Run time	4 days 15 hours 19 min 52 sec
CPU time	3 days 8 hours 29 min 20 sec
Validate state	Invalid
Credit	1,003.76
Device peak FLOPS	1.36 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.6.36</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 23:58:37 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:58:38 (5748): No heartbeat from core client for 30 sec - exiting 05:57:28 (2116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:29 (2116): No heartbeat from core client for 30 sec - exiting 10:56:26 (7804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:56:28 (7804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:27:02 (8540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1592, selfPID=1592, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5992, selfPID=5992, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4060, selfPID=4060, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4088, selfPID=4088, iMonCtr=2 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3556, selfPID=2384, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:45:36 (3944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:37 (3944): No heartbeat from core client for 30 sec - exiting 18:45:38 (3944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:07:01 (2404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:02 (2404): No heartbeat from core client for 30 sec - exiting 21:07:03 (2404): No heartbeat from core client for 30 sec - exiting 21:07:04 (2404): No heartbeat from core client for 30 sec - exiting 21:07:05 (2404): No heartbeat from core client for 30 sec - exiting 21:07:06 (2404): No heartbeat from core client for 30 sec - exiting 21:07:07 (2404): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3716, selfPID=3716, iMonCtr=2 21:07:08 (2404): No heartbeat from core client for 30 sec - exiting 21:07:09 (2404): No heartbeat from core client for 30 sec - exiting 21:07:10 (2404): No heartbeat from core client for 30 sec - exiting 21:07:11 (2404): No heartbeat from core client for 30 sec - exiting 21:07:12 (2404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6000, selfPID=6000, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 14:25:25 (6708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:26 (6708): No heartbeat from core client for 30 sec - exiting 20:24:22 (7692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:23 (7692): No heartbeat from core client for 30 sec - exiting 02:23:23 (6940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:23:24 (6940): No heartbeat from core client for 30 sec - exiting 02:23:25 (6940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11828, selfPID=11828, iMonCtr=2 08:22:20 (9440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:21 (9440): No heartbeat from core client for 30 sec - exiting 08:22:23 (9440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:21:18 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:21:19 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:28:38 (9340): No heartbeat from core client for 30 sec - exiting 21:28:39 (9340): No heartbeat from core client for 30 sec - exiting 21:28:40 (9340): No heartbeat from core client for 30 sec - exiting 21:28:41 (9340): No heartbeat from core client for 30 sec - exiting 21:28:42 (9340): No heartbeat from core client for 30 sec - exiting 21:28:43 (9340): No heartbeat from core client for 30 sec - exiting 21:28:44 (9340): No heartbeat from core client for 30 sec - exiting 21:28:45 (9340): No heartbeat from core client for 30 sec - exiting 21:28:46 (9340): No heartbeat from core client for 30 sec - exiting 21:28:47 (9340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:28:49 (9340): No heartbeat from core client for 30 sec - exiting 21:28:50 (9340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3980, selfPID=3980, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... RegionCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:40:04 (5968): No heartbeat from core client for 30 sec - exiting 14:40:05 (5968): No heartbeat from core client for 30 sec - exiting 14:40:06 (5968): No heartbeat from core client for 30 sec - exiting 14:40:07 (5968): No heartbeat from core client for 30 sec - exiting 14:40:08 (5968): No heartbeat from core client for 30 sec - exiting 14:40:09 (5968): No heartbeat from core client for 30 sec - exiting 14:40:10 (5968): No heartbeat from core client for 30 sec - exiting 14:40:11 (5968): No heartbeat from core client for 30 sec - exiting 14:40:12 (5968): No heartbeat from core client for 30 sec - exiting 14:40:14 (5968): No heartbeat from core client for 30 sec - exiting 14:40:15 (5968): No heartbeat from core client for 30 sec - exiting 14:40:16 (5968): No heartbeat from core client for 30 sec - exiting 14:40:17 (5968): No heartbeat from core client for 30 sec - exiting 14:40:18 (5968): No heartbeat from core client for 30 sec - exiting 14:40:19 (5968): No heartbeat from core client for 30 sec - exiting 14:40:20 (5968): No heartbeat from core client for 30 sec - exiting 14:40:21 (5968): No heartbeat from core client for 30 sec - exiting 14:40:22 (5968): No heartbeat from core client for 30 sec - exiting 14:40:23 (5968): No heartbeat from core client for 30 sec - exiting 14:40:25 (5968): No heartbeat from core client for 30 sec - exiting 14:40:26 (5968): No heartbeat from core client for 30 sec - exiting 14:40:27 (5968): No heartbeat from core client for 30 sec - exiting 14:40:28 (5968): No heartbeat from core client for 30 sec - exiting 14:40:29 (5968): No heartbeat from core client for 30 sec - exiting 14:40:30 (5968): No heartbeat from core client for 30 sec - exiting 14:40:31 (5968): No heartbeat from core client for 30 sec - exiting 14:40:32 (5968): No heartbeat from core client for 30 sec - exiting 14:40:33 (5968): No heartbeat from core client for 30 sec - exiting 14:40:34 (5968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=860, selfPID=860, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5176, selfPID=5176, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:19:40 (2152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:19:41 (2152): No heartbeat from core client for 30 sec - exiting 17:18:28 (5572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:18:29 (5572): No heartbeat from core client for 30 sec - exiting 21:17:14 (5624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:15 (5624): No heartbeat from core client for 30 sec - exiting CPDN MonitorNo Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7880, selfPID=7888, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7880, selfPID=7880, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 18:57:27 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:57:28 (6016): No heartbeat from core client for 30 sec - exiting 18:57:29 (6016): No heartbeat from core client for 30 sec - exiting 22:56:04 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:50 (5340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4712, selfPID=4712, iMonCtr=2 CNo Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9108, selfPID=9324, iMonCtr=1 forrtl: Access is denied. forrtl: severe (38): error during write, unit 8, file C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadam3p_pnw_775c_2003_1_007674285\tmp\xaakm.pipe_dummy Image PC Routine Line Source hadam3p_pnw_um_6. 0076A39A Unknown Unknown Unknown hadam3p_pnw_um_6. 007676C8 Unknown Unknown Unknown hadam3p_pnw_um_6. 00712CD0 Unknown Unknown Unknown hadam3p_pnw_um_6. 00711E9A Unknown Unknown Unknown hadam3p_pnw_um_6. 006EAA9D Unknown Unknown Unknown hadam3p_pnw_um_6. 0068F27C Unknown Unknown Unknown hadam3p_pnw_um_6. 00409BD2 Unknown Unknown Unknown hadam3p_pnw_um_6. 0074E638 Unknown Unknown Unknown kernel32.dll 7C817077 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2428, selfPID=6680, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_775c_2003_1_007674285_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_775c_2003_1_007674285_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_775c_2003_1_007674285_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_775c_2003_1_007674285_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_775c_2003_1_007674285_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_775c_2003_1_007674285_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_775c_2003_1_007674285_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_775c_2003_1_007674285_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Feb 2012 22:13:16	1097837	13899404	hadam3p_pnw_775c_2003_1_007674285_1	46,195	255,675	5.5347
05 Feb 2012 03:03:54	1097837	13899404	hadam3p_pnw_775c_2003_1_007674285_1	46,176	254,687	5.5156
27 Jan 2012 00:34:32	1097837	13899404	hadam3p_pnw_775c_2003_1_007674285_1	34,656	191,148	5.5156
26 Jan 2012 00:23:42	1097837	13899404	hadam3p_pnw_775c_2003_1_007674285_1	23,136	127,797	5.5237
15 Jan 2012 19:35:15	1097837	13899404	hadam3p_pnw_775c_2003_1_007674285_1	11,616	64,237	5.5300