Task 11685726

Name	hadam3p_saf_v772_1973_1_006682956_0
Workunit	6886209
Created	26 Aug 2010, 11:55:04 UTC
Sent	27 Aug 2010, 17:46:33 UTC
Report deadline	9 Aug 2011, 23:06:33 UTC
Received	5 Sep 2010, 20:41:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1087586
Run time	2 days 20 hours 56 min 24 sec
CPU time	2 days 19 hours 0 min 5 sec
Validate state	Invalid
Credit	935.95
Device peak FLOPS	1.52 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.05 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4672, selfPID=4672, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetValCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5696, selfPID=5696, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3860, selfPID=3860, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4048, selfPID=4048, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5700, selfPID=5700, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5492, selfPID=5492, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:55:56 (5700): No heartbeat from core client for 30 sec - exiting 04:55:57 (5700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:04 (5100): No heartbeat from core client for 30 sec - exiting 06:01:05 (5100): No heartbeat from core client for 30 sec - exiting 06:01:06 (5100): No heartbeat from core client for 30 sec - exiting 06:01:08 (5100): No heartbeat from core client for 30 sec - exiting 06:01:09 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5740, selfPID=5740, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4592, selfPID=4592, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 06:11:13 (2812): No heartbeat from core client for 30 sec - exiting 06:11:14 (2812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:13:14 (4976): No heartbeat from core client for 30 sec - exiting 06:13:15 (4976): No heartbeat from core client for 30 sec - exiting 06:13:16 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:15:26 (668): No heartbeat from core client for 30 sec - exiting 06:15:27 (668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5964, selfPID=5964, iMonCtr=2 06:24:43 (932): No heartbeat from core client for 30 sec - exiting 06:24:44 (932): No heartbeat from core client for 30 sec - exiting 06:24:45 (932): No heartbeat from core client for 30 sec - exiting 06:24:46 (932): No heartbeat from core client for 30 sec - exiting 06:24:47 (932): No heartbeat from core client for 30 sec - exiting 06:24:48 (932): No heartbeat from core client for 30 sec - exiting 06:24:49 (932): No heartbeat from core client for 30 sec - exiting 06:24:50 (932): No heartbeat from core client for 30 sec - exiting 06:24:51 (932): No heartbeat from core client for 30 sec - exiting 06:24:52 (932): No heartbeat from core client for 30 sec - exiting 06:24:53 (932): No heartbeat from core client for 30 sec - exiting 06:24:55 (932): No heartbeat from core client for 30 sec - exiting 06:24:56 (932): No heartbeat from core client for 30 sec - exiting 06:24:57 (932): No heartbeat from core client for 30 sec - exiting 06:24:58 (932): No heartbeat from core client for 30 sec - exiting 06:24:59 (932): No heartbeat from core client for 30 sec - exiting 06:25:00 (932): No heartbeat from core client for 30 sec - exiting 06:25:01 (932): No heartbeat from core client for 30 sec - exiting 06:25:02 (932): No heartbeat from core client for 30 sec - exiting 06:25:03 (932): No heartbeat from core client for 30 sec - exiting 06:25:04 (932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:28:14 (3912): No heartbeat from core client for 30 sec - exiting 06:28:15 (3912): No heartbeat from core client for 30 sec - exiting 06:28:16 (3912): No heartbeat from core client for 30 sec - exiting 06:28:17 (3912): No heartbeat from core client for 30 sec - exiting 06:28:18 (3912): No heartbeat from core client for 30 sec - exiting 06:28:19 (3912): No heartbeat from core client for 30 sec - exiting 06:28:21 (3912): No heartbeat from core client for 30 sec - exiting 06:28:22 (3912): No heartbeat from core client for 30 sec - exiting 06:28:23 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:33:44 (5636): No heartbeat from core client for 30 sec - exiting 06:33:45 (5636): No heartbeat from core client for 30 sec - exiting 06:33:46 (5636): No heartbeat from core client for 30 sec - exiting 06:33:47 (5636): No heartbeat from core client for 30 sec - exiting 06:33:48 (5636): No heartbeat from core client for 30 sec - exiting 06:33:49 (5636): No heartbeat from core client for 30 sec - exiting 06:33:50 (5636): No heartbeat from core client for 30 sec - exiting 06:33:52 (5636): No heartbeat from core client for 30 sec - exiting 06:33:53 (5636): No heartbeat from core client for 30 sec - exiting 06:33:54 (5636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:36:13 (4376): No heartbeat from core client for 30 sec - exiting 06:36:14 (4376): No heartbeat from core client for 30 sec - exiting 06:36:15 (4376): No heartbeat from core client for 30 sec - exiting 06:36:16 (4376): No heartbeat from core client for 30 sec - exiting 06:36:17 (4376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4812, selfPID=4812, iMonCtr=2 06:38:05 (4700): No heartbeat from core client for 30 sec - exiting 06:38:06 (4700): No heartbeat from core client for 30 sec - exiting 06:38:08 (4700): No heartbeat from core client for 30 sec - exiting 06:38:09 (4700): No heartbeat from core client for 30 sec - exiting 06:38:10 (4700): No heartbeat from core client for 30 sec - exiting 06:38:11 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:41:26 (2644): No heartbeat from core client for 30 sec - exiting 06:41:27 (2644): No heartbeat from core client for 30 sec - exiting 06:41:28 (2644): No heartbeat from core client for 30 sec - exiting 06:41:29 (2644): No heartbeat from core client for 30 sec - exiting 06:41:30 (2644): No heartbeat from core client for 30 sec - exiting 06:41:31 (2644): No heartbeat from core client for 30 sec - exiting 06:41:32 (2644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:30:40 (2672): No heartbeat from core client for 30 sec - exiting 19:30:42 (2672): No heartbeat from core client for 30 sec - exiting 19:30:43 (2672): No heartbeat from core client for 30 sec - exiting 19:30:44 (2672): No heartbeat from core client for 30 sec - exiting 19:30:45 (2672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:55:27 (2748): No heartbeat from core client for 30 sec - exiting 19:55:28 (2748): No heartbeat from core client for 30 sec - exiting 19:55:29 (2748): No heartbeat from core client for 30 sec - exiting 19:55:31 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3148, selfPID=3148, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:00:51 (2940): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3292, selfPID=3292, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:20 (1100): No heartbeat from core client for 30 sec - exiting 06:01:21 (1100): No heartbeat from core client for 30 sec - exiting 06:01:22 (1100): No heartbeat from core client for 30 sec - exiting 06:01:23 (1100): No heartbeat from core client for 30 sec - exiting 06:01:25 (1100): No heartbeat from core client for 30 sec - exiting 06:01:26 (1100): No heartbeat from core client for 30 sec - exiting 06:01:27 (1100): No heartbeat from core client for 30 sec - exiting 06:01:28 (1100): No heartbeat from core client for 30 sec - exiting 06:01:29 (1100): No heartbeat from core client for 30 sec - exiting 06:01:30 (1100): No heartbeat from core client for 30 sec - exiting 06:01:31 (1100): No heartbeat from core client for 30 sec - exiting 06:01:32 (1100): No heartbeat from core client for 30 sec - exiting 06:01:33 (1100): No heartbeat from core client for 30 sec - exiting 06:01:34 (1100): No heartbeat from core client for 30 sec - exiting 06:01:35 (1100): No heartbeat from core client for 30 sec - exiting 06:01:37 (1100): No heartbeat from core client for 30 sec - exiting 06:01:38 (1100): No heartbeat from core client for 30 sec - exiting 06:01:39 (1100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 06:03:59 (108): No heartbeat from core client for 30 sec - exiting 06:04:00 (108): No heartbeat from core client for 30 sec - exiting 06:04:01 (108): No heartbeat from core client for 30 sec - exiting 06:04:02 (108): No heartbeat from core client for 30 sec - exiting 06:04:03 (108): No heartbeat from core client for 30 sec - exiting 06:04:04 (108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3092, selfPID=3092, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3460, selfPID=3460, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3504, selfPID=3504, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5908, selfPID=5908, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5908, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 09:07:48 (4964): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_saf_v772_1973_1_006682956_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_v772_1973_1_006682956_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_v772_1973_1_006682956_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_v772_1973_1_006682956_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_v772_1973_1_006682956_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_v772_1973_1_006682956_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_v772_1973_1_006682956_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Sep 2010 15:48:40	1087586	11685726	hadam3p_saf_v772_1973_1_006682956_0	57,696	224,023	3.8828
04 Sep 2010 04:43:43	1087586	11685726	hadam3p_saf_v772_1973_1_006682956_0	46,176	179,795	3.8937
04 Sep 2010 04:43:43	1087586	11685726	hadam3p_saf_v772_1973_1_006682956_0	34,656	135,231	3.9021
01 Sep 2010 10:14:11	1087586	11685726	hadam3p_saf_v772_1973_1_006682956_0	23,145	91,215	3.9410
31 Aug 2010 08:04:29	1087586	11685726	hadam3p_saf_v772_1973_1_006682956_0	23,136	90,546	3.9136
29 Aug 2010 19:45:07	1087586	11685726	hadam3p_saf_v772_1973_1_006682956_0	11,616	45,908	3.9521