Task 18294835

Name	hadam3p_anz_m3nl_2013_1_009740901_0
Workunit	9811899
Created	9 Apr 2015, 11:34:11 UTC
Sent	13 Apr 2015, 18:01:40 UTC
Report deadline	25 Mar 2016, 23:21:40 UTC
Received	27 Apr 2015, 18:20:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1330183
Run time	3 days 10 hours 6 min 46 sec
CPU time	3 days 2 hours 38 min 28 sec
Validate state	Invalid
Credit	2,000.18
Device peak FLOPS	3.08 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:06:20 (7396): No heartbeat from core client for 30 sec - exiting 22:06:21 (7396): No heartbeat from core client for 30 sec - exiting 22:06:22 (7396): No heartbeat from core client for 30 sec - exiting 22:06:23 (7396): No heartbeat from core client for 30 sec - exiting 22:06:24 (7396): No heartbeat from core client for 30 sec - exiting 22:06:25 (7396): No heartbeat from core client for 30 sec - exiting 22:06:26 (7396): No heartbeat from core client for 30 sec - exiting 22:06:27 (7396): No heartbeat from core client for 30 sec - exiting 22:06:28 (7396): No heartbeat from core client for 30 sec - exiting 22:06:29 (7396): No heartbeat from core client for 30 sec - exiting 22:06:30 (7396): No heartbeat from core client for 30 sec - exiting 22:06:31 (7396): No heartbeat from core client for 30 sec - exiting 22:06:32 (7396): No heartbeat from core client for 30 sec - exiting 22:06:33 (7396): No heartbeat from core client for 30 sec - exiting 22:06:34 (7396): No heartbeat from core client for 30 sec - exiting 22:06:35 (7396): No heartbeat from core client for 30 sec - exiting 22:06:36 (7396): No heartbeat from core client for 30 sec - exiting 22:06:37 (7396): No heartbeat from core client for 30 sec - exiting 22:06:38 (7396): No heartbeat from core client for 30 sec - exiting 22:06:39 (7396): No heartbeat from core client for 30 sec - exiting 22:06:40 (7396): No heartbeat from core client for 30 sec - exiting 22:06:41 (7396): No heartbeat from core client for 30 sec - exiting 22:06:42 (7396): No heartbeat from core client for 30 sec - exiting 22:06:43 (7396): No heartbeat from core client for 30 sec - exiting 22:06:44 (7396): No heartbeat from core client for 30 sec - exiting 22:06:45 (7396): No heartbeat from core client for 30 sec - exiting 22:06:46 (7396): No heartbeat from core client for 30 sec - exiting 22:06:47 (7396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1732, selfPID=1732, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3256, selfPID=3256, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7648, iMonCtr=2 09:00:21 (5428): No heartbeat from core client for 30 sec - exiting 09:00:22 (5428): No heartbeat from core client for 30 sec - exiting 09:00:23 (5428): No heartbeat from core client for 30 sec - exiting 09:00:24 (5428): No heartbeat from core client for 30 sec - exiting 09:00:25 (5428): No heartbeat from core client for 30 sec - exiting 09:00:26 (5428): No heartbeat from core client for 30 sec - exiting 09:00:27 (5428): No heartbeat from core client for 30 sec - exiting 09:00:28 (5428): No heartbeat from core client for 30 sec - exiting 09:00:30 (5428): No heartbeat from core client for 30 sec - exiting 09:00:31 (5428): No heartbeat from core client for 30 sec - exiting 09:00:32 (5428): No heartbeat from core client for 30 sec - exiting 09:00:33 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3944, selfPID=3944, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:09:26 (5520): No heartbeat from core client for 30 sec - exiting 13:09:28 (5520): No heartbeat from core client for 30 sec - exiting 13:09:29 (5520): No heartbeat from core client for 30 sec - exiting 13:09:30 (5520): No heartbeat from core client for 30 sec - exiting 13:09:31 (5520): No heartbeat from core client for 30 sec - exiting 13:09:32 (5520): No heartbeat from core client for 30 sec - exiting 13:09:33 (5520): No heartbeat from core client for 30 sec - exiting 13:09:34 (5520): No heartbeat from core client for 30 sec - exiting 13:09:35 (5520): No heartbeat from core client for 30 sec - exiting 13:09:36 (5520): No heartbeat from core client for 30 sec - exiting 13:09:37 (5520): No heartbeat from core client for 30 sec - exiting 13:09:38 (5520): No heartbeat from core client for 30 sec - exiting 13:09:40 (5520): No heartbeat from core client for 30 sec - exiting 13:09:41 (5520): No heartbeat from core client for 30 sec - exiting 13:09:42 (5520): No heartbeat from core client for 30 sec - exiting 13:09:43 (5520): No heartbeat from core client for 30 sec - exiting 13:09:44 (5520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=368, selfPID=368, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 17:25:11 (4384): No heartbeat from core client for 30 sec - exiting 17:25:12 (4384): No heartbeat from core client for 30 sec - exiting 17:25:13 (4384): No heartbeat from core client for 30 sec - exiting 17:25:14 (4384): No heartbeat from core client for 30 sec - exiting 17:25:15 (4384): No heartbeat from core client for 30 sec - exiting 17:25:16 (4384): No heartbeat from core client for 30 sec - exiting 17:25:17 (4384): No heartbeat from core client for 30 sec - exiting 17:25:18 (4384): No heartbeat from core client for 30 sec - exiting 17:25:19 (4384): No heartbeat from core client for 30 sec - exiting 17:25:20 (4384): No heartbeat from core client for 30 sec - exiting 17:25:21 (4384): No heartbeat from core client for 30 sec - exiting 17:25:22 (4384): No heartbeat from core client for 30 sec - exiting 17:25:23 (4384): No heartbeat from core client for 30 sec - exiting 17:25:24 (4384): No heartbeat from core client for 30 sec - exiting 17:25:25 (4384): No heartbeat from core client for 30 sec - exiting 17:25:26 (4384): No heartbeat from core client for 30 sec - exiting 17:25:27 (4384): No heartbeat from core client for 30 sec - exiting 17:25:28 (4384): No heartbeat from core client for 30 sec - exiting 17:25:29 (4384): No heartbeat from core client for 30 sec - exiting 17:25:30 (4384): No heartbeat from core client for 30 sec - exiting 17:25:31 (4384): No heartbeat from core client for 30 sec - exiting 17:25:32 (4384): No heartbeat from core client for 30 sec - exiting 17:25:33 (4384): No heartbeat from core client for 30 sec - exiting 17:25:34 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4700, selfPID=4700, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8364, selfPID=8364, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:29:24 (6488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:41:13 (6592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:40:29 (4004): No heartbeat from core client for 30 sec - exiting 07:40:30 (4004): No heartbeat from core client for 30 sec - exiting 07:40:31 (4004): No heartbeat from core client for 30 sec - exiting 07:40:32 (4004): No heartbeat from core client for 30 sec - exiting 07:40:33 (4004): No heartbeat from core client for 30 sec - exiting 07:40:35 (4004): No heartbeat from core client for 30 sec - exiting 07:40:36 (4004): No heartbeat from core client for 30 sec - exiting 07:40:37 (4004): No heartbeat from core client for 30 sec - exiting 07:40:38 (4004): No heartbeat from core client for 30 sec - exiting 07:40:39 (4004): No heartbeat from core client for 30 sec - exiting 07:40:40 (4004): No heartbeat from core client for 30 sec - exiting 07:40:41 (4004): No heartbeat from core client for 30 sec - exiting 07:40:42 (4004): No heartbeat from core client for 30 sec - exiting 07:40:43 (4004): No heartbeat from core client for 30 sec - exiting 07:40:44 (4004): No heartbeat from core client for 30 sec - exiting 07:40:46 (4004): No heartbeat from core client for 30 sec - exiting 07:40:47 (4004): No heartbeat from core client for 30 sec - exiting 07:40:48 (4004): No heartbeat from core client for 30 sec - exiting 07:40:49 (4004): No heartbeat from core client for 30 sec - exiting 07:40:50 (4004): No heartbeat from core client for 30 sec - exiting 07:40:51 (4004): No heartbeat from core client for 30 sec - exiting 07:40:52 (4004): No heartbeat from core client for 30 sec - exiting 07:40:53 (4004): No heartbeat from core client for 30 sec - exiting 07:40:54 (4004): No heartbeat from core client for 30 sec - exiting 07:40:55 (4004): No heartbeat from core client for 30 sec - exiting 07:40:56 (4004): No heartbeat from core client for 30 sec - exiting 07:40:57 (4004): No heartbeat from core client for 30 sec - exiting 07:40:59 (4004): No heartbeat from core client for 30 sec - exiting 07:41:00 (4004): No heartbeat from core client for 30 sec - exiting 07:41:01 (4004): No heartbeat from core client for 30 sec - exiting 07:41:02 (4004): No heartbeat from core client for 30 sec - exiting 07:41:03 (4004): No heartbeat from core client for 30 sec - exiting 07:41:04 (4004): No heartbeat from core client for 30 sec - exiting 07:41:05 (4004): No heartbeat from core client for 30 sec - exiting 07:41:06 (4004): No heartbeat from core client for 30 sec - exiting 07:41:07 (4004): No heartbeat from core client for 30 sec - exiting 07:41:08 (4004): No heartbeat from core client for 30 sec - exiting 07:41:09 (4004): No heartbeat from core client for 30 sec - exiting 07:41:11 (4004): No heartbeat from core client for 30 sec - exiting 07:41:12 (4004): No heartbeat from core client for 30 sec - exiting 07:41:13 (4004): No heartbeat from core client for 30 sec - exiting 07:41:14 (4004): No heartbeat from core client for 30 sec - exiting 07:41:15 (4004): No heartbeat from core client for 30 sec - exiting 07:41:16 (4004): No heartbeat from core client for 30 sec - exiting 07:41:17 (4004): No heartbeat from core client for 30 sec - exiting 07:41:18 (4004): No heartbeat from core client for 30 sec - exiting 07:41:19 (4004): No heartbeat from core client for 30 sec - exiting 07:41:20 (4004): No heartbeat from core client for 30 sec - exiting 07:41:21 (4004): No heartbeat from core client for 30 sec - exiting 07:41:23 (4004): No heartbeat from core client for 30 sec - exiting 07:41:24 (4004): No heartbeat from core client for 30 sec - exiting 07:41:25 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:45:14 (1400): No heartbeat from core client for 30 sec - exiting 23:45:15 (1400): No heartbeat from core client for 30 sec - exiting 23:45:16 (1400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2976, selfPID=2976, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 09:22:57 (6488): No heartbeat from core client for 30 sec - exiting 09:22:58 (6488): No heartbeat from core client for 30 sec - exiting 09:22:59 (6488): No heartbeat from core client for 30 sec - exiting 09:23:00 (6488): No heartbeat from core client for 30 sec - exiting 09:23:01 (6488): No heartbeat from core client for 30 sec - exiting 09:23:02 (6488): No heartbeat from core client for 30 sec - exiting 09:23:04 (6488): No heartbeat from core client for 30 sec - exiting 09:23:05 (6488): No heartbeat from core client for 30 sec - exiting 09:23:06 (6488): No heartbeat from core client for 30 sec - exiting 09:23:07 (6488): No heartbeat from core client for 30 sec - exiting 09:23:08 (6488): No heartbeat from core client for 30 sec - exiting 09:23:09 (6488): No heartbeat from core client for 30 sec - exiting 09:23:10 (6488): No heartbeat from core client for 30 sec - exiting 09:23:11 (6488): No heartbeat from core client for 30 sec - exiting 09:23:12 (6488): No heartbeat from core client for 30 sec - exiting 09:23:13 (6488): No heartbeat from core client for 30 sec - exiting 09:23:15 (6488): No heartbeat from core client for 30 sec - exiting 09:23:16 (6488): No heartbeat from core client for 30 sec - exiting 09:23:17 (6488): No heartbeat from core client for 30 sec - exiting 09:23:18 (6488): No heartbeat from core client for 30 sec - exiting 09:23:19 (6488): No heartbeat from core client for 30 sec - exiting 09:23:20 (6488): No heartbeat from core client for 30 sec - exiting 09:23:21 (6488): No heartbeat from core client for 30 sec - exiting 09:23:22 (6488): No heartbeat from core client for 30 sec - exiting 09:23:23 (6488): No heartbeat from core client for 30 sec - exiting 09:23:24 (6488): No heartbeat from core client for 30 sec - exiting 09:23:25 (6488): No heartbeat from core client for 30 sec - exiting 09:23:27 (6488): No heartbeat from core client for 30 sec - exiting 09:23:28 (6488): No heartbeat from core client for 30 sec - exiting 09:23:29 (6488): No heartbeat from core client for 30 sec - exiting 09:23:30 (6488): No heartbeat from core client for 30 sec - exiting 09:23:31 (6488): No heartbeat from core client for 30 sec - exiting 09:23:32 (6488): No heartbeat from core client for 30 sec - exiting 09:23:33 (6488): No heartbeat from core client for 30 sec - exiting 09:23:34 (6488): No heartbeat from core client for 30 sec - exiting 09:23:35 (6488): No heartbeat from core client for 30 sec - exiting 09:23:36 (6488): No heartbeat from core client for 30 sec - exiting 09:23:37 (6488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional10:40:45 (1272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:21:46 (6768): No heartbeat from core client for 30 sec - exiting 14:21:47 (6768): No heartbeat from core client for 30 sec - exiting 14:21:48 (6768): No heartbeat from core client for 30 sec - exiting 14:21:49 (6768): No heartbeat from core client for 30 sec - exiting 14:21:50 (6768): No heartbeat from core client for 30 sec - exiting 14:21:51 (6768): No heartbeat from core client for 30 sec - exiting 14:21:52 (6768): No heartbeat from core client for 30 sec - exiting 14:21:53 (6768): No heartbeat from core client for 30 sec - exiting 14:21:54 (6768): No heartbeat from core client for 30 sec - exiting 14:21:55 (6768): No heartbeat from core client for 30 sec - exiting 14:21:56 (6768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2656, selfPID=6288, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_m3nl_2013_1_009740901_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m3nl_2013_1_009740901_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m3nl_2013_1_009740901_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m3nl_2013_1_009740901_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m3nl_2013_1_009740901_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m3nl_2013_1_009740901_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m3nl_2013_1_009740901_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_m3nl_2013_1_009740901_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Apr 2015 15:07:44	1330183	18294835	hadam3p_anz_m3nl_2013_1_009740901_0	46,379	232,668	5.0167
23 Apr 2015 15:20:03	1330183	18294835	hadam3p_anz_m3nl_2013_1_009740901_0	34,859	176,983	5.0771
21 Apr 2015 21:30:55	1330183	18294835	hadam3p_anz_m3nl_2013_1_009740901_0	23,339	117,076	5.0163
18 Apr 2015 09:15:01	1330183	18294835	hadam3p_anz_m3nl_2013_1_009740901_0	11,819	58,988	4.9909