Task 18614601

Name	hadam3p_anz_d4eu_2013_1_009940898_0
Workunit	9968260
Created	23 Jun 2015, 12:25:39 UTC
Sent	26 Jun 2015, 20:05:34 UTC
Report deadline	8 Jun 2016, 1:25:34 UTC
Received	1 Oct 2015, 17:40:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1358359
Run time	8 days 17 hours 17 min 22 sec
CPU time	8 days 7 hours 1 min 39 sec
Validate state	Invalid
Credit	3,490.64
Device peak FLOPS	1.75 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... G07:31:18 (156): No heartbeat from core client for 30 sec - exiting 07:31:19 (156): No heartbeat from core client for 30 sec - exiting 07:31:20 (156): No heartbeat from core client for 30 sec - exiting 07:31:21 (156): No heartbeat from core client for 30 sec - exiting 07:31:22 (156): No heartbeat from core client for 30 sec - exiting 07:31:23 (156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1548, selfPID=3232, iMonCtr=1 Model crash detected, will try to restart... 10:00:25 (2728): No heartbeat from core client for 30 sec - exiting 10:00:26 (2728): No heartbeat from core client for 30 sec - exiting 10:00:27 (2728): No heartbeat from core client for 30 sec - exiting 10:00:28 (2728): No heartbeat from core client for 30 sec - exiting 10:00:29 (2728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2964, selfPID=2964, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3208, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:43:44 (2960): No heartbeat from core client for 30 sec - exiting 07:43:45 (2960): No heartbeat from core client for 30 sec - exiting 07:43:46 (2960): No heartbeat from core client for 30 sec - exiting 07:43:47 (2960): No heartbeat from core client for 30 sec - exiting 07:43:48 (2960): No heartbeat from core client for 30 sec - exiting 07:43:49 (2960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:38 (3784): No heartbeat from core client for 30 sec - exiting 20:38:39 (3784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3120, selfPID=3120, iMonCtr=2 23:55:28 (3896): No heartbeat from core client for 30 sec - exiting 23:55:29 (3896): No heartbeat from core client for 30 sec - exiting 23:55:30 (3896): No heartbeat from core client for 30 sec - exiting 23:55:31 (3896): No heartbeat from core client for 30 sec - exiting 23:55:32 (3896): No heartbeat from core client for 30 sec - exiting 23:55:33 (3896): No heartbeat from core client for 30 sec - exiting 23:55:34 (3896): No heartbeat from core client for 30 sec - exiting 23:55:35 (3896): No heartbeat from core client for 30 sec - exiting 23:55:36 (3896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2284, selfPID=2284, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3760, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3216, iMonCtr=2 C17:56:42 (2836): No heartbeat from core client for 30 sec - exiting 17:56:47 (2836): No heartbeat from core client for 30 sec - exiting 17:56:50 (2836): No heartbeat from core client for 30 sec - exiting 17:58:25 (2836): No heartbeat from core client for 30 sec - exiting 17:58:26 (2836): No heartbeat from core client for 30 sec - exiting 17:58:27 (2836): No heartbeat from core client for 30 sec - exiting 17:58:28 (2836): No heartbeat from core client for 30 sec - exiting 17:58:29 (2836): No heartbeat from core client for 30 sec - exiting 17:58:30 (2836): No heartbeat from core client for 30 sec - exiting 17:58:31 (2836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:11:07 (1400): No heartbeat from core client for 30 sec - exiting 21:11:08 (1400): No heartbeat from core client for 30 sec - exiting 21:11:09 (1400): No heartbeat from core client for 30 sec - exiting 21:11:10 (1400): No heartbeat from core client for 30 sec - exiting 21:11:11 (1400): No heartbeat from core client for 30 sec - exiting 21:11:12 (1400): No heartbeat from core client for 30 sec - exiting 21:11:13 (1400): No heartbeat from core client for 30 sec - exiting 21:11:14 (1400): No heartbeat from core client for 30 sec - exiting 21:11:15 (1400): No heartbeat from core client for 30 sec - exiting 21:11:16 (1400): No heartbeat from core client for 30 sec - exiting 21:11:17 (1400): No heartbeat from core client for 30 sec - exiting 21:11:18 (1400): No heartbeat from core client for 30 sec - exiting 21:11:19 (1400): No heartbeat from core client for 30 sec - exiting 21:11:20 (1400): No heartbeat from core client for 30 sec - exiting 21:11:21 (1400): No heartbeat from core client for 30 sec - exiting 21:11:22 (1400): No heartbeat from core client for 30 sec - exiting 21:11:23 (1400): No heartbeat from core client for 30 sec - exiting 21:11:24 (1400): No heartbeat from core client for 30 sec - exiting 21:11:25 (1400): No heartbeat from core client for 30 sec - exiting 21:11:26 (1400): No heartbeat from core client for 30 sec - exiting 21:11:27 (1400): No heartbeat from core client for 30 sec - exiting 21:11:28 (1400): No heartbeat from core client for 30 sec - exiting 21:11:29 (1400): No heartbeat from core client for 30 sec - exiting 21:11:30 (1400): No heartbeat from core client for 30 sec - exiting 21:11:31 (1400): No heartbeat from core client for 30 sec - exiting 21:11:32 (1400): No heartbeat from core client for 30 sec - exiting 21:11:33 (1400): No heartbeat from core client for 30 sec - exiting 21:11:34 (1400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:27:24 (3356): No heartbeat from core client for 30 sec - exiting 23:27:25 (3356): No heartbeat from core client for 30 sec - exiting 23:27:26 (3356): No heartbeat from core client for 30 sec - exiting 23:27:27 (3356): No heartbeat from core client for 30 sec - exiting 23:27:28 (3356): No heartbeat from core client for 30 sec - exiting 23:27:29 (3356): No heartbeat from core client for 30 sec - exiting 23:27:30 (3356): No heartbeat from core client for 30 sec - exiting 23:27:31 (3356): No heartbeat from core client for 30 sec - exiting 23:27:32 (3356): No heartbeat from core client for 30 sec - exiting 23:27:33 (3356): No heartbeat from core client for 30 sec - exiting 23:27:34 (3356): No heartbeat from core client for 30 sec - exiting 23:27:35 (3356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2760, iMonCtr=2 Model crash detected, will try to restart... 17:16:59 (1460): No heartbeat from core client for 30 sec - exiting 17:17:01 (1460): No heartbeat from core client for 30 sec - exiting 17:17:02 (1460): No heartbeat from core client for 30 sec - exiting 17:17:03 (1460): No heartbeat from core client for 30 sec - exiting 17:17:05 (1460): No heartbeat from core client for 30 sec - exiting 17:17:06 (1460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3396, selfPID=792, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:54:57 (3836): No heartbeat from core client for 30 sec - exiting 10:54:59 (3836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=860, selfPID=860, iMonCtr=2 19:58:44 (1200): No heartbeat from core client for 30 sec - exiting 19:58:52 (1200): No heartbeat from core client for 30 sec - exiting 19:58:58 (1200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... GSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2416, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2688, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4364, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... GSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3884, iMonCtr=2 Model crash detected, will try to restart... 07:40:20 (1744): No heartbeat from core client for 30 sec - exiting 07:40:21 (1744): No heartbeat from core client for 30 sec - exiting 07:40:22 (1744): No heartbeat from core client for 30 sec - exiting 07:40:23 (1744): No heartbeat from core client for 30 sec - exiting 07:40:24 (1744): No heartbeat from core client for 30 sec - exiting 07:40:25 (1744): No heartbeat from core client for 30 sec - exiting 07:40:26 (1744): No heartbeat from core client for 30 sec - exiting 07:40:27 (1744): No heartbeat from core client for 30 sec - exiting 07:40:28 (1744): No heartbeat from core client for 30 sec - exiting 07:40:29 (1744): No heartbeat from core client for 30 sec - exiting 07:40:30 (1744): No heartbeat from core client for 30 sec - exiting 07:40:31 (1744): No heartbeat from core client for 30 sec - exiting 07:40:32 (1744): No heartbeat from core client for 30 sec - exiting 07:40:33 (1744): No heartbeat from core client for 30 sec - exiting 07:40:34 (1744): No heartbeat from core client for 30 sec - exiting 07:40:35 (1744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:47:32 (2448): No heartbeat from core client for 30 sec - exiting 11:47:34 (2448): No heartbeat from core client for 30 sec - exiting 11:47:35 (2448): No heartbeat from core client for 30 sec - exiting 11:47:36 (2448): No heartbeat from core client for 30 sec - exiting 11:47:37 (2448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:52:02 (3444): No heartbeat from core client for 30 sec - exiting 11:52:03 (3444): No heartbeat from core client for 30 sec - exiting 11:52:04 (3444): No heartbeat from core client for 30 sec - exiting 11:52:05 (3444): No heartbeat from core client for 30 sec - exiting 11:52:06 (3444): No heartbeat from core client for 30 sec - exiting 11:52:07 (3444): No heartbeat from core client for 30 sec - exiting 11:52:08 (3444): No heartbeat from core client for 30 sec - exiting 11:52:09 (3444): No heartbeat from core client for 30 sec - exiting 11:52:10 (3444): No heartbeat from core client for 30 sec - exiting 11:52:11 (3444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:33:26 (2608): No heartbeat from core client for 30 sec - exiting 07:33:27 (2608): No heartbeat from core client for 30 sec - exiting 07:33:28 (2608): No heartbeat from core client for 30 sec - exiting 07:33:29 (2608): No heartbeat from core client for 30 sec - exiting 07:33:30 (2608): No heartbeat from core client for 30 sec - exiting 07:33:31 (2608): No heartbeat from core client for 30 sec - exiting 07:33:32 (2608): No heartbeat from core client for 30 sec - exiting 07:33:33 (2608): No heartbeat from core client for 30 sec - exiting 07:33:34 (2608): No heartbeat from core client for 30 sec - exiting 07:33:35 (2608): No heartbeat from core client for 30 sec - exiting 07:33:36 (2608): No heartbeat from core client for 30 sec - exiting 07:33:37 (2608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:20:53 (1416): No heartbeat from core client for 30 sec - exiting 12:20:54 (1416): No heartbeat from core client for 30 sec - exiting 12:20:55 (1416): No heartbeat from core client for 30 sec - exiting 12:20:56 (1416): No heartbeat from core client for 30 sec - exiting 12:20:57 (1416): No heartbeat from core client for 30 sec - exiting 12:20:58 (1416): No heartbeat from core client for 30 sec - exiting 12:20:59 (1416): No heartbeat from core client for 30 sec - exiting 12:21:00 (1416): No heartbeat from core client for 30 sec - exiting 12:21:01 (1416): No heartbeat from core client for 30 sec - exiting 12:21:02 (1416): No heartbeat from core client for 30 sec - exiting 12:21:03 (1416): No heartbeat from core client for 30 sec - exiting 12:21:04 (1416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3400, selfPID=3336, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_d4eu_2013_1_009940898_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d4eu_2013_1_009940898_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d4eu_2013_1_009940898_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d4eu_2013_1_009940898_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d4eu_2013_1_009940898_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Oct 2015 17:44:01	1358359	18614601	hadam3p_anz_d4eu_2013_1_009940898_0	80,939	712,279	8.8002
17 Sep 2015 08:40:33	1358359	18614601	hadam3p_anz_d4eu_2013_1_009940898_0	69,419	610,851	8.7995
13 Sep 2015 08:29:40	1358359	18614601	hadam3p_anz_d4eu_2013_1_009940898_0	57,899	510,337	8.8143
07 Sep 2015 19:17:36	1358359	18614601	hadam3p_anz_d4eu_2013_1_009940898_0	46,379	409,738	8.8346
03 Sep 2015 18:31:27	1358359	18614601	hadam3p_anz_d4eu_2013_1_009940898_0	34,859	308,259	8.8430
03 Sep 2015 18:31:27	1358359	18614601	hadam3p_anz_d4eu_2013_1_009940898_0	23,339	206,402	8.8437
24 Jul 2015 16:05:27	1358359	18614601	hadam3p_anz_d4eu_2013_1_009940898_0	11,819	103,871	8.7885