Task 18341782

Name	hadam3p_anz_f0a1_2012_1_009776398_0
Workunit	9832362
Created	24 Apr 2015, 14:10:35 UTC
Sent	9 May 2015, 21:03:19 UTC
Report deadline	21 Apr 2016, 2:23:19 UTC
Received	6 Jun 2015, 21:31:42 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1296485
Run time	16 days 14 hours 44 min 45 sec
CPU time	15 days 17 hours 23 min 1 sec
Validate state	Workunit error - check skipped
Credit	5,974.74
Device peak FLOPS	2.52 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2664, iMonCtr=2 Model crash detected, will try to restart... 09:06:04 (7088): No heartbeat from core client for 30 sec - exiting 09:06:05 (7088): No heartbeat from core client for 30 sec - exiting 09:06:06 (7088): No heartbeat from core client for 30 sec - exiting 09:06:07 (7088): No heartbeat from core client for 30 sec - exiting 09:06:08 (7088): No heartbeat from core client for 30 sec - exiting 09:06:09 (7088): No heartbeat from core client for 30 sec - exiting 09:06:10 (7088): No heartbeat from core client for 30 sec - exiting 09:06:11 (7088): No heartbeat from core client for 30 sec - exiting 09:06:12 (7088): No heartbeat from core client for 30 sec - exiting 09:06:13 (7088): No heartbeat from core client for 30 sec - exiting 09:06:14 (7088): No heartbeat from core client for 30 sec - exiting 09:06:15 (7088): No heartbeat from core client for 30 sec - exiting 09:06:16 (7088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7056, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6804, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7572, selfPID=1840, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5952, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8040, selfPID=6156, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4044, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3280, selfPID=6584, iMonCtr=1 Model crash detected, will try to restart... 00:52:02 (5364): No heartbeat from core client for 30 sec - exiting 00:52:03 (5364): No heartbeat from core client for 30 sec - exiting 00:52:04 (5364): No heartbeat from core client for 30 sec - exiting 00:52:05 (5364): No heartbeat from core client for 30 sec - exiting 00:52:06 (5364): No heartbeat from core client for 30 sec - exiting 00:52:07 (5364): No heartbeat from core client for 30 sec - exiting 00:52:08 (5364): No heartbeat from core client for 30 sec - exiting 00:52:09 (5364): No heartbeat from core client for 30 sec - exiting 00:52:10 (5364): No heartbeat from core client for 30 sec - exiting 00:52:11 (5364): No heartbeat from core client for 30 sec - exiting 00:52:12 (5364): No heartbeat from core client for 30 sec - exiting 00:52:13 (5364): No heartbeat from core client for 30 sec - exiting 00:52:14 (5364): No heartbeat from core client for 30 sec - exiting 00:52:15 (5364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6684, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7920, iMonCtr=2 09:06:24 (5168): No heartbeat from core client for 30 sec - exiting 09:06:25 (5168): No heartbeat from core client for 30 sec - exiting 09:06:26 (5168): No heartbeat from core client for 30 sec - exiting 09:06:27 (5168): No heartbeat from core client for 30 sec - exiting 09:06:28 (5168): No heartbeat from core client for 30 sec - exiting 09:06:29 (5168): No heartbeat from core client for 30 sec - exiting 09:06:30 (5168): No heartbeat from core client for 30 sec - exiting 09:06:31 (5168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7692, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=416, selfPID=7540, iMonCtr=1 Model crash detected, will try to restart... 09:08:00 (3840): No heartbeat from core client for 30 sec - exiting 09:08:01 (3840): No heartbeat from core client for 30 sec - exiting 09:08:02 (3840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8104, selfPID=8104, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7316, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7476, selfPID=5072, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1104, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2352, selfPID=4644, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6988, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=876, selfPID=2888, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5608, selfPID=5176, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 23:06:41 (3472): No heartbeat from core client for 30 sec - exiting 23:06:42 (3472): No heartbeat from core client for 30 sec - exiting 23:06:43 (3472): No heartbeat from core client for 30 sec - exiting 23:06:44 (3472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:06:19 (7180): No heartbeat from core client for 30 sec - exiting 09:06:20 (7180): No heartbeat from core client for 30 sec - exiting 09:06:21 (7180): No heartbeat from core client for 30 sec - exiting 09:06:22 (7180): No heartbeat from core client for 30 sec - exiting 09:06:23 (7180): No heartbeat from core client for 30 sec - exiting 09:06:24 (7180): No heartbeat from core client for 30 sec - exiting 09:06:25 (7180): No heartbeat from core client for 30 sec - exiting 09:06:26 (7180): No heartbeat from core client for 30 sec - exiting 09:06:27 (7180): No heartbeat from core client for 30 sec - exiting 09:06:28 (7180): No heartbeat from core client for 30 sec - exiting 09:06:29 (7180): No heartbeat from core client for 30 sec - exiting 09:06:30 (7180): No heartbeat from core client for 30 sec - exiting 09:06:31 (7180): No heartbeat from core client for 30 sec - exiting 09:06:32 (7180): No heartbeat from core client for 30 sec - exiting 09:06:33 (7180): No heartbeat from core client for 30 sec - exiting 09:06:34 (7180): No heartbeat from core client for 30 sec - exiting 09:06:35 (7180): No heartbeat from core client for 30 sec - exiting 09:06:36 (7180): No heartbeat from core client for 30 sec - exiting 09:06:37 (7180): No heartbeat from core client for 30 sec - exiting 09:06:38 (7180): No heartbeat from core client for 30 sec - exiting 09:06:39 (7180): No heartbeat from core client for 30 sec - exiting 09:06:40 (7180): No heartbeat from core client for 30 sec - exiting 09:06:41 (7180): No heartbeat from core client for 30 sec - exiting 09:06:42 (7180): No heartbeat from core client for 30 sec - exiting 09:06:43 (7180): No heartbeat from core client for 30 sec - exiting 09:06:44 (7180): No heartbeat from core client for 30 sec - exiting 09:06:45 (7180): No heartbeat from core client for 30 sec - exiting 09:06:46 (7180): No heartbeat from core client for 30 sec - exiting 09:06:47 (7180): No heartbeat from core client for 30 sec - exiting 09:06:48 (7180): No heartbeat from core client for 30 sec - exiting 09:06:49 (7180): No heartbeat from core client for 30 sec - exiting 09:06:50 (7180): No heartbeat from core client for 30 sec - exiting 09:06:51 (7180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8788, selfPID=6920, iMonCtr=1 Model crash detected, will try to restart... 09:06:41 (7952): No heartbeat from core client for 30 sec - exiting 09:06:42 (7952): No heartbeat from core client for 30 sec - exiting 09:06:43 (7952): No heartbeat from core client for 30 sec - exiting 09:06:44 (7952): No heartbeat from core client for 30 sec - exiting 09:06:45 (7952): No heartbeat from core client for 30 sec - exiting 09:06:46 (7952): No heartbeat from core client for 30 sec - exiting 09:06:47 (7952): No heartbeat from core client for 30 sec - exiting 09:06:48 (7952): No heartbeat from core client for 30 sec - exiting 09:06:49 (7952): No heartbeat from core client for 30 sec - exiting 09:06:50 (7952): No heartbeat from core client for 30 sec - exiting 09:06:51 (7952): No heartbeat from core client for 30 sec - exiting 09:06:52 (7952): No heartbeat from core client for 30 sec - exiting 09:06:53 (7952): No heartbeat from core client for 30 sec - exiting 09:06:54 (7952): No heartbeat from core client for 30 sec - exiting 09:06:55 (7952): No heartbeat from core client for 30 sec - exiting 09:06:56 (7952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9020, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8648, iMonCtr=2 Model crash detected, will try to restart... 09:07:02 (7304): No heartbeat from core client for 30 sec - exiting 09:07:03 (7304): No heartbeat from core client for 30 sec - exiting 09:07:04 (7304): No heartbeat from core client for 30 sec - exiting 09:07:05 (7304): No heartbeat from core client for 30 sec - exiting 09:07:06 (7304): No heartbeat from core client for 30 sec - exiting 09:07:07 (7304): No heartbeat from core client for 30 sec - exiting 09:07:08 (7304): No heartbeat from core client for 30 sec - exiting 09:07:09 (7304): No heartbeat from core client for 30 sec - exiting 09:07:10 (7304): No heartbeat from core client for 30 sec - exiting 09:07:11 (7304): No heartbeat from core client for 30 sec - exiting 09:07:12 (7304): No heartbeat from core client for 30 sec - exiting 09:07:13 (7304): No heartbeat from core client for 30 sec - exiting 09:07:14 (7304): No heartbeat from core client for 30 sec - exiting 09:07:15 (7304): No heartbeat from core client for 30 sec - exiting 09:07:16 (7304): No heartbeat from core client for 30 sec - exiting 09:07:17 (7304): No heartbeat from core client for 30 sec - exiting 09:07:18 (7304): No heartbeat from core client for 30 sec - exiting 09:07:19 (7304): No heartbeat from core client for 30 sec - exiting 09:07:20 (7304): No heartbeat from core client for 30 sec - exiting 09:07:21 (7304): No heartbeat from core client for 30 sec - exiting 09:07:22 (7304): No heartbeat from core client for 30 sec - exiting 09:07:23 (7304): No heartbeat from core client for 30 sec - exiting 09:07:24 (7304): No heartbeat from core client for 30 sec - exiting 09:07:25 (7304): No heartbeat from core client for 30 sec - exiting 09:07:26 (7304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:44 (7848): No heartbeat from core client for 30 sec - exiting 09:05:45 (7848): No heartbeat from core client for 30 sec - exiting 09:05:46 (7848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:51:17 (2848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8484, iMonCtr=2 CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3096, selfPID=3564, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 09:06:06 (4364): No heartbeat from core client for 30 sec - exiting 09:06:07 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:32:37 (2808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:06:22 (5204): No heartbeat from core client for 30 sec - exiting 09:06:23 (5204): No heartbeat from core client for 30 sec - exiting 09:06:24 (5204): No heartbeat from core client for 30 sec - exiting 09:06:25 (5204): No heartbeat from core client for 30 sec - exiting 09:06:26 (5204): No heartbeat from core client for 30 sec - exiting 09:06:27 (5204): No heartbeat from core client for 30 sec - exiting 09:06:28 (5204): No heartbeat from core client for 30 sec - exiting 09:06:29 (5204): No heartbeat from core client for 30 sec - exiting 09:06:30 (5204): No heartbeat from core client for 30 sec - exiting 09:06:31 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:07:04 (6600): No heartbeat from core client for 30 sec - exiting 09:07:05 (6600): No heartbeat from core client for 30 sec - exiting 09:07:06 (6600): No heartbeat from core client for 30 sec - exiting 09:07:07 (6600): No heartbeat from core client for 30 sec - exiting 09:07:08 (6600): No heartbeat from core client for 30 sec - exiting 09:07:09 (6600): No heartbeat from core client for 30 sec - exiting 09:07:10 (6600): No heartbeat from core client for 30 sec - exiting 09:07:11 (6600): No heartbeat from core client for 30 sec - exiting 09:07:12 (6600): No heartbeat from core client for 30 sec - exiting 09:07:13 (6600): No heartbeat from core client for 30 sec - exiting 09:07:14 (6600): No heartbeat from core client for 30 sec - exiting 09:07:15 (6600): No heartbeat from core client for 30 sec - exiting 09:07:16 (6600): No heartbeat from core client for 30 sec - exiting 09:07:17 (6600): No heartbeat from core client for 30 sec - exiting 09:07:18 (6600): No heartbeat from core client for 30 sec - exiting 09:07:19 (6600): No heartbeat from core client for 30 sec - exiting 09:07:20 (6600): No heartbeat from core client for 30 sec - exiting 09:07:21 (6600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3792, selfPID=3792, iMonCtr=2 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jun 2015 20:06:19	1296485	18341782	hadam3p_anz_f0a1_2012_1_009776398_0	138,539	1,357,672	9.7999
04 Jun 2015 17:18:43	1296485	18341782	hadam3p_anz_f0a1_2012_1_009776398_0	127,019	1,243,563	9.7904
02 Jun 2015 11:42:51	1296485	18341782	hadam3p_anz_f0a1_2012_1_009776398_0	115,499	1,130,768	9.7903
30 May 2015 21:16:06	1296485	18341782	hadam3p_anz_f0a1_2012_1_009776398_0	103,979	1,015,772	9.7690
28 May 2015 20:12:30	1296485	18341782	hadam3p_anz_f0a1_2012_1_009776398_0	92,459	905,663	9.7953
26 May 2015 13:46:32	1296485	18341782	hadam3p_anz_f0a1_2012_1_009776398_0	80,939	793,341	9.8017
24 May 2015 11:18:09	1296485	18341782	hadam3p_anz_f0a1_2012_1_009776398_0	69,419	681,522	9.8175
22 May 2015 10:11:35	1296485	18341782	hadam3p_anz_f0a1_2012_1_009776398_0	57,899	566,920	9.7915
19 May 2015 20:01:49	1296485	18341782	hadam3p_anz_f0a1_2012_1_009776398_0	46,379	455,347	9.8180
18 May 2015 12:14:47	1296485	18341782	hadam3p_anz_f0a1_2012_1_009776398_0	34,859	341,570	9.7986
14 May 2015 21:24:17	1296485	18341782	hadam3p_anz_f0a1_2012_1_009776398_0	23,339	227,169	9.7335
12 May 2015 15:46:03	1296485	18341782	hadam3p_anz_f0a1_2012_1_009776398_0	11,819	116,062	9.8200