Task 11871691

Name	hadam3p_saf_v8gi_1978_1_006722645_0
Workunit	6925895
Created	6 Sep 2010, 11:57:29 UTC
Sent	7 Sep 2010, 8:24:47 UTC
Report deadline	20 Aug 2011, 13:44:47 UTC
Received	19 Sep 2010, 22:07:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1066791
Run time	3 days 15 hours 13 min 22 sec
CPU time	2 days 16 hours 38 min 31 sec
Validate state	Invalid
Credit	1,122.82
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.06 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.44</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (5262): called boinc_finish CPDN Monitor - Quit request from BOINC... (6174): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (6990): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (32353): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (27431): called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... (9863): called boinc_finish CPDN Monitor - Quit request from BOINC... (14471): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (14471): No heartbeat from core client for 30 sec - exiting (14471): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (28852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (28852): No heartbeat from core client for 30 sec - exiting (1594): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (1594): No heartbeat from core client for 30 sec - exiting (1594): No heartbeat from core client for 30 sec - exiting (1594): No heartbeat from core client for 30 sec - exiting (1594): No heartbeat from core client for 30 sec - exiting (1594): No heartbeat from core client for 30 sec - exiting (1594): No heartbeat from core client for 30 sec - exiting (1594): No heartbeat from core client for 30 sec - exiting (1594): No heartbeat from core client for 30 sec - exiting (1594): No heartbeat from core client for 30 sec - exiting (1594): No heartbeat from core client for 30 sec - exiting (1594): No heartbeat from core client for 30 sec - exiting (1594): No heartbeat from core client for 30 sec - exiting (2844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3442): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4122): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Stack trace (14 frames): /home/juerschen/BOINC/projects/climateprediction.net/hadam3p_saf_um_6.06_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x836249c] [0xf0fb4400] /home/juerschen/BOINC/projects/climateprediction.net/hadam3p_saf_um_6.06_i686-pc-linux-gnu[0x81351ee] /home/juerschen/BOINC/projects/climateprediction.net/hadam3p_saf_um_6.06_i686-pc-linux-gnu[0x813b38c] /home/juerschen/BOINC/projects/climateprediction.net/hadam3p_saf_um_6.06_i686-pc-linux-gnu[0x8130d28] /home/juerschen/BOINC/projects/climateprediction.net/hadam3p_saf_um_6.06_i686-pc-linux-gnu[0x813cb2b] /home/juerschen/BOINC/projects/climateprediction.net/hadam3p_saf_um_6.06_i686-pc-linux-gnu[0x8133041] /home/juerschen/BOINC/projects/climateprediction.net/hadam3p_saf_um_6.06_i686-pc-linux-gnu[0x8078164] /home/juerschen/BOINC/projects/climateprediction.net/hadam3p_saf_um_6.06_i686-pc-linux-gnu[0x82d7263] /home/juerschen/BOINC/projects/climateprediction.net/hadam3p_saf_um_6.06_i686-pc-linux-gnu[0x82f7b3b] /home/juerschen/BOINC/projects/climateprediction.net/hadam3p_saf_um_6.06_i686-pc-linux-gnu[0x82f1a7f] /home/juerschen/BOINC/projects/climateprediction.net/hadam3p_saf_um_6.06_i686-pc-linux-gnu[0x82f9572] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf0e08bd6] /home/juerschen/BOINC/projects/climateprediction.net/hadam3p_saf_um_6.06_i686-pc-linux-gnu[0x804c631] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6007, selfPID=5991, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... (5991): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_saf_v8gi_1978_1_006722645_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_v8gi_1978_1_006722645_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_v8gi_1978_1_006722645_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_v8gi_1978_1_006722645_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_v8gi_1978_1_006722645_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_v8gi_1978_1_006722645_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Sep 2010 10:42:08	1066791	11871691	hadam3p_saf_v8gi_1978_1_006722645_0	69,216	205,220	2.9649
11 Sep 2010 21:04:53	1066791	11871691	hadam3p_saf_v8gi_1978_1_006722645_0	57,696	171,457	2.9717
11 Sep 2010 10:13:54	1066791	11871691	hadam3p_saf_v8gi_1978_1_006722645_0	46,176	137,714	2.9824
11 Sep 2010 00:25:47	1066791	11871691	hadam3p_saf_v8gi_1978_1_006722645_0	34,656	103,652	2.9909
10 Sep 2010 14:07:24	1066791	11871691	hadam3p_saf_v8gi_1978_1_006722645_0	23,138	69,377	2.9984
10 Sep 2010 13:51:41	1066791	11871691	hadam3p_saf_v8gi_1978_1_006722645_0	23,136	68,858	2.9762
09 Sep 2010 14:02:14	1066791	11871691	hadam3p_saf_v8gi_1978_1_006722645_0	11,616	34,829	2.9984