Task 16043241

Name	hadcm3n_odg1_1900_40_008472548_0
Workunit	8623387
Created	27 Sep 2013, 10:14:13 UTC
Sent	29 Sep 2013, 21:37:31 UTC
Report deadline	30 Dec 2013, 5:04:42 UTC
Received	24 Nov 2013, 21:15:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	3 (0x00000003) Unknown error code
Computer ID	1276667
Run time	7 days 16 hours 57 min 27 sec
CPU time	7 days 11 hours 51 min 14 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.12 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.31</core_client_version> <![CDATA[ <message> The system cannot find the path specified. (0x3) - exit code 3 (0x3) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9068, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/odg1ko.pja7c10 Error converting file to netcdf: dataout/odg1ko.pia7c10 Error converting file to netcdf: dataout/odg1ko.pfa7c10 Error converting file to netcdf: dataout/odg1ka.pha7c10 Error converting file to netcdf: dataout/odg1ka.pga7c10 Error converting file to netcdf: dataout/odg1ka.pea7c10 Error converting file to netcdf: dataout/odg1ka.pda7c10 CPDN Monitor - Quit request from BOINC... 00:23:12 (15240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:24:25 (12024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:24:27 (12024): No heartbeat from core client for 30 sec - exiting 00:25:27 (16136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:26:20 (8256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:19 (14892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:28:43 (6184): No heartbeat from core client for 30 sec - exiting 14:28:44 (6184): No heartbeat from core client for 30 sec - exiting 14:28:45 (6184): No heartbeat from core client for 30 sec - exiting 14:28:46 (6184): No heartbeat from core client for 30 sec - exiting 14:28:47 (6184): No heartbeat from core client for 30 sec - exiting 14:28:48 (6184): No heartbeat from core client for 30 sec - exiting 14:28:49 (6184): No heartbeat from core client for 30 sec - exiting 14:28:50 (6184): No heartbeat from core client for 30 sec - exiting 14:28:51 (6184): No heartbeat from core client for 30 sec - exiting 14:28:52 (6184): No heartbeat from core client for 30 sec - exiting 14:28:53 (6184): No heartbeat from core client for 30 sec - exiting 14:28:54 (6184): No heartbeat from core client for 30 sec - exiting 14:28:55 (6184): No heartbeat from core client for 30 sec - exiting 14:28:56 (6184): No heartbeat from core client for 30 sec - exiting 14:28:57 (6184): No heartbeat from core client for 30 sec - exiting 14:28:58 (6184): No heartbeat from core client for 30 sec - exiting 14:28:59 (6184): No heartbeat from core client for 30 sec - exiting 14:29:00 (6184): No heartbeat from core client for 30 sec - exiting 14:29:01 (6184): No heartbeat from core client for 30 sec - exiting 14:29:02 (6184): No heartbeat from core client for 30 sec - exiting 14:29:03 (6184): No heartbeat from core client for 30 sec - exiting 14:29:04 (6184): No heartbeat from core client for 30 sec - exiting 14:29:05 (6184): No heartbeat from core client for 30 sec - exiting 14:29:06 (6184): No heartbeat from core client for 30 sec - exiting 14:29:07 (6184): No heartbeat from core client for 30 sec - exiting 14:29:08 (6184): No heartbeat from core client for 30 sec - exiting 14:29:09 (6184): No heartbeat from core client for 30 sec - exiting 14:29:10 (6184): No heartbeat from core client for 30 sec - exiting 14:29:11 (6184): No heartbeat from core client for 30 sec - exiting 14:29:12 (6184): No heartbeat from core client for 30 sec - exiting 14:29:13 (6184): No heartbeat from core client for 30 sec - exiting 14:29:14 (6184): No heartbeat from core client for 30 sec - exiting 14:29:15 (6184): No heartbeat from core client for 30 sec - exiting 14:29:16 (6184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:31:05 (6468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:34:50 (1144): No heartbeat from core client for 30 sec - exiting 20:34:51 (1144): No heartbeat from core client for 30 sec - exiting 20:34:53 (1144): No heartbeat from core client for 30 sec - exiting 20:34:54 (1144): No heartbeat from core client for 30 sec - exiting 20:34:55 (1144): No heartbeat from core client for 30 sec - exiting 20:34:56 (1144): No heartbeat from core client for 30 sec - exiting 20:34:57 (1144): No heartbeat from core client for 30 sec - exiting 20:34:58 (1144): No heartbeat from core client for 30 sec - exiting 20:34:59 (1144): No heartbeat from core client for 30 sec - exiting 20:35:00 (1144): No heartbeat from core client for 30 sec - exiting 20:35:01 (1144): No heartbeat from core client for 30 sec - exiting 20:35:02 (1144): No heartbeat from core client for 30 sec - exiting 20:35:04 (1144): No heartbeat from core client for 30 sec - exiting 20:35:05 (1144): No heartbeat from core client for 30 sec - exiting 20:35:06 (1144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:07 (1144): No heartbeat from core client for 30 sec - exiting 20:38:02 (7000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:17:53 (5872): No heartbeat from core client for 30 sec - exiting 22:17:54 (5872): No heartbeat from core client for 30 sec - exiting 22:17:55 (5872): No heartbeat from core client for 30 sec - exiting 22:17:56 (5872): No heartbeat from core client for 30 sec - exiting 22:17:57 (5872): No heartbeat from core client for 30 sec - exiting 22:17:58 (5872): No heartbeat from core client for 30 sec - exiting 22:17:59 (5872): No heartbeat from core client for 30 sec - exiting 22:18:00 (5872): No heartbeat from core client for 30 sec - exiting 22:18:01 (5872): No heartbeat from core client for 30 sec - exiting 22:18:02 (5872): No heartbeat from core client for 30 sec - exiting 22:18:04 (5872): No heartbeat from core client for 30 sec - exiting 22:18:05 (5872): No heartbeat from core client for 30 sec - exiting 22:18:06 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5328, iMonCtr=1 Model crash detected, will try to restart... 22:32:29 (5328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:06:38 (8604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:09:20 (12036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Nov 2013 13:37:43	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	518,400	619,783	1.1956
24 Nov 2013 03:35:32	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	492,480	590,761	1.1996
04 Nov 2013 16:20:02	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	466,560	558,080	1.1962
04 Nov 2013 06:28:34	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	440,640	528,757	1.2000
29 Oct 2013 22:04:58	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	414,720	496,799	1.1979
29 Oct 2013 10:18:41	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	388,800	464,856	1.1956
28 Oct 2013 19:10:39	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	362,880	432,607	1.1921
27 Oct 2013 23:24:55	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	336,960	402,107	1.1933
24 Oct 2013 15:31:35	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	311,040	372,089	1.1963
24 Oct 2013 05:17:23	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	285,120	342,150	1.2000
19 Oct 2013 23:14:45	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	259,200	312,062	1.2039
19 Oct 2013 07:24:59	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	233,280	280,448	1.2022
10 Oct 2013 22:39:38	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	207,360	249,378	1.2026
10 Oct 2013 13:45:51	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	181,440	218,182	1.2025
09 Oct 2013 06:51:39	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	155,520	186,934	1.2020
08 Oct 2013 17:29:52	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	129,600	155,471	1.1996
08 Oct 2013 04:21:21	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	103,680	124,286	1.1987
05 Oct 2013 00:15:12	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	77,760	92,896	1.1947
01 Oct 2013 02:38:01	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	51,840	61,670	1.1896
30 Sep 2013 18:08:24	1276667	16043241	hadcm3n_odg1_1900_40_008472548_0	25,920	30,920	1.1929