Task 15722051

Name	hadcm3n_481y_1940_40_008310477_3
Workunit	8461612
Created	12 Apr 2013, 1:17:37 UTC
Sent	12 Apr 2013, 1:18:04 UTC
Report deadline	12 Jul 2013, 8:45:15 UTC
Received	21 Oct 2013, 0:23:28 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1207031
Run time	6 days 14 hours 25 min 13 sec
CPU time	5 days 18 hours 59 min 16 sec
Validate state	Invalid
Credit	4,354.56
Device peak FLOPS	2.92 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 62 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/481yko.pjf0c10 is not a valid UM file. Error converting file to netcdf: dataout/481yko.pjf0c10 Error: Input file: dataout/481yko.pif0c10 is not a valid UM file. Error converting file to netcdf: dataout/481yko.pif0c10 Error: Input file: dataout/481yko.pff0c10 is not a valid UM file. Error converting file to netcdf: dataout/481yko.pff0c10 Error: Input file: dataout/481yko.pcf0c10 is not a valid UM file. Error converting file to netcdf: dataout/481yko.pcf0c10 Error: Input file: dataout/481yko.pbf0c10 is not a valid UM file. Error converting file to netcdf: dataout/481yko.pbf0c10 Error: Input file: dataout/481yko.paf0c10 is not a valid UM file. Error converting file to netcdf: dataout/481yko.paf0c10 Error: Input file: dataout/481yka.phf0c10 is not a valid UM file. Error converting file to netcdf: dataout/481yka.phf0c10 Error: Input file: dataout/481yka.pgf0c10 is not a valid UM file. Error converting file to netcdf: dataout/481yka.pgf0c10 Error: Input file: dataout/481yka.pef0c10 is not a valid UM file. Error converting file to netcdf: dataout/481yka.pef0c10 Error: Input file: dataout/481yka.pdf0c10 is not a valid UM file. Error converting file to netcdf: dataout/481yka.pdf0c10 hadcm3n_6.07_i686-apple-darwin(5650,0xad18f2c0) malloc: * error for object 0x3aa3604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5650,0xad18f2c0) malloc: * error for object 0x3aa3600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5650,0xad18f2c0) malloc: * error for object 0x3aa4404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5650,0xad18f2c0) malloc: * error for object 0x3aa4400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5650,0xad18f2c0) malloc: * error for object 0x3aa4404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5650,0xad18f2c0) malloc: * error for object 0x3aa4400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5650,0xad18f2c0) malloc: * error for object 0x3aa4404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5650,0xad18f2c0) malloc: * error for object 0x3aa4400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(5650,0xad18f2c0) malloc: * error for object 0x3aa4400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(6547,0xad18f2c0) malloc: * error for object 0x199ec04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(6547,0xad18f2c0) malloc: * error for object 0x199ec00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:08:24 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:26 (3276): No heartbeat from core client for 30 sec - exiting 12:08:27 (3276): No heartbeat from core client for 30 sec - exiting 12:08:28 (3276): No heartbeat from core client for 30 sec - exiting 12:08:29 (3276): No heartbeat from core client for 30 sec - exiting 12:08:30 (3276): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation 12:19:47 (3478): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:48 (3478): No heartbeat from core client for 30 sec - exiting 12:19:49 (3478): No heartbeat from core client for 30 sec - exiting 12:19:50 (3478): No heartbeat from core client for 30 sec - exiting 12:19:51 (3478): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 12:45:52 (4163): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:45:55 (4163): No heartbeat from core client for 30 sec - exiting 12:45:56 (4163): No heartbeat from core client for 30 sec - exiting 12:45:57 (4163): No heartbeat from core client for 30 sec - exiting 12:45:58 (4163): No heartbeat from core client for 30 sec - exiting 12:45:59 (4163): No heartbeat from core client for 30 sec - exiting 12:46:00 (4163): No heartbeat from core client for 30 sec - exiting 12:46:01 (4163): No heartbeat from core client for 30 sec - exiting 12:46:02 (4163): No heartbeat from core client for 30 sec - exiting 12:46:03 (4163): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:27:51 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:28:05 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:28:56 (11718): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:43:43 (11739): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:43:44 (11739): No heartbeat from core client for 30 sec - exiting 00:43:45 (11739): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation CPDN Monitor - Quit request from BOINC... 01:01:41 (12288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:17:31 (12371): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:22:17 (12698): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:37:43 (12780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:55:05 (13062): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:36:50 (13349): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 03:06:13 (14047): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:19 (14512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:27 (14512): No heartbeat from core client for 30 sec - exiting 03:42:13 (14889): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:42:15 (14889): No heartbeat from core client for 30 sec - exiting 03:58:43 (15216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/0/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Apr 2013 01:48:56	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	362,880	493,040	1.3587
26 Apr 2013 09:48:16	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	336,960	446,693	1.3257
25 Apr 2013 21:38:52	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	311,040	404,892	1.3017
24 Apr 2013 07:34:39	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	285,120	362,555	1.2716
22 Apr 2013 19:52:28	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	259,200	319,784	1.2337
22 Apr 2013 16:51:26	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	233,280	290,075	1.2435
22 Apr 2013 16:51:26	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	207,360	260,261	1.2551
22 Apr 2013 16:51:26	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	181,440	230,125	1.2683
19 Apr 2013 19:42:51	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	155,520	192,030	1.2348
19 Apr 2013 19:42:51	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	129,600	163,472	1.2614
19 Apr 2013 19:42:51	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	103,680	135,004	1.3021
19 Apr 2013 19:42:51	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	77,760	106,026	1.3635
19 Apr 2013 19:42:51	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	51,840	75,767	1.4616
19 Apr 2013 19:42:51	1207031	15722051	hadcm3n_481y_1940_40_008310477_3	25,920	43,163	1.6652