Task 16065476

Name	hadcm3n_oasj_1900_40_008469110_1
Workunit	8619949
Created	11 Oct 2013, 8:56:09 UTC
Sent	11 Oct 2013, 8:57:25 UTC
Report deadline	10 Jan 2014, 16:24:36 UTC
Received	17 Oct 2013, 4:12:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1191516
Run time	2 days 19 hours 39 min 18 sec
CPU time	2 days 16 hours 2 min 12 sec
Validate state	Invalid
Credit	1,555.20
Device peak FLOPS	3.08 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:20:37 (5264): No heartbeat from core client for 30 sec - exiting 11:20:38 (5264): No heartbeat from core client for 30 sec - exiting 11:20:40 (5264): No heartbeat from core client for 30 sec - exiting 11:20:41 (5264): No heartbeat from core client for 30 sec - exiting 11:20:42 (5264): No heartbeat from core client for 30 sec - exiting 11:20:43 (5264): No heartbeat from core client for 30 sec - exiting 11:20:44 (5264): No heartbeat from core client for 30 sec - exiting 11:20:45 (5264): No heartbeat from core client for 30 sec - exiting 11:20:46 (5264): No heartbeat from core client for 30 sec - exiting 11:20:47 (5264): No heartbeat from core client for 30 sec - exiting 11:20:48 (5264): No heartbeat from core client for 30 sec - exiting 11:20:49 (5264): No heartbeat from core client for 30 sec - exiting 11:20:51 (5264): No heartbeat from core client for 30 sec - exiting 11:20:52 (5264): No heartbeat from core client for 30 sec - exiting 11:20:53 (5264): No heartbeat from core client for 30 sec - exiting 11:20:54 (5264): No heartbeat from core client for 30 sec - exiting 11:20:55 (5264): No heartbeat from core client for 30 sec - exiting 11:20:56 (5264): No heartbeat from core client for 30 sec - exiting 11:20:57 (5264): No heartbeat from core client for 30 sec - exiting 11:20:58 (5264): No heartbeat from core client for 30 sec - exiting 11:20:59 (5264): No heartbeat from core client for 30 sec - exiting 11:21:00 (5264): No heartbeat from core client for 30 sec - exiting 11:21:01 (5264): No heartbeat from core client for 30 sec - exiting 11:21:03 (5264): No heartbeat from core client for 30 sec - exiting 11:21:04 (5264): No heartbeat from core client for 30 sec - exiting 11:21:05 (5264): No heartbeat from core client for 30 sec - exiting 11:21:06 (5264): No heartbeat from core client for 30 sec - exiting 11:21:07 (5264): No heartbeat from core client for 30 sec - exiting 11:21:08 (5264): No heartbeat from core client for 30 sec - exiting 11:21:09 (5264): No heartbeat from core client for 30 sec - exiting 11:21:10 (5264): No heartbeat from core client for 30 sec - exiting 11:21:11 (5264): No heartbeat from core client for 30 sec - exiting 11:21:12 (5264): No heartbeat from core client for 30 sec - exiting 11:21:13 (5264): No heartbeat from core client for 30 sec - exiting 11:21:15 (5264): No heartbeat from core client for 30 sec - exiting 11:21:16 (5264): No heartbeat from core client for 30 sec - exiting 11:21:17 (5264): No heartbeat from core client for 30 sec - exiting 11:21:18 (5264): No heartbeat from core client for 30 sec - exiting 11:21:19 (5264): No heartbeat from core client for 30 sec - exiting 11:21:20 (5264): No heartbeat from core client for 30 sec - exiting 11:21:21 (5264): No heartbeat from core client for 30 sec - exiting 11:21:22 (5264): No heartbeat from core client for 30 sec - exiting 11:21:23 (5264): No heartbeat from core client for 30 sec - exiting 11:21:24 (5264): No heartbeat from core client for 30 sec - exiting 11:21:25 (5264): No heartbeat from core client for 30 sec - exiting 11:21:27 (5264): No heartbeat from core client for 30 sec - exiting 11:21:28 (5264): No heartbeat from core client for 30 sec - exiting 11:21:29 (5264): No heartbeat from core client for 30 sec - exiting 11:21:30 (5264): No heartbeat from core client for 30 sec - exiting 11:21:31 (5264): No heartbeat from core client for 30 sec - exiting 11:21:32 (5264): No heartbeat from core client for 30 sec - exiting 11:21:33 (5264): No heartbeat from core client for 30 sec - exiting 11:21:34 (5264): No heartbeat from core client for 30 sec - exiting 11:21:35 (5264): No heartbeat from core client for 30 sec - exiting 11:21:36 (5264): No heartbeat from core client for 30 sec - exiting 11:21:37 (5264): No heartbeat from core client for 30 sec - exiting 11:21:39 (5264): No heartbeat from core client for 30 sec - exiting 11:21:40 (5264): No heartbeat from core client for 30 sec - exiting 11:21:41 (5264): No heartbeat from core client for 30 sec - exiting 11:21:42 (5264): No heartbeat from core client for 30 sec - exiting 11:21:43 (5264): No heartbeat from core client for 30 sec - exiting 11:21:44 (5264): No heartbeat from core client for 30 sec - exiting 11:21:45 (5264): No heartbeat from core client for 30 sec - exiting 11:21:46 (5264): No heartbeat from core client for 30 sec - exiting 11:21:47 (5264): No heartbeat from core client for 30 sec - exiting 11:21:48 (5264): No heartbeat from core client for 30 sec - exiting 11:21:49 (5264): No heartbeat from core client for 30 sec - exiting 11:21:51 (5264): No heartbeat from core client for 30 sec - exiting 11:21:52 (5264): No heartbeat from core client for 30 sec - exiting 11:21:53 (5264): No heartbeat from core client for 30 sec - exiting 11:21:54 (5264): No heartbeat from core client for 30 sec - exiting 11:21:55 (5264): No heartbeat from core client for 30 sec - exiting 11:21:56 (5264): No heartbeat from core client for 30 sec - exiting 11:21:57 (5264): No heartbeat from core client for 30 sec - exiting 11:21:58 (5264): No heartbeat from core client for 30 sec - exiting 11:21:59 (5264): No heartbeat from core client for 30 sec - exiting 11:22:00 (5264): No heartbeat from core client for 30 sec - exiting 11:22:01 (5264): No heartbeat from core client for 30 sec - exiting 11:22:03 (5264): No heartbeat from core client for 30 sec - exiting 11:22:04 (5264): No heartbeat from core client for 30 sec - exiting 11:22:05 (5264): No heartbeat from core client for 30 sec - exiting 11:22:06 (5264): No heartbeat from core client for 30 sec - exiting 11:22:07 (5264): No heartbeat from core client for 30 sec - exiting 11:22:08 (5264): No heartbeat from core client for 30 sec - exiting 11:22:09 (5264): No heartbeat from core client for 30 sec - exiting 11:22:10 (5264): No heartbeat from core client for 30 sec - exiting 11:22:11 (5264): No heartbeat from core client for 30 sec - exiting 11:22:12 (5264): No heartbeat from core client for 30 sec - exiting 11:22:13 (5264): No heartbeat from core client for 30 sec - exiting 11:22:15 (5264): No heartbeat from core client for 30 sec - exiting 11:22:16 (5264): No heartbeat from core client for 30 sec - exiting 11:22:17 (5264): No heartbeat from core client for 30 sec - exiting 11:22:18 (5264): No heartbeat from core client for 30 sec - exiting 11:22:19 (5264): No heartbeat from core client for 30 sec - exiting 11:22:20 (5264): No heartbeat from core client for 30 sec - exiting 11:22:21 (5264): No heartbeat from core client for 30 sec - exiting 11:22:22 (5264): No heartbeat from core client for 30 sec - exiting 11:22:23 (5264): No heartbeat from core client for 30 sec - exiting 11:22:24 (5264): No heartbeat from core client for 30 sec - exiting 11:22:26 (5264): No heartbeat from core client for 30 sec - exiting 11:22:27 (5264): No heartbeat from core client for 30 sec - exiting 11:22:28 (5264): No heartbeat from core client for 30 sec - exiting 11:22:29 (5264): No heartbeat from core client for 30 sec - exiting 11:22:30 (5264): No heartbeat from core client for 30 sec - exiting 11:22:31 (5264): No heartbeat from core client for 30 sec - exiting 11:22:32 (5264): No heartbeat from core client for 30 sec - exiting 11:22:33 (5264): No heartbeat from core client for 30 sec - exiting 11:22:34 (5264): No heartbeat from core client for 30 sec - exiting 11:22:35 (5264): No heartbeat from core client for 30 sec - exiting 11:22:36 (5264): No heartbeat from core client for 30 sec - exiting 11:22:38 (5264): No heartbeat from core client for 30 sec - exiting 11:22:39 (5264): No heartbeat from core client for 30 sec - exiting 11:22:40 (5264): No heartbeat from core client for 30 sec - exiting 11:22:41 (5264): No heartbeat from core client for 30 sec - exiting 11:22:42 (5264): No heartbeat from core client for 30 sec - exiting 11:22:43 (5264): No heartbeat from core client for 30 sec - exiting 11:22:44 (5264): No heartbeat from core client for 30 sec - exiting 11:22:45 (5264): No heartbeat from core client for 30 sec - exiting 11:22:46 (5264): No heartbeat from core client for 30 sec - exiting 11:22:47 (5264): No heartbeat from core client for 30 sec - exiting 11:22:48 (5264): No heartbeat from core client for 30 sec - exiting 11:22:50 (5264): No heartbeat from core client for 30 sec - exiting 11:22:51 (5264): No heartbeat from core client for 30 sec - exiting 11:22:52 (5264): No heartbeat from core client for 30 sec - exiting 11:22:53 (5264): No heartbeat from core client for 30 sec - exiting 11:22:54 (5264): No heartbeat from core client for 30 sec - exiting 11:22:55 (5264): No heartbeat from core client for 30 sec - exiting 11:22:56 (5264): No heartbeat from core client for 30 sec - exiting 11:22:57 (5264): No heartbeat from core client for 30 sec - exiting 11:22:58 (5264): No heartbeat from core client for 30 sec - exiting 11:22:59 (5264): No heartbeat from core client for 30 sec - exiting 11:23:00 (5264): No heartbeat from core client for 30 sec - exiting 11:23:02 (5264): No heartbeat from core client for 30 sec - exiting 11:23:03 (5264): No heartbeat from core client for 30 sec - exiting 11:23:04 (5264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 CPDN Monitor - Quit request from BOINC... SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Oct 2013 23:55:15	1191516	16065476	hadcm3n_oasj_1900_40_008469110_1	129,600	182,207	1.4059
15 Oct 2013 08:35:49	1191516	16065476	hadcm3n_oasj_1900_40_008469110_1	103,680	146,132	1.4095
14 Oct 2013 20:38:27	1191516	16065476	hadcm3n_oasj_1900_40_008469110_1	77,760	109,836	1.4125
14 Oct 2013 09:12:10	1191516	16065476	hadcm3n_oasj_1900_40_008469110_1	51,840	73,867	1.4249
12 Oct 2013 17:07:05	1191516	16065476	hadcm3n_oasj_1900_40_008469110_1	25,920	36,710	1.4163