Task 15979950

Name	hadcm3n_7r5o_1980_40_008446479_0
Workunit	8597335
Created	30 Aug 2013, 12:57:03 UTC
Sent	30 Aug 2013, 13:00:33 UTC
Report deadline	29 Nov 2013, 20:27:44 UTC
Received	23 Sep 2013, 9:38:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1286606
Run time	17 days 5 hours 31 min
CPU time	16 days 16 hours 12 min 3 sec
Validate state	Invalid
Credit	11,819.52
Device peak FLOPS	3.61 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:20:32 (5392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5472, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Sep 2013 00:37:57	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	984,960	1,430,753	1.4526
21 Sep 2013 11:31:09	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	959,040	1,386,211	1.4454
20 Sep 2013 23:17:38	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	933,120	1,343,640	1.4399
20 Sep 2013 12:10:29	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	907,200	1,304,794	1.4383
20 Sep 2013 00:56:28	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	881,280	1,265,338	1.4358
19 Sep 2013 12:58:35	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	855,360	1,223,222	1.4301
19 Sep 2013 01:10:27	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	829,440	1,182,192	1.4253
18 Sep 2013 12:29:55	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	803,520	1,138,837	1.4173
18 Sep 2013 01:17:50	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	777,600	1,100,688	1.4155
18 Sep 2013 01:17:50	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	777,600	1,100,688	1.4155
17 Sep 2013 13:47:15	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	751,680	1,061,610	1.4123
17 Sep 2013 01:41:03	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	725,760	1,027,126	1.4152
16 Sep 2013 08:31:46	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	699,840	985,576	1.4083
15 Sep 2013 21:17:38	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	673,920	952,927	1.4140
15 Sep 2013 06:53:23	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	648,000	920,781	1.4210
14 Sep 2013 07:32:33	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	622,080	884,541	1.4219
13 Sep 2013 21:08:52	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	596,160	851,778	1.4288
13 Sep 2013 06:25:29	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	570,240	818,060	1.4346
12 Sep 2013 09:59:48	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	544,320	784,744	1.4417
11 Sep 2013 16:38:04	1286606	15979950	hadcm3n_7r5o_1980_40_008446479_0	518,400	750,891	1.4485