Task 15280927

Name	hadcm3n_zm4h_1880_40_008200976_1
Workunit	8356100
Created	13 Sep 2012, 10:20:33 UTC
Sent	13 Sep 2012, 11:02:00 UTC
Report deadline	13 Dec 2012, 18:29:11 UTC
Received	27 Sep 2012, 6:43:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1212245
Run time	9 days 12 hours 53 min 22 sec
CPU time	8 days 20 hours 10 min 47 sec
Validate state	Invalid
Credit	4,976.64
Device peak FLOPS	1.08 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 09:43:00 (5856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:43:01 (5856): No heartbeat from core client for 30 sec - exiting 09:43:02 (5856): No heartbeat from core client for 30 sec - exiting 09:43:03 (5856): No heartbeat from core client for 30 sec - exiting 09:43:04 (5856): No heartbeat from core client for 30 sec - exiting 09:43:05 (5856): No heartbeat from core client for 30 sec - exiting 09:43:06 (5856): No heartbeat from core client for 30 sec - exiting 09:43:07 (5856): No heartbeat from core client for 30 sec - exiting 09:43:09 (5856): No heartbeat from core client for 30 sec - exiting 09:43:10 (5856): No heartbeat from core client for 30 sec - exiting 09:43:11 (5856): No heartbeat from core client for 30 sec - exiting 09:43:12 (5856): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 19:44:58 (5968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6040, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:20:43 (5968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:21:04 (5968): No heartbeat from core client for 30 sec - exiting 09:21:05 (5968): No heartbeat from core client for 30 sec - exiting 09:21:06 (5968): No heartbeat from core client for 30 sec - exiting 09:21:07 (5968): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5456, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Sep 2012 12:04:21	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	414,720	753,219	1.8162
25 Sep 2012 07:17:39	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	388,800	693,673	1.7841
23 Sep 2012 15:27:42	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	362,880	637,558	1.7569
23 Sep 2012 01:04:27	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	336,960	586,308	1.7400
22 Sep 2012 10:13:14	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	311,040	535,075	1.7203
21 Sep 2012 16:14:39	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	285,120	483,639	1.6963
19 Sep 2012 06:22:32	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	259,200	431,451	1.6645
18 Sep 2012 14:56:49	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	233,280	378,798	1.6238
18 Sep 2012 05:34:46	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	207,360	325,671	1.5706
17 Sep 2012 05:29:30	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	181,440	276,466	1.5237
17 Sep 2012 05:29:30	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	155,520	244,986	1.5753
17 Sep 2012 05:29:30	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	129,600	211,969	1.6356
17 Sep 2012 05:29:30	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	103,680	180,328	1.7393
17 Sep 2012 05:29:30	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	77,760	149,404	1.9213
17 Sep 2012 05:29:30	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	51,840	105,993	2.0446
14 Sep 2012 06:31:55	1212245	15280927	hadcm3n_zm4h_1880_40_008200976_1	25,920	52,020	2.0069