Task 20233030

Name	hadcm3s_76vb_200012_168_514_010915560_1
Workunit	10915560
Created	8 Feb 2017, 7:12:27 UTC
Sent	11 Feb 2017, 21:55:27 UTC
Report deadline	25 Jan 2018, 3:15:27 UTC
Received	24 Feb 2017, 10:06:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1398152
Run time	4 days 14 hours 20 min 53 sec
CPU time	4 days 7 hours 41 min 40 sec
Validate state	Invalid
Credit	4,355.42
Device peak FLOPS	3.13 GFLOPS
Application version	UK Met Office HadCM3 short v8.29 windows_intelx86
Peak working set size	164.93 MB
Peak swap size	192.65 MB
Peak disk usage	51.64 MB
Stderr	<core_client_version>7.6.33</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 21:08:53 (4084): Can't acquire lockfile (32) - waiting 35s 21:09:28 (4084): Can't acquire lockfile (32) - exiting 21:09:28 (4084): Error: The process cannot access the file because it is being used by another process. (0x20) BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 23:00:01 (7736): Can't set up shared mem: -1. Will run in standalone mode. Signal 11 received: Segment violation Signal 11 received: Software termination signal from kill Signal 11 received: Abnormal termination triggered by abort call Signal 11 received, exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7988, iMonCtr=1 Model crash detected, will try to restart... 23:00:16 (3436): Can't set up shared mem: -1. Will run in standalone mode. Signal 11 received: Segment violation Signal 11 received: Software termination signal from kill Signal 11 received: Abnormal termination triggered by abort call Signal 11 received, exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7988, iMonCtr=1 Model crash detected, will try to restart... 23:00:22 (7988): No heartbeat from client for 30 sec - exiting 23:00:22 (7988): timer handler: client dead, exiting 23:00:22 (956): Can't set up shared mem: -1. Will run in standalone mode. Signal 11 received: Segment violation Signal 11 received: Software termination signal from kill Signal 11 received: Abnormal termination triggered by abort call Signal 11 received, exiting... CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... cpdnmonitor: error reading file dataout/ocean_restart.day Model crashed: TEMPHIST: Write ERROR on history file for namelistNLIHISTO tmp/pipe_dummy Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 04:13:00 (2928): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8244, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 04:13:05 (8480): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8244, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 04:13:08 (8760): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8244, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 04:13:14 (5884): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8244, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 04:13:20 (8876): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8244, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 04:13:24 (8244): called boinc_finish(22) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Feb 2017 13:15:29	1398152	20233030	hadcm3s_76vb_200012_168_514_010915560_1	362,952	64,612	0.1780