Task 13538743

Name	hadcm3n_ygwa_1900_40_007516533_1
Workunit	7714008
Created	28 Oct 2011, 12:47:42 UTC
Sent	22 Nov 2011, 21:29:11 UTC
Report deadline	22 Feb 2012, 4:56:22 UTC
Received	25 Dec 2011, 8:57:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1166325
Run time	11 days 12 hours 3 min 23 sec
CPU time	10 days 21 hours 34 min 10 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.16 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ygwako.pja5c10 Error converting file to netcdf: dataout/ygwako.pia5c10 Error converting file to netcdf: dataout/ygwako.pfa5c10 Error converting file to netcdf: dataout/ygwaka.pha5c10 Error converting file to netcdf: dataout/ygwaka.pga5c10 Error converting file to netcdf: dataout/ygwaka.pea5c10 Error converting file to netcdf: dataout/ygwaka.pda5c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1272, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2032, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4820, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1916, iMonCtr=1 Model crash detected, will try to restart... 15:43:56 (2692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2192, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5984, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2248, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77293A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_ygwa_1900_40_007516533/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Dec 2011 10:55:22	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	518,400	941,645	1.8164
21 Dec 2011 19:58:48	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	492,480	893,867	1.8150
19 Dec 2011 19:27:38	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	466,560	847,140	1.8157
18 Dec 2011 09:02:33	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	440,640	799,950	1.8154
16 Dec 2011 12:47:55	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	414,720	751,494	1.8121
14 Dec 2011 17:10:30	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	388,800	704,330	1.8115
13 Dec 2011 09:51:50	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	362,880	657,196	1.8111
11 Dec 2011 19:39:05	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	336,960	609,035	1.8074
10 Dec 2011 17:43:13	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	311,040	562,461	1.8083
09 Dec 2011 13:53:54	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	285,120	514,573	1.8048
08 Dec 2011 12:19:05	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	259,200	468,322	1.8068
05 Dec 2011 19:14:24	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	233,280	421,980	1.8089
03 Dec 2011 19:25:48	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	207,360	375,662	1.8116
02 Dec 2011 13:03:09	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	181,440	329,158	1.8141
30 Nov 2011 19:40:24	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	155,520	283,498	1.8229
30 Nov 2011 06:35:48	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	129,600	237,649	1.8337
28 Nov 2011 14:42:12	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	103,680	189,784	1.8305
26 Nov 2011 18:27:13	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	77,760	142,906	1.8378
25 Nov 2011 15:12:36	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	51,840	96,189	1.8555
24 Nov 2011 11:02:14	1166325	13538743	hadcm3n_ygwa_1900_40_007516533_1	25,920	48,351	1.8654