Task 13113039

Name	hadcm3n_ygri_1900_40_007354584_1
Workunit	7552014
Created	6 Jul 2011, 14:34:38 UTC
Sent	11 Jul 2011, 0:56:01 UTC
Report deadline	10 Oct 2011, 8:23:12 UTC
Received	2 Jan 2012, 14:07:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1106858
Run time	33 days 8 hours 57 min 8 sec
CPU time	30 days 10 hours 44 min 48 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:52:16 (3540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:07:59 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:00 (3688): No heartbeat from core client for 30 sec - exiting 16:08:01 (3688): No heartbeat from core client for 30 sec - exiting 16:08:02 (3688): No heartbeat from core client for 30 sec - exiting 16:08:03 (3688): No heartbeat from core client for 30 sec - exiting 16:08:04 (3688): No heartbeat from core client for 30 sec - exiting 16:08:05 (3688): No heartbeat from core client for 30 sec - exiting 16:08:06 (3688): No heartbeat from core client for 30 sec - exiting 16:08:07 (3688): No heartbeat from core client for 30 sec - exiting 16:08:08 (3688): No heartbeat from core client for 30 sec - exiting 16:08:09 (3688): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2668, iMonCtr=1 Model crash detected, will try to restart... 20:33:28 (376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3608, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2196, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2612, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1096, iMonCtr=1 Model crash detected, will try to restart... 14:27:17 (2896): No heartbeat from core client for 30 sec - exiting 14:27:18 (2896): No heartbeat from core client for 30 sec - exiting 14:27:19 (2896): No heartbeat from core client for 30 sec - exiting 14:27:20 (2896): No heartbeat from core client for 30 sec - exiting 14:27:21 (2896): No heartbeat from core client for 30 sec - exiting 14:27:22 (2896): No heartbeat from core client for 30 sec - exiting 14:27:24 (2896): No heartbeat from core client for 30 sec - exiting 14:27:25 (2896): No heartbeat from core client for 30 sec - exiting 14:27:26 (2896): No heartbeat from core client for 30 sec - exiting 14:27:27 (2896): No heartbeat from core client for 30 sec - exiting 14:27:28 (2896): No heartbeat from core client for 30 sec - exiting 14:27:29 (2896): No heartbeat from core client for 30 sec - exiting 14:27:30 (2896): No heartbeat from core client for 30 sec - exiting 14:27:31 (2896): No heartbeat from core client for 30 sec - exiting 14:27:32 (2896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2916, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3292, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2940, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2912, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2940, iMonCtr=1 Model crash detected, will try to restart... C Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BB3F79 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_ygri_1900_40_007354584/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Jan 2012 13:10:49	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	1,036,800	2,630,677	2.5373
31 Dec 2011 11:22:02	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	1,010,880	2,565,505	2.5379
27 Dec 2011 19:25:26	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	984,960	2,489,392	2.5274
23 Dec 2011 22:37:55	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	959,040	2,417,029	2.5203
22 Dec 2011 23:18:25	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	933,120	2,350,246	2.5187
22 Dec 2011 03:26:48	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	907,200	2,284,410	2.5181
21 Dec 2011 08:27:50	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	881,280	2,218,367	2.5172
20 Dec 2011 13:15:25	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	855,360	2,152,933	2.5170
07 Aug 2011 14:51:27	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	829,440	2,084,586	2.5132
06 Aug 2011 17:09:44	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	803,520	2,020,146	2.5141
05 Aug 2011 15:04:30	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	777,600	1,947,662	2.5047
04 Aug 2011 15:10:20	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	751,680	1,867,227	2.4841
03 Aug 2011 12:20:39	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	725,760	1,774,461	2.4450
02 Aug 2011 08:31:41	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	699,840	1,684,126	2.4064
01 Aug 2011 05:09:15	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	673,920	1,592,193	2.3626
31 Jul 2011 02:10:29	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	648,000	1,500,851	2.3161
29 Jul 2011 22:14:11	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	622,080	1,415,026	2.2747
28 Jul 2011 23:21:36	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	596,160	1,342,573	2.2520
27 Jul 2011 23:33:35	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	570,240	1,267,431	2.2226
26 Jul 2011 21:02:29	1106858	13113039	hadcm3n_ygri_1900_40_007354584_1	544,320	1,204,669	2.2132