Task 15437753

Name	hadcm3n_zis7_1920_40_008245065_0
Workunit	8400189
Created	17 Nov 2012, 0:17:28 UTC
Sent	17 Nov 2012, 0:17:34 UTC
Report deadline	16 Feb 2013, 7:44:45 UTC
Received	15 Dec 2012, 22:11:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1235099
Run time	10 days 4 hours 20 min 50 sec
CPU time	9 days 12 hours 10 min 21 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.77 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:56:33 (7608): No heartbeat from core client for 30 sec - exiting 19:56:34 (7608): No heartbeat from core client for 30 sec - exiting 19:56:35 (7608): No heartbeat from core client for 30 sec - exiting 19:56:36 (7608): No heartbeat from core client for 30 sec - exiting 19:56:37 (7608): No heartbeat from core client for 30 sec - exiting 19:56:39 (7608): No heartbeat from core client for 30 sec - exiting 19:56:40 (7608): No heartbeat from core client for 30 sec - exiting 19:56:41 (7608): No heartbeat from core client for 30 sec - exiting 19:56:42 (7608): No heartbeat from core client for 30 sec - exiting 19:56:43 (7608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:44 (7608): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:18:56 (4388): No heartbeat from core client for 30 sec - exiting 09:18:57 (4388): No heartbeat from core client for 30 sec - exiting 09:18:58 (4388): No heartbeat from core client for 30 sec - exiting 09:18:59 (4388): No heartbeat from core client for 30 sec - exiting 09:19:00 (4388): No heartbeat from core client for 30 sec - exiting 09:19:01 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:49:30 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:49:32 (6052): No heartbeat from core client for 30 sec - exiting 18:49:33 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:21:27 (7092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:38:24 (3464): No heartbeat from core client for 30 sec - exiting 18:38:25 (3464): No heartbeat from core client for 30 sec - exiting 18:38:26 (3464): No heartbeat from core client for 30 sec - exiting 18:38:27 (3464): No heartbeat from core client for 30 sec - exiting 18:38:28 (3464): No heartbeat from core client for 30 sec - exiting 18:38:29 (3464): No heartbeat from core client for 30 sec - exiting 18:38:30 (3464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:38:31 (3464): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4104, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4104, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4104, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:57:36 (9708): No heartbeat from core client for 30 sec - exiting 08:57:37 (9708): No heartbeat from core client for 30 sec - exiting 08:57:38 (9708): No heartbeat from core client for 30 sec - exiting 08:57:39 (9708): No heartbeat from core client for 30 sec - exiting 08:57:41 (9708): No heartbeat from core client for 30 sec - exiting 08:57:42 (9708): No heartbeat from core client for 30 sec - exiting 08:57:43 (9708): No heartbeat from core client for 30 sec - exiting 08:57:44 (9708): No heartbeat from core client for 30 sec - exiting 08:57:45 (9708): No heartbeat from core client for 30 sec - exiting 08:57:46 (9708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x779FFF2B write attempt to address 0x403590E3 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77703AB3 read attempt to address 0x40AEFD56 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zis7_1920_40_008245065/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Dec 2012 12:10:08	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	777,600	819,542	1.0539
15 Dec 2012 02:02:14	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	751,680	792,995	1.0550
14 Dec 2012 08:39:52	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	725,760	765,642	1.0550
14 Dec 2012 08:39:52	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	699,840	738,123	1.0547
14 Dec 2012 08:39:52	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	673,920	710,652	1.0545
14 Dec 2012 08:39:52	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	648,000	683,769	1.0552
06 Dec 2012 10:38:42	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	622,080	656,309	1.0550
04 Dec 2012 10:47:40	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	596,160	628,008	1.0534
04 Dec 2012 01:45:39	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	570,240	600,392	1.0529
03 Dec 2012 09:59:36	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	544,320	573,306	1.0533
01 Dec 2012 23:21:41	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	518,400	545,708	1.0527
01 Dec 2012 05:25:32	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	492,480	518,058	1.0519
30 Nov 2012 11:12:26	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	466,560	490,495	1.0513
28 Nov 2012 08:21:44	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	440,640	462,677	1.0500
25 Nov 2012 09:05:29	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	414,720	435,257	1.0495
24 Nov 2012 06:58:05	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	388,800	407,775	1.0488
23 Nov 2012 22:36:03	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	362,880	380,114	1.0475
23 Nov 2012 05:09:47	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	336,960	352,567	1.0463
22 Nov 2012 20:46:20	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	311,040	324,977	1.0448
22 Nov 2012 13:28:28	1235099	15437753	hadcm3n_zis7_1920_40_008245065_0	285,120	297,524	1.0435