Task 13295446

Name	hadcm3n_o7bj_1940_40_007423255_0
Workunit	7620890
Created	25 Aug 2011, 8:59:19 UTC
Sent	25 Aug 2011, 10:11:17 UTC
Report deadline	24 Nov 2011, 17:38:28 UTC
Received	15 Nov 2011, 19:22:55 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1098636
Run time	14 days 16 hours 9 min 56 sec
CPU time	14 days 4 hours 22 min 43 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.67 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:14:52 (5044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:12:33 (5060): No heartbeat from core client for 30 sec - exiting 12:12:34 (5060): No heartbeat from core client for 30 sec - exiting 12:12:35 (5060): No heartbeat from core client for 30 sec - exiting 12:12:36 (5060): No heartbeat from core client for 30 sec - exiting 12:12:38 (5060): No heartbeat from core client for 30 sec - exiting 12:12:39 (5060): No heartbeat from core client for 30 sec - exiting 12:12:40 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:35:09 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:20:11 (3676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:55 (688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:56 (688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 11:35:15 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:55:00 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:53:05 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:26:08 (4228): No heartbeat from core client for 30 sec - exiting 12:26:09 (4228): No heartbeat from core client for 30 sec - exiting 12:26:10 (4228): No heartbeat from core client for 30 sec - exiting 12:26:11 (4228): No heartbeat from core client for 30 sec - exiting 12:26:12 (4228): No heartbeat from core client for 30 sec - exiting 12:26:13 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:14 (4228): No heartbeat from core client for 30 sec - exiting 20:31:13 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:55:51 (3812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:47:47 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:37:48 (1108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:49 (1108): No heartbeat from core client for 30 sec - exiting 11:37:50 (1108): No heartbeat from core client for 30 sec - exiting 11:37:52 (1108): No heartbeat from core client for 30 sec - exiting 11:37:53 (1108): No heartbeat from core client for 30 sec - exiting 11:37:54 (1108): No heartbeat from core client for 30 sec - exiting 11:37:55 (1108): No heartbeat from core client for 30 sec - exiting 11:37:56 (1108): No heartbeat from core client for 30 sec - exiting 11:37:57 (1108): No heartbeat from core client for 30 sec - exiting 11:37:58 (1108): No heartbeat from core client for 30 sec - exiting 11:37:59 (1108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:31:19 (4528): No heartbeat from core client for 30 sec - exiting 11:31:20 (4528): No heartbeat from core client for 30 sec - exiting 11:31:21 (4528): No heartbeat from core client for 30 sec - exiting 11:31:22 (4528): No heartbeat from core client for 30 sec - exiting 11:31:23 (4528): No heartbeat from core client for 30 sec - exiting 11:31:24 (4528): No heartbeat from core client for 30 sec - exiting 11:31:25 (4528): No heartbeat from core client for 30 sec - exiting 11:31:26 (4528): No heartbeat from core client for 30 sec - exiting 11:31:27 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:29 (4528): No heartbeat from core client for 30 sec - exiting 11:31:30 (4528): No heartbeat from core client for 30 sec - exiting 11:31:31 (4528): No heartbeat from core client for 30 sec - exiting 11:31:32 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5908, iMonCtr=1 Model crash detected, will try to restart... 08:42:16 (3140): No heartbeat from core client for 30 sec - exiting 08:42:17 (3140): No heartbeat from core client for 30 sec - exiting 08:42:18 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:19 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:41:47 (700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:52:15 (4628): No heartbeat from core client for 30 sec - exiting 16:52:17 (4628): No heartbeat from core client for 30 sec - exiting 16:52:18 (4628): No heartbeat from core client for 30 sec - exiting 16:52:19 (4628): No heartbeat from core client for 30 sec - exiting 16:52:20 (4628): No heartbeat from core client for 30 sec - exiting 16:52:21 (4628): No heartbeat from core client for 30 sec - exiting 16:52:22 (4628): No heartbeat from core client for 30 sec - exiting 16:52:23 (4628): No heartbeat from core client for 30 sec - exiting 16:52:24 (4628): No heartbeat from core client for 30 sec - exiting 16:52:25 (4628): No heartbeat from core client for 30 sec - exiting 16:52:26 (4628): No heartbeat from core client for 30 sec - exiting 16:52:27 (4628): No heartbeat from core client for 30 sec - exiting 16:52:29 (4628): No heartbeat from core client for 30 sec - exiting 16:52:30 (4628): No heartbeat from core client for 30 sec - exiting 16:52:31 (4628): No heartbeat from core client for 30 sec - exiting 16:52:32 (4628): No heartbeat from core client for 30 sec - exiting 16:52:33 (4628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o7bjko.pjf1c10 Error converting file to netcdf: dataout/o7bjko.pif1c10 Error converting file to netcdf: dataout/o7bjko.pff1c10 Error converting file to netcdf: dataout/o7bjka.phf1c10 Error converting file to netcdf: dataout/o7bjka.pgf1c10 Error converting file to netcdf: dataout/o7bjka.pef1c10 Error converting file to netcdf: dataout/o7bjka.pdf1c10 CPDN Monitor - Quit request from BOINC... 12:07:17 (2952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:43:52 (3620): No heartbeat from core client for 30 sec - exiting 17:43:53 (3620): No heartbeat from core client for 30 sec - exiting 17:43:54 (3620): No heartbeat from core client for 30 sec - exiting 17:43:56 (3620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:21:04 (2196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:17:58 (4604): No heartbeat from core client for 30 sec - exiting 10:17:59 (4604): No heartbeat from core client for 30 sec - exiting 10:18:00 (4604): No heartbeat from core client for 30 sec - exiting 10:18:01 (4604): No heartbeat from core client for 30 sec - exiting 10:18:03 (4604): No heartbeat from core client for 30 sec - exiting 10:18:04 (4604): No heartbeat from core client for 30 sec - exiting 10:18:05 (4604): No heartbeat from core client for 30 sec - exiting 10:18:06 (4604): No heartbeat from core client for 30 sec - exiting 10:18:07 (4604): No heartbeat from core client for 30 sec - exiting 10:18:08 (4604): No heartbeat from core client for 30 sec - exiting 10:18:09 (4604): No heartbeat from core client for 30 sec - exiting 10:18:10 (4604): No heartbeat from core client for 30 sec - exiting 10:18:11 (4604): No heartbeat from core client for 30 sec - exiting 10:18:12 (4604): No heartbeat from core client for 30 sec - exiting 10:18:13 (4604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:52:27 (5364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:53:51 (5404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:38:52 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:53 (3660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:24:45 (3852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:08:27 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:59:44 (3576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:59:07 (4912): No heartbeat from core client for 30 sec - exiting 16:59:08 (4912): No heartbeat from core client for 30 sec - exiting 16:59:09 (4912): No heartbeat from core client for 30 sec - exiting 16:59:10 (4912): No heartbeat from core client for 30 sec - exiting 16:59:11 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:19:18 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:10:42 (1036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:00:21 (704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:27:00 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:27:01 (5100): No heartbeat from core client for 30 sec - exiting 11:27:03 (5100): No heartbeat from core client for 30 sec - exiting 11:27:04 (5100): No heartbeat from core client for 30 sec - exiting 11:27:05 (5100): No heartbeat from core client for 30 sec - exiting 11:27:06 (5100): No heartbeat from core client for 30 sec - exiting 11:27:07 (5100): No heartbeat from core client for 30 sec - exiting 11:27:08 (5100): No heartbeat from core client for 30 sec - exiting 11:27:09 (5100): No heartbeat from core client for 30 sec - exiting 11:27:10 (5100): No heartbeat from core client for 30 sec - exiting 11:27:11 (5100): No heartbeat from core client for 30 sec - exiting 13:53:30 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 15:07:51 (4768): No heartbeat from core client for 30 sec - exiting 15:07:52 (4768): No heartbeat from core client for 30 sec - exiting 15:07:53 (4768): No heartbeat from core client for 30 sec - exiting 15:07:54 (4768): No heartbeat from core client for 30 sec - exiting 15:07:55 (4768): No heartbeat from core client for 30 sec - exiting 15:07:56 (4768): No heartbeat from core client for 30 sec - exiting 15:07:57 (4768): No heartbeat from core client for 30 sec - exiting 15:07:58 (4768): No heartbeat from core client for 30 sec - exiting 15:07:59 (4768): No heartbeat from core client for 30 sec - exiting 15:08:00 (4768): No heartbeat from core client for 30 sec - exiting 15:08:01 (4768): No heartbeat from core client for 30 sec - exiting 15:08:02 (4768): No heartbeat from core client for 30 sec - exiting 15:08:03 (4768): No heartbeat from core client for 30 sec - exiting 15:08:04 (4768): No heartbeat from core client for 30 sec - exiting 15:08:05 (4768): No heartbeat from core client for 30 sec - exiting 15:08:06 (4768): No heartbeat from core client for 30 sec - exiting 15:08:07 (4768): No heartbeat from core client for 30 sec - exiting 15:08:08 (4768): No heartbeat from core client for 30 sec - exiting 15:08:09 (4768): No heartbeat from core client for 30 sec - exiting 15:08:10 (4768): No heartbeat from core client for 30 sec - exiting 15:08:11 (4768): No heartbeat from core client for 30 sec - exiting 15:08:12 (4768): No heartbeat from core client for 30 sec - exiting 15:08:13 (4768): No heartbeat from core client for 30 sec - exiting 15:08:14 (4768): No heartbeat from core client for 30 sec - exiting 15:08:15 (4768): No heartbeat from core client for 30 sec - exiting 15:08:16 (4768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:08:17 (4768): No heartbeat from core client for 30 sec - exiting 17:25:06 (5656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:25:44 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:43:21 (5340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:26:22 (4508): No heartbeat from core client for 30 sec - exiting 17:26:24 (4508): No heartbeat from core client for 30 sec - exiting 17:26:25 (4508): No heartbeat from core client for 30 sec - exiting 17:26:26 (4508): No heartbeat from core client for 30 sec - exiting 17:26:27 (4508): No heartbeat from core client for 30 sec - exiting 17:26:28 (4508): No heartbeat from core client for 30 sec - exiting 17:26:29 (4508): No heartbeat from core client for 30 sec - exiting 17:26:30 (4508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:48:33 (2364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:48:52 (1152): No heartbeat from core client for 30 sec - exiting 18:48:53 (1152): No heartbeat from core client for 30 sec - exiting 18:48:54 (1152): No heartbeat from core client for 30 sec - exiting 18:48:55 (1152): No heartbeat from core client for 30 sec - exiting 18:48:57 (1152): No heartbeat from core client for 30 sec - exiting 18:48:58 (1152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:59 (1152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:06:32 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:37:51 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:41:41 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:42 (4568): No heartbeat from core client for 30 sec - exiting 10:41:43 (4568): No heartbeat from core client for 30 sec - exiting 10:41:44 (4568): No heartbeat from core client for 30 sec - exiting 10:41:45 (4568): No heartbeat from core client for 30 sec - exiting 10:41:46 (4568): No heartbeat from core client for 30 sec - exiting 10:41:48 (4568): No heartbeat from core client for 30 sec - exiting 10:41:49 (4568): No heartbeat from core client for 30 sec - exiting 10:41:50 (4568): No heartbeat from core client for 30 sec - exiting 10:41:51 (4568): No heartbeat from core client for 30 sec - exiting 10:41:52 (4568): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:02:18 (4524): No heartbeat from core client for 30 sec - exiting 12:02:19 (4524): No heartbeat from core client for 30 sec - exiting 12:02:20 (4524): No heartbeat from core client for 30 sec - exiting 12:02:21 (4524): No heartbeat from core client for 30 sec - exiting 12:02:22 (4524): No heartbeat from core client for 30 sec - exiting 12:02:23 (4524): No heartbeat from core client for 30 sec - exiting 12:02:24 (4524): No heartbeat from core client for 30 sec - exiting 12:02:26 (4524): No heartbeat from core client for 30 sec - exiting 12:02:27 (4524): No heartbeat from core client for 30 sec - exiting 12:02:28 (4524): No heartbeat from core client for 30 sec - exiting 12:02:29 (4524): No heartbeat from core client for 30 sec - exiting 12:02:30 (4524): No heartbeat from core client for 30 sec - exiting 12:02:31 (4524): No heartbeat from core client for 30 sec - exiting 12:02:32 (4524): No heartbeat from core client for 30 sec - exiting 12:02:33 (4524): No heartbeat from core client for 30 sec - exiting 12:02:34 (4524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:06 (5384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5372, iMonCtr=1 Model crash detected, will try to restart... 09:23:16 (1396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:11:44 (1340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:11:45 (1340): No heartbeat from core client for 30 sec - exiting 07:11:46 (1340): No heartbeat from core client for 30 sec - exiting 07:11:47 (1340): No heartbeat from core client for 30 sec - exiting 19:15:00 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:06:59 (5400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:07:01 (5400): No heartbeat from core client for 30 sec - exiting 17:07:02 (5400): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:46:40 (5104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:23:43 (4272): No heartbeat from core client for 30 sec - exiting 08:23:44 (4272): No heartbeat from core client for 30 sec - exiting 08:23:45 (4272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Nov 2011 19:34:25	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	777,600	1,225,361	1.5758
15 Nov 2011 19:34:25	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	751,680	1,185,618	1.5773
07 Nov 2011 19:12:34	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	725,760	1,143,969	1.5762
02 Nov 2011 22:33:08	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	699,840	1,103,885	1.5773
31 Oct 2011 19:43:03	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	673,920	1,059,976	1.5729
31 Oct 2011 18:44:24	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	648,000	1,020,093	1.5742
31 Oct 2011 18:12:35	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	622,080	979,879	1.5752
31 Oct 2011 17:13:38	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	596,160	934,743	1.5679
31 Oct 2011 13:25:04	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	570,240	892,743	1.5656
31 Oct 2011 13:25:04	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	544,320	853,157	1.5674
31 Oct 2011 13:25:04	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	518,400	813,800	1.5698
17 Oct 2011 20:58:34	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	492,480	773,680	1.5710
15 Oct 2011 15:13:16	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	466,560	733,892	1.5730
12 Oct 2011 17:50:03	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	440,640	692,795	1.5722
07 Oct 2011 20:35:33	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	414,720	652,159	1.5725
03 Oct 2011 21:20:48	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	388,800	608,697	1.5656
28 Sep 2011 16:52:27	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	362,880	568,088	1.5655
25 Sep 2011 17:11:07	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	336,960	529,170	1.5704
20 Sep 2011 21:18:55	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	311,040	487,467	1.5672
19 Sep 2011 21:24:39	1098636	13295446	hadcm3n_o7bj_1940_40_007423255_0	285,120	447,978	1.5712