Task 14404649

Name	hadcm3n_o5j1_1940_40_007834346_4
Workunit	7989458
Created	15 Apr 2012, 9:03:39 UTC
Sent	15 Apr 2012, 9:03:46 UTC
Report deadline	15 Jul 2012, 16:30:57 UTC
Received	6 Jul 2012, 11:38:45 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1128791
Run time	69 days 8 hours 2 min 34 sec
CPU time	50 days 23 hours 18 min 35 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	1.42 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 10:26:37 (7784): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:26:38 (7784): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7756, iMonCtr=1 Model crash detected, will try to restart... 14:54:14 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:54:15 (6052): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5484, iMonCtr=1 Model crash detected, will try to restart... CSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:24:30 (7004): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 21:24:31 (7004): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 04:01:31 (5812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:37 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:13:39 (4636): No heartbeat from core client for 30 sec - exiting 02:13:40 (4636): No heartbeat from core client for 30 sec - exiting 02:13:41 (4636): No heartbeat from core client for 30 sec - exiting 02:15:02 (5876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4976, iMonCtr=1 Model crash detected, will try to restart... 03:40:37 (6632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:23:09 (6296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:23:10 (6296): No heartbeat from core client for 30 sec - exiting 12:24:10 (6616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:24 (4604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:10 (7452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:00:38 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:00:39 (5564): No heartbeat from core client for 30 sec - exiting 08:37:10 (6524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:36:44 (936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8176, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4456, iMonCtr=1 Model crash detected, will try to restart... 07:20:05 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5628, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6140, iMonCtr=1 Model crash detected, will try to restart... 08:32:00 (6372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:58:50 (5624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7580, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5772, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6564, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 11:27:25 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:27:27 (6408): No heartbeat from core client for 30 sec - exiting 07:00:29 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:28:26 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5740, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 23:34:04 (3392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:13 (4148): No heartbeat from core client for 30 sec - exiting 00:15:14 (4148): No heartbeat from core client for 30 sec - exiting 00:15:15 (4148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6232, iMonCtr=1 Model crash detected, will try to restart... 00:17:22 (6308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:17:23 (6308): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:07:13 (212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:05:45 (6288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:05:47 (6288): No heartbeat from core client for 30 sec - exiting 05:03:41 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:03:42 (4252): No heartbeat from core client for 30 sec - exiting 05:03:44 (4252): No heartbeat from core client for 30 sec - exiting 05:03:45 (4252): No heartbeat from core client for 30 sec - exiting 05:03:46 (4252): No heartbeat from core client for 30 sec - exiting 05:03:47 (4252): No heartbeat from core client for 30 sec - exiting 05:03:48 (4252): No heartbeat from core client for 30 sec - exiting 05:03:49 (4252): No heartbeat from core client for 30 sec - exiting 05:03:50 (4252): No heartbeat from core client for 30 sec - exiting 05:03:51 (4252): No heartbeat from core client for 30 sec - exiting 05:03:52 (4252): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8812, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4544, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6992, iMonCtr=1 Model crash detected, will try to restart... 16:03:54 (5276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:03:55 (5276): No heartbeat from core client for 30 sec - exiting 16:03:56 (5276): No heartbeat from core client for 30 sec - exiting 16:03:57 (5276): No heartbeat from core client for 30 sec - exiting 16:03:58 (5276): No heartbeat from core client for 30 sec - exiting 16:03:59 (5276): No heartbeat from core client for 30 sec - exiting 16:04:00 (5276): No heartbeat from core client for 30 sec - exiting 16:04:01 (5276): No heartbeat from core client for 30 sec - exiting 16:04:02 (5276): No heartbeat from core client for 30 sec - exiting 16:04:03 (5276): No heartbeat from core client for 30 sec - exiting 16:04:04 (5276): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5624, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:51:30 (6572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:01:30 (23384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:34:04 (8060): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:34:05 (8060): No heartbeat from core client for 30 sec - exiting 22:34:06 (8060): No heartbeat from core client for 30 sec - exiting 22:34:07 (8060): No heartbeat from core client for 30 sec - exiting 22:34:08 (8060): No heartbeat from core client for 30 sec - exiting 22:34:09 (8060): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4588, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 04:11:34 (7088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jul 2012 05:53:42	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	1,036,800	4,402,482	4.2462
04 Jul 2012 13:37:48	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	1,010,880	4,290,997	4.2448
02 Jul 2012 12:21:45	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	984,960	4,177,283	4.2411
29 Jun 2012 19:39:55	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	959,040	4,063,136	4.2367
24 Jun 2012 07:02:54	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	933,120	3,951,330	4.2345
22 Jun 2012 03:39:34	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	907,200	3,838,502	4.2312
20 Jun 2012 03:13:05	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	881,280	3,724,588	4.2263
18 Jun 2012 05:16:45	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	855,360	3,611,417	4.2221
16 Jun 2012 06:02:04	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	829,440	3,497,012	4.2161
12 Jun 2012 21:29:54	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	803,520	3,385,784	4.2137
11 Jun 2012 03:15:06	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	777,600	3,274,808	4.2114
09 Jun 2012 09:37:37	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	751,680	3,163,389	4.2084
07 Jun 2012 13:30:24	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	725,760	3,050,784	4.2036
05 Jun 2012 22:02:46	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	699,840	2,943,472	4.2059
04 Jun 2012 07:17:31	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	673,920	2,837,089	4.2098
02 Jun 2012 16:13:13	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	648,000	2,730,591	4.2139
31 May 2012 23:49:34	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	622,080	2,623,213	4.2168
30 May 2012 09:19:53	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	596,160	2,516,594	4.2213
28 May 2012 18:32:15	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	570,240	2,410,753	4.2276
26 May 2012 22:29:22	1128791	14404649	hadcm3n_o5j1_1940_40_007834346_4	544,320	2,300,687	4.2267