Task 15472018

Name	hadcm3n_zl6h_1880_40_008245583_3
Workunit	8400707
Created	6 Dec 2012, 8:49:15 UTC
Sent	6 Dec 2012, 8:49:20 UTC
Report deadline	7 Mar 2013, 16:16:31 UTC
Received	31 Jul 2014, 16:12:07 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1147011
Run time	37 days 20 hours 20 min 11 sec
CPU time	28 days 0 hours 0 min 2 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	1.64 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2252, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3868, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iCPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2228, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:36:45 (5208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:36:46 (5208): No heartbeat from core client for 30 sec - exiting 20:36:47 (5208): No heartbeat from core client for 30 sec - exiting 20:36:48 (5208): No heartbeat from core client for 30 sec - exiting 20:36:49 (5208): No heartbeat from core client for 30 sec - exiting 20:36:50 (5208): No heartbeat from core client for 30 sec - exiting 20:42:45 (3948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:46 (3948): No heartbeat from core client for 30 sec - exiting 20:42:47 (3948): No heartbeat from core client for 30 sec - exiting 20:42:48 (3948): No heartbeat from core client for 30 sec - exiting 20:48:43 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:48:44 (3612): No heartbeat from core client for 30 sec - exiting 20:48:45 (3612): No heartbeat from core client for 30 sec - exiting 20:48:46 (3612): No heartbeat from core client for 30 sec - exiting 20:48:47 (3612): No heartbeat from core client for 30 sec - exiting 20:48:48 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 09:48:19 (5764): No heartbeat from core client for 30 sec - exiting 09:48:20 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1624, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not runniSuspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3580, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3668, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4716, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4020, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4288, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: C I/O Error feof - Unit 62 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/zl6hko.pj90c10 Error converting file to netcdf: dataout/zl6hko.pi90c10 Error converting file to netcdf: dataout/zl6hko.pf90c10 Error converting file to netcdf: dataout/zl6hko.pc90c10 Error converting file to netcdf: dataout/zl6hko.pb90c10 Error converting file to netcdf: dataout/zl6hko.pa90c10 Error converting file to netcdf: dataout/zl6hka.ph90c10 Error converting file to netcdf: dataout/zl6hka.pg90c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4248, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2612, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3980, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4600, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5160, iMonCtr=1 Model crash detected, will try to restart... CSuspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2840, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2480, iMonCtr=1 Model crash detected, will try to restart... CCPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2136, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4104, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4240, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3088, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4188, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3028, iMonCtr=1 Model crash detected, will try to restart... 11:14:35 (4216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:14:36 (4216): No heartbeat from core client for 30 sec - exiting 11:14:37 (4216): No heartbeat from core client for 30 sec - exiting 11:14:38 (4216): No heartbeat from core client for 30 sec - exiting 11:14:39 (4216): No heartbeat from core client for 30 sec - exiting 11:14:40 (4216): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3928, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Jul 2014 09:44:20	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	1,036,800	2,418,354	2.3325
11 May 2014 14:43:54	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	1,010,880	2,362,915	2.3375
09 May 2014 15:07:19	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	984,960	2,307,052	2.3423
06 May 2014 14:57:41	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	959,040	2,250,982	2.3471
04 May 2014 13:37:23	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	933,120	2,196,016	2.3534
01 May 2014 15:57:48	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	907,200	2,140,397	2.3593
27 Apr 2014 13:51:08	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	881,280	2,083,906	2.3646
02 Jun 2013 16:26:46	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	855,360	2,025,507	2.3680
31 May 2013 15:52:27	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	829,440	1,966,788	2.3712
28 May 2013 10:04:10	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	803,520	1,907,825	2.3743
23 May 2013 16:36:44	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	777,600	1,850,568	2.3798
16 May 2013 14:24:26	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	751,680	1,791,774	2.3837
12 May 2013 17:01:19	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	725,760	1,732,892	2.3877
09 May 2013 16:47:00	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	699,840	1,674,275	2.3924
07 Mar 2013 18:03:59	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	673,920	1,614,181	2.3952
03 Mar 2013 15:40:39	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	648,000	1,554,420	2.3988
27 Feb 2013 18:43:48	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	622,080	1,493,819	2.4013
25 Feb 2013 12:00:51	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	596,160	1,431,173	2.4007
21 Feb 2013 17:36:25	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	570,240	1,369,898	2.4023
19 Feb 2013 12:40:07	1147011	15472018	hadcm3n_zl6h_1880_40_008245583_3	544,320	1,308,877	2.4046