Task 16005510

Name	hadcm3n_811r_1980_40_008459298_1
Workunit	8610154
Created	6 Sep 2013, 7:56:35 UTC
Sent	6 Sep 2013, 8:32:44 UTC
Report deadline	6 Dec 2013, 15:59:55 UTC
Received	27 Oct 2013, 10:16:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1273094
Run time	3 days 11 hours 52 min 5 sec
CPU time	3 days 11 hours 33 min 23 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5764, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5860, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3928, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5324, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:20:13 (2192): No heartbeat from core client for 30 sec - exiting 08:20:14 (2192): No heartbeat from core client for 30 sec - exiting 08:20:15 (2192): No heartbeat from core client for 30 sec - exiting 08:20:16 (2192): No heartbeat from core client for 30 sec - exiting 08:20:17 (2192): No heartbeat from core client for 30 sec - exiting 08:20:18 (2192): No heartbeat from core client for 30 sec - exiting 08:20:20 (2192): No heartbeat from core client for 30 sec - exiting 08:20:21 (2192): No heartbeat from core client for 30 sec - exiting 08:20:22 (2192): No heartbeat from core client for 30 sec - exiting 08:20:23 (2192): No heartbeat from core client for 30 sec - exiting 08:20:24 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:41:43 (5872): No heartbeat from core client for 30 sec - exiting 08:41:44 (5872): No heartbeat from core client for 30 sec - exiting 08:41:45 (5872): No heartbeat from core client for 30 sec - exiting 08:41:46 (5872): No heartbeat from core client for 30 sec - exiting 08:41:47 (5872): No heartbeat from core client for 30 sec - exiting 08:41:48 (5872): No heartbeat from core client for 30 sec - exiting 08:41:49 (5872): No heartbeat from core client for 30 sec - exiting 08:41:50 (5872): No heartbeat from core client for 30 sec - exiting 08:41:51 (5872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5176, iMonCtr=1 Model crash detected, will try to restart... 11:14:46 (5732): No heartbeat from core client for 30 sec - exiting 11:14:47 (5732): No heartbeat from core client for 30 sec - exiting 11:14:48 (5732): No heartbeat from core client for 30 sec - exiting 11:14:49 (5732): No heartbeat from core client for 30 sec - exiting 11:14:51 (5732): No heartbeat from core client for 30 sec - exiting 11:14:52 (5732): No heartbeat from core client for 30 sec - exiting 11:14:53 (5732): No heartbeat from core client for 30 sec - exiting 11:14:54 (5732): No heartbeat from core client for 30 sec - exiting 11:14:55 (5732): No heartbeat from core client for 30 sec - exiting 11:14:56 (5732): No heartbeat from core client for 30 sec - exiting 11:14:57 (5732): No heartbeat from core client for 30 sec - exiting 11:14:58 (5732): No heartbeat from core client for 30 sec - exiting 11:14:59 (5732): No heartbeat from core client for 30 sec - exiting 11:15:00 (5732): No heartbeat from core client for 30 sec - exiting 11:15:01 (5732): No heartbeat from core client for 30 sec - exiting 11:15:03 (5732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:13:22 (4016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:53:36 (3344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:48:53 (5888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:50:30 (2456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:57:57 (5728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:59:26 (3036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:48:18 (5908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:49:43 (5320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:27:47 (3376): No heartbeat from core client for 30 sec - exiting 06:27:48 (3376): No heartbeat from core client for 30 sec - exiting 06:27:49 (3376): No heartbeat from core client for 30 sec - exiting 06:27:50 (3376): No heartbeat from core client for 30 sec - exiting 06:27:51 (3376): No heartbeat from core client for 30 sec - exiting 06:27:53 (3376): No heartbeat from core client for 30 sec - exiting 06:27:54 (3376): No heartbeat from core client for 30 sec - exiting 06:27:55 (3376): No heartbeat from core client for 30 sec - exiting 06:27:56 (3376): No heartbeat from core client for 30 sec - exiting 06:27:57 (3376): No heartbeat from core client for 30 sec - exiting 06:27:58 (3376): No heartbeat from core client for 30 sec - exiting 06:27:59 (3376): No heartbeat from core client for 30 sec - exiting 06:28:00 (3376): No heartbeat from core client for 30 sec - exiting 06:28:01 (3376): No heartbeat from core client for 30 sec - exiting 06:28:02 (3376): No heartbeat from core client for 30 sec - exiting 06:28:03 (3376): No heartbeat from core client for 30 sec - exiting 06:28:05 (3376): No heartbeat from core client for 30 sec - exiting 06:28:06 (3376): No heartbeat from core client for 30 sec - exiting 06:28:07 (3376): No heartbeat from core client for 30 sec - exiting 06:28:08 (3376): No heartbeat from core client for 30 sec - exiting 06:28:09 (3376): No heartbeat from core client for 30 sec - exiting 06:28:10 (3376): No heartbeat from core client for 30 sec - exiting 06:28:11 (3376): No heartbeat from core client for 30 sec - exiting 06:28:12 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:36 (5464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:06:18 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:14:15 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:50:27 (5912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:51:46 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:56 (1952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:43:55 (3632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:07:13 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:14 (3856): No heartbeat from core client for 30 sec - exiting 19:08:41 (3884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:55:27 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:56:10 (3280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:24:13 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:19 (5952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:59:31 (5756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:13 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:55:17 (4464): No heartbeat from core client for 30 sec - exiting 15:55:18 (4464): No heartbeat from core client for 30 sec - exiting 15:55:19 (4464): No heartbeat from core client for 30 sec - exiting 15:55:20 (4464): No heartbeat from core client for 30 sec - exiting 15:55:21 (4464): No heartbeat from core client for 30 sec - exiting 15:55:22 (4464): No heartbeat from core client for 30 sec - exiting 15:55:23 (4464): No heartbeat from core client for 30 sec - exiting 15:55:25 (4464): No heartbeat from core client for 30 sec - exiting 15:55:26 (4464): No heartbeat from core client for 30 sec - exiting 15:55:27 (4464): No heartbeat from core client for 30 sec - exiting 15:55:28 (4464): No heartbeat from core client for 30 sec - exiting 15:55:29 (4464): No heartbeat from core client for 30 sec - exiting 15:55:30 (4464): No heartbeat from core client for 30 sec - exiting 15:55:31 (4464): No heartbeat from core client for 30 sec - exiting 15:55:32 (4464): No heartbeat from core client for 30 sec - exiting 15:55:33 (4464): No heartbeat from core client for 30 sec - exiting 15:55:34 (4464): No heartbeat from core client for 30 sec - exiting 15:55:35 (4464): No heartbeat from core client for 30 sec - exiting 15:55:37 (4464): No heartbeat from core client for 30 sec - exiting 15:55:38 (4464): No heartbeat from core client for 30 sec - exiting 15:55:39 (4464): No heartbeat from core client for 30 sec - exiting 15:55:40 (4464): No heartbeat from core client for 30 sec - exiting 15:55:41 (4464): No heartbeat from core client for 30 sec - exiting 15:55:42 (4464): No heartbeat from core client for 30 sec - exiting 15:55:43 (4464): No heartbeat from core client for 30 sec - exiting 15:55:44 (4464): No heartbeat from core client for 30 sec - exiting 15:55:45 (4464): No heartbeat from core client for 30 sec - exiting 15:55:46 (4464): No heartbeat from core client for 30 sec - exiting 15:55:47 (4464): No heartbeat from core client for 30 sec - exiting 15:55:49 (4464): No heartbeat from core client for 30 sec - exiting 15:55:50 (4464): No heartbeat from core client for 30 sec - exiting 15:55:51 (4464): No heartbeat from core client for 30 sec - exiting 15:55:52 (4464): No heartbeat from core client for 30 sec - exiting 15:55:53 (4464): No heartbeat from core client for 30 sec - exiting 15:55:54 (4464): No heartbeat from core client for 30 sec - exiting 15:55:55 (4464): No heartbeat from core client for 30 sec - exiting 15:55:56 (4464): No heartbeat from core client for 30 sec - exiting 15:55:57 (4464): No heartbeat from core client for 30 sec - exiting 15:55:58 (4464): No heartbeat from core client for 30 sec - exiting 15:55:59 (4464): No heartbeat from core client for 30 sec - exiting 15:56:01 (4464): No heartbeat from core client for 30 sec - exiting 15:56:02 (4464): No heartbeat from core client for 30 sec - exiting 15:56:03 (4464): No heartbeat from core client for 30 sec - exiting 15:56:04 (4464): No heartbeat from core client for 30 sec - exiting 15:56:05 (4464): No heartbeat from core client for 30 sec - exiting 15:56:06 (4464): No heartbeat from core client for 30 sec - exiting 15:56:07 (4464): No heartbeat from core client for 30 sec - exiting 15:56:08 (4464): No heartbeat from core client for 30 sec - exiting 15:56:09 (4464): No heartbeat from core client for 30 sec - exiting 15:56:10 (4464): No heartbeat from core client for 30 sec - exiting 15:56:11 (4464): No heartbeat from core client for 30 sec - exiting 15:56:13 (4464): No heartbeat from core client for 30 sec - exiting 15:56:14 (4464): No heartbeat from core client for 30 sec - exiting 15:56:15 (4464): No heartbeat from core client for 30 sec - exiting 15:56:16 (4464): No heartbeat from core client for 30 sec - exiting 15:56:17 (4464): No heartbeat from core client for 30 sec - exiting 15:56:18 (4464): No heartbeat from core client for 30 sec - exiting 15:56:19 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:58:15 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:30:24 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:32:12 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:54:29 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:56:40 (6132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:54:06 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:54:57 (5244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:10:29 (5688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:13:33 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:10:20 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:12:39 (4320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:26:33 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:29:20 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:17:22 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:17:23 (6044): No heartbeat from core client for 30 sec - exiting 08:17:25 (6044): No heartbeat from core client for 30 sec - exiting 08:17:26 (6044): No heartbeat from core client for 30 sec - exiting 08:17:27 (6044): No heartbeat from core client for 30 sec - exiting 08:19:34 (3280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:54:24 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:26 (5616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:18:46 (5888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:20:49 (2236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:16:06 (5896): No heartbeat from core client for 30 sec - exiting 16:16:07 (5896): No heartbeat from core client for 30 sec - exiting 16:16:08 (5896): No heartbeat from core client for 30 sec - exiting 16:16:09 (5896): No heartbeat from core client for 30 sec - exiting 16:16:10 (5896): No heartbeat from core client for 30 sec - exiting 16:16:12 (5896): No heartbeat from core client for 30 sec - exiting 16:16:13 (5896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:18:01 (5640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:25:53 (3464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:26:36 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:22:43 (5924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:26:28 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:34:44 (5984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:37:31 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:58:37 (1608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:00:15 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:18:07 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:17:18 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4784, iMonCtr=1 Model crash detected, will try to restart... 10:46:23 (5824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:56:50 (5152): No heartbeat from core client for 30 sec - exiting 06:56:51 (5152): No heartbeat from core client for 30 sec - exiting 06:56:52 (5152): No heartbeat from core client for 30 sec - exiting 06:56:53 (5152): No heartbeat from core client for 30 sec - exiting 06:56:54 (5152): No heartbeat from core client for 30 sec - exiting 06:56:55 (5152): No heartbeat from core client for 30 sec - exiting 06:56:57 (5152): No heartbeat from core client for 30 sec - exiting 06:56:58 (5152): No heartbeat from core client for 30 sec - exiting 06:56:59 (5152): No heartbeat from core client for 30 sec - exiting 06:57:00 (5152): No heartbeat from core client for 30 sec - exiting 06:57:01 (5152): No heartbeat from core client for 30 sec - exiting 06:57:02 (5152): No heartbeat from core client for 30 sec - exiting 06:57:03 (5152): No heartbeat from core client for 30 sec - exiting 06:57:04 (5152): No heartbeat from core client for 30 sec - exiting 06:57:05 (5152): No heartbeat from core client for 30 sec - exiting 06:57:06 (5152): No heartbeat from core client for 30 sec - exiting 06:57:07 (5152): No heartbeat from core client for 30 sec - exiting 06:57:09 (5152): No heartbeat from core client for 30 sec - exiting 06:57:10 (5152): No heartbeat from core client for 30 sec - exiting 06:57:11 (5152): No heartbeat from core client for 30 sec - exiting 06:57:12 (5152): No heartbeat from core client for 30 sec - exiting 06:57:13 (5152): No heartbeat from core client for 30 sec - exiting 06:57:14 (5152): No heartbeat from core client for 30 sec - exiting 06:57:15 (5152): No heartbeat from core client for 30 sec - exiting 06:57:16 (5152): No heartbeat from core client for 30 sec - exiting 06:57:17 (5152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:57:18 (5152): No heartbeat from core client for 30 sec - exiting 06:57:19 (5152): No heartbeat from core client for 30 sec - exiting 06:57:21 (5152): No heartbeat from core client for 30 sec - exiting 06:57:22 (5152): No heartbeat from core client for 30 sec - exiting 17:19:04 (2184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4856, iMonCtr=1 Model crash detected, will try to restart... C13:36:29 (4968): No heartbeat from core client for 30 sec - exiting 13:36:30 (4968): No heartbeat from core client for 30 sec - exiting 13:36:31 (4968): No heartbeat from core client for 30 sec - exiting 13:36:32 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:54:42 (5980): No heartbeat from core client for 30 sec - exiting 13:54:43 (5980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:12:43 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77603AC3 read attempt to address 0x40406886 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773D3AC3 read attempt to address 0x40406886 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Oct 2013 04:41:08	1273094	16005510	hadcm3n_811r_1980_40_008459298_1	259,200	299,072	1.1538
22 Oct 2013 07:37:34	1273094	16005510	hadcm3n_811r_1980_40_008459298_1	233,280	268,778	1.1522
17 Oct 2013 12:30:49	1273094	16005510	hadcm3n_811r_1980_40_008459298_1	207,360	240,083	1.1578
14 Oct 2013 13:40:32	1273094	16005510	hadcm3n_811r_1980_40_008459298_1	181,440	210,023	1.1575
09 Oct 2013 07:26:49	1273094	16005510	hadcm3n_811r_1980_40_008459298_1	155,520	177,134	1.1390
03 Oct 2013 08:20:55	1273094	16005510	hadcm3n_811r_1980_40_008459298_1	129,600	147,018	1.1344
26 Sep 2013 14:44:29	1273094	16005510	hadcm3n_811r_1980_40_008459298_1	103,680	117,355	1.1319
18 Sep 2013 06:46:56	1273094	16005510	hadcm3n_811r_1980_40_008459298_1	77,760	87,253	1.1221
14 Sep 2013 05:01:35	1273094	16005510	hadcm3n_811r_1980_40_008459298_1	51,840	57,892	1.1167
10 Sep 2013 13:00:40	1273094	16005510	hadcm3n_811r_1980_40_008459298_1	25,920	28,113	1.0846