Task 11916327

Name	hadsm3dhet2_u0bs_006724975_10
Workunit	6928318
Created	23 Sep 2010, 20:44:51 UTC
Sent	23 Sep 2010, 21:04:01 UTC
Report deadline	6 Sep 2011, 2:24:01 UTC
Received	7 Jan 2011, 11:57:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	942107
Run time	30 days 18 hours 20 min 25 sec
CPU time	9 days 16 hours 55 min 21 sec
Validate state	Invalid
Credit	4,465.95
Device peak FLOPS	1.91 GFLOPS
Application version	UK Met Office HadSM3 Slab Model v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7656, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5920, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1200, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1200, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1200, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5976, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5976, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5976, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=908, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4364, iMonCtr=1 Model crash detected, will try to restart... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. MainError: 08:13:33 PM No files match the supplied pattern. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5388, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5388, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5388, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5664, iMonCtr=1 Model crash detected, will try to restart... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5524, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5524, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8508, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8508, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8508, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8508, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8508, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8508, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11488, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8600, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8600, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13996, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13996, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day forrtl: Access is denied. No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day Model crashed: (null) cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day Model crashed: (null) cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day Model crashed: (null) cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day no start tag in app init data Can't parse init data file - running in standalone mode Model crashed: (null) cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day Model crashed: (null) CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day Model crashed: (null) cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day no start tag in app init data Can't parse init data file - running in standalone mode Model crashed: (null) cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day Model crashed: (null) cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day Model crashed: (null) cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day Model crashed: (null) cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadsm3dhet2_u0bs_006724975/dataout/restart.day Model crashed: (null) Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Dec 2010 10:09:33	942107	11916327	hadsm3dhet2_u0bs_006724975_10	226,842	829,158	1.7058
24 Dec 2010 15:33:48	942107	11916327	hadsm3dhet2_u0bs_006724975_10	216,040	810,090	1.7044
23 Dec 2010 23:27:47	942107	11916327	hadsm3dhet2_u0bs_006724975_10	205,238	791,321	1.7036
22 Dec 2010 23:16:40	942107	11916327	hadsm3dhet2_u0bs_006724975_10	194,436	772,257	1.7022
22 Dec 2010 10:50:25	942107	11916327	hadsm3dhet2_u0bs_006724975_10	183,634	753,761	1.7019
21 Dec 2010 11:06:29	942107	11916327	hadsm3dhet2_u0bs_006724975_10	172,832	735,011	1.7011
20 Dec 2010 17:06:33	942107	11916327	hadsm3dhet2_u0bs_006724975_10	162,030	716,356	1.7004
19 Dec 2010 23:36:09	942107	11916327	hadsm3dhet2_u0bs_006724975_10	151,228	697,407	1.6990
19 Dec 2010 10:07:36	942107	11916327	hadsm3dhet2_u0bs_006724975_10	140,426	678,311	1.6972
18 Dec 2010 12:55:22	942107	11916327	hadsm3dhet2_u0bs_006724975_10	129,624	659,644	1.6963
16 Dec 2010 21:38:14	942107	11916327	hadsm3dhet2_u0bs_006724975_10	118,822	641,412	1.6965
15 Dec 2010 16:23:15	942107	11916327	hadsm3dhet2_u0bs_006724975_10	108,020	623,120	1.6966
04 Dec 2010 20:40:36	942107	11916327	hadsm3dhet2_u0bs_006724975_10	97,218	604,800	1.6967
03 Dec 2010 14:46:50	942107	11916327	hadsm3dhet2_u0bs_006724975_10	86,416	586,736	1.6974
02 Dec 2010 00:39:27	942107	11916327	hadsm3dhet2_u0bs_006724975_10	75,614	568,783	1.6986
29 Nov 2010 18:07:55	942107	11916327	hadsm3dhet2_u0bs_006724975_10	64,812	550,617	1.6991
28 Nov 2010 19:26:47	942107	11916327	hadsm3dhet2_u0bs_006724975_10	54,010	532,892	1.7011
27 Nov 2010 12:39:00	942107	11916327	hadsm3dhet2_u0bs_006724975_10	43,208	515,208	1.7034
26 Nov 2010 15:22:08	942107	11916327	hadsm3dhet2_u0bs_006724975_10	32,406	497,680	1.7064
23 Nov 2010 16:47:08	942107	11916327	hadsm3dhet2_u0bs_006724975_10	21,604	479,866	1.7086