climateprediction.net home page
Task 21320724

Task 21320724

Name wah2_pnw25_pqw5_206209_28_757_011643420_1
Workunit 11643420
Created 15 Sep 2018, 21:01:41 UTC
Sent 6 Oct 2018, 15:42:00 UTC
Report deadline 18 Sep 2019, 21:02:00 UTC
Received 28 Oct 2018, 20:07:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1379190
Run time 2 days 2 hours 39 min 17 sec
CPU time 1 days 23 hours 19 min 51 sec
Validate state Invalid
Credit 10,658.83
Device peak FLOPS 5.47 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 188.18 MB
Peak swap size 166.42 MB
Peak disk usage 12.28 MB
Stderr 
<core_client_version>7.12.1</core_client_version>
<![CDATA[
<message>
finish file present too long</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2996, selfPID=18892, iMonCtr=1
Model crash detected, will try to restart...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2996, selfPID=2996, iMonCtr=2
Leaving CPDN_ain::Monitor...
20:17:18 (18892): called boinc_finish(0)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0273712C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 10/28/18 21:07:42
Install Directory : 
Data Directory    : F:\Boinc
Project Symstore  : 
LoadLibraryA( F:\Boinc\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( F:\Boinc\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( F:\Boinc\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( F:\Boinc\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: F:\Boinc\projects\climateprediction.net;F:\Boinc\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 F:\Boinc\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077050000 000000000019c000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.17763.105 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.17763.105

ModLoad: 0000000075840000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.17763.105 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.17763.105

ModLoad: 0000000074ef0000 00000000001f9000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.17763.105 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.17763.105

ModLoad: 00000000748b0000 0000000000199000 C:\WINDOWS\System32\USER32.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.17763.105 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.17763.105

ModLoad: 0000000076bc0000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000077010000 0000000000023000 C:\WINDOWS\System32\GDI32.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076d00000 0000000000166000 C:\WINDOWS\System32\gdi32full.dll (6.2.17763.55) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.17763.55 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.55

ModLoad: 00000000769b0000 0000000000080000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076210000 0000000000123000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076ad0000 000000000007e000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17763.105 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.17763.105

ModLoad: 0000000076be0000 00000000000c0000 C:\WINDOWS\System32\msvcrt.dll (7.0.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.17763.1

ModLoad: 0000000075ad0000 0000000000079000 C:\WINDOWS\System32\sechost.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000075a10000 00000000000bf000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.17763.105 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; -k&#228;ytt&#246;j&#228;rjestelm&#228;
    Product Version       : 10.0.17763.105

ModLoad: 00000000746c0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000746b0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076b50000 0000000000062000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076440000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000660a0000 000000000018f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000074090000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 3023, Write: 0, Other 24477

- I/O Transfers Counters -
Read: 0, Write: 1794, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 93064, QuotaPeakPagedPoolUsage: 93224
QuotaNonPagedPoolUsage: 9168, QuotaPeakNonPagedPoolUsage: 9320

- Virtual Memory Usage -
VirtualSize: 57561088, PeakVirtualSize: 57561088

- Pagefile Usage -
PagefileUsage: 4263936, PeakPagefileUsage: 4263936

- Working Set Size -
WorkingSetSize: 6569984, PeakWorkingSetSize: 6574080, PageFaultCount: 1900

*** Dump of thread ID 20288 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 2812500.000000, User Time: 5625000.000000, Wait Time: 697182.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0273712C

- Registers -
eax=00000065 ebx=004b63b9 ecx=0019dbf8 edx=0273712c esi=0019d9b0 edi=0019dc28
eip=0048ee46 esp=0019d944 ebp=0019dbd4
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0019dbd4 0048161c 0019dbf8 004b63b8 00000000 0019dc28 wah2_8.24_windows_intelx86!+0x0 
0019dc18 0044fa52 0273712c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 
0019dc38 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0019dc50 00485ca1 c0000005 0019dc84 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ff70 7585fe09 00218000 7585fdf0 0019ffdc 770b607d wah2_8.24_windows_intelx86!+0x0 
0019ff80 770b607d 00218000 5ae348e4 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 770b604d ffffffff 770d45ac 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0019ffec 00000000 00485cce 00218000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 6488 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 696236.000000

- Registers -
eax=00000000 ebx=007b5530 ecx=00000000 edx=00000000 esi=007b5370 edi=007b4010
eip=770c1a2c esp=0078fdb4 ebp=0078ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
0078ff70 7585fe09 007b4010 7585fdf0 0078ffdc 770b607d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
0078ff80 770b607d 007b4010 5a8248e4 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0078ffdc 770b604d ffffffff 770d45ac 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0078ffec 00000000 7709d620 007b4010 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 19500 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 696236.000000

- Registers -
eax=00000000 ebx=007b8dc8 ecx=00000000 edx=00000000 esi=007b8c08 edi=007b4010
eip=770c1a2c esp=00a2fdb4 ebp=00a2ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
00a2ff70 7585fe09 007b4010 7585fdf0 00a2ffdc 770b607d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
00a2ff80 770b607d 007b4010 5a5848e4 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00a2ffdc 770b604d ffffffff 770d45ac 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
00a2ffec 00000000 7709d620 007b4010 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 7988 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 696236.000000

- Registers -
eax=00000000 ebx=007b9218 ecx=00000000 edx=00000000 esi=007b9058 edi=007b4010
eip=770c1a2c esp=00b6fdb4 ebp=00b6ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
00b6ff70 7585fe09 007b4010 7585fdf0 00b6ffdc 770b607d ntdll!NtWaitForWorkViaWorkerFactory+0x0 
00b6ff80 770b607d 007b4010 5a4c48e4 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00b6ffdc 770b604d ffffffff 770d45ac 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
00b6ffec 00000000 7709d620 007b4010 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 13700 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 697177.000000

- Registers -
eax=00000000 ebx=025bfd0c ecx=00000000 edx=00000000 esi=00000000 edi=025bfd0c
eip=770c00ac esp=025bfccc ebp=025bfd30
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
025bfd30 74fe8a4f 00000064 00000000 025bff70 00478b44 ntdll!ZwDelayExecution+0x0 
025bfd40 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
025bff70 7585fe09 00000000 7585fdf0 025bffdc 770b607d wah2_8.24_windows_intelx86!+0x0 
025bff80 770b607d 00000000 58a148e4 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
025bffdc 770b604d ffffffff 770d45ac 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
025bffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Nov 2018 11:11:24 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 161,579 166,793 1.0323
24 Oct 2018 06:08:51 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 150,059 154,416 1.0290
23 Oct 2018 10:53:18 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 138,539 142,738 1.0303
23 Oct 2018 10:37:11 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 127,019 130,652 1.0286
23 Oct 2018 10:33:06 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 115,499 118,008 1.0217
23 Oct 2018 10:31:55 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 103,979 105,776 1.0173
23 Oct 2018 10:26:32 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 92,459 93,060 1.0065
19 Oct 2018 10:32:01 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 80,939 81,204 1.0033
15 Oct 2018 14:24:04 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 69,419 69,834 1.0060
14 Oct 2018 11:32:45 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 57,899 58,613 1.0123
14 Oct 2018 07:25:56 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 46,379 47,142 1.0165
13 Oct 2018 12:23:05 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 34,859 35,619 1.0218
12 Oct 2018 15:56:30 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 23,339 23,902 1.0241
07 Oct 2018 15:26:36 1379190 21320724 wah2_pnw25_pqw5_206209_28_757_011643420_1 11,819 12,317 1.0421


©2024 climateprediction.net