climateprediction.net home page
Task 21637961

Task 21637961

Name wah2_sam50_n3pj_201612_25_811_011830319_0
Workunit 11830319
Created 24 Apr 2019, 6:39:40 UTC
Sent 24 Apr 2019, 10:23:10 UTC
Report deadline 5 Apr 2020, 15:43:10 UTC
Received 23 Oct 2019, 9:47:33 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1371323
Run time 6 days 21 hours 44 min 22 sec
CPU time 4 days 20 hours 48 min 22 sec
Validate state Invalid
Credit 12,938.64
Device peak FLOPS 3.15 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 224.58 MB
Peak swap size 188.23 MB
Peak disk usage 91.38 MB
Stderr
<core_client_version>7.8.3</core_client_version>
<![CDATA[
<message>
finish file present too long</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=36720, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=33972, iMonCtr=2
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=28232, selfPID=13876, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
23:49:59 (13876): called boinc_finish(0)
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20816, selfPID=20816, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8528, selfPID=20272, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8528, selfPID=8528, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19844, selfPID=19844, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=26120, selfPID=26120, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=26648, iMonCtr=2
ontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10008, iMonCtr=2
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17724, selfPID=24912, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17724, selfPID=17724, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14220, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9200, selfPID=9200, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18924, selfPID=18924, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
GGCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16

CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=47504, selfPID=47504, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=56056, selfPID=56640, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
00:51:36 (56640): called boinc_finish(0)
CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0242A12C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 10/23/19 18:44:39
Install Directory : C:\Program Files (x86)\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\Program Files (x86)\BOINC\\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\Program Files (x86)\BOINC\\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files (x86)\BOINC\\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077180000 000000000019a000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.18362.10024) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.18362.418 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.418

ModLoad: 0000000075b50000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.18362.10022) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.18362.418 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.418

ModLoad: 0000000076bc0000 00000000001fc000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.18362.10024) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.18362.418 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.418

ModLoad: 0000000075660000 0000000000197000 C:\WINDOWS\System32\USER32.dll (6.2.18362.10024) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.18362.418 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.418

ModLoad: 0000000076370000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.18362.10024) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.18362.10024 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.10024

ModLoad: 0000000075a30000 0000000000021000 C:\WINDOWS\System32\GDI32.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 0000000076df0000 000000000015a000 C:\WINDOWS\System32\gdi32full.dll (6.2.18362.10024) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.18362.10024 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.10024

ModLoad: 0000000076fb0000 000000000007c000 C:\WINDOWS\System32\msvcp_win.dll (6.2.18362.10013) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.18362.10013 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.10013

ModLoad: 0000000075800000 000000000011f000 C:\WINDOWS\System32\ucrtbase.dll (6.2.18362.10024) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.18362.10024 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.10024

ModLoad: 00000000766b0000 0000000000079000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.18362.10022) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.18362.418 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.418

ModLoad: 0000000076b00000 00000000000bf000 C:\WINDOWS\System32\msvcrt.dll (7.0.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 7.0.18362.1

ModLoad: 0000000075a60000 0000000000076000 C:\WINDOWS\System32\sechost.dll (6.2.18362.10013) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000770b0000 00000000000bb000 C:\WINDOWS\System32\RPCRT4.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.18362.418 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.418

ModLoad: 0000000074950000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.18362.10000) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.18362.10000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.10000

ModLoad: 0000000074940000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000761b0000 000000000005f000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.18362.10024) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.18362.10024 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.10024

ModLoad: 00000000755d0000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.18362.10024) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.18362.10024 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.10024

ModLoad: 0000000072420000 000000000018f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.1

ModLoad: 00000000735f0000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.18362.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.18362.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#162;&#231; Windows&#162;&#231; Operating System
    Product Version       : 10.0.18362.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 8653, Write: 0, Other 50393

- I/O Transfers Counters -
Read: 0, Write: 4107, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 99536, QuotaPeakPagedPoolUsage: 99624
QuotaNonPagedPoolUsage: 9168, QuotaPeakNonPagedPoolUsage: 9592

- Virtual Memory Usage -
VirtualSize: 59150336, PeakVirtualSize: 59150336

- Pagefile Usage -
PagefileUsage: 3584000, PeakPagefileUsage: 3584000

- Working Set Size -
WorkingSetSize: 6381568, PeakWorkingSetSize: 6385664, PageFaultCount: 1915

*** Dump of thread ID 5768 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 35156248.000000, User Time: 23125000.000000, Wait Time: 7759.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0242A12C

- Registers -
eax=00000065 ebx=004b63b9 ecx=0019dc80 edx=0242a12c esi=0019da38 edi=0019dcb0
eip=0048ee46 esp=0019d9cc ebp=0019dc5c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0019dc5c 0048161c 0019dc80 004b63b8 00000000 0019dcb0 wah2_8.24_windows_intelx86!+0x0 
0019dca0 0044fa52 0242a12c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 
0019dcc0 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0019dcd8 00485ca1 c0000005 0019dd0c 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ff70 75b66359 0026b000 75b66340 0019ffdc 771e7b74 wah2_8.24_windows_intelx86!+0x0 
0019ff80 771e7b74 0026b000 f409c8d5 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 771e7b44 ffffffff 77208efd 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0019ffec 00000000 00485cce 0026b000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 5776 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 6398.000000

- Registers -
eax=00000000 ebx=008c5358 ecx=00000000 edx=00000000 esi=008c5358 edi=008c3fe0
eip=771f3a4c esp=0083fdb8 ebp=0083ff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
0083ff70 75b66359 008c3fe0 75b66340 0083ffdc 771e7b74 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
0083ff80 771e7b74 008c3fe0 f493c8d5 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0083ffdc 771e7b44 ffffffff 77208efd 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0083ffec 00000000 771d63b0 008c3fe0 00000000 62613c00 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 5760 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 6398.000000

- Registers -
eax=00000000 ebx=008c6160 ecx=00000000 edx=00000000 esi=008c6160 edi=008c3fe0
eip=771f3a4c esp=00abfdb8 ebp=00abff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
00abff70 75b66359 008c3fe0 75b66340 00abffdc 771e7b74 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
00abff80 771e7b74 008c3fe0 f4bbc8d5 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00abffdc 771e7b44 ffffffff 77208efd 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
00abffec 00000000 771d63b0 008c3fe0 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 5764 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 6398.000000

- Registers -
eax=00000000 ebx=008c9470 ecx=00000000 edx=00000000 esi=008c9470 edi=008c3fe0
eip=771f3a4c esp=00bbfdb8 ebp=00bbff70
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
00bbff70 75b66359 008c3fe0 75b66340 00bbffdc 771e7b74 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
00bbff80 771e7b74 008c3fe0 f4abc8d5 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00bbffdc 771e7b44 ffffffff 77208efd 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
00bbffec 00000000 771d63b0 008c3fe0 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 5924 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 7753.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=02a1fd0c
eip=771f20bc esp=02a1fccc ebp=02a1fd30
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
02a1fd30 76cce7cf 00000064 00000000 02a1ff70 00478b44 ntdll!NtDelayExecution+0x0 
02a1fd40 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
02a1ff70 75b66359 00000000 75b66340 02a1ffdc 771e7b74 wah2_8.24_windows_intelx86!+0x0 
02a1ff80 771e7b74 00000000 f6b1c8d5 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
02a1ffdc 771e7b44 ffffffff 77208efd 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
02a1ffec 00000000 00478b20 00000000 00000000 32fd1f16 ntdll!RtlGetAppContainerNamedObjectPath+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
22 Oct 2019 15:31:48 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 196,139 420,324 2.1430
15 Oct 2019 11:35:39 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 184,619 393,424 2.1310
11 Oct 2019 13:06:24 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 173,099 369,337 2.1337
11 Oct 2019 05:42:47 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 161,579 345,686 2.1394
10 Oct 2019 07:11:41 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 150,059 322,367 2.1483
10 Oct 2019 00:20:54 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 138,539 298,800 2.1568
07 Oct 2019 11:39:16 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 127,019 275,058 2.1655
05 Oct 2019 23:38:14 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 115,499 251,403 2.1767
01 Oct 2019 10:42:49 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 103,979 226,571 2.1790
01 Oct 2019 10:42:20 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 92,459 202,210 2.1870
28 Sep 2019 10:06:33 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 80,939 176,598 2.1819
24 Sep 2019 14:13:03 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 69,419 152,822 2.2014
11 Sep 2019 11:29:44 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 57,899 127,242 2.1977
10 Sep 2019 13:50:36 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 46,379 101,049 2.1788
10 Sep 2019 13:50:32 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 34,859 76,050 2.1816
10 Sep 2019 13:48:09 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 23,339 51,770 2.2182
18 Jul 2019 12:05:16 1371323 21637961 wah2_sam50_n3pj_201612_25_811_011830319_0 11,819 29,017 2.4551


©2024 climateprediction.net