climateprediction.net home page
Batch 712 (and 710 and 711) failure

Batch 712 (and 710 and 711) failure

Message boards : Number crunching : Batch 712 (and 710 and 711) failure
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 334
Credit: 16,775,908
RAC: 2,586
Message 57952 - Posted: 18 Mar 2018, 18:16:53 UTC

Just had a model crash with this debug report:

stderr out

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:22:56 (29156): start_timer_thread(): CreateThread() failed, errno 0


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x767408F2

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp : 03/18/18 17:22:56
Install Directory : C:\Program Files (x86)\BOINC\
Data Directory : C:\ProgramData\BOINC
Project Symstore :
LoadLibraryA( C:\Program Files (x86)\BOINC\\dbghelp.dll ): GetLastError = 126
Loaded Library : dbghelp.dll
LoadLibraryA( C:\Program Files (x86)\BOINC\\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files (x86)\BOINC\\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\wah2_eas50_n3v9_201612_10_712_011494772;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000001080000 00000000008f0000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2rm3m2t_um_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
Linked PDB Filename : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\WAH2 Release\wah2rm3m2t.pdb

ModLoad: 0000000077d50000 000000000018d000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.16299.248) (-exported- Symbols Loaded)
Linked PDB Filename : wntdll.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000074910000 00000000000d0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.16299.15) (-exported- Symbols Loaded)
Linked PDB Filename : wkernel32.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000076640000 00000000001d7000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.16299.309) (-exported- Symbols Loaded)
Linked PDB Filename : wkernelbase.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000074790000 0000000000175000 C:\WINDOWS\System32\USER32.dll (6.2.16299.125) (-exported- Symbols Loaded)
Linked PDB Filename : wuser32.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000074770000 0000000000016000 C:\WINDOWS\System32\win32u.dll (6.2.16299.15) (-exported- Symbols Loaded)
Linked PDB Filename : wwin32u.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000075bb0000 0000000000022000 C:\WINDOWS\System32\GDI32.dll (6.2.16299.15) (-exported- Symbols Loaded)
Linked PDB Filename : wgdi32.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 00000000758c0000 000000000015e000 C:\WINDOWS\System32\gdi32full.dll (6.2.16299.98) (-exported- Symbols Loaded)
Linked PDB Filename : wgdi32full.pdb
File Version : 10.0.16299.98 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.98

ModLoad: 0000000075e30000 000000000007c000 C:\WINDOWS\System32\msvcp_win.dll (6.2.16299.248) (-exported- Symbols Loaded)
Linked PDB Filename : msvcp_win.pdb
File Version : 10.0.16299.248 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.248

ModLoad: 0000000074e10000 0000000000117000 C:\WINDOWS\System32\ucrtbase.dll (6.2.16299.248) (-exported- Symbols Loaded)
Linked PDB Filename : ucrtbase.pdb
File Version : 10.0.16299.248 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.248

ModLoad: 0000000075270000 0000000000078000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.16299.192) (-exported- Symbols Loaded)
Linked PDB Filename : advapi32.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000076580000 00000000000bd000 C:\WINDOWS\System32\msvcrt.dll (7.0.16299.125) (-exported- Symbols Loaded)
Linked PDB Filename : msvcrt.pdb
File Version : 7.0.16299.125 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 7.0.16299.125

ModLoad: 0000000077b60000 0000000000043000 C:\WINDOWS\System32\sechost.dll (6.2.16299.15) (-exported- Symbols Loaded)
Linked PDB Filename : sechost.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000075eb0000 00000000000be000 C:\WINDOWS\System32\RPCRT4.dll (6.2.16299.309) (-exported- Symbols Loaded)
Linked PDB Filename : wrpcrt4.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000074750000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.16299.192) (-exported- Symbols Loaded)
Linked PDB Filename : wsspicli.pdb
File Version : 10.0.16299.192 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.192

ModLoad: 0000000074740000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.16299.15) (-exported- Symbols Loaded)
Linked PDB Filename : cryptbase.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000075a20000 0000000000057000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.16299.98) (-exported- Symbols Loaded)
Linked PDB Filename : bcryptprimitives.pdb
File Version : 10.0.16299.98 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.98

ModLoad: 0000000074f30000 0000000000019000 C:\WINDOWS\System32\imagehlp.dll (6.2.16299.15) (-exported- Symbols Loaded)
Linked PDB Filename : imagehlp.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000075b70000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.16299.15) (-exported- Symbols Loaded)
Linked PDB Filename : wimm32.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000076330000 0000000000246000 C:\WINDOWS\System32\combase.dll (6.2.16299.15) (-exported- Symbols Loaded)
Linked PDB Filename : combase.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000071fa0000 0000000000181000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.16299.15) (-exported- Symbols Loaded)
Linked PDB Filename : dbghelp.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15

ModLoad: 0000000073d60000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.16299.15) (-exported- Symbols Loaded)
Linked PDB Filename : version.pdb
File Version : 10.0.16299.15 (WinBuild.160101.0800)
Company Name : Microsoft Corporation
Product Name : Microsoft&#174; Windows&#174; Operating System
Product Version : 10.0.16299.15



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 9, Write: 0, Other 257

- I/O Transfers Counters -
Read: 0, Write: 111, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 255672, QuotaPeakPagedPoolUsage: 255768
QuotaNonPagedPoolUsage: 8896, QuotaPeakNonPagedPoolUsage: 8896

- Virtual Memory Usage -
VirtualSize: 1662197760, PeakVirtualSize: 1662197760

- Pagefile Usage -
PagefileUsage: 25079808, PeakPagefileUsage: 40206336

- Working Set Size -
WorkingSetSize: 6283264, PeakWorkingSetSize: 6283264, PageFaultCount: 1640

*** Dump of thread ID 28792 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 312500.000000, User Time: 0.000000, Wait Time: 23826800.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x767408F2

- Registers -
eax=1308f530 ebx=003c5000 ecx=00000003 edx=00000000 esi=014138a0 edi=014fd6ac
eip=767408f2 esp=1308f530 ebp=1308f588
cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216

- Callstack -
ChildEBP RetAddr Args to Child
1308f588 013b9707 e06d7363 00000001 00000003 1308f5b4 KERNELBASE!RaiseException+0x0
1308f5c0 013b62d1 1308f5d0 01430274 014138a0 01428584 wah2rm3m2t_um_8.24_windows_inte!+0x0
1308f5e0 01086521 00fd9f80 01000000 010890b9 4aa00000 wah2rm3m2t_um_8.24_windows_inte!+0x0
1308fa10 013b86ea 01080000 00000000 0072410e 0000000a wah2rm3m2t_um_8.24_windows_inte!+0x0
1308faa0 74928654 003c5000 74928630 41dcd2ec 1308fafc wah2rm3m2t_um_8.24_windows_inte!+0x0
1308fab4 77db4a77 003c5000 7bd84c44 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
1308fafc 77db4a47 ffffffff 77dd9ed2 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0
1308fb0c 00000000 013b873d 003c5000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0

*** Dump of thread ID 24072 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 23826796.000000

- Registers -
eax=00000000 ebx=00723d50 ecx=00000000 edx=00000000 esi=00724df8 edi=00724fb8
eip=77dc041c esp=267bf840 ebp=267bfa34
cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000212

- Callstack -
ChildEBP RetAddr Args to Child
267bfa34 74928654 00723d50 74928630 74afd210 267bfa90 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
267bfa48 77db4a77 00723d50 4eab4c28 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
267bfa90 77db4a47 ffffffff 77dd9ed2 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0
267bfaa0 00000000 77d83880 00723d50 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0

*** Dump of thread ID 23932 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 23826796.000000

- Registers -
eax=00000000 ebx=00723d50 ecx=00000000 edx=00000000 esi=007298c0 edi=00729a80
eip=77dc041c esp=37edf780 ebp=37edf974
cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000212

- Callstack -
ChildEBP RetAddr Args to Child
37edf974 74928654 00723d50 74928630 6539d1d0 37edf9d0 ntdll!ZwWaitForWorkViaWorkerFactory+0x0
37edf988 77db4a77 00723d50 5f3d4f68 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
37edf9d0 77db4a47 ffffffff 77dd9ed2 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0
37edf9e0 00000000 77d83880 00723d50 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0

*** Dump of thread ID 29460 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 23826796.000000

- Registers -
eax=00000000 ebx=00723d50 ecx=00000000 edx=00000000 esi=0072aa00 edi=0072abc0
eip=77dc041c esp=495ffd7c ebp=495fff70
cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202

- Callstack -
ChildEBP RetAddr Args to Child
495fff70 74928654 00723d50 74928630 1b8bd7dc 495fffcc ntdll!ZwWaitForWorkViaWorkerFactory+0x0
495fff84 77db4a77 00723d50 218f4974 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0
495fffcc 77db4a47 ffffffff 77dd9ed2 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0
495fffdc 00000000 77d83880 00723d50 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0


*** Debug Message Dump ****


*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27564, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
17:23:00 (27564): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
<file_name>wah2_eas50_n3v9_201612_10_712_011494772_0_r2081437192_1.zip</file_name>
<error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>wah2_eas50_n3v9_201612_10_712_011494772_0_r2081437192_2.zip</file_name>
<error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>wah2_eas50_n3v9_201612_10_712_011494772_0_r2081437192_3.zip</file_name>
<error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>wah2_eas50_n3v9_201612_10_712_011494772_0_r2081437192_4.zip</file_name>
<error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>wah2_eas50_n3v9_201612_10_712_011494772_0_r2081437192_5.zip</file_name>
<error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>wah2_eas50_n3v9_201612_10_712_011494772_0_r2081437192_6.zip</file_name>
<error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>wah2_eas50_n3v9_201612_10_712_011494772_0_r2081437192_7.zip</file_name>
<error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>wah2_eas50_n3v9_201612_10_712_011494772_0_r2081437192_8.zip</file_name>
<error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>wah2_eas50_n3v9_201612_10_712_011494772_0_r2081437192_9.zip</file_name>
<error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>wah2_eas50_n3v9_201612_10_712_011494772_0_r2081437192_10.zip</file_name>
<error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>wah2_eas50_n3v9_201612_10_712_011494772_0_r2081437192_restart.zip</file_name>
<error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>

Any ideas.
ID: 57952 · Report as offensive     Reply Quote

Message boards : Number crunching : Batch 712 (and 710 and 711) failure

©2020 climateprediction.net