Task 18456355

Name	hadcm3s_9414_1994_2_009792004_1
Workunit	9847948
Created	19 May 2015, 15:10:40 UTC
Sent	19 May 2015, 15:12:24 UTC
Report deadline	18 Aug 2015, 22:39:35 UTC
Received	7 Jul 2015, 22:12:14 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1345023
Run time	1 days 15 hours 2 min 37 sec
CPU time	1 days 11 hours 6 min 35 sec
Validate state	Valid
Credit	622.08
Device peak FLOPS	4.20 GFLOPS
Application version	UK Met Office HadCM3 short v7.24 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> INC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_9414_1994_2_009792004;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000c36000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_um_7.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077d50000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 0000000075a70000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.1.7601.18015 (win7sp1_gdr.121129-1432) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.18015 ModLoad: 0000000076250000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.1.7601.18015 (win7sp1_gdr.121129-1432) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.18015 ModLoad: 0000000075cd0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.17514 ModLoad: 0000000075dd0000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18778) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.1.7601.18778 (win7sp1_gdr.150304-1507) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18778 ModLoad: 0000000076370000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18768) (-exported- Symbols Loaded) Linked PDB Filename : wlpk.pdb File Version : 6.1.7601.18768 (win7sp1_gdr.150219-1512) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18768 ModLoad: 0000000075760000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18454) (-exported- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.7601.18454 (win7sp1_gdr.140424-1533) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.7601.18454 ModLoad: 00000000762b0000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.7601.17744 (win7sp1_gdr.111215-1535) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.7601.17744 ModLoad: 0000000077850000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.18869 ModLoad: 0000000075740000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 00000000763e0000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.18532) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 00000000756c0000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 00000000756b0000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 00000000773a0000 000000000002b000 C:\Windows\syswow64\imagehlp.dll (6.1.7601.18288) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.1.7601.18288 (win7sp1_gdr.131018-1533) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18288 ModLoad: 00000000764e0000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 0000000076650000 00000000000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.18731) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 0000000074fa0000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 00000000755e0000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 15624 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D - Registers - eax=1143fa1c ebx=7efde000 ecx=00000003 edx=00000000 esi=0080e158 edi=009e849c eip=7625c42d esp=1143fa1c ebp=1143fa6c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 1143fa6c 007b2d27 e06d7363 00000001 00000003 1143fa98 KERNELBASE!RaiseException+0x0 1143faa4 007afae1 1143fab4 0083a2cc 0080e158 00832824 hadcm3s_um_7.24_windows_intelx8!+0x0 1143fac4 0040643c 04600000 01000000 00500000 00407892 hadcm3s_um_7.24_windows_intelx8!+0x0 1143fef8 007b1c2a 00400000 00000000 1155376b 0000000a hadcm3s_um_7.24_windows_intelx8!+0x0 1143ff88 75a8337a 7efde000 1143ffd4 77d892e2 7efde000 hadcm3s_um_7.24_windows_intelx8!+0x0 1143ff94 77d892e2 7efde000 3dae502d 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 1143ffd4 77d892b5 007b1c7d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 1143ffec 00000000 007b1c7d 7efde000 00000000 12d70000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 10824 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=007352d0 ebx=00000000 ecx=00000000 edx=00000000 esi=33f7fd24 edi=00000000 eip=77d6fddd esp=33f7fce0 ebp=33f7fd48 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246 - Callstack - ChildEBP RetAddr Args to Child 33f7fd48 762644ab 00000064 00000000 33f7ff88 007352f4 ntdll!NtDelayExecution+0x0 33f7fd58 007352f4 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 33f7ff88 75a8337a 00000000 33f7ffd4 77d892e2 00000000 hadcm3s_um_7.24_windows_intelx8!+0x0 33f7ff94 77d892e2 00000000 1f1a502d 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 33f7ffd4 77d892b5 007352d0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 33f7ffec 00000000 007352d0 00000000 00000000 34490000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15520, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 7.2.4 Dump Timestamp : 07/03/15 08:44:15 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_9414_1994_2_009792004;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000c36000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_um_7.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077d50000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 0000000075a70000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 0000000076250000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18869) (-nosymbols- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 0000000075cd0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.17514 ModLoad: 0000000075dd0000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18778) (-nosymbols- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.1.7601.18778 (win7sp1_gdr.150304-1507) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18778 ModLoad: 0000000076370000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18768) (-nosymbols- Symbols Loaded) Linked PDB Filename : wlpk.pdb File Version : 6.1.7601.18768 (win7sp1_gdr.150219-1512) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18768 ModLoad: 0000000075760000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18454) (-nosymbols- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.7601.18454 (win7sp1_gdr.140424-1533) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.7601.18454 ModLoad: 00000000762b0000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-nosymbols- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.7601.17744 (win7sp1_gdr.111215-1535) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.7601.17744 ModLoad: 0000000077850000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.18869) (-nosymbols- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.18869 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 3000 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D - Registers - eax=1143fa1c ebx=7efde000 ecx=00000003 edx=00000000 esi=0080e158 edi=009e849c eip=7625c42d esp=1143fa1c ebp=1143fa6c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 1143fa6c 007b2d27 e06d7363 00000001 00000003 1143fa98 KERNELBASE!+0x0 1143faa4 007afae1 1143fab4 0083a2cc 0080e158 00832824 hadcm3s_um_7.24_windows_intelx8!+0x0 1143fac4 0040643c 04600000 01000000 00500000 00407892 hadcm3s_um_7.24_windows_intelx8!+0x0 1143fef8 007b1c2a 00400000 00000000 0024376b 0000000a hadcm3s_um_7.24_windows_intelx8!+0x0 1143ff88 75a8337a 7efde000 1143ffd4 77d892e2 7efde000 hadcm3s_um_7.24_windows_intelx8!+0x0 1143ff94 77d892e2 7efde000 3dae47bf 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 1143ffd4 77d892b5 007b1c7d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 1143ffec 00000000 007b1c7d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 16032 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=007352d0 ebx=00000000 ecx=00000000 edx=00000000 esi=33d5fd24 edi=00000000 eip=77d6fddd esp=33d5fce0 ebp=33d5fd48 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246 - Callstack - ChildEBP RetAddr Args to Child 33d5fd48 762644ab 00000064 00000000 33d5ff88 007352f4 ntdll!NtDelayExecution+0x0 33d5fd58 007352f4 00000064 00000000 00000000 00000000 KERNELBASE!+0x0 33d5ff88 75a8337a 00000000 33d5ffd4 77d892e2 00000000 hadcm3s_um_7.24_windows_intelx8!+0x0 33d5ff94 77d892e2 00000000 1f3847bf 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 33d5ffd4 77d892b5 007352d0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 33d5ffec 00000000 007352d0 00000000 00000000 34270000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15520, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 7.2.4 Dump Timestamp : 07/03/15 08:44:18 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll SymInitialize(): GetLastError = 8 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 3388 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D * Dump of thread ID 14780 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15520, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 7.2.4 Dump Timestamp : 07/03/15 08:44:20 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll SymInitialize(): GetLastError = 8 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 13192 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D * Dump of thread ID 11060 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15520, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 08:44:23 (15520): called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 7.2.4 Dump Timestamp : 07/03/15 08:45:50 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll SymInitialize(): GetLastError = 8 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 16276 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D * Dump of thread ID 9564 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16284, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 7.2.4 Dump Timestamp : 07/03/15 08:45:53 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_9414_1994_2_009792004;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000c36000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_um_7.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077d50000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 0000000075a70000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 0000000076250000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 0000000075cd0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.17514 ModLoad: 0000000075dd0000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18778) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.1.7601.18778 (win7sp1_gdr.150304-1507) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18778 ModLoad: 0000000076370000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18768) (-exported- Symbols Loaded) Linked PDB Filename : wlpk.pdb File Version : 6.1.7601.18768 (win7sp1_gdr.150219-1512) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18768 ModLoad: 0000000075760000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18454) (-exported- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.7601.18454 (win7sp1_gdr.140424-1533) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.7601.18454 ModLoad: 00000000762b0000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.7601.17744 (win7sp1_gdr.111215-1535) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.7601.17744 ModLoad: 0000000077850000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.18869 ModLoad: 0000000075740000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 00000000763e0000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.18532) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 00000000756c0000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 00000000756b0000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 00000000773a0000 000000000002b000 C:\Windows\syswow64\imagehlp.dll (6.1.7601.18288) (-nosymbols- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.1.7601.18288 (win7sp1_gdr.131018-1533) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18288 ModLoad: 00000000764e0000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-nosymbols- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 0000000076650000 00000000000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.18731) (-nosymbols- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 0000000074fa0000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 00000000755e0000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 11816 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D - Registers - eax=1143fa1c ebx=7efde000 ecx=00000003 edx=00000000 esi=0080e158 edi=009e849c eip=7625c42d esp=1143fa1c ebp=1143fa6c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 1143fa6c 007b2d27 e06d7363 00000001 00000003 1143fa98 KERNELBASE!RaiseException+0x0 1143faa4 007afae1 1143fab4 0083a2cc 0080e158 00832824 hadcm3s_um_7.24_windows_intelx8!+0x0 1143fac4 0040643c 04600000 01000000 00500000 00407892 hadcm3s_um_7.24_windows_intelx8!+0x0 1143fef8 007b1c2a 00400000 00000000 1159376b 0000000a hadcm3s_um_7.24_windows_intelx8!+0x0 1143ff88 75a8337a 7efde000 1143ffd4 77d892e2 7efde000 hadcm3s_um_7.24_windows_intelx8!+0x0 1143ff94 77d892e2 7efde000 3dacc75d 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 1143ffd4 77d892b5 007b1c7d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 1143ffec 00000000 007b1c7d 7efde000 00000000 025f8901 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 13040 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=007352d0 ebx=00000000 ecx=00000000 edx=00000000 esi=33ddfd24 edi=00000000 eip=77d6fddd esp=33ddfce0 ebp=33ddfd48 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246 - Callstack - ChildEBP RetAddr Args to Child 33ddfd48 762644ab 00000064 00000000 33ddff88 007352f4 ntdll!NtDelayExecution+0x0 33ddfd58 007352f4 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 33ddff88 75a8337a 00000000 33ddffd4 77d892e2 00000000 hadcm3s_um_7.24_windows_intelx8!+0x0 33ddff94 77d892e2 00000000 1f32c75d 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 33ddffd4 77d892b5 007352d0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 33ddffec 00000000 007352d0 00000000 00000000 342f0000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16284, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 7.2.4 Dump Timestamp : 07/03/15 08:45:56 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_9414_1994_2_009792004;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000c36000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_um_7.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077d50000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 0000000075a70000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 0000000076250000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 0000000075cd0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.17514 ModLoad: 0000000075dd0000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18778) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.1.7601.18778 (win7sp1_gdr.150304-1507) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18778 ModLoad: 0000000076370000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18768) (-exported- Symbols Loaded) Linked PDB Filename : wlpk.pdb File Version : 6.1.7601.18768 (win7sp1_gdr.150219-1512) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18768 ModLoad: 0000000075760000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18454) (-exported- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.7601.18454 (win7sp1_gdr.140424-1533) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.7601.18454 ModLoad: 00000000762b0000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.7601.17744 (win7sp1_gdr.111215-1535) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.7601.17744 ModLoad: 0000000077850000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.18869 ModLoad: 0000000075740000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 00000000763e0000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.18532) (-nosymbols- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7600.16385 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 8368 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D - Registers - eax=1143fa1c ebx=7efde000 ecx=00000003 edx=00000000 esi=0080e158 edi=009e849c eip=7625c42d esp=1143fa1c ebp=1143fa6c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 1143fa6c 007b2d27 e06d7363 00000001 00000003 1143fa98 KERNELBASE!RaiseException+0x0 1143faa4 007afae1 1143fab4 0083a2cc 0080e158 00832824 hadcm3s_um_7.24_windows_intelx8!+0x0 1143fac4 0040643c 04600000 01000000 00500000 00407892 hadcm3s_um_7.24_windows_intelx8!+0x0 1143fef8 007b1c2a 00400000 00000000 1155376b 0000000a hadcm3s_um_7.24_windows_intelx8!+0x0 1143ff88 75a8337a 7efde000 1143ffd4 77d892e2 7efde000 hadcm3s_um_7.24_windows_intelx8!+0x0 1143ff94 77d892e2 7efde000 3dacfc0a 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 1143ffd4 77d892b5 007b1c7d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 1143ffec 00000000 007b1c7d 7efde000 00000000 497fb73e ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 8320 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=007352d0 ebx=00000000 ecx=00000000 edx=00000000 esi=33f6fd24 edi=00000000 eip=77d6fddd esp=33f6fce0 ebp=33f6fd48 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246 - Callstack - ChildEBP RetAddr Args to Child 33f6fd48 762644ab 00000064 00000000 33f6ff88 007352f4 ntdll!NtDelayExecution+0x0 33f6fd58 007352f4 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 33f6ff88 75a8337a 00000000 33f6ffd4 77d892e2 00000000 hadcm3s_um_7.24_windows_intelx8!+0x0 33f6ff94 77d892e2 00000000 1f19fc0a 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 33f6ffd4 77d892b5 007352d0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 33f6ffec 00000000 007352d0 00000000 00000000 34480000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16284, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 7.2.4 Dump Timestamp : 07/03/15 08:45:59 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_9414_1994_2_009792004;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000c36000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_um_7.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077d50000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 0000000075a70000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.1.7601.18015 (win7sp1_gdr.121129-1432) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.18015 ModLoad: 0000000076250000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.1.7601.18015 (win7sp1_gdr.121129-1432) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.18015 ModLoad: 0000000075cd0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.17514 ModLoad: 0000000075dd0000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18778) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.1.7601.18778 (win7sp1_gdr.150304-1507) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18778 ModLoad: 0000000076370000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18768) (-exported- Symbols Loaded) Linked PDB Filename : wlpk.pdb File Version : 6.1.7601.18768 (win7sp1_gdr.150219-1512) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18768 ModLoad: 0000000075760000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18454) (-exported- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.7601.18454 (win7sp1_gdr.140424-1533) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.7601.18454 ModLoad: 00000000762b0000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.7601.17744 (win7sp1_gdr.111215-1535) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.7601.17744 ModLoad: 0000000077850000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.18869 ModLoad: 0000000075740000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 00000000763e0000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.18532) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 00000000756c0000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 00000000756b0000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 00000000773a0000 000000000002b000 C:\Windows\syswow64\imagehlp.dll (6.1.7601.18288) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.1.7601.18288 (win7sp1_gdr.131018-1533) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18288 ModLoad: 00000000764e0000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 0000000076650000 00000000000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.18731) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 0000000074fa0000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 00000000755e0000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 3476 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D - Registers - eax=1143fa1c ebx=7efde000 ecx=00000003 edx=00000000 esi=0080e158 edi=009e849c eip=7625c42d esp=1143fa1c ebp=1143fa6c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 1143fa6c 007b2d27 e06d7363 00000001 00000003 1143fa98 KERNELBASE!RaiseException+0x0 1143faa4 007afae1 1143fab4 0083a2cc 0080e158 00832824 hadcm3s_um_7.24_windows_intelx8!+0x0 1143fac4 0040643c 04600000 01000000 00500000 00407892 hadcm3s_um_7.24_windows_intelx8!+0x0 1143fef8 007b1c2a 00400000 00000000 001c376b 0000000a hadcm3s_um_7.24_windows_intelx8!+0x0 1143ff88 75a8337a 7efde000 1143ffd4 77d892e2 7efde000 hadcm3s_um_7.24_windows_intelx8!+0x0 1143ff94 77d892e2 7efde000 3dacf121 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 1143ffd4 77d892b5 007b1c7d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 1143ffec 00000000 007b1c7d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 16228 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=007352d0 ebx=00000000 ecx=00000000 edx=00000000 esi=33e0fd24 edi=00000000 eip=77d6fddd esp=33e0fce0 ebp=33e0fd48 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246 - Callstack - ChildEBP RetAddr Args to Child 33e0fd48 762644ab 00000064 00000000 33e0ff88 007352f4 ntdll!NtDelayExecution+0x0 33e0fd58 007352f4 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 33e0ff88 75a8337a 00000000 33e0ffd4 77d892e2 00000000 hadcm3s_um_7.24_windows_intelx8!+0x0 33e0ff94 77d892e2 00000000 1f0ff121 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 33e0ffd4 77d892b5 007352d0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 33e0ffec 00000000 007352d0 00000000 00000000 34320000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16284, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 7.2.4 Dump Timestamp : 07/03/15 08:46:02 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_9414_1994_2_009792004;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000c36000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_um_7.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077d50000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 0000000075a70000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 0000000076250000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18869) (-nosymbols- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.1.7601.18869 (win7sp1_gdr.150525-0603) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18869 ModLoad: 0000000075cd0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Operativsystemet Microsoft® Windows® Product Version : 6.1.7601.17514 ModLoad: 0000000075dd0000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18778) (-nosymbols- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.1.7601.18778 (win7sp1_gdr.150304-1507) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18778 ModLoad: 0000000075760000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18454) (-nosymbols- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.7601.18454 (win7sp1_gdr.140424-1533) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.7601.18454 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 3416 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7625C42D - Registers - eax=1143fa1c ebx=7efde000 ecx=00000003 edx=00000000 esi=0080e158 edi=009e849c eip=7625c42d esp=1143fa1c ebp=1143fa6c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 1143fa6c 007b2d27 e06d7363 00000001 00000003 1143fa98 KERNELBASE!+0x0 1143faa4 007afae1 1143fab4 0083a2cc 0080e158 00832824 hadcm3s_um_7.24_windows_intelx8!+0x0 1143fac4 0040643c 04600000 01000000 00500000 00407892 hadcm3s_um_7.24_windows_intelx8!+0x0 1143fef8 007b1c2a 00400000 00000000 002e376b 0000000a hadcm3s_um_7.24_windows_intelx8!+0x0 1143ff88 75a8337a 7efde000 1143ffd4 77d892e2 7efde000 hadcm3s_um_7.24_windows_intelx8!+0x0 1143ff94 77d892e2 7efde000 3dace68f 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 1143ffd4 77d892b5 007b1c7d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 1143ffec 00000000 007b1c7d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 12856 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=007352d0 ebx=00000000 ecx=00000000 edx=00000000 esi=33e0fd24 edi=00000000 eip=77d6fddd esp=33e0fce0 ebp=33e0fd48 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246 - Callstack - ChildEBP RetAddr Args to Child 33e0fd48 762644ab 00000064 00000000 33e0ff88 007352f4 ntdll!NtDelayExecution+0x0 33e0fd58 007352f4 00000064 00000000 00000000 00000000 KERNELBASE!+0x0 33e0ff88 75a8337a 00000000 33e0ffd4 77d892e2 00000000 hadcm3s_um_7.24_windows_intelx8!+0x0 33e0ff94 77d892e2 00000000 1f0fe68f 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 33e0ffd4 77d892b5 007352d0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 33e0ffec 00000000 007352d0 00000000 00000000 34320000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16284, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... 08:46:05 (11436): called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16284, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 08:46:09 (16284): called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit re

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Jul 2015 21:04:33	1345023	18456355	hadcm3s_9414_1994_2_009792004_1	51,840	127,332	2.4563
25 Jun 2015 19:14:23	1345023	18456355	hadcm3s_9414_1994_2_009792004_1	25,920	39,832	1.5367