Task 16593958

Name	hadcm3n_8f4o_1980_40_008729027_0
Workunit	8875005
Created	23 Apr 2014, 14:14:30 UTC
Sent	24 Apr 2014, 18:28:56 UTC
Report deadline	25 Jul 2014, 1:56:07 UTC
Received	19 Jun 2014, 16:46:22 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-529697949 (0xE06D7363) Unknown error code
Computer ID	1285360
Run time	13 days 21 hours 39 min 5 sec
CPU time	13 days 10 hours 18 min 58 sec
Validate state	Invalid
Credit	10,264.32
Device peak FLOPS	2.91 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.3.19</core_client_version> <![CDATA[ <message> (unknown error) - exit code -529697949 (0xe06d7363) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7710C42D Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 06/19/14 18:41:19 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_8f4o_1980_40_008729027;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00111000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 77550000 00180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18247) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 75c40000 00110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18409) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.1.7601.18015 (win7sp1_gdr.121129-1432) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 6.1.7601.18015 ModLoad: 77100000 00047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18409) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.1.7601.18015 (win7sp1_gdr.121129-1432) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 6.1.7601.18015 ModLoad: 76050000 00100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 6.1.7601.17514 ModLoad: 766f0000 00090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18275) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.1.7601.18275 (win7sp1_gdr.131002-1533) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18275 ModLoad: 76d70000 0000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18177) (-exported- Symbols Loaded) Linked PDB Filename : wlpk.pdb File Version : 6.1.7601.18177 (win7sp1_gdr.130605-1534) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18177 ModLoad: 76ba0000 0009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18009) (-exported- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.7601.18009 (win7sp1_gdr.121121-1431) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.7601.18009 ModLoad: 76cb0000 000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.7601.17744 (win7sp1_gdr.111215-1535) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.7601.17744 ModLoad: 76d90000 000a0000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.18247) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 76460000 00019000 C:\Windows\SysWOW64\sechost.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 75ea0000 000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.18205) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 74f80000 00060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.18443) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.1.7601.18443 (win7sp1_gdr.140411-1533) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18443 ModLoad: 74f70000 0000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 75d50000 00060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 76ad0000 000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 72ea0000 00021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : ntmarta.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 75e20000 00045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : wldap32.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 6.1.7600.16385 ModLoad: 745e0000 0004c000 C:\Windows\system32\apphelp.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : apphelp.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 6.1.7601.17514 ModLoad: 6f2a0000 000a4000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_se_6.07_windows_intelx86.dll (-exported- Symbols Loaded) Linked PDB Filename : d:\cpdn\cpdnboinc\hadcm3\test\projects\reqs.comlab.ox.ac.uk_cpdn\hadcm3n_se_6.07_windows_intelx86.pdb ModLoad: 723a0000 000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 74be0000 00009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 5944 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7710C42D - Registers - eax=0018f228 ebx=025e7d00 ecx=00000003 edx=00000000 esi=6f33a484 edi=013afa00 eip=7710c42d esp=0018f228 ebp=0018f278 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 0018f278 6f2fe730 e06d7363 00000001 00000003 0018f2a4 KERNELBASE!RaiseException+0x0 0018f2b0 6f2fbcdc 0018f2c0 6f331fe0 6f3213f4 6f32b230 hadcm3n_se_6.07_windows_intelx8!umtonc+0x0 0018f2cc 6f2afa97 04ebe800 00000010 025e78f8 00000000 hadcm3n_se_6.07_windows_intelx8!umtonc+0x0 0018f2e4 6f2a36b8 ab577ad6 004bb848 004bb710 0018f6e4 hadcm3n_se_6.07_windows_intelx8!+0x0 00000000 00000000 00000000 00000000 00000000 00000000 hadcm3n_se_6.07_windows_intelx8!+0x0 * Dump of thread ID 5300 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=0212ff48 edi=00000000 eip=7756fd91 esp=0212ff04 ebp=0212ff6c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246 - Callstack - ChildEBP RetAddr Args to Child 0212ff6c 771144a5 00000064 00000000 0212ff88 00413da4 ntdll!ZwDelayExecution+0x0 0212ff7c 00413da4 00000064 0212ff94 75c5338a 00000000 KERNELBASE!Sleep+0x0 0212ff88 75c5338a 00000000 0212ffd4 77589f72 00000000 hadcm3n_6.07_windows_intelx86!+0x0 0212ff94 77589f72 00000000 ea00eee7 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 0212ffd4 77589f45 00413d90 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 0212ffec 00000000 00413d90 00000000 00000000 63646168 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Jun 2014 17:49:16	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	855,360	1,130,463	1.3216
11 Jun 2014 14:52:38	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	829,440	1,101,562	1.3281
11 Jun 2014 05:31:39	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	803,520	1,071,980	1.3341
10 Jun 2014 20:10:45	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	777,600	1,040,305	1.3378
10 Jun 2014 09:59:41	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	751,680	1,008,497	1.3417
10 Jun 2014 09:04:06	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	725,760	976,564	1.3456
10 Jun 2014 09:02:14	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	699,840	943,710	1.3485
10 Jun 2014 09:01:33	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	673,920	908,833	1.3486
10 Jun 2014 09:00:54	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	648,000	872,921	1.3471
09 Jun 2014 22:58:08	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	622,080	837,003	1.3455
08 Jun 2014 03:19:50	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	596,160	801,018	1.3436
06 Jun 2014 13:38:30	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	570,240	765,027	1.3416
05 Jun 2014 20:14:51	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	544,320	729,066	1.3394
05 Jun 2014 08:39:45	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	518,400	694,272	1.3393
04 Jun 2014 22:53:20	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	492,480	659,676	1.3395
04 Jun 2014 11:21:29	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	466,560	625,181	1.3400
04 Jun 2014 01:44:43	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	440,640	590,715	1.3406
03 Jun 2014 16:03:00	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	414,720	556,211	1.3412
03 Jun 2014 06:21:02	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	388,800	521,679	1.3418
02 Jun 2014 20:39:11	1285360	16593958	hadcm3n_8f4o_1980_40_008729027_0	362,880	487,222	1.3427