climateprediction.net home page
Task 19160695

Task 19160695

Name hadcm3n_xdio_198012_480_010218182_1
Workunit 10218182
Created 14 Dec 2015, 20:49:35 UTC
Sent 14 Dec 2015, 20:50:37 UTC
Report deadline 26 Nov 2016, 2:10:37 UTC
Received 30 Dec 2015, 16:39:13 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1051604
Run time 12 days 15 hours 59 min 27 sec
CPU time 8 days 22 hours 33 min 48 sec
Validate state Invalid
Credit 4,976.64
Device peak FLOPS 2.72 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.6.12</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/xdioko.pjj5c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioko.pjj5c10
Error: Input file: dataout/xdioko.pij5c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioko.pij5c10
Error: Input file: dataout/xdioko.pfj5c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioko.pfj5c10
Error: Input file: dataout/xdioka.phj5c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioka.phj5c10
Error: Input file: dataout/xdioka.pgj5c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioka.pgj5c10
Error: Input file: dataout/xdioka.pej5c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioka.pej5c10
Error: Input file: dataout/xdioka.pdj5c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioka.pdj5c10
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/xdioko.pjj6c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioko.pjj6c10
Error: Input file: dataout/xdioko.pij6c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioko.pij6c10
Error: Input file: dataout/xdioko.pfj6c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioko.pfj6c10
Error: Input file: dataout/xdioka.phj6c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioka.phj6c10
Error: Input file: dataout/xdioka.pgj6c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioka.pgj6c10
Error: Input file: dataout/xdioka.pej6c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioka.pej6c10
Error: Input file: dataout/xdioka.pdj6c10 is not a valid UM file.
Error converting file to netcdf: dataout/xdioka.pdj6c10
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.10.5 build 14F27
Wed Dec 30 09:37:49 2015

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc88 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x90188000 - 0x901b1fff /usr/lib/system/libsystem_info.dylib
0x9052f000 - 0x9052ffff /usr/lib/system/liblaunch.dylib
0x90599000 - 0x90605fff /usr/lib/system/libcorecrypto.dylib
0x90a98000 - 0x90ab1fff /usr/lib/system/libsystem_malloc.dylib
0x90dab000 - 0x90dadfff /usr/lib/system/libsystem_sandbox.dylib
0x91a52000 - 0x91a5afff /usr/lib/system/libsystem_pthread.dylib
0x91c0a000 - 0x91c16fff /usr/lib/system/libcommonCrypto.dylib
0x91cae000 - 0x91cd5fff /usr/lib/system/libdispatch.dylib
0x92b5f000 - 0x92b64fff /usr/lib/system/libcompiler_rt.dylib
0x92b65000 - 0x92b67fff /usr/lib/system/libsystem_secinit.dylib
0x92f94000 - 0x92f95fff /usr/lib/system/libremovefile.dylib
0x932fd000 - 0x93323fff /usr/lib/system/libxpc.dylib
0x93463000 - 0x9347afff /usr/lib/system/libsystem_asl.dylib
0x93ca2000 - 0x93cabfff /usr/lib/system/libsystem_notify.dylib
0x94231000 - 0x94237fff /usr/lib/system/libsystem_networkextension.dylib
0x94238000 - 0x94238fff /usr/lib/system/libkeymgr.dylib
0x94612000 - 0x94623fff /usr/lib/system/libsystem_coretls.dylib
0x94df1000 - 0x94df3fff /usr/lib/system/libsystem_coreservices.dylib
0x968d7000 - 0x968dbfff /usr/lib/system/libcache.dylib
0x968fc000 - 0x968fffff /usr/lib/system/libdyld.dylib
0x9690a000 - 0x96910fff /usr/lib/system/libsystem_platform.dylib
0x96b68000 - 0x96ba5fff /usr/lib/system/libsystem_network.dylib
0x97167000 - 0x97169fff /usr/lib/system/libquarantine.dylib
0x976d0000 - 0x976d6fff /usr/lib/system/libsystem_trace.dylib
0x9774a000 - 0x9774afff /usr/lib/system/libunc.dylib
0x99177000 - 0x9917cfff /usr/lib/system/libmacho.dylib
0x9945c000 - 0x9948ffff /usr/lib/system/libsystem_m.dylib
0x99df2000 - 0x99df3fff /usr/lib/libSystem.B.dylib
0x99f61000 - 0x99ff6fff /usr/lib/system/libsystem_c.dylib
0x9a10d000 - 0x9a10efff /usr/lib/system/libsystem_blocks.dylib
0x9a116000 - 0x9a11dfff /usr/lib/system/libunwind.dylib
0x9a600000 - 0x9a60efff /usr/lib/libz.1.dylib
0x9aa74000 - 0x9aa7dfff /usr/lib/system/libcopyfile.dylib
0x9ba3b000 - 0x9ba43fff /usr/lib/system/libsystem_dnssd.dylib
0x9bb03000 - 0x9bb22fff /usr/lib/system/libsystem_kernel.dylib
0x9c056000 - 0x9c058fff /usr/lib/system/libsystem_configuration.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2158, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.10.5 build 14F27
Wed Dec 30 09:37:53 2015

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc88 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x90188000 - 0x901b1fff /usr/lib/system/libsystem_info.dylib
0x9052f000 - 0x9052ffff /usr/lib/system/liblaunch.dylib
0x90599000 - 0x90605fff /usr/lib/system/libcorecrypto.dylib
0x90a98000 - 0x90ab1fff /usr/lib/system/libsystem_malloc.dylib
0x90dab000 - 0x90dadfff /usr/lib/system/libsystem_sandbox.dylib
0x91a52000 - 0x91a5afff /usr/lib/system/libsystem_pthread.dylib
0x91c0a000 - 0x91c16fff /usr/lib/system/libcommonCrypto.dylib
0x91cae000 - 0x91cd5fff /usr/lib/system/libdispatch.dylib
0x92b5f000 - 0x92b64fff /usr/lib/system/libcompiler_rt.dylib
0x92b65000 - 0x92b67fff /usr/lib/system/libsystem_secinit.dylib
0x92f94000 - 0x92f95fff /usr/lib/system/libremovefile.dylib
0x932fd000 - 0x93323fff /usr/lib/system/libxpc.dylib
0x93463000 - 0x9347afff /usr/lib/system/libsystem_asl.dylib
0x93ca2000 - 0x93cabfff /usr/lib/system/libsystem_notify.dylib
0x94231000 - 0x94237fff /usr/lib/system/libsystem_networkextension.dylib
0x94238000 - 0x94238fff /usr/lib/system/libkeymgr.dylib
0x94612000 - 0x94623fff /usr/lib/system/libsystem_coretls.dylib
0x94df1000 - 0x94df3fff /usr/lib/system/libsystem_coreservices.dylib
0x968d7000 - 0x968dbfff /usr/lib/system/libcache.dylib
0x968fc000 - 0x968fffff /usr/lib/system/libdyld.dylib
0x9690a000 - 0x96910fff /usr/lib/system/libsystem_platform.dylib
0x96b68000 - 0x96ba5fff /usr/lib/system/libsystem_network.dylib
0x97167000 - 0x97169fff /usr/lib/system/libquarantine.dylib
0x976d0000 - 0x976d6fff /usr/lib/system/libsystem_trace.dylib
0x9774a000 - 0x9774afff /usr/lib/system/libunc.dylib
0x99177000 - 0x9917cfff /usr/lib/system/libmacho.dylib
0x9945c000 - 0x9948ffff /usr/lib/system/libsystem_m.dylib
0x99df2000 - 0x99df3fff /usr/lib/libSystem.B.dylib
0x99f61000 - 0x99ff6fff /usr/lib/system/libsystem_c.dylib
0x9a10d000 - 0x9a10efff /usr/lib/system/libsystem_blocks.dylib
0x9a116000 - 0x9a11dfff /usr/lib/system/libunwind.dylib
0x9a600000 - 0x9a60efff /usr/lib/libz.1.dylib
0x9aa74000 - 0x9aa7dfff /usr/lib/system/libcopyfile.dylib
0x9ba3b000 - 0x9ba43fff /usr/lib/system/libsystem_dnssd.dylib
0x9bb03000 - 0x9bb22fff /usr/lib/system/libsystem_kernel.dylib
0x9c056000 - 0x9c058fff /usr/lib/system/libsystem_configuration.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2158, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.10.5 build 14F27
Wed Dec 30 09:37:57 2015

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc88 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x90188000 - 0x901b1fff /usr/lib/system/libsystem_info.dylib
0x9052f000 - 0x9052ffff /usr/lib/system/liblaunch.dylib
0x90599000 - 0x90605fff /usr/lib/system/libcorecrypto.dylib
0x90a98000 - 0x90ab1fff /usr/lib/system/libsystem_malloc.dylib
0x90dab000 - 0x90dadfff /usr/lib/system/libsystem_sandbox.dylib
0x91a52000 - 0x91a5afff /usr/lib/system/libsystem_pthread.dylib
0x91c0a000 - 0x91c16fff /usr/lib/system/libcommonCrypto.dylib
0x91cae000 - 0x91cd5fff /usr/lib/system/libdispatch.dylib
0x92b5f000 - 0x92b64fff /usr/lib/system/libcompiler_rt.dylib
0x92b65000 - 0x92b67fff /usr/lib/system/libsystem_secinit.dylib
0x92f94000 - 0x92f95fff /usr/lib/system/libremovefile.dylib
0x932fd000 - 0x93323fff /usr/lib/system/libxpc.dylib
0x93463000 - 0x9347afff /usr/lib/system/libsystem_asl.dylib
0x93ca2000 - 0x93cabfff /usr/lib/system/libsystem_notify.dylib
0x94231000 - 0x94237fff /usr/lib/system/libsystem_networkextension.dylib
0x94238000 - 0x94238fff /usr/lib/system/libkeymgr.dylib
0x94612000 - 0x94623fff /usr/lib/system/libsystem_coretls.dylib
0x94df1000 - 0x94df3fff /usr/lib/system/libsystem_coreservices.dylib
0x968d7000 - 0x968dbfff /usr/lib/system/libcache.dylib
0x968fc000 - 0x968fffff /usr/lib/system/libdyld.dylib
0x9690a000 - 0x96910fff /usr/lib/system/libsystem_platform.dylib
0x96b68000 - 0x96ba5fff /usr/lib/system/libsystem_network.dylib
0x97167000 - 0x97169fff /usr/lib/system/libquarantine.dylib
0x976d0000 - 0x976d6fff /usr/lib/system/libsystem_trace.dylib
0x9774a000 - 0x9774afff /usr/lib/system/libunc.dylib
0x99177000 - 0x9917cfff /usr/lib/system/libmacho.dylib
0x9945c000 - 0x9948ffff /usr/lib/system/libsystem_m.dylib
0x99df2000 - 0x99df3fff /usr/lib/libSystem.B.dylib
0x99f61000 - 0x99ff6fff /usr/lib/system/libsystem_c.dylib
0x9a10d000 - 0x9a10efff /usr/lib/system/libsystem_blocks.dylib
0x9a116000 - 0x9a11dfff /usr/lib/system/libunwind.dylib
0x9a600000 - 0x9a60efff /usr/lib/libz.1.dylib
0x9aa74000 - 0x9aa7dfff /usr/lib/system/libcopyfile.dylib
0x9ba3b000 - 0x9ba43fff /usr/lib/system/libsystem_dnssd.dylib
0x9bb03000 - 0x9bb22fff /usr/lib/system/libsystem_kernel.dylib
0x9c056000 - 0x9c058fff /usr/lib/system/libsystem_configuration.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2158, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.10.5 build 14F27
Wed Dec 30 09:38:00 2015

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc88 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x90188000 - 0x901b1fff /usr/lib/system/libsystem_info.dylib
0x9052f000 - 0x9052ffff /usr/lib/system/liblaunch.dylib
0x90599000 - 0x90605fff /usr/lib/system/libcorecrypto.dylib
0x90a98000 - 0x90ab1fff /usr/lib/system/libsystem_malloc.dylib
0x90dab000 - 0x90dadfff /usr/lib/system/libsystem_sandbox.dylib
0x91a52000 - 0x91a5afff /usr/lib/system/libsystem_pthread.dylib
0x91c0a000 - 0x91c16fff /usr/lib/system/libcommonCrypto.dylib
0x91cae000 - 0x91cd5fff /usr/lib/system/libdispatch.dylib
0x92b5f000 - 0x92b64fff /usr/lib/system/libcompiler_rt.dylib
0x92b65000 - 0x92b67fff /usr/lib/system/libsystem_secinit.dylib
0x92f94000 - 0x92f95fff /usr/lib/system/libremovefile.dylib
0x932fd000 - 0x93323fff /usr/lib/system/libxpc.dylib
0x93463000 - 0x9347afff /usr/lib/system/libsystem_asl.dylib
0x93ca2000 - 0x93cabfff /usr/lib/system/libsystem_notify.dylib
0x94231000 - 0x94237fff /usr/lib/system/libsystem_networkextension.dylib
0x94238000 - 0x94238fff /usr/lib/system/libkeymgr.dylib
0x94612000 - 0x94623fff /usr/lib/system/libsystem_coretls.dylib
0x94df1000 - 0x94df3fff /usr/lib/system/libsystem_coreservices.dylib
0x968d7000 - 0x968dbfff /usr/lib/system/libcache.dylib
0x968fc000 - 0x968fffff /usr/lib/system/libdyld.dylib
0x9690a000 - 0x96910fff /usr/lib/system/libsystem_platform.dylib
0x96b68000 - 0x96ba5fff /usr/lib/system/libsystem_network.dylib
0x97167000 - 0x97169fff /usr/lib/system/libquarantine.dylib
0x976d0000 - 0x976d6fff /usr/lib/system/libsystem_trace.dylib
0x9774a000 - 0x9774afff /usr/lib/system/libunc.dylib
0x99177000 - 0x9917cfff /usr/lib/system/libmacho.dylib
0x9945c000 - 0x9948ffff /usr/lib/system/libsystem_m.dylib
0x99df2000 - 0x99df3fff /usr/lib/libSystem.B.dylib
0x99f61000 - 0x99ff6fff /usr/lib/system/libsystem_c.dylib
0x9a10d000 - 0x9a10efff /usr/lib/system/libsystem_blocks.dylib
0x9a116000 - 0x9a11dfff /usr/lib/system/libunwind.dylib
0x9a600000 - 0x9a60efff /usr/lib/libz.1.dylib
0x9aa74000 - 0x9aa7dfff /usr/lib/system/libcopyfile.dylib
0x9ba3b000 - 0x9ba43fff /usr/lib/system/libsystem_dnssd.dylib
0x9bb03000 - 0x9bb22fff /usr/lib/system/libsystem_kernel.dylib
0x9c056000 - 0x9c058fff /usr/lib/system/libsystem_configuration.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2158, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.10.5 build 14F27
Wed Dec 30 09:38:03 2015

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc88 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x90188000 - 0x901b1fff /usr/lib/system/libsystem_info.dylib
0x9052f000 - 0x9052ffff /usr/lib/system/liblaunch.dylib
0x90599000 - 0x90605fff /usr/lib/system/libcorecrypto.dylib
0x90a98000 - 0x90ab1fff /usr/lib/system/libsystem_malloc.dylib
0x90dab000 - 0x90dadfff /usr/lib/system/libsystem_sandbox.dylib
0x91a52000 - 0x91a5afff /usr/lib/system/libsystem_pthread.dylib
0x91c0a000 - 0x91c16fff /usr/lib/system/libcommonCrypto.dylib
0x91cae000 - 0x91cd5fff /usr/lib/system/libdispatch.dylib
0x92b5f000 - 0x92b64fff /usr/lib/system/libcompiler_rt.dylib
0x92b65000 - 0x92b67fff /usr/lib/system/libsystem_secinit.dylib
0x92f94000 - 0x92f95fff /usr/lib/system/libremovefile.dylib
0x932fd000 - 0x93323fff /usr/lib/system/libxpc.dylib
0x93463000 - 0x9347afff /usr/lib/system/libsystem_asl.dylib
0x93ca2000 - 0x93cabfff /usr/lib/system/libsystem_notify.dylib
0x94231000 - 0x94237fff /usr/lib/system/libsystem_networkextension.dylib
0x94238000 - 0x94238fff /usr/lib/system/libkeymgr.dylib
0x94612000 - 0x94623fff /usr/lib/system/libsystem_coretls.dylib
0x94df1000 - 0x94df3fff /usr/lib/system/libsystem_coreservices.dylib
0x968d7000 - 0x968dbfff /usr/lib/system/libcache.dylib
0x968fc000 - 0x968fffff /usr/lib/system/libdyld.dylib
0x9690a000 - 0x96910fff /usr/lib/system/libsystem_platform.dylib
0x96b68000 - 0x96ba5fff /usr/lib/system/libsystem_network.dylib
0x97167000 - 0x97169fff /usr/lib/system/libquarantine.dylib
0x976d0000 - 0x976d6fff /usr/lib/system/libsystem_trace.dylib
0x9774a000 - 0x9774afff /usr/lib/system/libunc.dylib
0x99177000 - 0x9917cfff /usr/lib/system/libmacho.dylib
0x9945c000 - 0x9948ffff /usr/lib/system/libsystem_m.dylib
0x99df2000 - 0x99df3fff /usr/lib/libSystem.B.dylib
0x99f61000 - 0x99ff6fff /usr/lib/system/libsystem_c.dylib
0x9a10d000 - 0x9a10efff /usr/lib/system/libsystem_blocks.dylib
0x9a116000 - 0x9a11dfff /usr/lib/system/libunwind.dylib
0x9a600000 - 0x9a60efff /usr/lib/libz.1.dylib
0x9aa74000 - 0x9aa7dfff /usr/lib/system/libcopyfile.dylib
0x9ba3b000 - 0x9ba43fff /usr/lib/system/libsystem_dnssd.dylib
0x9bb03000 - 0x9bb22fff /usr/lib/system/libsystem_kernel.dylib
0x9c056000 - 0x9c058fff /usr/lib/system/libsystem_configuration.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2158, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.10.5 build 14F27
Wed Dec 30 09:38:07 2015

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc88 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x90188000 - 0x901b1fff /usr/lib/system/libsystem_info.dylib
0x9052f000 - 0x9052ffff /usr/lib/system/liblaunch.dylib
0x90599000 - 0x90605fff /usr/lib/system/libcorecrypto.dylib
0x90a98000 - 0x90ab1fff /usr/lib/system/libsystem_malloc.dylib
0x90dab000 - 0x90dadfff /usr/lib/system/libsystem_sandbox.dylib
0x91a52000 - 0x91a5afff /usr/lib/system/libsystem_pthread.dylib
0x91c0a000 - 0x91c16fff /usr/lib/system/libcommonCrypto.dylib
0x91cae000 - 0x91cd5fff /usr/lib/system/libdispatch.dylib
0x92b5f000 - 0x92b64fff /usr/lib/system/libcompiler_rt.dylib
0x92b65000 - 0x92b67fff /usr/lib/system/libsystem_secinit.dylib
0x92f94000 - 0x92f95fff /usr/lib/system/libremovefile.dylib
0x932fd000 - 0x93323fff /usr/lib/system/libxpc.dylib
0x93463000 - 0x9347afff /usr/lib/system/libsystem_asl.dylib
0x93ca2000 - 0x93cabfff /usr/lib/system/libsystem_notify.dylib
0x94231000 - 0x94237fff /usr/lib/system/libsystem_networkextension.dylib
0x94238000 - 0x94238fff /usr/lib/system/libkeymgr.dylib
0x94612000 - 0x94623fff /usr/lib/system/libsystem_coretls.dylib
0x94df1000 - 0x94df3fff /usr/lib/system/libsystem_coreservices.dylib
0x968d7000 - 0x968dbfff /usr/lib/system/libcache.dylib
0x968fc000 - 0x968fffff /usr/lib/system/libdyld.dylib
0x9690a000 - 0x96910fff /usr/lib/system/libsystem_platform.dylib
0x96b68000 - 0x96ba5fff /usr/lib/system/libsystem_network.dylib
0x97167000 - 0x97169fff /usr/lib/system/libquarantine.dylib
0x976d0000 - 0x976d6fff /usr/lib/system/libsystem_trace.dylib
0x9774a000 - 0x9774afff /usr/lib/system/libunc.dylib
0x99177000 - 0x9917cfff /usr/lib/system/libmacho.dylib
0x9945c000 - 0x9948ffff /usr/lib/system/libsystem_m.dylib
0x99df2000 - 0x99df3fff /usr/lib/libSystem.B.dylib
0x99f61000 - 0x99ff6fff /usr/lib/system/libsystem_c.dylib
0x9a10d000 - 0x9a10efff /usr/lib/system/libsystem_blocks.dylib
0x9a116000 - 0x9a11dfff /usr/lib/system/libunwind.dylib
0x9a600000 - 0x9a60efff /usr/lib/libz.1.dylib
0x9aa74000 - 0x9aa7dfff /usr/lib/system/libcopyfile.dylib
0x9ba3b000 - 0x9ba43fff /usr/lib/system/libsystem_dnssd.dylib
0x9bb03000 - 0x9bb22fff /usr/lib/system/libsystem_kernel.dylib
0x9c056000 - 0x9c058fff /usr/lib/system/libsystem_configuration.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2158, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
29 Dec 2015 23:21:41 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 414,720 754,005 1.8181
28 Dec 2015 10:19:38 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 388,800 706,597 1.8174
26 Dec 2015 22:10:30 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 362,880 658,195 1.8138
25 Dec 2015 09:32:55 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 336,960 610,292 1.8112
24 Dec 2015 05:49:39 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 311,040 565,528 1.8182
23 Dec 2015 07:49:56 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 285,120 512,319 1.7969
22 Dec 2015 10:18:58 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 259,200 466,106 1.7982
21 Dec 2015 16:15:14 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 233,280 420,868 1.8041
21 Dec 2015 00:06:05 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 207,360 369,333 1.7811
20 Dec 2015 07:57:22 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 181,440 318,019 1.7528
19 Dec 2015 12:52:52 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 155,520 273,790 1.7605
18 Dec 2015 18:29:53 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 129,600 228,756 1.7651
18 Dec 2015 00:38:27 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 103,680 185,079 1.7851
17 Dec 2015 06:18:57 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 77,760 141,827 1.8239
16 Dec 2015 11:45:18 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 51,840 93,364 1.8010
15 Dec 2015 17:11:04 1051604 19160695 hadcm3n_xdio_198012_480_010218182_1 25,920 46,402 1.7902


©2024 climateprediction.net