 |
|
| Name | hadcm3n_o3dj_1980_40_007456893_4 |
| Workunit | 7654396 |
| Created | 25 Oct 2011, 16:15:47 UTC |
| Sent | 25 Oct 2011, 16:16:26 UTC |
| Report deadline | 24 Jan 2012, 23:43:37 UTC |
| Received | 5 Dec 2011, 17:44:47 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1132603 |
| Run time | 21 days 15 hours 12 min 58 sec |
| CPU time | 17 days 23 hours 42 min 15 sec |
| Validate state | Invalid |
| Credit | 6,220.80 |
| Device peak FLOPS | 1.82 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0857acb8 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6bf31)[0xf74fff31] /lib32/libc.so.6(+0x6d7a8)[0xf75017a8] /lib32/libc.so.6(cfree+0x6d)[0xf750488d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76daa31] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76daa8d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf74aac76] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:2b 919754 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:2b 919754 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 08525000-0858b000 rw-p 00000000 00:00 0 [heap] f6f00000-f6f21000 rw-p 00000000 00:00 0 f6f21000-f7000000 ---p 00000000 00:00 0 f7017000-f7492000 rw-s 00000000 08:2b 1052090 /var/lib/boinc-client/slots/7/137810 f7492000-f7494000 rw-p 00000000 00:00 0 f7494000-f75d4000 r-xp 00000000 08:2b 1444719 /lib32/libc-2.11.2.so f75d4000-f75d5000 ---p 00140000 08:2b 1444719 /lib32/libc-2.11.2.so f75d5000-f75d7000 r--p 00140000 08:2b 1444719 /lib32/libc-2.11.2.so f75d7000-f75d8000 rw-p 00142000 08:2b 1444719 /lib32/libc-2.11.2.so f75d8000-f75db000 rw-p 00000000 00:00 0 f75db000-f75f8000 r-xp 00000000 08:2b 394080 /usr/lib32/libgcc_s.so.1 f75f8000-f75f9000 rw-p 0001c000 08:2b 394080 /usr/lib32/libgcc_s.so.1 f75f9000-f761d000 r-xp 00000000 08:2b 1444728 /lib32/libm-2.11.2.so f761d000-f761e000 r--p 00023000 08:2b 1444728 /lib32/libm-2.11.2.so f761e000-f761f000 rw-p 00024000 08:2b 1444728 /lib32/libm-2.11.2.so f761f000-f7708000 r-xp 00000000 08:2b 394092 /usr/lib32/libstdc++.so.6.0.13 f7708000-f770c000 r--p 000e9000 08:2b 394092 /usr/lib32/libstdc++.so.6.0.13 f770c000-f770d000 rw-p 000ed000 08:2b 394092 /usr/lib32/libstdc++.so.6.0.13 f770d000-f7714000 rw-p 00000000 00:00 0 f7714000-f7716000 r-xp 00000000 08:2b 1444718 /lib32/libdl-2.11.2.so f7716000-f7717000 r--p 00001000 08:2b 1444718 /lib32/libdl-2.11.2.so f7717000-f7718000 rw-p 00002000 08:2b 1444718 /lib32/libdl-2.11.2.so f7718000-f7719000 rw-p 00000000 00:00 0 f7719000-f772e000 r-xp 00000000 08:2b 1444720 /lib32/libpthread-2.11.2.so f772e000-f772f000 r--p 00014000 08:2b 1444720 /lib32/libpthread-2.11.2.so f772f000-f7730000 rw-p 00015000 08:2b 1444720 /lib32/libpthread-2.11.2.so f7730000-f7732000 rw-p 00000000 00:00 0 f774a000-f774b000 rw-p 00000000 00:00 0 f774b000-f774c000 ---p 00000000 00:00 0 f774c000-f774f000 rw-p 00000000 00:00 0 f774f000-f7751000 rw-s 00000000 08:2b 1052050 /var/lib/boinc-client/slots/7/boinc_mmap_file f7751000-f7753000 rw-p 00000000 00:00 0 f7753000-f7754000 r-xp 00000000 00:00 0 [vdso] f7754000-f7770000 r-xp 00000000 08:2b 1444731 /lib32/ld-2.11.2.so f7770000-f7771000 r--p 0001b000 08:2b 1444731 /lib32/ld-2.11.2.so f7771000-f7772000 rw-p 0001c000 08:2b 1444731 /lib32/ld-2.11.2.so ff84e000-ff8be000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf7753400] [0xf7753425] /lib32/libc.so.6(gsignal+0x51)[0xf74bea21] /lib32/libc.so.6(abort+0x182)[0xf74c1e42] /lib32/libc.so.6(+0x61e35)[0xf74f5e35] /lib32/libc.so.6(+0x6bf31)[0xf74fff31] /lib32/libc.so.6(+0x6d7a8)[0xf75017a8] /lib32/libc.so.6(cfree+0x6d)[0xf750488d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76daa31] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76daa8d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf74aac76] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 05 Dec 2011 17:49:08 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 518,400 | 1,554,129 | 2.9979 |
| 03 Dec 2011 01:29:33 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 492,480 | 1,475,936 | 2.9969 |
| 01 Dec 2011 14:47:58 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 466,560 | 1,398,403 | 2.9973 |
| 30 Nov 2011 10:11:58 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 440,640 | 1,321,712 | 2.9995 |
| 29 Nov 2011 01:13:34 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 414,720 | 1,244,661 | 3.0012 |
| 25 Nov 2011 19:45:32 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 388,800 | 1,166,175 | 2.9994 |
| 24 Nov 2011 10:11:56 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 362,880 | 1,087,659 | 2.9973 |
| 22 Nov 2011 18:31:37 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 336,960 | 1,009,201 | 2.9950 |
| 21 Nov 2011 15:35:17 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 311,040 | 930,673 | 2.9921 |
| 19 Nov 2011 11:19:22 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 285,120 | 852,674 | 2.9906 |
| 17 Nov 2011 17:55:49 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 259,200 | 775,492 | 2.9919 |
| 16 Nov 2011 07:54:32 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 233,280 | 697,362 | 2.9894 |
| 15 Nov 2011 17:18:10 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 207,360 | 620,711 | 2.9934 |
| 10 Nov 2011 07:52:22 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 181,440 | 542,570 | 2.9904 |
| 08 Nov 2011 19:15:11 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 155,520 | 465,456 | 2.9929 |
| 06 Nov 2011 08:24:28 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 129,600 | 387,739 | 2.9918 |
| 04 Nov 2011 09:48:30 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 103,680 | 311,161 | 3.0012 |
| 31 Oct 2011 20:04:16 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 77,760 | 234,183 | 3.0116 |
| 31 Oct 2011 18:19:15 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 51,840 | 156,540 | 3.0197 |
| 31 Oct 2011 16:54:50 | 1132603 | 13517240 | hadcm3n_o3dj_1980_40_007456893_4 | 25,920 | 78,002 | 3.0093 |
©2024 climateprediction.net