 |
|
| Name | hadcm3n_u5la_1980_40_007752873_1 |
| Workunit | 7907982 |
| Created | 16 Feb 2012, 19:47:25 UTC |
| Sent | 16 Feb 2012, 19:48:14 UTC |
| Report deadline | 18 May 2012, 3:15:25 UTC |
| Received | 12 Mar 2012, 23:12:43 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1288357 |
| Run time | 13 days 23 hours 2 min 38 sec |
| CPU time | 13 days 16 hours 21 min 55 sec |
| Validate state | Invalid |
| Credit | 6,220.80 |
| Device peak FLOPS | 2.28 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/u5lako.pjj8c10 is not a valid UM file. Error converting file to netcdf: dataout/u5lako.pjj8c10 Error: Input file: dataout/u5lako.pij8c10 is not a valid UM file. Error converting file to netcdf: dataout/u5lako.pij8c10 Error: Input file: dataout/u5lako.pfj8c10 is not a valid UM file. Error converting file to netcdf: dataout/u5lako.pfj8c10 Error: Input file: dataout/u5laka.phj8c10 is not a valid UM file. Error converting file to netcdf: dataout/u5laka.phj8c10 Error: Input file: dataout/u5laka.pgj8c10 is not a valid UM file. Error converting file to netcdf: dataout/u5laka.pgj8c10 Error: Input file: dataout/u5laka.pej8c10 is not a valid UM file. Error converting file to netcdf: dataout/u5laka.pej8c10 Error: Input file: dataout/u5laka.pdj8c10 is not a valid UM file. Error converting file to netcdf: dataout/u5laka.pdj8c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09fa8180 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6be01)[0xf7493e01] /lib32/libc.so.6(+0x6d688)[0xf7495688] /lib32/libc.so.6(cfree+0x6d)[0xf749876d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7681a91] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7681aed] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf743ebd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:05 197450 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:05 197450 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09f52000-09fb8000 rw-p 00000000 00:00 0 [heap] f6e00000-f6e21000 rw-p 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6fab000-f7426000 rw-s 00000000 08:05 194654 /var/lib/boinc-client/slots/0/137605 f7426000-f7428000 rw-p 00000000 00:00 0 f7428000-f757b000 r-xp 00000000 08:05 680307 /lib32/libc-2.11.1.so f757b000-f757d000 r--p 00153000 08:05 680307 /lib32/libc-2.11.1.so f757d000-f757e000 rw-p 00155000 08:05 680307 /lib32/libc-2.11.1.so f757e000-f7581000 rw-p 00000000 00:00 0 f7581000-f759e000 r-xp 00000000 08:05 261345 /usr/lib32/libgcc_s.so.1 f759e000-f759f000 r--p 0001c000 08:05 261345 /usr/lib32/libgcc_s.so.1 f759f000-f75a0000 rw-p 0001d000 08:05 261345 /usr/lib32/libgcc_s.so.1 f75a0000-f75c4000 r-xp 00000000 08:05 680290 /lib32/libm-2.11.1.so f75c4000-f75c5000 r--p 00023000 08:05 680290 /lib32/libm-2.11.1.so f75c5000-f75c6000 rw-p 00024000 08:05 680290 /lib32/libm-2.11.1.so f75c6000-f76af000 r-xp 00000000 08:05 274478 /usr/lib32/libstdc++.so.6.0.13 f76af000-f76b0000 ---p 000e9000 08:05 274478 /usr/lib32/libstdc++.so.6.0.13 f76b0000-f76b4000 r--p 000e9000 08:05 274478 /usr/lib32/libstdc++.so.6.0.13 f76b4000-f76b5000 rw-p 000ed000 08:05 274478 /usr/lib32/libstdc++.so.6.0.13 f76b5000-f76bc000 rw-p 00000000 00:00 0 f76bc000-f76be000 r-xp 00000000 08:05 680311 /lib32/libdl-2.11.1.so f76be000-f76bf000 r--p 00001000 08:05 680311 /lib32/libdl-2.11.1.so f76bf000-f76c0000 rw-p 00002000 08:05 680311 /lib32/libdl-2.11.1.so f76c0000-f76c1000 rw-p 00000000 00:00 0 f76c1000-f76d6000 r-xp 00000000 08:05 680305 /lib32/libpthread-2.11.1.so f76d6000-f76d7000 r--p 00014000 08:05 680305 /lib32/libpthread-2.11.1.so f76d7000-f76d8000 rw-p 00015000 08:05 680305 /lib32/libpthread-2.11.1.so f76d8000-f76da000 rw-p 00000000 00:00 0 f76f5000-f76f6000 rw-p 00000000 00:00 0 f76f6000-f76f7000 ---p 00000000 00:00 0 f76f7000-f76fa000 rw-p 00000000 00:00 0 f76fa000-f76fc000 rw-s 00000000 08:05 136478 /var/lib/boinc-client/slots/0/boinc_mmap_file f76fc000-f76fe000 rw-p 00000000 00:00 0 f76fe000-f76ff000 r-xp 00000000 00:00 0 [vdso] f76ff000-f771b000 r-xp 00000000 08:05 680292 /lib32/ld-2.11.1.so f771b000-f771c000 r--p 0001b000 08:05 680292 /lib32/ld-2.11.1.so f771c000-f771d000 rw-p 0001c000 08:05 680292 /lib32/ld-2.11.1.so ffb1a000-ffb89000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf76fe400] [0xf76fe430] /lib32/libc.so.6(gsignal+0x51)[0xf7452921] /lib32/libc.so.6(abort+0x182)[0xf7455d52] /lib32/libc.so.6(+0x61d0d)[0xf7489d0d] /lib32/libc.so.6(+0x6be01)[0xf7493e01] /lib32/libc.so.6(+0x6d688)[0xf7495688] /lib32/libc.so.6(cfree+0x6d)[0xf749876d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7681a91] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7681aed] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf743ebd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 12 Mar 2012 23:12:59 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 518,400 | 1,182,110 | 2.2803 |
| 11 Mar 2012 08:49:58 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 492,480 | 1,119,775 | 2.2737 |
| 10 Mar 2012 00:59:05 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 466,560 | 1,055,966 | 2.2633 |
| 08 Mar 2012 14:33:37 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 440,640 | 993,220 | 2.2540 |
| 07 Mar 2012 04:58:00 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 414,720 | 929,956 | 2.2424 |
| 05 Mar 2012 18:55:14 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 388,800 | 871,177 | 2.2407 |
| 04 Mar 2012 06:31:06 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 362,880 | 811,984 | 2.2376 |
| 02 Mar 2012 23:44:02 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 336,960 | 753,003 | 2.2347 |
| 01 Mar 2012 10:22:47 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 311,040 | 692,576 | 2.2266 |
| 28 Feb 2012 21:59:55 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 285,120 | 631,614 | 2.2153 |
| 27 Feb 2012 10:08:13 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 259,200 | 570,313 | 2.2003 |
| 26 Feb 2012 03:16:36 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 233,280 | 512,517 | 2.1970 |
| 25 Feb 2012 02:23:42 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 207,360 | 455,363 | 2.1960 |
| 24 Feb 2012 00:39:07 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 181,440 | 398,457 | 2.1961 |
| 22 Feb 2012 23:13:14 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 155,520 | 341,821 | 2.1979 |
| 21 Feb 2012 23:22:03 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 129,600 | 284,968 | 2.1988 |
| 20 Feb 2012 22:34:12 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 103,680 | 228,455 | 2.2035 |
| 19 Feb 2012 22:26:05 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 77,760 | 171,724 | 2.2084 |
| 18 Feb 2012 22:14:39 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 51,840 | 114,174 | 2.2024 |
| 17 Feb 2012 19:54:31 | 1184745 | 14102182 | hadcm3n_u5la_1980_40_007752873_1 | 25,920 | 56,263 | 2.1706 |
©2024 climateprediction.net