climateprediction.net home page
Task 17983388

Task 17983388

Name hadam3pm2_k1p8_1959_10_009463431_2
Workunit 9545665
Created 26 Feb 2015, 8:44:15 UTC
Sent 2 Mar 2015, 21:03:04 UTC
Report deadline 13 Feb 2016, 2:23:04 UTC
Received 8 Apr 2015, 17:13:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID 1356656
Run time 9 days 9 hours 29 min 48 sec
CPU time 8 days 19 hours 31 min 5 sec
Validate state Invalid
Credit 7,070.56
Device peak FLOPS 1.34 GFLOPS
Application version UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03
i686-pc-linux-gnu
Stderr
<core_client_version>7.2.33</core_client_version>
<![CDATA[
<message>
too many exit(0)s
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
14:04:14 (3185): BOINC client no longer exists - exiting
14:04:14 (3185): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:31:56 (32314): BOINC client no longer exists - exiting
10:31:56 (32314): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Unable to load library hadam3pm2_se_7.03_i686-pc-linux-gnu.so
dlopen error: libz.so.1: cannot open shared object file: No such file or directory
Unable to load library hadam3pm2_se_7.03_i686-pc-linux-gnu.so
dlopen error: libz.so.1: cannot open shared object file: No such file or directory
Unable to load library hadam3pm2_se_7.03_i686-pc-linux-gnu.so
dlopen error: libz.so.1: cannot open shared object file: No such file or directory
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:22:12 (14321): BOINC client no longer exists - exiting
18:22:12 (14321): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10036, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10036, iMonCtr=1
Model crash detected, will try to restart...
09:03:36 (10036): BOINC client no longer exists - exiting
09:03:36 (10036): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:03:47 (15558): BOINC client no longer exists - exiting
09:03:47 (15558): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:03:58 (15562): BOINC client no longer exists - exiting
09:03:58 (15562): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:04:09 (15567): BOINC client no longer exists - exiting
09:04:09 (15567): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:04:19 (15572): BOINC client no longer exists - exiting
09:04:19 (15572): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:04:30 (15577): BOINC client no longer exists - exiting
09:04:30 (15577): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:04:41 (15582): BOINC client no longer exists - exiting
09:04:41 (15582): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:04:51 (15587): BOINC client no longer exists - exiting
09:04:51 (15587): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:05:02 (15592): BOINC client no longer exists - exiting
09:05:02 (15592): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:05:13 (15623): BOINC client no longer exists - exiting
09:05:13 (15623): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:05:24 (15628): BOINC client no longer exists - exiting
09:05:24 (15628): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:05:35 (15633): BOINC client no longer exists - exiting
09:05:35 (15633): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:05:46 (15638): BOINC client no longer exists - exiting
09:05:46 (15638): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:05:56 (15643): BOINC client no longer exists - exiting
09:05:56 (15643): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:06:07 (15648): BOINC client no longer exists - exiting
09:06:07 (15648): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:06:18 (15654): BOINC client no longer exists - exiting
09:06:18 (15654): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:06:29 (15659): BOINC client no longer exists - exiting
09:06:29 (15659): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:06:39 (15664): BOINC client no longer exists - exiting
09:06:39 (15664): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:06:50 (15669): BOINC client no longer exists - exiting
09:06:50 (15669): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:07:01 (15674): BOINC client no longer exists - exiting
09:07:01 (15674): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:07:12 (15678): BOINC client no longer exists - exiting
09:07:12 (15678): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:07:24 (15683): BOINC client no longer exists - exiting
09:07:24 (15683): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:07:35 (15688): BOINC client no longer exists - exiting
09:07:35 (15688): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:07:46 (15693): BOINC client no longer exists - exiting
09:07:46 (15693): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:07:57 (15698): BOINC client no longer exists - exiting
09:07:57 (15698): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:08:08 (15703): BOINC client no longer exists - exiting
09:08:08 (15703): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:08:19 (15708): BOINC client no longer exists - exiting
09:08:19 (15708): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:08:30 (15713): BOINC client no longer exists - exiting
09:08:30 (15713): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:08:41 (15720): BOINC client no longer exists - exiting
09:08:41 (15720): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:08:51 (15725): BOINC client no longer exists - exiting
09:08:51 (15725): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:09:02 (15729): BOINC client no longer exists - exiting
09:09:02 (15729): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:09:13 (15734): BOINC client no longer exists - exiting
09:09:13 (15734): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:09:24 (15739): BOINC client no longer exists - exiting
09:09:24 (15739): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:09:35 (15744): BOINC client no longer exists - exiting
09:09:35 (15744): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:09:45 (15749): BOINC client no longer exists - exiting
09:09:45 (15749): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:09:56 (15754): BOINC client no longer exists - exiting
09:09:56 (15754): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:10:07 (15759): BOINC client no longer exists - exiting
09:10:07 (15759): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:10:18 (15786): BOINC client no longer exists - exiting
09:10:18 (15786): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:10:29 (15792): BOINC client no longer exists - exiting
09:10:29 (15792): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:10:40 (15797): BOINC client no longer exists - exiting
09:10:40 (15797): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:10:52 (15802): BOINC client no longer exists - exiting
09:10:52 (15802): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:11:03 (15806): BOINC client no longer exists - exiting
09:11:03 (15806): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:11:14 (15812): BOINC client no longer exists - exiting
09:11:14 (15812): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:11:25 (15817): BOINC client no longer exists - exiting
09:11:25 (15817): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:11:36 (15822): BOINC client no longer exists - exiting
09:11:36 (15822): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:11:47 (15827): BOINC client no longer exists - exiting
09:11:47 (15827): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:11:58 (15832): BOINC client no longer exists - exiting
09:11:58 (15832): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:12:09 (16252): BOINC client no longer exists - exiting
09:12:09 (16252): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:12:20 (16873): BOINC client no longer exists - exiting
09:12:20 (16873): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:12:31 (17501): BOINC client no longer exists - exiting
09:12:31 (17501): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:12:42 (18129): BOINC client no longer exists - exiting
09:12:42 (18129): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:12:53 (18757): BOINC client no longer exists - exiting
09:12:53 (18757): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:13:04 (19232): BOINC client no longer exists - exiting
09:13:04 (19232): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:13:16 (19237): BOINC client no longer exists - exiting
09:13:16 (19237): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:13:27 (19242): BOINC client no longer exists - exiting
09:13:27 (19242): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:13:38 (19247): BOINC client no longer exists - exiting
09:13:38 (19247): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:13:49 (19252): BOINC client no longer exists - exiting
09:13:49 (19252): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:13:59 (19257): BOINC client no longer exists - exiting
09:13:59 (19257): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:14:10 (19262): BOINC client no longer exists - exiting
09:14:10 (19262): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:14:20 (19267): BOINC client no longer exists - exiting
09:14:20 (19267): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:14:31 (19272): BOINC client no longer exists - exiting
09:14:31 (19272): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:14:42 (19277): BOINC client no longer exists - exiting
09:14:42 (19277): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:14:53 (19281): BOINC client no longer exists - exiting
09:14:53 (19281): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:15:05 (19286): BOINC client no longer exists - exiting
09:15:05 (19286): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:15:16 (19317): BOINC client no longer exists - exiting
09:15:16 (19317): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:15:27 (19323): BOINC client no longer exists - exiting
09:15:27 (19323): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:15:38 (19328): BOINC client no longer exists - exiting
09:15:38 (19328): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:15:49 (19333): BOINC client no longer exists - exiting
09:15:49 (19333): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:16:00 (19338): BOINC client no longer exists - exiting
09:16:00 (19338): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:16:11 (19343): BOINC client no longer exists - exiting
09:16:11 (19343): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:16:22 (19351): BOINC client no longer exists - exiting
09:16:22 (19351): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:16:33 (19358): BOINC client no longer exists - exiting
09:16:33 (19358): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:16:44 (19365): BOINC client no longer exists - exiting
09:16:44 (19365): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:16:55 (19371): BOINC client no longer exists - exiting
09:16:55 (19371): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:17:07 (19376): BOINC client no longer exists - exiting
09:17:07 (19376): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:17:18 (19382): BOINC client no longer exists - exiting
09:17:18 (19382): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:17:29 (19387): BOINC client no longer exists - exiting
09:17:29 (19387): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:17:40 (19392): BOINC client no longer exists - exiting
09:17:40 (19392): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:17:51 (19397): BOINC client no longer exists - exiting
09:17:51 (19397): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:18:02 (19402): BOINC client no longer exists - exiting
09:18:02 (19402): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:18:13 (19408): BOINC client no longer exists - exiting
09:18:13 (19408): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:18:24 (19413): BOINC client no longer exists - exiting
09:18:24 (19413): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:18:35 (19418): BOINC client no longer exists - exiting
09:18:35 (19418): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:18:46 (19423): BOINC client no longer exists - exiting
09:18:46 (19423): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:18:57 (19428): BOINC client no longer exists - exiting
09:18:57 (19428): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:19:08 (19433): BOINC client no longer exists - exiting
09:19:08 (19433): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:19:19 (19437): BOINC client no longer exists - exiting
09:19:19 (19437): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:19:30 (19442): BOINC client no longer exists - exiting
09:19:30 (19442): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:19:41 (19447): BOINC client no longer exists - exiting
09:19:41 (19447): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:19:52 (19452): BOINC client no longer exists - exiting
09:19:52 (19452): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:20:03 (19457): BOINC client no longer exists - exiting
09:20:03 (19457): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:20:14 (19484): BOINC client no longer exists - exiting
09:20:14 (19484): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:20:25 (19490): BOINC client no longer exists - exiting
09:20:25 (19490): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:20:36 (19495): BOINC client no longer exists - exiting
09:20:36 (19495): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:20:47 (19500): BOINC client no longer exists - exiting
09:20:47 (19500): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:20:58 (19511): BOINC client no longer exists - exiting
09:20:58 (19511): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:21:09 (19516): BOINC client no longer exists - exiting
09:21:09 (19516): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:21:20 (19522): BOINC client no longer exists - exiting
09:21:20 (19522): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:21:31 (19527): BOINC client no longer exists - exiting
09:21:31 (19527): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:21:42 (19532): BOINC client no longer exists - exiting
09:21:42 (19532): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:21:53 (19537): BOINC client no longer exists - exiting
09:21:53 (19537): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
07 Apr 2015 10:01:05 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 244,868 706,717 2.8861
30 Mar 2015 23:02:52 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 216,068 611,991 2.8324
30 Mar 2015 20:31:57 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 213,188 603,613 2.8314
30 Mar 2015 18:41:24 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 210,308 595,219 2.8302
29 Mar 2015 10:13:42 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 175,748 496,113 2.8229
28 Mar 2015 06:33:49 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 144,068 406,636 2.8225
28 Mar 2015 04:23:00 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 141,188 398,623 2.8233
28 Mar 2015 02:06:41 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 138,308 390,560 2.8238
27 Mar 2015 23:50:22 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 135,428 382,458 2.8241
27 Mar 2015 21:25:35 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 132,548 374,246 2.8235
27 Mar 2015 19:03:07 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 129,668 366,026 2.8228
27 Mar 2015 16:39:51 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 126,788 357,859 2.8225
27 Mar 2015 14:18:15 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 123,908 349,689 2.8222
27 Mar 2015 11:56:49 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 121,028 341,541 2.8220
27 Mar 2015 09:35:31 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 118,148 333,399 2.8219
27 Mar 2015 07:09:23 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 115,268 325,234 2.8215
27 Mar 2015 04:53:24 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 112,388 317,074 2.8212
27 Mar 2015 02:33:42 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 109,508 308,842 2.8203
27 Mar 2015 00:12:18 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 106,628 300,583 2.8190
16 Mar 2015 21:36:38 1356656 17983388 hadam3pm2_k1p8_1959_10_009463431_2 77,828 216,763 2.7852


©2024 climateprediction.net