Name | hadcm3n_n23y_1920_40_008335169_3 |
Workunit | 8486030 |
Created | 23 Sep 2013, 11:23:19 UTC |
Sent | 23 Sep 2013, 11:31:25 UTC |
Report deadline | 23 Dec 2013, 18:58:36 UTC |
Received | 25 Dec 2013, 21:06:05 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1262488 |
Run time | 88 days 21 hours 9 min 9 sec |
CPU time | 28 days 12 hours 23 min 38 sec |
Validate state | Invalid |
Credit | 6,842.88 |
Device peak FLOPS | 1.24 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
Stderr | <core_client_version>7.2.33</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 01:00:07 (6076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:31:52 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:31:53 (4364): No heartbeat from core client for 30 sec - exiting 07:31:54 (4364): No heartbeat from core client for 30 sec - exiting 07:31:55 (4364): No heartbeat from core client for 30 sec - exiting 07:31:56 (4364): No heartbeat from core client for 30 sec - exiting 07:31:57 (4364): No heartbeat from core client for 30 sec - exiting 07:32:00 (2872): Can't acquire lockfile (32) - waiting 35s Suspended CPDN Monitor - Suspend request from BOINC... 04:19:25 (5008): No heartbeat from core client for 30 sec - exiting 04:19:26 (5008): No heartbeat from core client for 30 sec - exiting 04:19:27 (5008): No heartbeat from core client for 30 sec - exiting 04:19:28 (5008): No heartbeat from core client for 30 sec - exiting 04:19:29 (5008): No heartbeat from core client for 30 sec - exiting 04:19:30 (5008): No heartbeat from core client for 30 sec - exiting 04:19:31 (5008): No heartbeat from core client for 30 sec - exiting 04:19:32 (5008): No heartbeat from core client for 30 sec - exiting 04:19:33 (5008): No heartbeat from core client for 30 sec - exiting 04:19:34 (5008): No heartbeat from core client for 30 sec - exiting 04:19:35 (5008): No heartbeat from core client for 30 sec - exiting 04:19:36 (5008): No heartbeat from core client for 30 sec - exiting 04:19:37 (5008): No heartbeat from core client for 30 sec - exiting 04:19:38 (5008): No heartbeat from core client for 30 sec - exiting 04:19:39 (5008): No heartbeat from core client for 30 sec - exiting 04:19:40 (5008): No heartbeat from core client for 30 sec - exiting 04:19:41 (5008): No heartbeat from core client for 30 sec - exiting 04:19:42 (5008): No heartbeat from core client for 30 sec - exiting 04:19:43 (5008): No heartbeat from core client for 30 sec - exiting 04:19:44 (5008): No heartbeat from core client for 30 sec - exiting 04:19:45 (5008): No heartbeat from core client for 30 sec - exiting 04:19:46 (5008): No heartbeat from core client for 30 sec - exiting 04:19:47 (5008): No heartbeat from core client for 30 sec - exiting 04:19:48 (5008): No heartbeat from core client for 30 sec - exiting 04:19:49 (5008): No heartbeat from core client for 30 sec - exiting 04:19:50 (5008): No heartbeat from core client for 30 sec - exiting 04:19:51 (5008): No heartbeat from core client for 30 sec - exiting 04:19:52 (5008): No heartbeat from core client for 30 sec - exiting 04:19:53 (5008): No heartbeat from core client for 30 sec - exiting 04:19:54 (5008): No heartbeat from core client for 30 sec - exiting 04:19:55 (5008): No heartbeat from core client for 30 sec - exiting 04:19:56 (5008): No heartbeat from core client for 30 sec - exiting 04:19:57 (5008): No heartbeat from core client for 30 sec - exiting 04:19:58 (5008): No heartbeat from core client for 30 sec - exiting 04:19:59 (5008): No heartbeat from core client for 30 sec - exiting 04:20:00 (5008): No heartbeat from core client for 30 sec - exiting 04:20:01 (5008): No heartbeat from core client for 30 sec - exiting 04:20:02 (6016): Can't acquire lockfile (32) - waiting 35s 04:20:02 (5008): No heartbeat from core client for 30 sec - exiting 04:20:03 (5008): No heartbeat from core client for 30 sec - exiting 04:20:04 (5008): No heartbeat from core client for 30 sec - exiting 04:20:05 (5008): No heartbeat from core client for 30 sec - exiting 04:20:06 (5008): No heartbeat from core client for 30 sec - exiting 04:20:07 (5008): No heartbeat from core client for 30 sec - exiting 04:20:08 (5008): No heartbeat from core client for 30 sec - exiting 04:20:09 (5008): No heartbeat from core client for 30 sec - exiting 04:20:10 (5008): No heartbeat from core client for 30 sec - exiting 04:20:11 (5008): No heartbeat from core client for 30 sec - exiting 04:20:12 (5008): No heartbeat from core client for 30 sec - exiting 04:20:13 (5008): No heartbeat from core client for 30 sec - exiting 04:20:14 (5008): No heartbeat from core client for 30 sec - exiting 04:20:15 (5008): No heartbeat from core client for 30 sec - exiting 04:20:16 (5008): No heartbeat from core client for 30 sec - exiting 04:20:17 (5008): No heartbeat from core client for 30 sec - exiting 04:20:18 (5008): No heartbeat from core client for 30 sec - exiting 04:20:19 (5008): No heartbeat from core client for 30 sec - exiting 04:20:20 (5008): No heartbeat from core client for 30 sec - exiting 04:20:22 (5008): No heartbeat from core client for 30 sec - exiting 04:20:23 (5008): No heartbeat from core client for 30 sec - exiting 04:20:24 (5008): No heartbeat from core client for 30 sec - exiting 04:20:25 (5008): No heartbeat from core client for 30 sec - exiting 04:20:26 (5008): No heartbeat from core client for 30 sec - exiting 04:20:27 (5008): No heartbeat from core client for 30 sec - exiting 04:20:28 (5008): No heartbeat from core client for 30 sec - exiting 04:20:29 (5008): No heartbeat from core client for 30 sec - exiting 04:20:30 (5008): No heartbeat from core client for 30 sec - exiting 04:20:31 (5008): No heartbeat from core client for 30 sec - exiting 04:20:32 (5008): No heartbeat from core client for 30 sec - exiting 04:20:33 (5008): No heartbeat from core client for 30 sec - exiting 04:20:34 (5008): No heartbeat from core client for 30 sec - exiting 04:20:35 (5008): No heartbeat from core client for 30 sec - exiting 04:20:36 (5008): No heartbeat from core client for 30 sec - exiting 04:20:37 (5008): No heartbeat from core client for 30 sec - exiting 04:20:38 (5008): No heartbeat from core client for 30 sec - exiting 04:20:39 (5008): No heartbeat from core client for 30 sec - exiting 04:20:40 (5008): No heartbeat from core client for 30 sec - exiting 04:20:41 (5008): No heartbeat from core client for 30 sec - exiting 04:20:42 (5008): No heartbeat from core client for 30 sec - exiting 04:20:42 (6016): Can't acquire lockfile (32) - exiting 04:20:42 (6016): Error: The process cannot access the file because it is being used by another process. (0x20) 04:20:43 (5008): No heartbeat from core client for 30 sec - exiting 04:20:44 (5008): No heartbeat from core client for 30 sec - exiting 04:20:45 (5008): No heartbeat from core client for 30 sec - exiting 04:20:46 (5008): No heartbeat from core client for 30 sec - exiting 04:20:47 (5008): No heartbeat from core client for 30 sec - exiting 04:20:48 (5008): No heartbeat from core client for 30 sec - exiting 04:20:49 (5008): No heartbeat from core client for 30 sec - exiting 04:20:50 (5008): No heartbeat from core client for 30 sec - exiting 04:20:51 (5008): No heartbeat from core client for 30 sec - exiting 04:20:52 (5008): No heartbeat from core client for 30 sec - exiting 04:20:53 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:20:54 (5008): No heartbeat from core client for 30 sec - exiting 04:20:55 (5008): No heartbeat from core client for 30 sec - exiting 04:20:56 (5008): No heartbeat from core client for 30 sec - exiting 04:20:57 (5008): No heartbeat from core client for 30 sec - exiting 05:45:24 (2436): No heartbeat from core client for 30 sec - exiting 05:45:25 (2436): No heartbeat from core client for 30 sec - exiting 05:45:26 (2436): No heartbeat from core client for 30 sec - exiting 05:45:27 (2436): No heartbeat from core client for 30 sec - exiting 05:45:28 (2436): No heartbeat from core client for 30 sec - exiting 05:45:29 (2436): No heartbeat from core client for 30 sec - exiting 05:45:30 (2436): No heartbeat from core client for 30 sec - exiting 05:45:32 (2436): No heartbeat from core client for 30 sec - exiting 05:45:33 (2436): No heartbeat from core client for 30 sec - exiting 05:45:34 (2436): No heartbeat from core client for 30 sec - exiting 05:45:35 (2436): No heartbeat from core client for 30 sec - exiting 05:45:36 (2436): No heartbeat from core client for 30 sec - exiting 05:45:37 (2436): No heartbeat from core client for 30 sec - exiting 05:45:38 (2436): No heartbeat from core client for 30 sec - exiting 05:45:39 (2436): No heartbeat from core client for 30 sec - exiting 05:45:40 (2436): No heartbeat from core client for 30 sec - exiting 05:45:41 (2436): No heartbeat from core client for 30 sec - exiting 05:45:42 (2436): No heartbeat from core client for 30 sec - exiting 05:45:43 (2436): No heartbeat from core client for 30 sec - exiting 05:45:44 (2436): No heartbeat from core client for 30 sec - exiting 05:45:45 (2436): No heartbeat from core client for 30 sec - exiting 05:45:46 (2436): No heartbeat from core client for 30 sec - exiting 05:45:47 (2436): No heartbeat from core client for 30 sec - exiting 05:45:48 (2436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:47:37 (2044): Can't acquire lockfile (32) - waiting 35s Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 04:01:56 (5752): No heartbeat from core client for 30 sec - exiting 04:01:57 (5752): No heartbeat from core client for 30 sec - exiting 04:01:58 (5752): No heartbeat from core client for 30 sec - exiting 04:01:59 (5752): No heartbeat from core client for 30 sec - exiting 04:02:00 (5752): No heartbeat from core client for 30 sec - exiting 04:02:01 (5752): No heartbeat from core client for 30 sec - exiting 04:02:02 (5752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:04:03 (5524): Can't acquire lockfile (32) - waiting 35s 17:28:56 (5524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:28:57 (5524): No heartbeat from core client for 30 sec - exiting 17:29:04 (8068): Can't acquire lockfile (32) - waiting 35s Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:04:51 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:04:52 (5764): No heartbeat from core client for 30 sec - exiting 18:04:53 (5764): No heartbeat from core client for 30 sec - exiting 18:04:54 (5764): No heartbeat from core client for 30 sec - exiting 18:04:55 (5764): No heartbeat from core client for 30 sec - exiting 18:05:02 (5152): Can't acquire lockfile (32) - waiting 35s 04:03:36 (5544): No heartbeat from core client for 30 sec - exiting 04:03:37 (5544): No heartbeat from core client for 30 sec - exiting 04:03:38 (5544): No heartbeat from core client for 30 sec - exiting 04:03:39 (5544): No heartbeat from core client for 30 sec - exiting 04:03:40 (5544): No heartbeat from core client for 30 sec - exiting 04:03:41 (5544): No heartbeat from core client for 30 sec - exiting 04:03:42 (5544): No heartbeat from core client for 30 sec - exiting 04:03:43 (5544): No heartbeat from core client for 30 sec - exiting 04:03:45 (5544): No heartbeat from core client for 30 sec - exiting 04:03:46 (5544): No heartbeat from core client for 30 sec - exiting 04:03:47 (5544): No heartbeat from core client for 30 sec - exiting 04:03:48 (5544): No heartbeat from core client for 30 sec - exiting 04:03:49 (5544): No heartbeat from core client for 30 sec - exiting 04:03:50 (5544): No heartbeat from core client for 30 sec - exiting 04:03:51 (5544): No heartbeat from core client for 30 sec - exiting 04:03:52 (5544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:05:55 (4992): Can't acquire lockfile (32) - waiting 35s Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3120, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... 17:49:26 (6048): No heartbeat from core client for 30 sec - exiting 17:49:27 (6048): No heartbeat from core client for 30 sec - exiting 17:49:28 (6048): No heartbeat from core client for 30 sec - exiting 17:49:29 (6048): No heartbeat from core client for 30 sec - exiting 17:49:31 (6048): No heartbeat from core client for 30 sec - exiting 17:49:32 (6048): No heartbeat from core client for 30 sec - exiting 17:49:33 (6048): No heartbeat from core client for 30 sec - exiting 17:49:34 (6048): No heartbeat from core client for 30 sec - exiting 17:49:35 (6048): No heartbeat from core client for 30 sec - exiting 17:49:36 (6048): No heartbeat from core client for 30 sec - exiting 17:49:37 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:50:05 (2136): Can't acquire lockfile (32) - waiting 35s 06:13:45 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:50:12 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:13 (4644): No heartbeat from core client for 30 sec - exiting 17:21:10 (5132): No heartbeat from core client for 30 sec - exiting 17:21:11 (5132): No heartbeat from core client for 30 sec - exiting 17:21:12 (5132): No heartbeat from core client for 30 sec - exiting 17:21:13 (5132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:22:48 (2248): Can't acquire lockfile (32) - waiting 35s Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=1 Model crash detected, will try to restart... 15:07:05 (4832): No heartbeat from core client for 30 sec - exiting 15:07:06 (4832): No heartbeat from core client for 30 sec - exiting 15:07:07 (4832): No heartbeat from core client for 30 sec - exiting 15:07:09 (4832): No heartbeat from core client for 30 sec - exiting 15:07:10 (4832): No heartbeat from core client for 30 sec - exiting 15:07:11 (4832): No heartbeat from core client for 30 sec - exiting 15:07:12 (4832): No heartbeat from core client for 30 sec - exiting 15:07:13 (4832): No heartbeat from core client for 30 sec - exiting 15:07:14 (4832): No heartbeat from core client for 30 sec - exiting 15:07:15 (4832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:27:57 (4664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:27:58 (4664): No heartbeat from core client for 30 sec - exiting 17:27:59 (4664): No heartbeat from core client for 30 sec - exiting 17:28:00 (4664): No heartbeat from core client for 30 sec - exiting 17:28:01 (4664): No heartbeat from core client for 30 sec - exiting 17:28:02 (4664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3092, iMonCtr=1 Model crash detected, will try to restart... 13:02:25 (2824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:26 (2824): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4592, iMonCtr=1 Model crash detected, will try to restart... 03:53:05 (5808): No heartbeat from core client for 30 sec - exiting 03:53:06 (5808): No heartbeat from core client for 30 sec - exiting 03:53:07 (5808): No heartbeat from core client for 30 sec - exiting 03:53:08 (5808): No heartbeat from core client for 30 sec - exiting 03:53:09 (5808): No heartbeat from core client for 30 sec - exiting 03:53:11 (5808): No heartbeat from core client for 30 sec - exiting 03:53:12 (5808): No heartbeat from core client for 30 sec - exiting 03:53:13 (5808): No heartbeat from core client for 30 sec - exiting 03:53:14 (5808): No heartbeat from core client for 30 sec - exiting 03:53:15 (5808): No heartbeat from core client for 30 sec - exiting 03:53:16 (5808): No heartbeat from core client for 30 sec - exiting 03:53:17 (5808): No heartbeat from core client for 30 sec - exiting 03:53:18 (5808): No heartbeat from core client for 30 sec - exiting 03:53:19 (5808): No heartbeat from core client for 30 sec - exiting 03:53:20 (5808): No heartbeat from core client for 30 sec - exiting 03:53:21 (5808): No heartbeat from core client for 30 sec - exiting 03:53:22 (5808): No heartbeat from core client for 30 sec - exiting 03:53:24 (5808): No heartbeat from core client for 30 sec - exiting 03:53:25 (5808): No heartbeat from core client for 30 sec - exiting 03:53:26 (5808): No heartbeat from core client for 30 sec - exiting 03:53:27 (5808): No heartbeat from core client for 30 sec - exiting 03:53:28 (5808): No heartbeat from core client for 30 sec - exiting 03:53:29 (5808): No heartbeat from core client for 30 sec - exiting 03:53:30 (5808): No heartbeat from core client for 30 sec - exiting 03:53:31 (5808): No heartbeat from core client for 30 sec - exiting 03:53:32 (5808): No heartbeat from core client for 30 sec - exiting 03:53:34 (5808): No heartbeat from core client for 30 sec - exiting 03:53:35 (5808): No heartbeat from core client for 30 sec - exiting 03:53:36 (5808): No heartbeat from core client for 30 sec - exiting 03:53:37 (5808): No heartbeat from core client for 30 sec - exiting 03:53:38 (5808): No heartbeat from core client for 30 sec - exiting 03:53:39 (5808): No heartbeat from core client for 30 sec - exiting 03:53:40 (5808): No heartbeat from core client for 30 sec - exiting 03:53:41 (5808): No heartbeat from core client for 30 sec - exiting 03:53:42 (5808): No heartbeat from core client for 30 sec - exiting 03:53:43 (5808): No heartbeat from core client for 30 sec - exiting 03:53:44 (5808): No heartbeat from core client for 30 sec - exiting 03:53:46 (5808): No heartbeat from core client for 30 sec - exiting 03:53:47 (5808): No heartbeat from core client for 30 sec - exiting 03:53:48 (5808): No heartbeat from core client for 30 sec - exiting 03:53:49 (5808): No heartbeat from core client for 30 sec - exiting 03:53:50 (5808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:54:41 (1704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:54:42 (1704): No heartbeat from core client for 30 sec - exiting 05:54:43 (1704): No heartbeat from core client for 30 sec - exiting 15:00:09 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:00:10 (5576): No heartbeat from core client for 30 sec - exiting 15:00:11 (5576): No heartbeat from core client for 30 sec - exiting 15:00:12 (5576): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3364, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=640, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3172, iMonCtr=1 Model crash detected, will try to restController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5144, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5144, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5144, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5144, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5144, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5144, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
23 Dec 2013 02:39:35 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 570,240 | 2,369,128 | 4.1546 |
20 Dec 2013 08:20:49 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 544,320 | 2,264,135 | 4.1596 |
16 Dec 2013 21:52:52 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 518,400 | 2,159,303 | 4.1653 |
13 Dec 2013 04:47:14 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 492,480 | 2,053,144 | 4.1690 |
07 Dec 2013 20:23:34 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 466,560 | 1,949,699 | 4.1789 |
02 Dec 2013 13:20:02 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 440,640 | 1,836,936 | 4.1688 |
27 Nov 2013 10:06:12 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 414,720 | 1,720,985 | 4.1498 |
22 Nov 2013 08:51:13 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 388,800 | 1,612,186 | 4.1466 |
18 Nov 2013 04:38:45 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 362,880 | 1,499,552 | 4.1324 |
12 Nov 2013 16:46:11 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 336,960 | 1,387,709 | 4.1183 |
08 Nov 2013 17:41:27 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 311,040 | 1,282,873 | 4.1245 |
04 Nov 2013 08:24:12 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 285,120 | 1,177,130 | 4.1285 |
01 Nov 2013 04:20:54 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 259,200 | 1,070,944 | 4.1317 |
28 Oct 2013 18:55:22 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 233,280 | 964,854 | 4.1360 |
24 Oct 2013 14:29:49 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 207,360 | 857,355 | 4.1346 |
20 Oct 2013 01:10:44 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 181,440 | 748,433 | 4.1250 |
15 Oct 2013 01:52:12 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 155,520 | 640,782 | 4.1203 |
11 Oct 2013 10:05:39 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 129,600 | 533,604 | 4.1173 |
07 Oct 2013 16:27:42 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 103,680 | 429,343 | 4.1410 |
03 Oct 2013 21:20:25 | 1262488 | 16031544 | hadcm3n_n23y_1920_40_008335169_3 | 77,760 | 325,151 | 4.1815 |
©2024 climateprediction.net