climateprediction.net home page
Task 21384783

Task 21384783

Name wah2_global_e0bk_208812_145_767_011657288_1
Workunit 11657288
Created 16 Nov 2018, 17:32:11 UTC
Sent 16 Nov 2018, 17:42:12 UTC
Report deadline 29 Oct 2019, 23:02:12 UTC
Received 9 Dec 2018, 17:08:45 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1168327
Run time 9 days 22 hours 3 min 23 sec
CPU time 7 days 14 hours 20 min 6 sec
Validate state Invalid
Credit 9,693.61
Device peak FLOPS 2.34 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 238.27 MB
Peak swap size 174.09 MB
Peak disk usage 50.78 MB
Stderr 
<core_client_version>7.12.1</core_client_version>
<![CDATA[
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:12:16 (17904): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
19:00:12 (12144): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9808, selfPID=9808, iMonCtr=1
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
11:07:19 (15284): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=15284, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11416, selfPID=11416, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11416, selfPID=8644, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
11:07:56 (8644): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_52.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_53.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_54.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_55.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_56.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_57.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_58.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_59.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_60.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_61.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_62.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_63.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_64.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_65.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_66.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_67.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_68.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_69.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_70.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_71.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_72.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_73.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_74.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_75.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_76.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_77.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_78.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_79.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_80.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_81.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_82.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_83.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_84.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_85.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_86.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_87.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_88.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_89.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_90.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_91.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_92.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_93.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_94.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_95.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_96.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_97.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_98.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_99.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_100.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_101.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_102.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_103.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_104.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_105.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_106.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_107.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_108.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_109.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_110.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_111.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_112.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_113.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_114.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_115.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_116.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_117.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_118.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_119.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_120.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_121.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_122.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_123.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_124.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_125.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_126.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_127.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_128.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_129.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_130.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_131.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_132.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_133.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_134.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_135.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_136.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_137.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_138.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_139.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_140.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_141.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_142.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_143.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_144.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_145.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e0bk_208812_145_767_011657288_1_r928934076_restart.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Dec 2018 12:47:15 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 146,947 646,360 4.3986
09 Dec 2018 07:37:17 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 144,067 633,944 4.4003
09 Dec 2018 02:22:55 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 141,187 621,150 4.3995
08 Dec 2018 18:52:42 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 138,307 608,517 4.3998
08 Dec 2018 13:13:56 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 135,427 596,065 4.4014
08 Dec 2018 07:22:09 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 132,547 583,680 4.4036
08 Dec 2018 00:41:58 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 129,667 570,932 4.4031
07 Dec 2018 17:43:09 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 126,787 557,935 4.4006
07 Dec 2018 12:39:51 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 123,907 545,030 4.3987
07 Dec 2018 07:30:54 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 121,027 532,316 4.3983
07 Dec 2018 03:26:30 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 118,147 519,556 4.3975
05 Dec 2018 11:06:02 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 115,267 507,118 4.3995
05 Dec 2018 11:06:02 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 112,387 494,929 4.4038
05 Dec 2018 04:55:26 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 109,507 482,656 4.4075
04 Dec 2018 11:40:49 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 106,627 470,258 4.4103
04 Dec 2018 06:07:09 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 103,747 458,040 4.4150
02 Dec 2018 06:13:00 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 100,867 445,907 4.4207
28 Nov 2018 08:12:51 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 97,987 433,162 4.4206
28 Nov 2018 04:03:44 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 95,107 420,188 4.4181
27 Nov 2018 11:50:56 1168327 21384783 wah2_global_e0bk_208812_145_767_011657288_1 92,227 407,427 4.4177


©2024 climateprediction.net