climateprediction.net home page
Task 14198926

Task 14198926

Name hadcm3n_106q_1940_40_007817105_1
Workunit 7972214
Created 28 Feb 2012, 1:23:23 UTC
Sent 28 Feb 2012, 4:25:36 UTC
Report deadline 29 May 2012, 11:52:47 UTC
Received 25 Mar 2012, 22:53:39 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1244551
Run time 21 days 14 hours 3 min 38 sec
CPU time 15 days 20 hours 17 min 50 sec
Validate state Invalid
Credit 5,598.72
Device peak FLOPS 2.08 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.41</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:51:52 (30603): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
02:02:16 (5567): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Skipping gmts_generator due to netcdf error -46 - Invalid dimension id or name
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Skipping gmts_generator due to netcdf error -49 - Variable not found
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
24 Mar 2012 16:14:31 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 466,560 1,350,764 2.8952
23 Mar 2012 11:44:07 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 440,640 1,275,225 2.8940
22 Mar 2012 06:59:07 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 414,720 1,198,797 2.8906
21 Mar 2012 02:17:44 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 388,800 1,131,788 2.9110
19 Mar 2012 21:31:10 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 362,880 1,055,818 2.9096
18 Mar 2012 16:44:52 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 336,960 982,706 2.9164
17 Mar 2012 12:33:19 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 311,040 907,324 2.9171
16 Mar 2012 08:04:03 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 285,120 831,525 2.9164
15 Mar 2012 03:15:08 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 259,200 755,623 2.9152
13 Mar 2012 23:29:06 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 233,280 678,549 2.9087
12 Mar 2012 19:01:07 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 207,360 603,510 2.9104
11 Mar 2012 07:03:07 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 181,440 528,085 2.9105
10 Mar 2012 03:19:05 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 155,520 452,668 2.9107
08 Mar 2012 21:55:20 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 129,600 377,721 2.9145
07 Mar 2012 15:37:34 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 103,680 302,582 2.9184
06 Mar 2012 11:00:18 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 77,760 227,535 2.9261
05 Mar 2012 06:24:59 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 51,840 152,716 2.9459
03 Mar 2012 14:56:30 1195719 14198926 hadcm3n_106q_1940_40_007817105_1 25,920 76,484 2.9508


©2024 climateprediction.net