climateprediction.net home page
Task 16066892

Task 16066892

Name hadcm3n_3i84_1980_40_008364945_3
Workunit 8515804
Created 13 Oct 2013, 8:48:59 UTC
Sent 13 Oct 2013, 8:49:44 UTC
Report deadline 12 Jan 2014, 16:16:55 UTC
Received 12 Jan 2014, 18:55:19 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1195874
Run time 67 days 7 hours 41 min 43 sec
CPU time 60 days 11 hours 39 min 15 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 0.76 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
07:48:27 (4448): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 15 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:07:46 (2007): No heartbeat from core client for 30 sec - exiting
14:07:47 (2007): No heartbeat from core client for 30 sec - exiting
14:07:48 (2007): No heartbeat from core client for 30 sec - exiting
14:07:49 (2007): No heartbeat from core client for 30 sec - exiting
14:07:50 (2007): No heartbeat from core client for 30 sec - exiting
14:07:51 (2007): No heartbeat from core client for 30 sec - exiting
14:07:52 (2007): No heartbeat from core client for 30 sec - exiting
14:07:53 (2007): No heartbeat from core client for 30 sec - exiting
14:07:54 (2007): No heartbeat from core client for 30 sec - exiting
14:07:55 (2007): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_3i84_1980_40_008364945/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_3i84_1980_40_008364945/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_3i84_1980_40_008364945/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_3i84_1980_40_008364945/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_3i84_1980_40_008364945/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_3i84_1980_40_008364945/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_3i84_1980_40_008364945/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_3i84_1980_40_008364945/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_3i84_1980_40_008364945/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_3i84_1980_40_008364945/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_3i84_1980_40_008364945/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_3i84_1980_40_008364945/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Jan 2014 18:59:28 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 1,036,800 5,226,002 5.0405
09 Jan 2014 22:54:26 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 1,010,880 5,099,369 5.0445
08 Jan 2014 04:09:26 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 984,960 4,972,121 5.0480
06 Jan 2014 11:55:36 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 959,040 4,842,537 5.0494
04 Jan 2014 20:01:48 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 933,120 4,712,385 5.0501
03 Jan 2014 04:24:39 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 907,200 4,583,897 5.0528
01 Jan 2014 12:40:24 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 881,280 4,455,434 5.0556
30 Dec 2013 21:42:22 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 855,360 4,326,927 5.0586
29 Dec 2013 06:21:53 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 829,440 4,197,758 5.0610
27 Dec 2013 14:47:41 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 803,520 4,069,556 5.0647
25 Dec 2013 22:06:10 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 777,600 3,937,686 5.0639
24 Dec 2013 05:37:55 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 751,680 3,808,135 5.0662
22 Dec 2013 14:16:08 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 725,760 3,680,484 5.0712
20 Dec 2013 02:03:54 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 699,840 3,552,664 5.0764
18 Dec 2013 10:07:14 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 673,920 3,425,051 5.0823
10 Dec 2013 12:57:22 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 648,000 3,295,958 5.0864
07 Dec 2013 09:20:35 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 622,080 3,163,864 5.0859
05 Dec 2013 16:33:15 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 596,160 3,030,476 5.0833
03 Dec 2013 11:08:49 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 570,240 2,897,633 5.0814
01 Dec 2013 16:04:27 1195874 16066892 hadcm3n_3i84_1980_40_008364945_3 544,320 2,769,848 5.0886


©2024 climateprediction.net