climateprediction.net home page
Task 12458720

Task 12458720

Name famous_xaq3_1699_200_007075730_1
Workunit 7279030
Created 2 Jan 2011, 23:48:53 UTC
Sent 2 Jan 2011, 23:58:44 UTC
Report deadline 4 Apr 2011, 7:25:55 UTC
Received 6 Jan 2011, 21:13:57 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1101510
Run time 2 days 0 hours 21 min 7 sec
CPU time 3 days 16 hours 7 min 12 sec
Validate state Invalid
Credit 772.13
Device peak FLOPS 2.69 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
 (18413): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  

Model crashed:                                                                                                                                                                                                                                                                 tmp/pipe_dummy                                                                  

Model crashed: ERROR,RDBASIS: LEVELS LIST HAS NO ENTRIES                                                                                                                                                                                                                       tmp/pipe_dummy                                                                  

Model crashed: ERROR,RDBASIS: LEVELS LIST HAS NO ENTRIES                                                                                                                                                                                                                       tmp/pipe_dummy                                                                  

Model crashed: ERROR,RDBASIS: LEVELS LIST HAS NO ENTRIES                                                                                                                                                                                                                       tmp/pipe_dummy                                                                  

Model crashed: ERROR,RDBASIS: LEVELS LIST HAS NO ENTRIES                                                                                                                                                                                                                       tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
 (3484): called boinc_finish
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
SIGSEGV: segmentation violation
Stack trace (15 frames):
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400]
[0xf7780400]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x822ceed]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81b05ee]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81b2bac]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81b2559]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8135fef]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81b35a8]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8079c3f]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8314811]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf75debd6]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2293, iMonCtr=1
Model crash detected, will try to restart...
 (2293): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
 (4251): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
SIGSEGV: segmentation violation
Stack trace (15 frames):
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400]
[0xf7753400]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x822ceed]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81b05ee]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81b2bac]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81b2559]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8135fef]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81b35a8]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8079c3f]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8314811]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf75b1bd6]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3696, iMonCtr=1
Model crash detected, will try to restart...
 (3696): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
SIGSEGV: segmentation violation
Stack trace (14 frames):
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(boinc_catch_signal+0x58)[0x83aa400]
[0xf7779400]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x822cd31]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x828fdab]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x812ad5c]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x81b6e3e]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x82376ab]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8077bf6]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8314811]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x832dc4d]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x8330bdf]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu[0x83415d2]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf75d7bd6]
/var/lib/boinc-client/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu(pthread_mutex_unlock+0x149)[0x804c041]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2355, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: SUBROUTINE POTTEM STOPPING - PRESSURE OUT OF RANGE

Model crashed: ERROR,RDBASIS: LEVELS LIST HAS NO ENTRIES                                                                                                                                                                                                                       tmp/pipe_dummy                                                                  

Model crashed: ERROR,RDBASIS: LEVELS LIST HAS NO ENTRIES                                                                                                                                                                                                                       tmp/pipe_dummy                                                                  

Model crashed: ERROR,RDBASIS: LEVELS LIST HAS NO ENTRIES                                                                                                                                                                                                                       tmp/pipe_dummy                                                                  

Model crashed: ERROR,RDBASIS: LEVELS LIST HAS NO ENTRIES                                                                                                                                                                                                                       tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
 (2355): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
04 Jan 2011 21:20:49 1101510 12458720 famous_xaq3_1699_200_007075730_1 234,026 104,800 0.4478
04 Jan 2011 20:14:44 1101510 12458720 famous_xaq3_1699_200_007075730_1 224,666 100,816 0.4487
04 Jan 2011 19:34:15 1101510 12458720 famous_xaq3_1699_200_007075730_1 215,306 96,733 0.4493
04 Jan 2011 19:34:15 1101510 12458720 famous_xaq3_1699_200_007075730_1 205,946 92,512 0.4492
04 Jan 2011 19:34:15 1101510 12458720 famous_xaq3_1699_200_007075730_1 196,586 88,303 0.4492
04 Jan 2011 19:34:15 1101510 12458720 famous_xaq3_1699_200_007075730_1 187,226 84,111 0.4492
04 Jan 2011 11:39:06 1101510 12458720 famous_xaq3_1699_200_007075730_1 177,866 79,914 0.4493
04 Jan 2011 09:56:23 1101510 12458720 famous_xaq3_1699_200_007075730_1 168,506 75,712 0.4493
04 Jan 2011 08:14:58 1101510 12458720 famous_xaq3_1699_200_007075730_1 159,146 71,513 0.4494
04 Jan 2011 06:33:44 1101510 12458720 famous_xaq3_1699_200_007075730_1 149,786 67,300 0.4493
04 Jan 2011 04:29:46 1101510 12458720 famous_xaq3_1699_200_007075730_1 140,426 63,074 0.4492
04 Jan 2011 01:39:33 1101510 12458720 famous_xaq3_1699_200_007075730_1 131,066 58,859 0.4491
04 Jan 2011 00:00:23 1101510 12458720 famous_xaq3_1699_200_007075730_1 121,706 54,639 0.4489
03 Jan 2011 21:57:03 1101510 12458720 famous_xaq3_1699_200_007075730_1 112,346 50,424 0.4488
03 Jan 2011 20:13:32 1101510 12458720 famous_xaq3_1699_200_007075730_1 102,986 46,217 0.4488
03 Jan 2011 18:42:48 1101510 12458720 famous_xaq3_1699_200_007075730_1 93,626 41,993 0.4485
03 Jan 2011 16:44:22 1101510 12458720 famous_xaq3_1699_200_007075730_1 84,266 37,793 0.4485
03 Jan 2011 15:28:45 1101510 12458720 famous_xaq3_1699_200_007075730_1 74,906 33,592 0.4485
03 Jan 2011 13:00:38 1101510 12458720 famous_xaq3_1699_200_007075730_1 65,546 29,396 0.4485
03 Jan 2011 11:14:50 1101510 12458720 famous_xaq3_1699_200_007075730_1 56,186 25,203 0.4486


©2024 climateprediction.net