climateprediction.net home page
Task 15860683

Task 15860683

Name hadcm3n_o6tx_1980_40_008388614_1
Workunit 8539473
Created 24 Jun 2013, 2:25:20 UTC
Sent 24 Jun 2013, 18:43:08 UTC
Report deadline 24 Sep 2013, 2:10:19 UTC
Received 14 Aug 2013, 17:28:29 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1284221
Run time 4 days 20 hours 35 min 26 sec
CPU time 4 days 16 hours 31 min 14 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 3.46 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:13:35 (1413): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:23:35 (19280): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:24:36 (25811): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:25:41 (25828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
SIGABRT: abort called
Stack trace (15 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf76f4400]
[0xf76f4430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf74e5b1f]
/lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf74e90b3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8401b90]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7af5]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7b32]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7c5a]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f825e]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f829d]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839dfbf]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf3]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf74d0935]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=26490, iMonCtr=1
Model crash detected, will try to restart...
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
SIGABRT: abort called
Stack trace (15 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7797400]
[0xf7797430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf7588b1f]
/lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf758c0b3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8401b90]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7af5]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7b32]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7c5a]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f825e]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f829d]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839dfbf]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf3]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7573935]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=26490, iMonCtr=1
Model crash detected, will try to restart...
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
SIGABRT: abort called
Stack trace (15 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77da400]
[0xf77da430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75cbb1f]
/lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf75cf0b3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8401b90]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7af5]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7b32]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7c5a]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f825e]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f829d]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839dfbf]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf3]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf75b6935]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=26490, iMonCtr=1
Model crash detected, will try to restart...
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
SIGABRT: abort called
Stack trace (15 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7732400]
[0xf7732430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf7523b1f]
/lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf75270b3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8401b90]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7af5]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7b32]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7c5a]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f825e]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f829d]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839dfbf]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf3]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf750e935]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=26490, iMonCtr=1
Model crash detected, will try to restart...
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
SIGABRT: abort called
Stack trace (15 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77db400]
[0xf77db430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75ccb1f]
/lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf75d00b3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8401b90]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7af5]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7b32]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7c5a]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f825e]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f829d]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839dfbf]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf3]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf75b7935]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=26490, iMonCtr=1
Model crash detected, will try to restart...
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
SIGABRT: abort called
Stack trace (15 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77a4400]
[0xf77a4430]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf7595b1f]
/lib/i386-linux-gnu/libc.so.6(abort+0x143)[0xf75990b3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8401b90]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7af5]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7b32]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f7c5a]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f825e]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83f829d]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839dfbf]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf3]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7580935]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=26490, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Aug 2013 17:32:36 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 518,400 395,445 0.7628
14 Aug 2013 17:32:36 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 492,480 376,092 0.7637
14 Aug 2013 17:32:36 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 466,560 357,081 0.7653
14 Aug 2013 17:32:36 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 440,640 338,075 0.7672
14 Aug 2013 17:32:36 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 414,720 319,009 0.7692
14 Aug 2013 17:32:36 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 388,800 299,796 0.7711
14 Aug 2013 17:32:36 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 362,880 279,939 0.7714
14 Aug 2013 17:32:36 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 336,960 259,866 0.7712
14 Aug 2013 17:32:36 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 311,040 239,762 0.7708
14 Aug 2013 17:32:36 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 285,120 219,522 0.7699
06 Jul 2013 04:33:38 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 259,200 200,152 0.7722
28 Jun 2013 13:00:20 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 233,280 180,708 0.7746
28 Jun 2013 07:17:48 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 207,360 160,804 0.7755
27 Jun 2013 18:22:24 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 181,440 140,739 0.7757
27 Jun 2013 12:25:33 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 155,520 120,655 0.7758
26 Jun 2013 21:28:08 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 129,600 100,598 0.7762
26 Jun 2013 15:42:52 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 103,680 80,605 0.7774
26 Jun 2013 09:55:07 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 77,760 60,542 0.7786
25 Jun 2013 19:07:53 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 51,840 40,514 0.7815
25 Jun 2013 11:07:14 1284221 15860683 hadcm3n_o6tx_1980_40_008388614_1 25,920 20,401 0.7871


©2024 climateprediction.net