climateprediction.net home page
Task 17541811

Task 17541811

Name hadam3pm2_i157_1959_10_009272621_1
Workunit 9365537
Created 3 Dec 2014, 16:01:39 UTC
Sent 3 Dec 2014, 17:23:42 UTC
Report deadline 15 Nov 2015, 22:43:42 UTC
Received 4 Dec 2014, 21:56:05 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1347403
Run time 1 days 4 hours 23 min 55 sec
CPU time 1 min 21 sec
Validate state Invalid
Credit 1,166.20
Device peak FLOPS 3.94 GFLOPS
Application version UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03
i686-pc-linux-gnu
Stderr
<core_client_version>7.2.42</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
oa.pc|9dec.nc
oa.pc|0jan.nc
oa.pc|0feb.nc
oa.pc|0mar.nc
oa.pc|0apr.nc
oa.pc|0may.nc
oa.pc|0jun.nc
oa.pc|0jul.nc
oa.pc|0aug.nc
oa.pc|0sep.nc
oa.pc|0oct.nc
oa.pc|0nov.nc
oa.pe|9dec.nc
oa.pe|0jan.nc
oa.pe|0feb.nc
oa.pe|0mar.nc
oa.pe|0apr.nc
oa.pe|0may.nc
oa.pe|0jun.nc
oa.pe|0jul.nc
oa.pe|0aug.nc
oa.pe|0sep.nc
oa.pe|0oct.nc
oa.pe|0nov.nc
SIGSEGV: segmentation violation
Stack trace (13 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0f82400]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8165b39]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816b8f8]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8162a76]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x816d014]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8161751]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8085677]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0d53a83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=30920, iMonCtr=1
Model crash detected, will try to restart...
SIGILL: illegal instruction
Stack trace (11 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0faf400]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x80e0185]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x814abb1]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x80d515a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8084dbd]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0d81a83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=30920, iMonCtr=1
Model crash detected, will try to restart...
SIGILL: illegal instruction
Stack trace (11 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0f75400]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x80e0185]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x814abb1]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x80d515a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8084dbd]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0d47a83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=30920, iMonCtr=1
Model crash detected, will try to restart...
SIGILL: illegal instruction
Stack trace (11 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0f9f400]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x80e0185]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x814abb1]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x80d515a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8084dbd]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0d71a83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=30920, iMonCtr=1
Model crash detected, will try to restart...
SIGILL: illegal instruction
Stack trace (11 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0fc0400]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x80e0185]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x814abb1]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x80d515a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8084dbd]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0d92a83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=30920, iMonCtr=1
Model crash detected, will try to restart...
SIGILL: illegal instruction
Stack trace (11 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0f61400]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x80e0185]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x814abb1]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x80d515a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8084dbd]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0d33a83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=30920, iMonCtr=1
Model crash detected, will try to restart...
SIGILL: illegal instruction
Stack trace (11 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x83bccdf]
[0xf0f23400]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x80e0185]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x814abb1]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x80d515a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8084dbd]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x8094c0a]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x831e514]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x83205f9]
/var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_um_7.03_i686-pc-linux-gnu[0x834c82d]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf0cf5a83]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=30920, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
21:48:38 (30920): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Dec 2014 11:18:41 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 40,388 809 0.0200
04 Dec 2014 18:44:40 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 37,508 88,558 2.3610
04 Dec 2014 14:42:43 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 31,748 75,367 2.3739
04 Dec 2014 13:43:25 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 28,868 68,587 2.3759
04 Dec 2014 11:37:48 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 25,988 61,378 2.3618
04 Dec 2014 09:36:57 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 23,108 54,152 2.3434
04 Dec 2014 07:36:41 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 20,228 46,985 2.3228
04 Dec 2014 05:36:25 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 17,348 39,865 2.2980
04 Dec 2014 03:36:13 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 14,468 32,729 2.2622
04 Dec 2014 01:30:47 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 11,588 25,638 2.2125
03 Dec 2014 23:30:11 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 8,708 18,766 2.1550
03 Dec 2014 21:30:10 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 5,828 11,680 2.0041
03 Dec 2014 19:30:10 1347403 17541811 hadam3pm2_i157_1959_10_009272621_1 2,948 5,307 1.8002


©2024 climateprediction.net