climateprediction.net home page
Task 21979155

Task 21979155

Name hadam4h_h04o_201011_5_889_012043655_0
Workunit 12043655
Created 17 Dec 2020, 15:23:11 UTC
Sent 17 Sep 2021, 4:33:25 UTC
Report deadline 30 Aug 2022, 9:53:25 UTC
Received 30 Sep 2021, 13:50:28 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 12 (0x0000000C) Unknown error code
Computer ID 1521337
Run time 9 days 8 hours 40 min 17 sec
CPU time 9 days 7 hours 25 min 54 sec
Validate state Invalid
Credit 6,897.54
Device peak FLOPS 6.32 GFLOPS
Application version UK Met Office HadAM4 at N216 resolution v8.52
i686-pc-linux-gnu
Peak working set size 1,356.85 MB
Peak swap size 1,378.43 MB
Peak disk usage 163.03 MB
Stderr 
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 12 (0xc, -244)</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
13:33:48 (2301): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
13:33:49 (2301): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f8b560]
/lib32/libc.so.6(getenv+0xa2)[0xf7a8f372]
/lib32/libc.so.6(+0xbae9d)[0xf7b12e9d]
/lib32/libc.so.6(+0xbb25e)[0xf7b1325e]
/lib32/libc.so.6(localtime_r+0x1b)[0xf7b111ab]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f8b560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f8b549]
/lib32/libc.so.6(+0xc57c3)[0xf7b1d7c3]
/lib32/libc.so.6(clock_nanosleep+0x52)[0xf7b1d9b2]
/lib32/libc.so.6(nanosleep+0x24)[0xf7b240c4]
/lib32/libc.so.6(usleep+0x45)[0xf7b579e5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf5)[0xf7a76ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc8560]
/lib32/libc.so.6(getenv+0xa2)[0xf7acc372]
/lib32/libc.so.6(+0xbae9d)[0xf7b4fe9d]
/lib32/libc.so.6(+0xbb25e)[0xf7b5025e]
/lib32/libc.so.6(localtime_r+0x1b)[0xf7b4e1ab]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc8560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fc8549]
/lib32/libc.so.6(+0xc57c3)[0xf7b5a7c3]
/lib32/libc.so.6(clock_nanosleep+0x52)[0xf7b5a9b2]
/lib32/libc.so.6(nanosleep+0x24)[0xf7b610c4]
/lib32/libc.so.6(usleep+0x45)[0xf7b949e5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf5)[0xf7ab3ee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f13560]
/lib32/libc.so.6(getenv+0xa2)[0xf7a17372]
/lib32/libc.so.6(+0xbae9d)[0xf7a9ae9d]
/lib32/libc.so.6(+0xbb25e)[0xf7a9b25e]
/lib32/libc.so.6(localtime_r+0x1b)[0xf7a991ab]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f13560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f13549]
/lib32/libc.so.6(+0xc57c3)[0xf7aa57c3]
/lib32/libc.so.6(clock_nanosleep+0x52)[0xf7aa59b2]
/lib32/libc.so.6(nanosleep+0x24)[0xf7aac0c4]
/lib32/libc.so.6(usleep+0x45)[0xf7adf9e5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf5)[0xf79feee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa2560]
/lib32/libc.so.6(getenv+0xa2)[0xf7aa6372]
/lib32/libc.so.6(+0xbae9d)[0xf7b29e9d]
/lib32/libc.so.6(+0xbb25e)[0xf7b2a25e]
/lib32/libc.so.6(localtime_r+0x1b)[0xf7b281ab]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa2560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa2549]
/lib32/libc.so.6(+0xc57c3)[0xf7b347c3]
/lib32/libc.so.6(clock_nanosleep+0x52)[0xf7b349b2]
/lib32/libc.so.6(nanosleep+0x24)[0xf7b3b0c4]
/lib32/libc.so.6(usleep+0x45)[0xf7b6e9e5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf5)[0xf7a8dee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f74560]
/lib32/libc.so.6(getenv+0xa2)[0xf7a78372]
/lib32/libc.so.6(+0xbae9d)[0xf7afbe9d]
/lib32/libc.so.6(+0xbb25e)[0xf7afc25e]
/lib32/libc.so.6(localtime_r+0x1b)[0xf7afa1ab]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f74560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f74549]
/lib32/libc.so.6(+0xc57c3)[0xf7b067c3]
/lib32/libc.so.6(clock_nanosleep+0x52)[0xf7b069b2]
/lib32/libc.so.6(nanosleep+0x24)[0xf7b0d0c4]
/lib32/libc.so.6(usleep+0x45)[0xf7b409e5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf5)[0xf7a5fee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
13:37:34 (2298): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
13:37:35 (2298): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
13:00:29 (2450): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa2560]
/lib32/libc.so.6(getenv+0xa2)[0xf7aa6372]
/lib32/libc.so.6(+0xbae9d)[0xf7b29e9d]
/lib32/libc.so.6(+0xbb25e)[0xf7b2a25e]
/lib32/libc.so.6(localtime_r+0x1b)[0xf7b281ab]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa2560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa2549]
/lib32/libc.so.6(+0xc57c3)[0xf7b347c3]
/lib32/libc.so.6(clock_nanosleep+0x52)[0xf7b349b2]
/lib32/libc.so.6(nanosleep+0x24)[0xf7b3b0c4]
/lib32/libc.so.6(usleep+0x45)[0xf7b6e9e5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib32/libc.so.6(__libc_start_main+0xf5)[0xf7a8dee5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
OPEN:  File Creation Failed: No such file or directory
OPEN:  Unable to Open File dataout/h04oga.pbl0dec for Read/Write

Model crashed: STWORK  : Error opening output PP file on unit 61                                                                                                                                                                                                               tmp/xnnuj.pipe_dummy                                                            
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/jobs/xnnuj.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/jobs/xnnuj.namelists after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/dataout/atmos_restart.day after 11 attempts
forrtl: Bad file descriptor
forrtl: severe (30): open failure, unit 6, file /proc/23329/fd/
Image              PC        Routine            Line        Source             
hadam4_um_8.52_i6  083F6605  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  0843E0A0  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  081DF6C9  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  0836E63F  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2383, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/jobs/xnnuj.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/jobs/xnnuj.namelists after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/dataout/atmos_restart.day after 11 attempts
forrtl: Bad file descriptor
forrtl: severe (30): open failure, unit 6, file /proc/23332/fd/
Image              PC        Routine            Line        Source             
hadam4_um_8.52_i6  083F6605  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  0843E0A0  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  081DF6C9  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  0836E63F  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2383, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/jobs/xnnuj.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/jobs/xnnuj.namelists after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/dataout/atmos_restart.day after 11 attempts
forrtl: Bad file descriptor
forrtl: severe (30): open failure, unit 6, file /proc/23343/fd/
Image              PC        Routine            Line        Source             
hadam4_um_8.52_i6  083F6605  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  0843E0A0  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  081DF6C9  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  0836E63F  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2383, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/jobs/xnnuj.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/jobs/xnnuj.namelists after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/dataout/atmos_restart.day after 11 attempts
forrtl: Bad file descriptor
forrtl: severe (30): open failure, unit 6, file /proc/23346/fd/
Image              PC        Routine            Line        Source             
hadam4_um_8.52_i6  083F6605  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  0843E0A0  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  081DF6C9  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  0836E63F  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2383, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/jobs/xnnuj.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/jobs/xnnuj.namelists after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadam4h_h04o_201011_5_889_012043655/dataout/atmos_restart.day after 11 attempts
forrtl: Bad file descriptor
forrtl: severe (30): open failure, unit 6, file /proc/23348/fd/
Image              PC        Routine            Line        Source             
hadam4_um_8.52_i6  083F6605  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  0843E0A0  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  081DF6C9  Unknown               Unknown  Unknown
hadam4_um_8.52_i6  0836E63F  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2383, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
28 Sep 2021 16:33:01 1521337 21979155 hadam4h_h04o_201011_5_889_012043655_0 8,843 685,834 77.5567


©2024 climateprediction.net