climateprediction.net home page
Task 15496890

Task 15496890

Name hadcm3n_3dib_1940_40_008267276_0
Workunit 8422400
Created 21 Dec 2012, 19:07:25 UTC
Sent 21 Dec 2012, 19:08:04 UTC
Report deadline 23 Mar 2013, 2:35:15 UTC
Received 6 Feb 2013, 16:01:19 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1258660
Run time 30 days 13 hours 41 min 6 sec
CPU time 28 days 13 hours 47 min 45 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 1.48 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:24:37 (2684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:27:30 (3626): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:31:22 (3649): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:36:03 (3677): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:40:45 (3704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:42:51 (3722): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:47:37 (3752): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:49:34 (3773): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:27:18 (3381): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:28:21 (3975): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:52:11 (2382): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:53:01 (3978): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:53:47 (4327): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:54:48 (4354): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:46:42 (18218): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:47:49 (19336): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:48:52 (19931): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:08:39 (3366): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:11:38 (16573): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:31:07 (17095): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:33:07 (23645): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:34:09 (23708): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:47:09 (23801): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:35:33 (3239): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:21:22 (3642): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:22:25 (3744): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:01:28 (3696): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:02:46 (5469): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:37:20 (3298): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:39:19 (6602): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:45:50 (6627): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:47:36 (6663): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:51:58 (6688): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:53:49 (6724): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:55:43 (6747): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:57:53 (6770): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0970e100 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6bbe1)[0xf74a7be1]
/lib32/libc.so.6(+0x6d458)[0xf74a9458]
/lib32/libc.so.6(cfree+0x6d)[0xf74ac53d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7682a31]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7682a8d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7452ca6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 fe:03 272648                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 fe:03 272648                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
096b8000-0971e000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fbf000-f743a000 rw-s 00000000 fe:03 393998                             /var/lib/boinc-client/slots/4/136600
f743a000-f743c000 rw-p 00000000 00:00 0 
f743c000-f757c000 r-xp 00000000 fe:01 917569                             /lib32/libc-2.11.3.so
f757c000-f757d000 ---p 00140000 fe:01 917569                             /lib32/libc-2.11.3.so
f757d000-f757f000 r--p 00140000 fe:01 917569                             /lib32/libc-2.11.3.so
f757f000-f7580000 rw-p 00142000 fe:01 917569                             /lib32/libc-2.11.3.so
f7580000-f7583000 rw-p 00000000 00:00 0 
f7583000-f75a0000 r-xp 00000000 fe:02 155757                             /usr/lib32/libgcc_s.so.1
f75a0000-f75a1000 rw-p 0001c000 fe:02 155757                             /usr/lib32/libgcc_s.so.1
f75a1000-f75c5000 r-xp 00000000 fe:01 917582                             /lib32/libm-2.11.3.so
f75c5000-f75c6000 r--p 00023000 fe:01 917582                             /lib32/libm-2.11.3.so
f75c6000-f75c7000 rw-p 00024000 fe:01 917582                             /lib32/libm-2.11.3.so
f75c7000-f76b0000 r-xp 00000000 fe:02 155769                             /usr/lib32/libstdc++.so.6.0.13
f76b0000-f76b4000 r--p 000e9000 fe:02 155769                             /usr/lib32/libstdc++.so.6.0.13
f76b4000-f76b5000 rw-p 000ed000 fe:02 155769                             /usr/lib32/libstdc++.so.6.0.13
f76b5000-f76bc000 rw-p 00000000 00:00 0 
f76bc000-f76be000 r-xp 00000000 fe:01 917581                             /lib32/libdl-2.11.3.so
f76be000-f76bf000 r--p 00001000 fe:01 917581                             /lib32/libdl-2.11.3.so
f76bf000-f76c0000 rw-p 00002000 fe:01 917581                             /lib32/libdl-2.11.3.so
f76c0000-f76c1000 rw-p 00000000 00:00 0 
f76c1000-f76d6000 r-xp 00000000 fe:01 917564                             /lib32/libpthread-2.11.3.so
f76d6000-f76d7000 r--p 00014000 fe:01 917564                             /lib32/libpthread-2.11.3.so
f76d7000-f76d8000 rw-p 00015000 fe:01 917564                             /lib32/libpthread-2.11.3.so
f76d8000-f76da000 rw-p 00000000 00:00 0 
f76eb000-f76ec000 rw-p 00000000 00:00 0 
f76ec000-f76ed000 ---p 00000000 00:00 0 
f76ed000-f76f0000 rw-p 00000000 00:00 0 
f76f0000-f76f2000 rw-s 00000000 fe:03 393995                             /var/lib/boinc-client/slots/4/boinc_mmap_file
f76f2000-f76f4000 rw-p 00000000 00:00 0 
f76f4000-f76f5000 r-xp 00000000 00:00 0                                  [vdso]
f76f5000-f7711000 r-xp 00000000 fe:01 917565                             /lib32/ld-2.11.3.so
f7711000-f7712000 r--p 0001b000 fe:01 917565                             /lib32/ld-2.11.3.so
f7712000-f7713000 rw-p 0001c000 fe:01 917565                             /lib32/ld-2.11.3.so
ffe1b000-ffe8b000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf76f4400]
[0xf76f4430]
/lib32/libc.so.6(gsignal+0x51)[0xf7466a71]
/lib32/libc.so.6(abort+0x182)[0xf7469e92]
/lib32/libc.so.6(+0x61ae5)[0xf749dae5]
/lib32/libc.so.6(+0x6bbe1)[0xf74a7be1]
/lib32/libc.so.6(+0x6d458)[0xf74a9458]
/lib32/libc.so.6(cfree+0x6d)[0xf74ac53d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7682a31]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7682a8d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7452ca6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Feb 2013 05:52:35 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 777,600 2,468,856 3.1750
03 Feb 2013 02:46:19 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 751,680 2,388,135 3.1771
02 Feb 2013 00:58:49 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 725,760 2,306,918 3.1786
31 Jan 2013 13:45:22 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 699,840 2,227,477 3.1828
29 Jan 2013 22:31:49 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 673,920 2,147,420 3.1865
26 Jan 2013 06:19:31 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 648,000 2,063,936 3.1851
24 Jan 2013 20:01:04 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 622,080 1,980,347 3.1834
22 Jan 2013 11:56:04 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 596,160 1,896,511 3.1812
20 Jan 2013 08:19:34 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 570,240 1,814,661 3.1823
18 Jan 2013 03:43:41 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 544,320 1,732,751 3.1833
17 Jan 2013 03:03:24 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 518,400 1,648,743 3.1804
15 Jan 2013 16:16:02 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 492,480 1,566,080 3.1800
14 Jan 2013 05:07:50 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 466,560 1,484,918 3.1827
13 Jan 2013 06:19:04 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 440,640 1,403,563 3.1853
12 Jan 2013 06:48:57 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 414,720 1,322,371 3.1886
11 Jan 2013 13:05:12 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 388,800 1,239,310 3.1875
10 Jan 2013 07:03:22 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 362,880 1,156,124 3.1860
09 Jan 2013 06:54:53 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 336,960 1,072,949 3.1842
08 Jan 2013 07:06:38 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 311,040 989,796 3.1822
07 Jan 2013 07:25:42 1258660 15496890 hadcm3n_3dib_1940_40_008267276_0 285,120 906,741 3.1802


©2024 climateprediction.net