climateprediction.net home page
Task 13548112

Task 13548112

Name hadcm3n_y9z6_1900_40_007521212_0
Workunit 7718687
Created 28 Oct 2011, 13:11:52 UTC
Sent 2 Nov 2011, 21:24:48 UTC
Report deadline 2 Feb 2012, 4:51:59 UTC
Received 30 Nov 2011, 15:39:33 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1059061
Run time 11 days 3 hours 21 min 10 sec
CPU time 10 days 0 hours 45 min 16 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.78 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.18</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:38:36 (4361): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x089f3c98 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6c421)[0xf7554421]
/lib32/libc.so.6(+0x6dcb0)[0xf7555cb0]
/lib32/libc.so.6(cfree+0x6d)[0xf7558d5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf772f7b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf772f80d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74fece7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:19 392832                             /mnt/boinc_data/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:19 392832                             /mnt/boinc_data/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
0899e000-08a02000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f706a000-f74e5000 rw-s 00000000 08:19 131033                             /mnt/boinc_data/slots/0/133140
f74e5000-f74e8000 rw-p 00000000 00:00 0 
f74e8000-f763c000 r-xp 00000000 08:01 402927                             /lib32/libc-2.12.1.so
f763c000-f763d000 ---p 00154000 08:01 402927                             /lib32/libc-2.12.1.so
f763d000-f763f000 r--p 00154000 08:01 402927                             /lib32/libc-2.12.1.so
f763f000-f7640000 rw-p 00156000 08:01 402927                             /lib32/libc-2.12.1.so
f7640000-f7643000 rw-p 00000000 00:00 0 
f7643000-f765d000 r-xp 00000000 08:01 11834                              /usr/lib32/libgcc_s.so.1
f765d000-f765e000 r--p 00019000 08:01 11834                              /usr/lib32/libgcc_s.so.1
f765e000-f765f000 rw-p 0001a000 08:01 11834                              /usr/lib32/libgcc_s.so.1
f765f000-f7683000 r-xp 00000000 08:01 402934                             /lib32/libm-2.12.1.so
f7683000-f7684000 r--p 00023000 08:01 402934                             /lib32/libm-2.12.1.so
f7684000-f7685000 rw-p 00024000 08:01 402934                             /lib32/libm-2.12.1.so
f7685000-f7764000 r-xp 00000000 08:01 12272                              /usr/lib32/libstdc++.so.6.0.14
f7764000-f7768000 r--p 000de000 08:01 12272                              /usr/lib32/libstdc++.so.6.0.14
f7768000-f7769000 rw-p 000e2000 08:01 12272                              /usr/lib32/libstdc++.so.6.0.14
f7769000-f7770000 rw-p 00000000 00:00 0 
f7770000-f7772000 r-xp 00000000 08:01 402943                             /lib32/libdl-2.12.1.so
f7772000-f7773000 r--p 00001000 08:01 402943                             /lib32/libdl-2.12.1.so
f7773000-f7774000 rw-p 00002000 08:01 402943                             /lib32/libdl-2.12.1.so
f7774000-f7775000 rw-p 00000000 00:00 0 
f7775000-f778a000 r-xp 00000000 08:01 402929                             /lib32/libpthread-2.12.1.so
f778a000-f778b000 r--p 00014000 08:01 402929                             /lib32/libpthread-2.12.1.so
f778b000-f778c000 rw-p 00015000 08:01 402929                             /lib32/libpthread-2.12.1.so
f778c000-f778e000 rw-p 00000000 00:00 0 
f77aa000-f77ab000 rw-p 00000000 00:00 0 
f77ab000-f77ac000 ---p 00000000 00:00 0 
f77ac000-f77af000 rw-p 00000000 00:00 0 
f77af000-f77b1000 rw-s 00000000 08:19 131028                             /mnt/boinc_data/slots/0/boinc_mmap_file
f77b1000-f77b3000 rw-p 00000000 00:00 0 
f77b3000-f77b4000 r-xp 00000000 00:00 0                                  [vdso]
f77b4000-f77d0000 r-xp 00000000 08:01 402935                             /lib32/ld-2.12.1.so
f77d0000-f77d1000 r--p 0001b000 08:01 402935                             /lib32/ld-2.12.1.so
f77d1000-f77d2000 rw-p 0001c000 08:01 402935                             /lib32/ld-2.12.1.so
ffeaf000-fff1e000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77b3400]
[0xf77b3430]
/lib32/libc.so.6(gsignal+0x51)[0xf7512a01]
/lib32/libc.so.6(abort+0x182)[0xf7515e42]
/lib32/libc.so.6(+0x62345)[0xf754a345]
/lib32/libc.so.6(+0x6c421)[0xf7554421]
/lib32/libc.so.6(+0x6dcb0)[0xf7555cb0]
/lib32/libc.so.6(cfree+0x6d)[0xf7558d5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf772f7b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf772f80d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74fece7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
29 Nov 2011 15:42:49 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 518,400 866,711 1.6719
28 Nov 2011 08:00:19 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 492,480 825,506 1.6762
26 Nov 2011 11:40:18 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 466,560 783,618 1.6796
24 Nov 2011 16:03:32 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 440,640 742,050 1.6840
22 Nov 2011 07:08:20 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 414,720 700,047 1.6880
20 Nov 2011 09:48:02 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 388,800 657,831 1.6920
19 Nov 2011 05:37:50 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 362,880 615,690 1.6967
18 Nov 2011 00:01:46 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 336,960 571,103 1.6949
16 Nov 2011 01:41:46 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 311,040 526,896 1.6940
15 Nov 2011 17:26:47 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 285,120 483,002 1.6940
15 Nov 2011 17:26:47 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 259,200 438,958 1.6935
15 Nov 2011 17:26:47 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 233,280 395,377 1.6949
15 Nov 2011 17:26:47 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 207,360 350,845 1.6920
15 Nov 2011 17:26:47 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 181,440 307,352 1.6940
10 Nov 2011 02:19:17 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 155,520 264,001 1.6975
09 Nov 2011 07:12:47 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 129,600 220,301 1.6999
07 Nov 2011 07:44:03 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 103,680 176,782 1.7051
06 Nov 2011 18:57:14 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 77,760 132,933 1.7095
05 Nov 2011 01:21:19 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 51,840 88,491 1.7070
04 Nov 2011 05:39:11 1059061 13548112 hadcm3n_y9z6_1900_40_007521212_0 25,920 43,826 1.6908


©2024 climateprediction.net