climateprediction.net home page
Task 18701201

Task 18701201

Name hadcm3n_xdlj_1940_40_010021406_2
Workunit 10019477
Created 14 Jul 2015, 19:14:30 UTC
Sent 14 Jul 2015, 19:24:13 UTC
Report deadline 14 Oct 2015, 2:51:24 UTC
Received 24 Jul 2015, 12:43:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1087841
Run time 7 days 6 hours 49 min 1 sec
CPU time 7 days 6 hours 44 min 5 sec
Validate state Invalid
Credit 4,976.64
Device peak FLOPS 2.72 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.45</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:33:24 (16112): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:33:25 (16112): No heartbeat from core client for 30 sec - exiting
12:33:26 (16112): No heartbeat from core client for 30 sec - exiting
12:33:27 (16112): No heartbeat from core client for 30 sec - exiting
12:33:28 (16112): No heartbeat from core client for 30 sec - exiting
12:33:29 (16112): No heartbeat from core client for 30 sec - exiting
12:33:30 (16112): No heartbeat from core client for 30 sec - exiting
12:33:31 (16112): No heartbeat from core client for 30 sec - exiting
12:33:32 (16112): No heartbeat from core client for 30 sec - exiting
12:33:33 (16112): No heartbeat from core client for 30 sec - exiting
12:33:34 (16112): No heartbeat from core client for 30 sec - exiting
12:33:35 (16112): No heartbeat from core client for 30 sec - exiting
12:33:36 (16112): No heartbeat from core client for 30 sec - exiting
12:33:37 (16112): No heartbeat from core client for 30 sec - exiting
12:33:38 (16112): No heartbeat from core client for 30 sec - exiting
12:33:39 (16112): No heartbeat from core client for 30 sec - exiting
12:33:40 (16112): No heartbeat from core client for 30 sec - exiting
12:33:41 (16112): No heartbeat from core client for 30 sec - exiting
12:33:42 (16112): No heartbeat from core client for 30 sec - exiting
12:33:43 (16112): No heartbeat from core client for 30 sec - exiting
12:33:44 (16112): No heartbeat from core client for 30 sec - exiting
12:33:45 (16112): No heartbeat from core client for 30 sec - exiting
12:33:46 (16112): No heartbeat from core client for 30 sec - exiting
12:33:47 (16112): No heartbeat from core client for 30 sec - exiting
12:33:48 (16112): No heartbeat from core client for 30 sec - exiting
12:33:49 (16112): No heartbeat from core client for 30 sec - exiting
12:33:50 (16112): No heartbeat from core client for 30 sec - exiting
12:33:51 (16112): No heartbeat from core client for 30 sec - exiting
12:33:52 (16112): No heartbeat from core client for 30 sec - exiting
12:33:53 (16112): No heartbeat from core client for 30 sec - exiting
12:33:54 (16112): No heartbeat from core client for 30 sec - exiting
12:33:55 (16112): No heartbeat from core client for 30 sec - exiting
12:33:56 (16112): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
01:32:35 (4311): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:34:18 (4573): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:36:00 (4593): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:37:43 (4614): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:39:25 (4635): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:42:28 (4656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:49:38 (4683): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:41:17 (4709): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:41:18 (4709): No heartbeat from core client for 30 sec - exiting
08:41:19 (4709): No heartbeat from core client for 30 sec - exiting
08:41:20 (4709): No heartbeat from core client for 30 sec - exiting
08:41:21 (4709): No heartbeat from core client for 30 sec - exiting
08:41:22 (4709): No heartbeat from core client for 30 sec - exiting
08:41:23 (4709): No heartbeat from core client for 30 sec - exiting
08:41:24 (4709): No heartbeat from core client for 30 sec - exiting
08:41:25 (4709): No heartbeat from core client for 30 sec - exiting
08:41:26 (4709): No heartbeat from core client for 30 sec - exiting
08:41:27 (4709): No heartbeat from core client for 30 sec - exiting
08:41:28 (4709): No heartbeat from core client for 30 sec - exiting
08:41:29 (4709): No heartbeat from core client for 30 sec - exiting
08:41:30 (4709): No heartbeat from core client for 30 sec - exiting
08:41:31 (4709): No heartbeat from core client for 30 sec - exiting
08:41:32 (4709): No heartbeat from core client for 30 sec - exiting
08:41:33 (4709): No heartbeat from core client for 30 sec - exiting
08:41:34 (4709): No heartbeat from core client for 30 sec - exiting
08:41:35 (4709): No heartbeat from core client for 30 sec - exiting
08:41:36 (4709): No heartbeat from core client for 30 sec - exiting
08:41:37 (4709): No heartbeat from core client for 30 sec - exiting
08:41:38 (4709): No heartbeat from core client for 30 sec - exiting
08:41:39 (4709): No heartbeat from core client for 30 sec - exiting
08:41:40 (4709): No heartbeat from core client for 30 sec - exiting
08:41:41 (4709): No heartbeat from core client for 30 sec - exiting
08:41:42 (4709): No heartbeat from core client for 30 sec - exiting
08:41:43 (4709): No heartbeat from core client for 30 sec - exiting
08:41:44 (4709): No heartbeat from core client for 30 sec - exiting
08:41:45 (4709): No heartbeat from core client for 30 sec - exiting
08:41:46 (4709): No heartbeat from core client for 30 sec - exiting
08:41:47 (4709): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (10 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x587400]
[0x587430]
/lib/libc.so.6(gsignal+0x51)[0xb32871]
/lib/libc.so.6(abort+0x17a)[0xb3414a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0xb1ed36]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xccd400]
[0xccd430]
/lib/libc.so.6(gsignal+0x51)[0xb32871]
/lib/libc.so.6(abort+0x17a)[0xb3414a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0xb1ed36]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf1d400]
[0xf1d430]
/lib/libc.so.6(gsignal+0x51)[0xb32871]
/lib/libc.so.6(abort+0x17a)[0xb3414a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0xb1ed36]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xe21400]
[0xe21430]
/lib/libc.so.6(gsignal+0x51)[0xb32871]
/lib/libc.so.6(abort+0x17a)[0xb3414a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0xb1ed36]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x6f6400]
[0x6f6430]
/lib/libc.so.6(gsignal+0x51)[0xb32871]
/lib/libc.so.6(abort+0x17a)[0xb3414a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0xb1ed36]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x1a8400]
[0x1a8430]
/lib/libc.so.6(gsignal+0x51)[0xb32871]
/lib/libc.so.6(abort+0x17a)[0xb3414a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0xb1ed36]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
24 Jul 2015 04:32:49 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 414,720 596,979 1.4395
23 Jul 2015 11:46:40 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 388,800 559,612 1.4393
23 Jul 2015 03:02:53 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 362,880 522,563 1.4400
23 Jul 2015 03:02:53 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 336,960 485,523 1.4409
22 Jul 2015 02:59:44 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 311,040 448,232 1.4411
21 Jul 2015 10:07:16 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 285,120 410,602 1.4401
21 Jul 2015 03:13:33 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 259,200 375,779 1.4498
20 Jul 2015 07:05:31 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 233,280 341,787 1.4651
20 Jul 2015 04:29:22 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 207,360 304,402 1.4680
18 Jul 2015 03:03:13 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 181,440 266,396 1.4682
18 Jul 2015 03:03:13 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 155,520 228,341 1.4682
17 Jul 2015 05:57:08 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 129,600 190,293 1.4683
17 Jul 2015 03:00:26 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 103,680 152,217 1.4681
16 Jul 2015 06:57:14 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 77,760 114,163 1.4681
16 Jul 2015 02:59:58 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 51,840 76,084 1.4677
15 Jul 2015 08:52:13 1087841 18701201 hadcm3n_xdlj_1940_40_010021406_2 25,920 38,034 1.4674


©2024 climateprediction.net