climateprediction.net home page
Task 18701057

Task 18701057

Name hadcm3n_xdnm_1940_40_010021481_1
Workunit 10019552
Created 14 Jul 2015, 17:33:47 UTC
Sent 14 Jul 2015, 19:24:13 UTC
Report deadline 14 Oct 2015, 2:51:24 UTC
Received 24 Jul 2015, 12:43:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1087841
Run time 7 days 13 hours 48 min 24 sec
CPU time 7 days 13 hours 43 min 30 sec
Validate state Invalid
Credit 5,287.68
Device peak FLOPS 2.72 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.45</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:33:24 (16111): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:33:25 (16111): No heartbeat from core client for 30 sec - exiting
12:33:26 (16111): No heartbeat from core client for 30 sec - exiting
12:33:27 (16111): No heartbeat from core client for 30 sec - exiting
12:33:28 (16111): No heartbeat from core client for 30 sec - exiting
12:33:29 (16111): No heartbeat from core client for 30 sec - exiting
12:33:30 (16111): No heartbeat from core client for 30 sec - exiting
12:33:31 (16111): No heartbeat from core client for 30 sec - exiting
12:33:32 (16111): No heartbeat from core client for 30 sec - exiting
12:33:33 (16111): No heartbeat from core client for 30 sec - exiting
12:33:34 (16111): No heartbeat from core client for 30 sec - exiting
12:33:35 (16111): No heartbeat from core client for 30 sec - exiting
12:33:36 (16111): No heartbeat from core client for 30 sec - exiting
12:33:37 (16111): No heartbeat from core client for 30 sec - exiting
12:33:38 (16111): No heartbeat from core client for 30 sec - exiting
12:33:39 (16111): No heartbeat from core client for 30 sec - exiting
12:33:40 (16111): No heartbeat from core client for 30 sec - exiting
12:33:41 (16111): No heartbeat from core client for 30 sec - exiting
12:33:42 (16111): No heartbeat from core client for 30 sec - exiting
12:33:43 (16111): No heartbeat from core client for 30 sec - exiting
12:33:44 (16111): No heartbeat from core client for 30 sec - exiting
12:33:45 (16111): No heartbeat from core client for 30 sec - exiting
12:33:46 (16111): No heartbeat from core client for 30 sec - exiting
12:33:47 (16111): No heartbeat from core client for 30 sec - exiting
12:33:48 (16111): No heartbeat from core client for 30 sec - exiting
12:33:49 (16111): No heartbeat from core client for 30 sec - exiting
12:33:50 (16111): No heartbeat from core client for 30 sec - exiting
12:33:51 (16111): No heartbeat from core client for 30 sec - exiting
12:33:52 (16111): No heartbeat from core client for 30 sec - exiting
12:33:53 (16111): No heartbeat from core client for 30 sec - exiting
12:33:54 (16111): No heartbeat from core client for 30 sec - exiting
12:33:55 (16111): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
01:32:36 (4310): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:34:18 (4569): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:36:01 (4589): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:37:43 (4610): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:39:25 (4631): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:42:29 (4652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:49:37 (4679): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:41:17 (4705): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:41:19 (4705): No heartbeat from core client for 30 sec - exiting
08:41:20 (4705): No heartbeat from core client for 30 sec - exiting
08:41:21 (4705): No heartbeat from core client for 30 sec - exiting
08:41:22 (4705): No heartbeat from core client for 30 sec - exiting
08:41:23 (4705): No heartbeat from core client for 30 sec - exiting
08:41:24 (4705): No heartbeat from core client for 30 sec - exiting
08:41:25 (4705): No heartbeat from core client for 30 sec - exiting
08:41:26 (4705): No heartbeat from core client for 30 sec - exiting
08:41:27 (4705): No heartbeat from core client for 30 sec - exiting
08:41:28 (4705): No heartbeat from core client for 30 sec - exiting
08:41:29 (4705): No heartbeat from core client for 30 sec - exiting
08:41:30 (4705): No heartbeat from core client for 30 sec - exiting
08:41:31 (4705): No heartbeat from core client for 30 sec - exiting
08:41:32 (4705): No heartbeat from core client for 30 sec - exiting
08:41:33 (4705): No heartbeat from core client for 30 sec - exiting
08:41:34 (4705): No heartbeat from core client for 30 sec - exiting
08:41:35 (4705): No heartbeat from core client for 30 sec - exiting
08:41:36 (4705): No heartbeat from core client for 30 sec - exiting
08:41:37 (4705): No heartbeat from core client for 30 sec - exiting
08:41:38 (4705): No heartbeat from core client for 30 sec - exiting
08:41:39 (4705): No heartbeat from core client for 30 sec - exiting
08:41:40 (4705): No heartbeat from core client for 30 sec - exiting
08:41:41 (4705): No heartbeat from core client for 30 sec - exiting
08:41:42 (4705): No heartbeat from core client for 30 sec - exiting
08:41:43 (4705): No heartbeat from core client for 30 sec - exiting
08:41:44 (4705): No heartbeat from core client for 30 sec - exiting
08:41:45 (4705): No heartbeat from core client for 30 sec - exiting
08:41:46 (4705): No heartbeat from core client for 30 sec - exiting
08:41:47 (4705): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (10 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x86e400]
[0x86e430]
/lib/libc.so.6(gsignal+0x51)[0xb32871]
/lib/libc.so.6(abort+0x17a)[0xb3414a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0xb1ed36]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5957, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x5bc400]
[0x5bc430]
/lib/libc.so.6(gsignal+0x51)[0xb32871]
/lib/libc.so.6(abort+0x17a)[0xb3414a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0xb1ed36]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5957, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xe11400]
[0xe11430]
/lib/libc.so.6(gsignal+0x51)[0xb32871]
/lib/libc.so.6(abort+0x17a)[0xb3414a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0xb1ed36]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5957, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x75d400]
[0x75d430]
/lib/libc.so.6(gsignal+0x51)[0xb32871]
/lib/libc.so.6(abort+0x17a)[0xb3414a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0xb1ed36]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5957, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xd10400]
[0xd10430]
/lib/libc.so.6(gsignal+0x51)[0xb32871]
/lib/libc.so.6(abort+0x17a)[0xb3414a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0xb1ed36]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5957, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0x59a400]
[0x59a430]
/lib/libc.so.6(gsignal+0x51)[0xb32871]
/lib/libc.so.6(abort+0x17a)[0xb3414a]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xe6)[0xb1ed36]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5957, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
24 Jul 2015 07:09:01 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 440,640 632,725 1.4359
24 Jul 2015 04:32:49 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 414,720 595,220 1.4352
23 Jul 2015 05:34:17 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 388,800 558,099 1.4354
23 Jul 2015 03:02:53 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 362,880 521,183 1.4362
22 Jul 2015 07:37:19 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 336,960 484,401 1.4376
22 Jul 2015 02:59:44 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 311,040 446,856 1.4367
21 Jul 2015 07:31:03 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 285,120 409,573 1.4365
21 Jul 2015 03:13:33 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 259,200 375,075 1.4470
20 Jul 2015 06:05:05 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 233,280 341,327 1.4632
20 Jul 2015 04:29:22 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 207,360 304,049 1.4663
18 Jul 2015 03:03:13 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 181,440 266,080 1.4665
18 Jul 2015 03:03:13 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 155,520 228,034 1.4663
17 Jul 2015 04:56:36 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 129,600 189,999 1.4660
17 Jul 2015 03:00:26 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 103,680 151,995 1.4660
16 Jul 2015 05:56:44 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 77,760 113,997 1.4660
16 Jul 2015 02:59:58 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 51,840 75,993 1.4659
15 Jul 2015 07:51:28 1087841 18701057 hadcm3n_xdnm_1940_40_010021481_1 25,920 38,004 1.4662


©2024 climateprediction.net