climateprediction.net home page
Task 17578011

Task 17578011

Name hadam3pm2_i07l_1959_10_009271411_1
Workunit 9364327
Created 17 Dec 2014, 8:24:50 UTC
Sent 17 Dec 2014, 9:54:47 UTC
Report deadline 29 Nov 2015, 15:14:47 UTC
Received 30 Dec 2014, 22:21:53 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1279977
Run time 5 days 1 hours 26 min 18 sec
CPU time 1 days 15 hours 38 min 36 sec
Validate state Invalid
Credit 2,247.28
Device peak FLOPS 2.48 GFLOPS
Application version UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03
i686-pc-linux-gnu
Stderr 
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 
CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 
12:40:45 (10513): No heartbeat from client for 30 sec - exiting
12:40:45 (10513): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 
21:13:51 (1909): No heartbeat from client for 30 sec - exiting
21:13:51 (1909): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No spacSuspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 
07:43:31 (3754): No heartbeat from client for 30 sec - exiting
07:43:31 (3754): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_i07l_1959_10_009271411/dataoutController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1949, iMonCtr=1
Model crash detected, will try to restart...
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_i07l_1959_10_009271411/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadam3pm2_um_7.03  0845AB9D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08459995  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0842865F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7E1D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7767  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0841E6D8  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08181F02  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08184898  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  081972DE  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0831901D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083205F9  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0834C82D  Unknown               Unknown  Unknown
libc.so.6          F0CE54D3  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1949, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
10:59:45 (1949): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
30 Dec 2014 01:26:49 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 77,828 186,604 2.3976
29 Dec 2014 21:46:10 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 74,948 175,169 2.3372
29 Dec 2014 18:25:35 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 72,068 164,121 2.2773
24 Dec 2014 04:41:03 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 37,508 150,498 4.0124
19 Dec 2014 03:29:38 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 28,868 129,281 4.4783
18 Dec 2014 23:07:04 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 25,988 115,642 4.4498
18 Dec 2014 18:51:21 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 23,108 102,199 4.4227
18 Dec 2014 14:45:43 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 20,228 88,817 4.3908
18 Dec 2014 10:30:07 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 17,348 75,289 4.3399
18 Dec 2014 06:14:25 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 14,468 61,995 4.2850
18 Dec 2014 02:12:56 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 11,588 49,275 4.2522
17 Dec 2014 22:09:22 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 8,708 36,705 4.2151
17 Dec 2014 18:03:15 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 5,828 24,167 4.1467
17 Dec 2014 14:37:45 1279977 17578011 hadam3pm2_i07l_1959_10_009271411_1 2,948 12,145 4.1197


©2024 climateprediction.net