Task 16277340

Name	hadcm3n_7n92_1980_40_008441417_2
Workunit	8592273
Created	31 Jan 2014, 4:42:23 UTC
Sent	31 Jan 2014, 4:42:37 UTC
Report deadline	4 Aug 2023, 10:02:37 UTC
Received	27 Feb 2014, 15:02:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1310846
Run time	13 days 1 hours 7 min 16 sec
CPU time	10 days 15 hours 7 min 33 sec
Validate state	Invalid
Credit	4,976.64
Device peak FLOPS	2.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:16:32 (1986): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_7n92_1980_40_008441417/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 084554BF Unknown Unknown Unknown hadcm3n_um_6.07_i 0829D1FE Unknown Unknown Unknown hadcm3n_um_6.07_i 08340D81 Unknown Unknown Unknown hadcm3n_um_6.07_i 08194301 Unknown BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_7n92_1980_40_008441417/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 084554BF Unknown Unknown Unknown hadcm3n_um_6.07_i 08451EF9 Unknown Unknown Unknown hadcm3n_um_6.07_i 0817917D Unknown Unknown Unknown hadcm3n_um_6.07_i 081795D4 Unknown Unknown Unknown hadcm3n_um_6.07_i 081908AF Unknown Unknown Unknown hadcm3n_um_6.07_i 08391957 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F8B7 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 F75604D3 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19846, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Feb 2014 05:12:14	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	414,720	881,781	2.1262
18 Feb 2014 13:54:14	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	388,800	833,991	2.1450
16 Feb 2014 11:13:58	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	362,880	764,990	2.1081
15 Feb 2014 05:36:19	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	336,960	685,573	2.0346
14 Feb 2014 08:30:54	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	311,040	629,679	2.0244
13 Feb 2014 14:13:31	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	285,120	576,932	2.0235
12 Feb 2014 19:45:19	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	259,200	523,321	2.0190
11 Feb 2014 19:09:00	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	233,280	469,192	2.0113
10 Feb 2014 13:02:57	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	207,360	417,075	2.0114
09 Feb 2014 13:01:25	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	181,440	367,811	2.0272
08 Feb 2014 18:52:35	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	155,520	317,110	2.0390
07 Feb 2014 12:10:57	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	129,600	262,088	2.0223
06 Feb 2014 13:26:21	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	103,680	206,549	1.9922
05 Feb 2014 10:51:18	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	77,760	154,531	1.9873
03 Feb 2014 17:45:43	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	51,840	108,724	2.0973
02 Feb 2014 17:57:52	1310846	16277340	hadcm3n_7n92_1980_40_008441417_2	25,920	56,694	2.1873