Task 15914275

Name	hadcm3n_zju0_1920_40_008361875_1
Workunit	8512734
Created	14 Aug 2013, 11:38:28 UTC
Sent	14 Aug 2013, 18:20:04 UTC
Report deadline	14 Nov 2013, 1:47:15 UTC
Received	3 Oct 2013, 5:35:04 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	871746
Run time	33 days 2 hours 45 min 20 sec
CPU time	29 days 17 hours 50 min 19 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.48 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 OPEN: File Creation Failed: No space left on device OPEN: Unable to Open File dataout/zju0ko.daf51h0 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zju0_1920_40_008361875/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0042E622 Unknown Unknown Unknown hadcm3n_um_6.07_i 0042D0EB Unknown Unknown Unknown hadcm3n_um_6.07_i 003EF4DD Unknown Unknown Unknown hadcm3n_um_6.07_i 003A66F5 Unknown Unknown Unknown hadcm3n_um_6.07_i 003A5E57 Unknown Unknown Unknown hadcm3n_um_6.07_i 003E6199 Unknown Unknown Unknown hadcm3n_um_6.07_i 003193CE Unknown Unknown Unknown hadcm3n_um_6.07_i 002E3B60 Unknown Unknown Unknown hadcm3n_um_6.07_i 0016F741 Unknown Unknown Unknown hadcm3n_um_6.07_i 0038CE7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0038A1ED Unknown Unknown Unknown hadcm3n_um_6.07_i 000048E1 Unknown Unknown Unknown hadcm3n_um_6.07_i 000027FB Unknown Unknown Unknown hadcm3n_um_6.07_i 00002729 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=78710, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zju0_1920_40_008361875/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0042E622 Unknown Unknown Unknown hadcm3n_um_6.07_i 0042D0EB Unknown Unknown Unknown hadcm3n_um_6.07_i 003EF4DD Unknown Unknown Unknown hadcm3n_um_6.07_i 003A66F5 Unknown Unknown Unknown hadcm3n_um_6.07_i 003A5E57 Unknown Unknown Unknown hadcm3n_um_6.07_i 003E6199 Unknown Unknown Unknown hadcm3n_um_6.07_i 003193CE Unknown Unknown Unknown hadcm3n_um_6.07_i 002E3B60 Unknown Unknown Unknown hadcm3n_um_6.07_i 0016F741 Unknown Unknown Unknown hadcm3n_um_6.07_i 0038CE7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0038A1ED Unknown Unknown Unknown hadcm3n_um_6.07_i 000048E1 Unknown Unknown Unknown hadcm3n_um_6.07_i 000027FB Unknown Unknown Unknown hadcm3n_um_6.07_i 00002729 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=78710, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zju0Called boinc_finish BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 OPEN: File Creation Failed: No space left on device OPEN: Unable to Open File dataout/zju0ka.dac18i0 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... 10:17:56 (266): No heartbeat from core client for 30 sec - exiting 10:17:58 (266): No heartbeat from core client for 30 sec - exiting 10:17:59 (266): No heartbeat from core client for 30 sec - exiting 10:18:00 (266): No heartbeat from core client for 30 sec - exiting 10:18:01 (266): No heartbeat from core client for 30 sec - exiting 10:18:02 (266): No heartbeat from core client for 30 sec - exiting 10:18:03 (266): No heartbeat from core client for 30 sec - exiting 10:18:04 (266): No heartbeat from core client for 30 sec - exiting 10:18:05 (266): No heartbeat from core client for 30 sec - exiting 10:18:06 (266): No heartbeat from core client for 30 sec - exiting 10:18:07 (266): No heartbeat from core client for 30 sec - exiting 10:18:08 (266): No heartbeat from core client for 30 sec - exiting 10:18:09 (266): No heartbeat from core client for 30 sec - exiting 10:18:10 (266): No heartbeat from core client for 30 sec - exiting 10:18:11 (266): No heartbeat from core client for 30 sec - exiting 10:18:12 (266): No heartbeat from core client for 30 sec - exiting 10:18:13 (266): No heartbeat from core client for 30 sec - exiting 10:18:14 (266): No heartbeat from core client for 30 sec - exiting 10:18:15 (266): No heartbeat from core client for 30 sec - exiting 10:18:16 (266): No heartbeat from core client for 30 sec - exiting 10:18:17 (266): No heartbeat from core client for 30 sec - exiting 10:18:18 (266): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:45:04 (257): No heartbeat from core client for 30 sec - exiting 16:45:06 (257): No heartbeat from core client for 30 sec - exiting 16:45:07 (257): No heartbeat from core client for 30 sec - exiting 16:45:08 (257): No heartbeat from core client for 30 sec - exiting 16:45:09 (257): No heartbeat from core client for 30 sec - exiting 16:45:10 (257): No heartbeat from core client for 30 sec - exiting 16:45:11 (257): No heartbeat from core client for 30 sec - exiting 16:45:12 (257): No heartbeat from core client for 30 sec - exiting 16:45:13 (257): No heartbeat from core client for 30 sec - exiting 16:45:14 (257): No heartbeat from core client for 30 sec - exiting 16:45:17 (257): No heartbeat from core client for 30 sec - exiting 16:45:18 (257): No heartbeat from core client for 30 sec - exiting 16:45:19 (257): No heartbeat from core client for 30 sec - exiting 16:45:20 (257): No heartbeat from core client for 30 sec - exiting 16:45:21 (257): No heartbeat from core client for 30 sec - exiting 16:45:22 (257): No heartbeat from core client for 30 sec - exiting 16:45:23 (257): No heartbeat from core client for 30 sec - exiting 16:45:24 (257): No heartbeat from core client for 30 sec - exiting 16:45:25 (257): No heartbeat from core client for 30 sec - exiting 16:45:26 (257): No heartbeat from core client for 30 sec - exiting 16:45:27 (257): No heartbeat from core client for 30 sec - exiting 16:45:28 (257): No heartbeat from core client for 30 sec - exiting 16:45:29 (257): No heartbeat from core client for 30 sec - exiting 16:45:30 (257): No heartbeat from core client for 30 sec - exiting 16:45:31 (257): No heartbeat from core client for 30 sec - exiting 16:45:32 (257): No heartbeat from core client for 30 sec - exiting 16:45:33 (257): No heartbeat from core client for 30 sec - exiting 16:45:34 (257): No heartbeat from core client for 30 sec - exiting 16:45:35 (257): No heartbeat from core client for 30 sec - exiting 16:45:36 (257): No heartbeat from core client for 30 sec - exiting 16:45:37 (257): No heartbeat from core client for 30 sec - exiting 16:45:38 (257): No heartbeat from core client for 30 sec - exiting 16:45:39 (257): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 17:27:44 (292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA CPDN Monitor - Quit request from BOINC... OPEN: File Creation Failed: No space left on device OPEN: Unable to Open File dataout/zju0ka.dac2850 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 08:43:26 (253): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Oct 2013 05:39:49	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	1,036,800	2,569,257	2.4781
02 Oct 2013 18:34:07	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	1,010,880	2,532,928	2.5057
02 Oct 2013 07:28:42	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	984,960	2,496,495	2.5346
01 Oct 2013 20:33:16	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	959,040	2,460,147	2.5652
01 Oct 2013 09:31:08	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	933,120	2,424,336	2.5981
30 Sep 2013 23:06:21	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	907,200	2,388,637	2.6330
09 Sep 2013 20:49:20	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	881,280	1,213,202	1.3766
09 Sep 2013 10:18:41	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	855,360	1,177,651	1.3768
08 Sep 2013 22:15:44	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	829,440	1,142,229	1.3771
08 Sep 2013 11:07:52	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	803,520	1,106,106	1.3766
07 Sep 2013 22:23:14	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	777,600	1,069,920	1.3759
06 Sep 2013 04:05:22	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	751,680	1,033,790	1.3753
03 Sep 2013 17:49:35	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	725,760	998,645	1.3760
03 Sep 2013 07:14:52	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	699,840	963,666	1.3770
02 Sep 2013 21:00:31	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	673,920	928,717	1.3781
02 Sep 2013 06:53:21	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	648,000	893,747	1.3792
01 Sep 2013 07:58:46	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	622,080	858,821	1.3806
31 Aug 2013 14:12:25	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	596,160	823,708	1.3817
30 Aug 2013 23:35:47	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	570,240	788,827	1.3833
30 Aug 2013 12:06:41	871746	15914275	hadcm3n_zju0_1920_40_008361875_1	544,320	753,462	1.3842