Task 12833425

Name	hadcm3n_p72j_1900_40_007226747_1
Workunit	7424987
Created	26 Apr 2011, 15:38:26 UTC
Sent	26 Apr 2011, 23:43:53 UTC
Report deadline	27 Jul 2011, 7:11:04 UTC
Received	14 May 2011, 7:17:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1076802
Run time	16 days 6 hours 22 min 12 sec
CPU time	11 days 20 hours 16 min 35 sec
Validate state	Invalid
Credit	6,531.84
Device peak FLOPS	1.70 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 19:47:18 (22075): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) 23:26:55 (8749): No heartbeat from core client for 30 sec - exiting 23:26:56 (8749): No heartbeat from core client for 30 sec - exiting 23:26:57 (8749): No heartbeat from core client for 30 sec - exiting 23:26:58 (8749): No heartbeat from core client for 30 sec - exiting 23:26:59 (8749): No heartbeat from core client for 30 sec - exiting 23:27:05 (8749): No heartbeat from core client for 30 sec - exiting 23:27:06 (8749): No heartbeat from core client for 30 sec - exiting 23:27:07 (8749): No heartbeat from core client for 30 sec - exiting 23:27:08 (8749): No heartbeat from core client for 30 sec - exiting 23:27:09 (8749): No heartbeat from core client for 30 sec - exiting 23:27:10 (8749): No heartbeat from core client for 30 sec - exiting 23:27:11 (8749): No heartbeat from core client for 30 sec - exiting 23:27:12 (8749): No heartbeat from core client for 30 sec - exiting 23:27:13 (8749): No heartbeat from core client for 30 sec - exiting 23:27:14 (8749): No heartbeat from core client for 30 sec - exiting 23:27:15 (8749): No heartbeat from core client for 30 sec - exiting 23:27:16 (8749): No heartbeat from core client for 30 sec - exiting 23:27:17 (8749): No heartbeat from core client for 30 sec - exiting 23:27:20 (8749): No heartbeat from core client for 30 sec - exiting 23:27:21 (8749): No heartbeat from core client for 30 sec - exiting 23:27:22 (8749): No heartbeat from core client for 30 sec - exiting 23:27:23 (8749): No heartbeat from core client for 30 sec - exiting 23:27:24 (8749): No heartbeat from core client for 30 sec - exiting 23:27:25 (8749): No heartbeat from core client for 30 sec - exiting 23:27:26 (8749): No heartbeat from core client for 30 sec - exiting 23:27:28 (8749): No heartbeat from core client for 30 sec - exiting 23:27:29 (8749): No heartbeat from core client for 30 sec - exiting 23:27:30 (8749): No heartbeat from core client for 30 sec - exiting 23:27:31 (8749): No heartbeat from core client for 30 sec - exiting 23:27:32 (8749): No heartbeat from core client for 30 sec - exiting 23:27:33 (8749): No heartbeat from core client for 30 sec - exiting 23:27:34 (8749): No heartbeat from core client for 30 sec - exiting 23:27:35 (8749): No heartbeat from core client for 30 sec - exiting 23:27:36 (8749): No heartbeat from core client for 30 sec - exiting 23:27:37 (8749): No heartbeat from core client for 30 sec - exiting 23:27:38 (8749): No heartbeat from core client for 30 sec - exiting 23:27:39 (8749): No heartbeat from core client for 30 sec - exiting 23:27:40 (8749): No heartbeat from core client for 30 sec - exiting 23:27:41 (8749): No heartbeat from core client for 30 sec - exiting 23:27:42 (8749): No heartbeat from core client for 30 sec - exiting 23:27:43 (8749): No heartbeat from core client for 30 sec - exiting 23:27:44 (8749): No heartbeat from core client for 30 sec - exiting 23:27:45 (8749): No heartbeat from core client for 30 sec - exiting 23:27:46 (8749): No heartbeat from core client for 30 sec - exiting 23:27:47 (8749): No heartbeat from core client for 30 sec - exiting 23:27:48 (8749): No heartbeat from core client for 30 sec - exiting 23:27:49 (8749): No heartbeat from core client for 30 sec - exiting 23:27:50 (8749): No heartbeat from core client for 30 sec - exiting 23:27:51 (8749): No heartbeat from core client for 30 sec - exiting 23:27:52 (8749): No heartbeat from core client for 30 sec - exiting 23:27:53 (8749): No heartbeat from core client for 30 sec - exiting 23:27:54 (8749): No heartbeat from core client for 30 sec - exiting 23:27:55 (8749): No heartbeat from core client for 30 sec - exiting 23:27:56 (8749): No heartbeat from core client for 30 sec - exiting 23:27:57 (8749): No heartbeat from core client for 30 sec - exiting 23:27:58 (8749): No heartbeat from core client for 30 sec - exiting 23:27:59 (8749): No heartbeat from core client for 30 sec - exiting 23:28:00 (8749): No heartbeat from core client for 30 sec - exiting 23:28:01 (8749): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) 10:21:42 (13852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) 11:11:28 (8761): No heartbeat from core client for 30 sec - exiting 11:11:29 (8761): No heartbeat from core client for 30 sec - exiting 11:11:30 (8761): No heartbeat from core client for 30 sec - exiting 11:11:31 (8761): No heartbeat from core client for 30 sec - exiting 11:11:32 (8761): No heartbeat from core client for 30 sec - exiting 11:11:33 (8761): No heartbeat from core client for 30 sec - exiting 11:11:34 (8761): No heartbeat from core client for 30 sec - exiting 11:11:35 (8761): No heartbeat from core client for 30 sec - exiting 11:11:36 (8761): No heartbeat from core client for 30 sec - exiting 11:11:37 (8761): No heartbeat from core client for 30 sec - exiting 11:11:38 (8761): No heartbeat from core client for 30 sec - exiting 11:11:39 (8761): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_p72j_1900_40_007226747/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08455448 Unknown Unknown Unknown hadcm3n_um_6.07_i 08372172 Unknown Unknown Unknown hadcm3n_um_6.07_i 0837FE35 Unknown Unknown Unknown hadcm3n_um_6.07_i 0822B1DE Unknown Unknown Unknown hadcm3n_um_6.07_i 0818A767 Unknown Unknown Unknown hadcm3n_um_6.07_i 0818D749 Unknown Unknown Unknown hadcm3n_um_6.07_i 08391957 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F8B7 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 00258E9C Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8917, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_p72j_1900_40_007226747/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08451069 Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 0836D10D Unknown Unknown Unknown hadcm3n_um_6.07_i 082EB086 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F66D Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 00258E9C Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10189, iMonCtr=1 Model crash detected, will try to restart... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_se_6.07_i686-pc-linux-gnu.so) BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_p72j_1900_40_007226747/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08451069 Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 0836D10D Unknown Unknown Unknown hadcm3n_um_6.07_i 082EB086 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F66D Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 00258E9C Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14949, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_p72j_1900_40_007226747/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08451069 Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 0836D10D Unknown Unknown Unknown hadcm3n_um_6.07_i 082EB086 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F66D Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 00258E9C Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14949, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_p72j_1900_40_007226747/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08451069 Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 0836D10D Unknown Unknown Unknown hadcm3n_um_6.07_i 082EB086 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F66D Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 00258E9C Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14949, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_p72j_1900_40_007226747/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08451069 Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 0836D10D Unknown Unknown Unknown hadcm3n_um_6.07_i 082EB086 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F66D Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 00258E9C Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14949, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /root/BOINC/projects/climateprediction.net_index.php/hadcm3n_p72j_1900_40_007226747/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08451069 Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 0836D10D Unknown Unknown Unknown hadcm3n_um_6.07_i 082EB086 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F66D Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 00258E9C Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14949, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 May 2011 20:04:40	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	544,320	982,986	1.8059
13 May 2011 03:04:16	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	518,400	921,764	1.7781
12 May 2011 10:03:42	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	492,480	995,908	2.0222
11 May 2011 17:18:20	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	466,560	935,618	2.0054
11 May 2011 00:43:37	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	440,640	951,550	2.1595
10 May 2011 07:25:03	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	414,720	1,010,675	2.4370
09 May 2011 14:01:37	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	388,800	948,333	2.4391
08 May 2011 20:31:33	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	362,880	920,339	2.5362
08 May 2011 02:40:36	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	336,960	856,333	2.5413
06 May 2011 20:17:44	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	311,040	790,278	2.5408
05 May 2011 13:18:36	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	285,120	731,502	2.5656
04 May 2011 17:24:17	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	259,200	661,149	2.5507
03 May 2011 22:14:28	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	233,280	595,603	2.5532
03 May 2011 03:14:44	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	207,360	530,587	2.5588
02 May 2011 08:29:29	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	181,440	463,095	2.5523
01 May 2011 13:53:51	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	155,520	396,043	2.5466
30 Apr 2011 19:31:00	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	129,600	329,816	2.5449
30 Apr 2011 00:56:07	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	103,680	263,071	2.5373
29 Apr 2011 07:31:38	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	77,760	196,672	2.5292
28 Apr 2011 23:21:23	1076802	12833425	hadcm3n_p72j_1900_40_007226747_1	51,840	129,415	2.4964