Task 13693606

Name	hadam3p_saf_7gnd_2005_1_007578514_0
Workunit	7756644
Created	2 Dec 2011, 16:30:25 UTC
Sent	12 Dec 2011, 1:48:27 UTC
Report deadline	23 Nov 2012, 7:08:27 UTC
Received	15 Jan 2012, 19:33:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-177 (0xFFFFFF4F) ERR_RSC_LIMIT_EXCEEDED
Computer ID	1097837
Run time	6 days 11 hours 21 min 17 sec
CPU time	5 days 4 hours 32 min 19 sec
Validate state	Invalid
Credit	1,496.58
Device peak FLOPS	1.41 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.6.36</core_client_version> <![CDATA[ <message> Maximum memory exceeded </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8748, selfPID=8748, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDNNo Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2784, selfPID=6228, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5984, selfPID=5984, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6264, selfPID=4148, iMonCtr=1 CNo Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7716, selfPID=6188, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:33:51 (1120): No heartbeat from core client for 30 sec - exiting 15:33:52 (1120): No heartbeat from core client for 30 sec - exiting 15:33:53 (1120): No heartbeat from core client for 30 sec - exiting 15:33:54 (1120): No heartbeat from core client for 30 sec - exiting 15:33:55 (1120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:18:15 (1540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:18:16 (1540): No heartbeat from core client for 30 sec - exiting 17:18:18 (1540): No heartbeat from core client for 30 sec - exiting 17:18:19 (1540): No heartbeat from core client for 30 sec - exiting 17:18:20 (1540): No heartbeat from core client for 30 sec - exiting 17:41:13 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:41:14 (4572): No heartbeat from core client for 30 sec - exiting 17:41:16 (4572): No heartbeat from core client for 30 sec - exiting 17:41:17 (4572): No heartbeat from core client for 30 sec - exiting 17:41:18 (4572): No heartbeat from core client for 30 sec - exiting 20:50:56 (6032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:57 (6032): No heartbeat from core client for 30 sec - exiting CPDN MoniNo Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5000, selfPID=5000, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5000, selfPID=5764, iMonCtr=1 CPDN MoNo Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5416, selfPID=5416, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN MonitoNo Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9320, selfPID=9692, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9320, selfPID=9320, iMonCtr=1 CPDN MoNo Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10044, selfPID=8380, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadam3p_saf_7gnd_2005_1_007578514/dataout\7gndga.pdk6feb CPDN Monitor - Quit request from BOINC... 10:11:40 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:11:41 (3228): No heartbeat from core client for 30 sec - exiting 10:11:43 (3228): No heartbeat from core client for 30 sec - exiting 10:11:44 (3228): No heartbeat from core client for 30 sec - exiting 10:11:45 (3228): No heartbeat from core client for 30 sec - exiting 10:11:46 (3228): No heartbeat from core client for 30 sec - exiting 10:11:47 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5464, selfPID=5464, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3448, selfPID=3448, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5432, selfPID=5432, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3596, selfPID=3596, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5600, selfPID=5600, iMonCtr=2 CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4680, selfPID=4680, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4680, selfPID=3172, iMonCtr=1 00:19:00 (7392): No heartbeat from core client for 30 sec - exiting 00:19:01 (7392): No heartbeat from core client for 30 sec - exiting 00:19:02 (7392): No heartbeat from core client for 30 sec - exiting 00:19:03 (7392): No heartbeat from core client for 30 sec - exiting 00:19:04 (7392): No heartbeat from core client for 30 sec - exiting 00:19:05 (7392): No heartbeat from core client for 30 sec - exiting 00:19:06 (7392): No heartbeat from core client for 30 sec - exiting 00:19:08 (7392): No heartbeat from core client for 30 sec - exiting 00:19:09 (7392): No heartbeat from core client for 30 sec - exiting 00:19:10 (7392): No heartbeat from core client for 30 sec - exiting 00:19:11 (7392): No heartbeat from core client for 30 sec - exiting 00:19:12 (7392): No heartbeat from core client for 30 sec - exiting 00:19:13 (7392): No heartbeat from core client for 30 sec - exiting 00:19:14 (7392): No heartbeat from core client for 30 sec - exiting 00:19:15 (7392): No heartbeat from core client for 30 sec - exiting 00:19:16 (7392): No heartbeat from core client for 30 sec - exiting 00:19:17 (7392): No heartbeat from core client for 30 sec - exiting 00:19:18 (7392): No heartbeat from core client for 30 sec - exiting 00:19:20 (7392): No heartbeat from core client for 30 sec - exiting 00:19:21 (7392): No heartbeat from core client for 30 sec - exiting 00:19:22 (7392): No heartbeat from core client for 30 sec - exiting 00:19:23 (7392): No heartbeat from core client for 30 sec - exiting 00:19:24 (7392): No heartbeat from core client for 30 sec - exiting 00:19:25 (7392): No heartbeat from core client for 30 sec - exiting 00:19:26 (7392): No heartbeat from core client for 30 sec - exiting 00:19:27 (7392): No heartbeat from core client for 30 sec - exiting 00:19:28 (7392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:17:52 (7808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7620, selfPID=7620, iMonCtr=2 05:17:53 (7808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - QuitRegional Worker:: CPDN process is not running, exiting, bRetVal = 1, cheNkPI Proc=9288ss Ha selfdle GID=86obal 0, iMorkernCtr=: CPD N process is not running, exiting, bRetVal = 1, checkPID=9288, selfPID=9288, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9088, selfPID=9088, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:16:44 (9436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:32 (6492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:33 (6492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 23:14:31 (8512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:22 (8144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:23 (8144): No heartbeat from core client for 30 sec - exiting 10:12:21 (3092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:22 (3092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8620, selfPID=8620, iMonCtr=2 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=880, selfPID=880, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:10:20 (10224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:21 (10224): No heartbeat from core client for 30 sec - exiting 21:10:22 (10224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... NoCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5696, selfPID=5696, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:45:05 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3344, selfPID=1416, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:24:57 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:23:54 (3576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:23:55 (3576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... Re10:52:23 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:25 (3616): No heartbeat from core client for 30 sec - exiting 10:52:26 (3616): No heartbeat from core client for 30 sec - exiting 10:52:27 (3616): No heartbeat from core client for 30 sec - exiting 10:52:28 (3616): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1716, selfPID=1716, iMonCtr=2 10:52:29 (3616): No heartbeat from core client for 30 sec - exiting 10:52:30 (3616): No heartbeat from core client for 30 sec - exiting 10:52:31 (3616): No heartbeat from core client for 30 sec - exiting 10:52:32 (3616): No heartbeat from core client for 30 sec - exiting 10:52:33 (3616): No heartbeat from core client for 30 sec - exiting 10:52:35 (3616): No heartbeat from core client for 30 sec - exiting 10:52:36 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4736N se ProcfPID=ss Ha736, dle RMonCtgiona=1 l Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4736, selfPID=4756, iMonCtr=1 12:40:39 (4408): No heartbeat from core client for 30 sec - exiting 12:40:40 (4408): No heartbeat from core client for 30 sec - exiting 12:40:41 (4408): No heartbeat from core client for 30 sec - exiting 12:40:42 (4408): No heartbeat from core client for 30 sec - exiting 12:40:43 (4408): No heartbeat from core client for 30 sec - exiting 12:40:44 (4408): No heartbeat from core client for 30 sec - exiting 12:40:45 (4408): No heartbeat from core client for 30 sec - exiting 12:40:47 (4408): No heartbeat from core client for 30 sec - exiting 12:40:48 (4408): No heartbeat from core client for 30 sec - exiting 12:40:49 (4408): No heartbeat from core client for 30 sec - exiting 12:40:50 (4408): No heartbeat from core client for 30 sec - exiting 12:40:51 (4408): No heartbeat from core client for 30 sec - exiting 12:40:52 (4408): No heartbeat from core client for 30 sec - exiting 12:40:53 (4408): No heartbeat from core client for 30 sec - exiting 12:40:54 (4408): No heartbeat from core client for 30 sec - exiting 12:40:55 (4408): No heartbeat from core client for 30 sec - exiting 12:40:56 (4408): No heartbeat from core client for 30 sec - exiting 12:40:57 (4408): No heartbeat from core client for 30 sec - exiting 12:40:59 (4408): No heartbeat from core client for 30 sec - exiting 12:41:00 (4408): No heartbeat from core client for 30 sec - exiting 12:41:01 (4408): No heartbeat from core client for 30 sec - exiting 12:41:02 (4408): No heartbeat from core client for 30 sec - exiting 12:41:03 (4408): No heartbeat from core client for 30 sec - exiting 12:41:04 (4408): No heartbeat from core client for 30 sec - exiting 12:41:05 (4408): No heartbeat from core client for 30 sec - exiting 12:41:06 (4408): No heartbeat from core client for 30 sec - exiting 12:41:07 (4408): No heartbeat from core client for 30 sec - exiting 12:41:08 (4408): No heartbeat from core client for 30 sec - exiting 12:41:10 (4408): No heartbeat from core client for 30 sec - exiting 12:41:11 (4408): No heartbeat from core client for 30 sec - exiting 12:41:12 (4408): No heartbeat from core client for 30 sec - exiting 12:41:13 (4408): No heartbeat from core client for 30 sec - exiting 12:41:14 (4408): No heartbeat from core client for 30 sec - exiting 12:41:15 (4408): No heartbeat from core client for 30 sec - exiting 12:41:16 (4408): No heartbeat from core client for 30 sec - exiting 12:41:17 (4408): No heartbeat from core client for 30 sec - exiting 12:41:18 (4408): No heartbeat from core client for 30 sec - exiting 12:41:19 (4408): No heartbeat from core client for 30 sec - exiting 12:41:21 (4408): No heartbeat from core client for 30 sec - exiting 12:41:22 (4408): No heartbeat from core client for 30 sec - exiting 12:41:23 (4408): No heartbeat from core client for 30 sec - exiting 12:41:24 (4408): No heartbeat from core client for 30 sec - exiting 12:41:25 (4408): No heartbeat from core client for 30 sec - exiting 12:41:26 (4408): No heartbeat from core client for 30 sec - exiting 12:41:27 (4408): No heartbeat from core client for 30 sec - exiting 12:41:28 (4408): No heartbeat from core client for 30 sec - exiting 12:41:29 (4408): No heartbeat from core client for 30 sec - exiting 12:41:31 (4408): No heartbeat from core client for 30 sec - exiting 12:41:32 (4408): No heartbeat from core client for 30 sec - exiting 12:41:33 (4408): No heartbeat from core client for 30 sec - exiting 12:41:34 (4408): No heartbeat from core client for 30 sec - exiting 12:42:28 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=884, selfPID=884, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=884, selfPID=4508, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1444, selfPID=1444, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1444, selfPID=1984, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4572, selfPID=4572, iMonCtr=2 17:31:45 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:46 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN MoNo Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=432, selfPID=432, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=432, selfPID=5232, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7388, selfPID=7388, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Jan 2012 21:55:10	1097837	13693606	hadam3p_saf_7gnd_2005_1_007578514_0	92,256	429,027	4.6504
07 Jan 2012 02:46:00	1097837	13693606	hadam3p_saf_7gnd_2005_1_007578514_0	80,736	376,429	4.6625
05 Jan 2012 17:21:48	1097837	13693606	hadam3p_saf_7gnd_2005_1_007578514_0	69,216	325,412	4.7014
05 Jan 2012 16:01:26	1097837	13693606	hadam3p_saf_7gnd_2005_1_007578514_0	57,696	273,928	4.7478
05 Jan 2012 16:01:26	1097837	13693606	hadam3p_saf_7gnd_2005_1_007578514_0	46,176	215,506	4.6671
05 Jan 2012 16:01:26	1097837	13693606	hadam3p_saf_7gnd_2005_1_007578514_0	34,656	159,314	4.5970
18 Dec 2011 21:34:55	1097837	13693606	hadam3p_saf_7gnd_2005_1_007578514_0	23,136	107,370	4.6408
14 Dec 2011 13:19:08	1097837	13693606	hadam3p_saf_7gnd_2005_1_007578514_0	11,616	53,748	4.6271