Task 15716219

Name	hadcm3n_4lmp_1940_40_008304316_4
Workunit	8455451
Created	8 Apr 2013, 1:19:48 UTC
Sent	8 Apr 2013, 1:42:24 UTC
Report deadline	8 Jul 2013, 9:09:35 UTC
Received	21 Apr 2013, 10:45:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1273462
Run time	10 days 7 hours 46 min 57 sec
CPU time	8 days 17 hours 44 min 13 sec
Validate state	Invalid
Credit	11,508.48
Device peak FLOPS	3.13 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> Enheden genkender ikke kommandoen. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 09:57:10 (2896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:47:58 (3836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:17:33 (2968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:02:28 (2364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3508, iMonCtr=1 Model crash detected, will try to restart... 08:38:29 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:04:53 (2224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:35:28 (2908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:48 (3400): No heartbeat from core client for 30 sec - exiting 23:48:49 (3400): No heartbeat from core client for 30 sec - exiting 23:48:50 (3400): No heartbeat from core client for 30 sec - exiting 23:48:51 (3400): No heartbeat from core client for 30 sec - exiting 23:48:52 (3400): No heartbeat from core client for 30 sec - exiting 23:48:53 (3400): No heartbeat from core client for 30 sec - exiting 23:48:55 (3400): No heartbeat from core client for 30 sec - exiting 23:48:56 (3400): No heartbeat from core client for 30 sec - exiting 23:48:57 (3400): No heartbeat from core client for 30 sec - exiting 23:48:58 (3400): No heartbeat from core client for 30 sec - exiting 23:48:59 (3400): No heartbeat from core client for 30 sec - exiting 23:49:00 (3400): No heartbeat from core client for 30 sec - exiting 23:49:01 (3400): No heartbeat from core client for 30 sec - exiting 23:49:02 (3400): No heartbeat from core client for 30 sec - exiting 23:49:03 (3400): No heartbeat from core client for 30 sec - exiting 23:49:04 (3400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:36:46 (3680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Apr 2013 21:38:30	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	959,040	749,977	0.7820
20 Apr 2013 15:10:38	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	933,120	729,993	0.7823
20 Apr 2013 08:48:57	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	907,200	710,069	0.7827
20 Apr 2013 02:26:41	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	881,280	689,659	0.7826
19 Apr 2013 19:47:52	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	855,360	669,460	0.7827
19 Apr 2013 08:33:32	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	829,440	649,662	0.7833
19 Apr 2013 02:06:28	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	803,520	629,407	0.7833
18 Apr 2013 19:41:54	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	777,600	609,011	0.7832
18 Apr 2013 13:45:08	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	751,680	589,006	0.7836
18 Apr 2013 07:15:45	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	725,760	568,855	0.7838
18 Apr 2013 00:47:24	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	699,840	548,350	0.7835
17 Apr 2013 12:53:22	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	673,920	528,262	0.7839
17 Apr 2013 05:55:57	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	648,000	508,200	0.7843
16 Apr 2013 23:18:29	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	622,080	487,327	0.7834
16 Apr 2013 16:51:21	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	596,160	467,204	0.7837
16 Apr 2013 02:57:46	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	570,240	446,807	0.7835
15 Apr 2013 20:57:43	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	544,320	426,575	0.7837
15 Apr 2013 14:06:58	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	518,400	406,122	0.7834
15 Apr 2013 03:43:42	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	492,480	385,553	0.7829
14 Apr 2013 20:45:51	1273462	15716219	hadcm3n_4lmp_1940_40_008304316_4	466,560	365,481	0.7834