climateprediction.net home page
Task 15644818

Task 15644818

Name hadcm3n_o6q1_2140_40_008271732_2
Workunit 8426856
Created 2 Mar 2013, 0:12:55 UTC
Sent 2 Mar 2013, 0:13:38 UTC
Report deadline 1 Jun 2013, 7:40:49 UTC
Received 23 Jun 2013, 14:51:04 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1255681
Run time 41 days 16 hours 28 min 56 sec
CPU time 39 days 12 hours 10 min 23 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 1.26 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
11:58:55 (3716): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:59:36 (3296): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:12:27 (27524): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:12:30 (27524): No heartbeat from core client for 30 sec - exiting
20:23:11 (13576): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:23:13 (13576): No heartbeat from core client for 30 sec - exiting
21:00:35 (23664): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:00:37 (23664): No heartbeat from core client for 30 sec - exiting
21:00:38 (23664): No heartbeat from core client for 30 sec - exiting
21:28:18 (30052): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:28:19 (30052): No heartbeat from core client for 30 sec - exiting
21:28:20 (30052): No heartbeat from core client for 30 sec - exiting
21:35:09 (28968): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:35:10 (28968): No heartbeat from core client for 30 sec - exiting
21:37:55 (16804): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:39:42 (9928): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:56:17 (6780): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:13:19 (3648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:47:19 (15292): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:04:26 (4076): Can't acquire lockfile (32) - waiting 35s
12:04:34 (2452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:18:20 (4748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:18:22 (4748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:09:44 (9876): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:09:46 (9876): No heartbeat from core client for 30 sec - exiting
21:17:00 (2932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:17:01 (2932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	04:19:36 AM	No files match the supplied pattern.
MainError:	04:19:36 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	07:40:06 AM	No files match the supplied pattern.
MainError:	07:40:06 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	02:26:28 PM	No files match the supplied pattern.
MainError:	02:26:28 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:24:50 (9852): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:24:52 (9852): No heartbeat from core client for 30 sec - exiting
23:24:53 (9852): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	08:22:37 PM	No files match the supplied pattern.
MainError:	08:22:37 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	11:24:52 PM	No files match the supplied pattern.
MainError:	11:24:53 PM	No files match the supplied pattern.
MainError:	07:42:26 AM	No files match the supplied pattern.
MainError:	07:42:27 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	12:39:23 AM	No files match the supplied pattern.
MainError:	12:39:23 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:30:22 (3240): No heartbeat from core client for 30 sec - exiting
17:30:23 (3240): No heartbeat from core client for 30 sec - exiting
17:30:24 (3240): No heartbeat from core client for 30 sec - exiting
17:30:25 (3240): No heartbeat from core client for 30 sec - exiting
17:30:26 (3240): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:30:27 (3240): No heartbeat from core client for 30 sec - exiting
MainError:	04:45:25 AM	No files match the supplied pattern.
MainError:	04:45:25 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
MainError:	10:59:03 PM	No files match the supplied pattern.
MainError:	10:59:04 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
21:02:03 (42732): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:02:05 (42732): No heartbeat from core client for 30 sec - exiting
23:37:29 (15940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:37:30 (15940): No heartbeat from core client for 30 sec - exiting
MainError:	12:42:07 AM	No files match the supplied pattern.
MainError:	12:42:07 AM	No files match the supplied pattern.
20:16:33 (3220): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:02:07 (3372): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:37:36 (3672): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Error converting file to netcdf: dataout/o6q1ka.ph11c10
Error converting file to netcdf: dataout/o6q1ka.pg11c10
Error converting file to netcdf: dataout/o6q1ka.pe11c10
MainError:	05:35:09 AM	No files match the supplied pattern.
MainError:	05:35:09 AM	No files match the supplied pattern.
00:35:45 (536): No heartbeat from core client for 30 sec - exiting
00:35:46 (536): No heartbeat from core client for 30 sec - exiting
00:35:47 (536): No heartbeat from core client for 30 sec - exiting
00:35:48 (536): No heartbeat from core client for 30 sec - exiting
00:35:49 (536): No heartbeat from core client for 30 sec - exiting
00:35:50 (536): No heartbeat from core client for 30 sec - exiting
00:35:51 (536): No heartbeat from core client for 30 sec - exiting
00:35:52 (536): No heartbeat from core client for 30 sec - exiting
00:35:53 (536): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o6q1_2140_40_008271732/dataout/atmos_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o6q1_2140_40_008271732/dataout/atmos_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o6q1_2140_40_008271732/dataout/atmos_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o6q1_2140_40_008271732/dataout/atmos_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o6q1_2140_40_008271732/dataout/atmos_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_o6q1_2140_40_008271732/dataout/atmos_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Jun 2013 14:54:23 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 777,600 3,413,395 4.3897
20 Jun 2013 14:10:20 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 751,680 3,299,510 4.3895
15 Jun 2013 23:16:35 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 725,760 3,183,903 4.3870
14 Jun 2013 16:32:55 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 699,840 3,068,238 4.3842
12 Jun 2013 16:43:17 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 673,920 2,950,011 4.3774
08 Jun 2013 08:28:34 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 648,000 2,835,357 4.3756
07 Jun 2013 02:07:38 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 622,080 2,721,949 4.3756
02 Jun 2013 20:22:21 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 596,160 2,609,945 4.3779
31 May 2013 15:58:12 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 570,240 2,511,026 4.4035
29 May 2013 08:22:49 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 544,320 2,403,809 4.4162
27 May 2013 04:22:28 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 518,400 2,295,727 4.4285
25 May 2013 18:16:18 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 492,480 2,175,218 4.4169
19 May 2013 16:09:54 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 466,560 2,073,011 4.4432
14 May 2013 17:12:22 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 440,640 1,965,869 4.4614
10 May 2013 17:07:13 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 414,720 1,856,726 4.4771
06 May 2013 18:32:15 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 388,800 1,740,686 4.4771
05 May 2013 16:41:04 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 362,880 1,624,610 4.4770
04 May 2013 02:59:38 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 336,960 1,511,364 4.4853
23 Apr 2013 15:35:44 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 311,040 1,395,167 4.4855
22 Apr 2013 03:37:02 1255681 15644818 hadcm3n_o6q1_2140_40_008271732_2 285,120 1,283,820 4.5027


©2024 climateprediction.net