Task 14861597

Name	hadam3p_pnw_c1os_1964_1_008027393_0
Workunit	8182507
Created	4 Jul 2012, 15:33:16 UTC
Sent	4 Jul 2012, 15:33:23 UTC
Report deadline	16 Jun 2013, 20:53:23 UTC
Received	18 Jul 2012, 18:13:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1187786
Run time	20 hours 30 min 15 sec
CPU time	18 hours 55 min 21 sec
Validate state	Invalid
Credit	502.72
Device peak FLOPS	3.06 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3804, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3824, selfPID=3628, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:49:54 (3196): No heartbeat from core client for 30 sec - exiting 15:49:55 (3196): No heartbeat from core client for 30 sec - exiting 15:49:56 (3196): No heartbeat from core client for 30 sec - exiting 15:49:57 (3196): No heartbeat from core client for 30 sec - exiting 15:49:58 (3196): No heartbeat from core client for 30 sec - exiting 15:49:59 (3196): No heartbeat from core client for 30 sec - exiting 15:50:00 (3196): No heartbeat from core client for 30 sec - exiting 15:50:01 (3196): No heartbeat from core client for 30 sec - exiting 15:50:03 (3196): No heartbeat from core client for 30 sec - exiting 15:50:04 (3196): No heartbeat from core client for 30 sec - exiting 15:50:05 (3196): No heartbeat from core client for 30 sec - exiting 15:50:06 (3196): No heartbeat from core client for 30 sec - exiting 15:50:07 (3196): No heartbeat from core client for 30 sec - exiting 15:50:08 (3196): No heartbeat from core client for 30 sec - exiting 15:50:09 (3196): No heartbeat from core client for 30 sec - exiting 15:50:10 (3196): No heartbeat from core client for 30 sec - exiting 15:50:11 (3196): No heartbeat from core client for 30 sec - exiting 15:50:12 (3196): No heartbeat from core client for 30 sec - exiting 15:50:13 (3196): No heartbeat from core client for 30 sec - exiting 15:50:15 (3196): No heartbeat from core client for 30 sec - exiting 15:50:16 (3196): No heartbeat from core client for 30 sec - exiting 15:50:17 (3196): No heartbeat from core client for 30 sec - exiting 15:50:18 (3196): No heartbeat from core client for 30 sec - exiting 15:50:19 (3196): No heartbeat from core client for 30 sec - exiting 15:50:20 (3196): No heartbeat from core client for 30 sec - exiting 15:50:21 (3196): No heartbeat from core client for 30 sec - exiting 15:50:22 (3196): No heartbeat from core client for 30 sec - exiting 15:50:23 (3196): No heartbeat from core client for 30 sec - exiting 15:50:24 (3196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:50:30 (3980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2372, selfPID=3088, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 14:05:58 (2996): No heartbeat from core client for 30 sec - exiting 14:06:00 (2996): No heartbeat from core client for 30 sec - exiting 14:06:01 (2996): No heartbeat from core client for 30 sec - exiting 14:06:02 (2996): No heartbeat from core client for 30 sec - exiting 14:06:03 (2996): No heartbeat from core client for 30 sec - exiting 14:06:04 (2996): No heartbeat from core client for 30 sec - exiting 14:06:05 (2996): No heartbeat from core client for 30 sec - exiting 14:06:06 (2996): No heartbeat from core client for 30 sec - exiting 14:06:07 (2996): No heartbeat from core client for 30 sec - exiting 14:06:08 (2996): No heartbeat from core client for 30 sec - exiting 14:06:09 (2996): No heartbeat from core client for 30 sec - exiting 14:06:10 (2996): No heartbeat from core client for 30 sec - exiting 14:06:12 (2996): No heartbeat from core client for 30 sec - exiting 14:06:13 (2996): No heartbeat from core client for 30 sec - exiting 14:06:14 (2996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2148, selfPID=2148, iMonCtr=2 15:15:07 (3956): No heartbeat from core client for 30 sec - exiting 15:15:08 (3956): No heartbeat from core client for 30 sec - exiting 15:15:10 (3956): No heartbeat from core client for 30 sec - exiting 15:15:11 (3956): No heartbeat from core client for 30 sec - exiting 15:15:12 (3956): No heartbeat from core client for 30 sec - exiting 15:15:13 (3956): No heartbeat from core client for 30 sec - exiting 15:15:14 (3956): No heartbeat from core client for 30 sec - exiting 15:15:15 (3956): No heartbeat from core client for 30 sec - exiting 15:15:16 (3956): No heartbeat from core client for 30 sec - exiting 15:15:17 (3956): No heartbeat from core client for 30 sec - exiting 15:15:18 (3956): No heartbeat from core client for 30 sec - exiting 15:15:19 (3956): No heartbeat from core client for 30 sec - exiting 15:15:21 (3956): No heartbeat from core client for 30 sec - exiting 15:15:22 (3956): No heartbeat from core client for 30 sec - exiting 15:15:23 (3956): No heartbeat from core client for 30 sec - exiting 15:15:24 (3956): No heartbeat from core client for 30 sec - exiting 15:15:25 (3956): No heartbeat from core client for 30 sec - exiting 15:15:26 (3956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:15:27 (3956): No heartbeat from core client for 30 sec - exiting 16:57:38 (2940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:35 (1060): No heartbeat from core client for 30 sec - exiting 19:01:36 (1060): No heartbeat from core client for 30 sec - exiting 19:01:37 (1060): No heartbeat from core client for 30 sec - exiting 19:01:38 (1060): No heartbeat from core client for 30 sec - exiting 19:01:39 (1060): No heartbeat from core client for 30 sec - exiting 19:01:40 (1060): No heartbeat from core client for 30 sec - exiting 19:01:41 (1060): No heartbeat from core client for 30 sec - exiting 19:01:42 (1060): No heartbeat from core client for 30 sec - exiting 19:01:43 (1060): No heartbeat from core client for 30 sec - exiting 19:01:44 (1060): No heartbeat from core client for 30 sec - exiting 19:01:46 (1060): No heartbeat from core client for 30 sec - exiting 19:01:47 (1060): No heartbeat from core client for 30 sec - exiting 19:01:48 (1060): No heartbeat from core client for 30 sec - exiting 19:01:49 (1060): No heartbeat from core client for 30 sec - exiting 19:01:50 (1060): No heartbeat from core client for 30 sec - exiting 19:01:51 (1060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:54:45 (2864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:52:55 (2952): No heartbeat from core client for 30 sec - exiting 08:52:56 (2952): No heartbeat from core client for 30 sec - exiting 08:52:57 (2952): No heartbeat from core client for 30 sec - exiting 08:52:58 (2952): No heartbeat from core client for 30 sec - exiting 08:52:59 (2952): No heartbeat from core client for 30 sec - exiting 08:53:00 (2952): No heartbeat from core client for 30 sec - exiting 08:53:02 (2952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:39 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2944, selfPID=2944, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 18:29:06 (2896): No heartbeat from core client for 30 sec - exiting 18:29:07 (2896): No heartbeat from core client for 30 sec - exiting 18:29:08 (2896): No heartbeat from core client for 30 sec - exiting 18:29:09 (2896): No heartbeat from core client for 30 sec - exiting 18:29:10 (2896): No heartbeat from core client for 30 sec - exiting 18:29:11 (2896): No heartbeat from core client for 30 sec - exiting 18:29:12 (2896): No heartbeat from core client for 30 sec - exiting 18:29:14 (2896): No heartbeat from core client for 30 sec - exiting 18:29:15 (2896): No heartbeat from core client for 30 sec - exiting 18:29:16 (2896): No heartbeat from core client for 30 sec - exiting 18:29:17 (2896): No heartbeat from core client for 30 sec - exiting 18:29:18 (2896): No heartbeat from core client for 30 sec - exiting 18:29:19 (2896): No heartbeat from core client for 30 sec - exiting 18:29:20 (2896): No heartbeat from core client for 30 sec - exiting 18:29:21 (2896): No heartbeat from core client for 30 sec - exiting 18:29:22 (2896): No heartbeat from core client for 30 sec - exiting 18:29:23 (2896): No heartbeat from core client for 30 sec - exiting 18:29:24 (2896): No heartbeat from core client for 30 sec - exiting 18:29:25 (2896): No heartbeat from core client for 30 sec - exiting 18:29:26 (2896): No heartbeat from core client for 30 sec - exiting 18:29:27 (2896): No heartbeat from core client for 30 sec - exiting 18:29:28 (2896): No heartbeat from core client for 30 sec - exiting 18:29:29 (2896): No heartbeat from core client for 30 sec - exiting 18:29:31 (2896): No heartbeat from core client for 30 sec - exiting 18:29:32 (2896): No heartbeat from core client for 30 sec - exiting 18:29:33 (2896): No heartbeat from core client for 30 sec - exiting 18:29:34 (2896): No heartbeat from core client for 30 sec - exiting 18:29:35 (2896): No heartbeat from core client for 30 sec - exiting 18:29:36 (2896): No heartbeat from core client for 30 sec - exiting 18:29:37 (2896): No heartbeat from core client for 30 sec - exiting 18:29:38 (2896): No heartbeat from core client for 30 sec - exiting 18:29:39 (2896): No heartbeat from core client for 30 sec - exiting 18:29:40 (2896): No heartbeat from core client for 30 sec - exiting 18:29:41 (2896): No heartbeat from core client for 30 sec - exiting 18:29:42 (2896): No heartbeat from core client for 30 sec - exiting 18:29:44 (2896): No heartbeat from core client for 30 sec - exiting 18:29:45 (2896): No heartbeat from core client for 30 sec - exiting 18:29:46 (2896): No heartbeat from core client for 30 sec - exiting 18:29:47 (2896): No heartbeat from core client for 30 sec - exiting 18:29:48 (2896): No heartbeat from core client for 30 sec - exiting 18:29:49 (2896): No heartbeat from core client for 30 sec - exiting 18:29:50 (2896): No heartbeat from core client for 30 sec - exiting 18:29:51 (2896): No heartbeat from core client for 30 sec - exiting 18:29:52 (2896): No heartbeat from core client for 30 sec - exiting 18:29:53 (2896): No heartbeat from core client for 30 sec - exiting 18:29:55 (2896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4804, selfPID=3500, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2380, selfPID=2972, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 18:26:53 (2288): No heartbeat from core client for 30 sec - exiting 18:26:54 (2288): No heartbeat from core client for 30 sec - exiting 18:26:55 (2288): No heartbeat from core client for 30 sec - exiting 18:26:56 (2288): No heartbeat from core client for 30 sec - exiting 18:26:57 (2288): No heartbeat from core client for 30 sec - exiting 18:26:59 (2288): No heartbeat from core client for 30 sec - exiting 18:27:00 (2288): No heartbeat from core client for 30 sec - exiting 18:27:01 (2288): No heartbeat from core client for 30 sec - exiting 18:27:02 (2288): No heartbeat from core client for 30 sec - exiting 18:27:03 (2288): No heartbeat from core client for 30 sec - exiting 18:27:04 (2288): No heartbeat from core client for 30 sec - exiting 18:27:05 (2288): No heartbeat from core client for 30 sec - exiting 18:27:06 (2288): No heartbeat from core client for 30 sec - exiting 18:27:07 (2288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: severe (24): end-of-file during read, unit 9, file C:\Programy\BOINC\Boinc_DATA\projects\climateprediction.net\hadam3p_pnw_c1os_1964_1_008027393\tmp\xaakm.namelists Image PC Routine Line Source hadam3p_pnw_um_6. 004CA39A Unknown Unknown Unknown hadam3p_pnw_um_6. 00472CD0 Unknown Unknown Unknown hadam3p_pnw_um_6. 00471E9A Unknown Unknown Unknown hadam3p_pnw_um_6. 00452819 Unknown Unknown Unknown hadam3p_pnw_um_6. 00352287 Unknown Unknown Unknown hadam3p_pnw_um_6. 003EE7B2 Unknown Unknown Unknown hadam3p_pnw_um_6. 003EF2DA Unknown Unknown Unknown hadam3p_pnw_um_6. 00169BD2 Unknown Unknown Unknown hadam3p_pnw_um_6. 004AE638 Unknown Unknown Unknown kernel32.dll 76C21174 Unknown Unknown Unknown ntdll.dll 76FCB3F5 Unknown Unknown Unknown ntdll.dll 76FCB3C8 Unknown Unknown Unknown forrtl: severe (24): end-of-file during read, unit 9, file C:\Programy\BOINC\Boinc_DATA\projects\climateprediction.net\hadam3p_pnw_c1os_1964_1_008027393\tmp\xaakg.namelists Image PC Routine Line Source hadrm3p_pnw_um_6. 00CAC52A Unknown Unknown Unknown hadrm3p_pnw_um_6. 00C54460 Unknown Unknown Unknown hadrm3p_pnw_um_6. 00C5362A Unknown Unknown Unknown hadrm3p_pnw_um_6. 00C32469 Unknown Unknown Unknown hadrm3p_pnw_um_6. 00B366EB Unknown Unknown Unknown hadrm3p_pnw_um_6. 00BD2AE2 Unknown Unknown Unknown hadrm3p_pnw_um_6. 00BD35AF Unknown Unknown Unknown hadrm3p_pnw_um_6. 00979860 Unknown Unknown Unknown hadrm3p_pnw_um_6. 00C90893 Unknown Unknown Unknown kernel32.dll 76C21174 Unknown Unknown Unknown ntdll.dll 76FCB3F5 Unknown Unknown Unknown ntdll.dll 76FCB3C8 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2640, selfPID=472, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_c1os_1964_1_008027393_0_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_c1os_1964_1_008027393_0_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_c1os_1964_1_008027393_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_c1os_1964_1_008027393_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_c1os_1964_1_008027393_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_c1os_1964_1_008027393_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_c1os_1964_1_008027393_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_c1os_1964_1_008027393_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_c1os_1964_1_008027393_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_c1os_1964_1_008027393_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Jul 2012 19:40:04	1187786	14861597	hadam3p_pnw_c1os_1964_1_008027393_0	23,136	65,230	2.8194
11 Jul 2012 06:13:13	1187786	14861597	hadam3p_pnw_c1os_1964_1_008027393_0	11,616	32,951	2.8367