climateprediction.net home page
Multiple download errors

Multiple download errors

Questions and Answers : Windows : Multiple download errors
Message board moderation

To post messages, you must log in.

AuthorMessage
nedsram-cdl

Send message
Joined: 14 Apr 05
Posts: 31
Credit: 16,491,691
RAC: 0
Message 47883 - Posted: 29 Dec 2013, 12:31:04 UTC

At least ten attempted downloads over the last couple of weeks have failed. All report failure due to "Error while downloading". I've appended one such example. As these are flagged as "client error", after a while BOINC is then refused further tasks for the rest of the day due to "too many failed tasks". I have checked the news thread and can see nothing posted about this, which is happening on both my desktop and laptop PCs.

<core_client_version>7.2.33</core_client_version>
<![CDATA[
<message>
WU download error: couldn't get input files:
<file_xfer_error>
<file_name>hadam3p_pnw_c7cr_1987_1_008091161.zip</file_name>
<error_code>-224</error_code>
<error_message>permanent HTTP error</error_message>
</file_xfer_error>
<file_xfer_error>
<file_name>atmos_c7cr_1987_1_008091161_0.gz</file_name>
<error_code>-224</error_code>
<error_message>permanent HTTP error</error_message>
</file_xfer_error>
<file_xfer_error>
<file_name>pnw_c7cr_1987_1_008091161_0.gz</file_name>
<error_code>-224</error_code>
<error_message>permanent HTTP error</error_message>
</file_xfer_error>

</message>
]]>

29/12/2013 09:53:11 | climateprediction.net | Scheduler request completed: got 1 new tasks
29/12/2013 09:53:13 | climateprediction.net | Started download of hadam3p_pnw_c7cr_1987_1_008091161.zip
29/12/2013 09:53:13 | climateprediction.net | Started download of atmos_c7cr_1987_1_008091161_0.gz
29/12/2013 09:53:16 | climateprediction.net | Giving up on download of hadam3p_pnw_c7cr_1987_1_008091161.zip: permanent HTTP error
29/12/2013 09:53:16 | climateprediction.net | Giving up on download of atmos_c7cr_1987_1_008091161_0.gz: permanent HTTP error
29/12/2013 09:53:16 | climateprediction.net | Started download of pnw_c7cr_1987_1_008091161_0.gz
29/12/2013 09:53:16 | climateprediction.net | Started download of HadISST_SST_N96_1986_12_1989_01f.gz
29/12/2013 09:53:17 | climateprediction.net | Giving up on download of pnw_c7cr_1987_1_008091161_0.gz: permanent HTTP error

Brian
ID: 47883 · Report as offensive     Reply Quote
Profile Iain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1079
Credit: 6,902,393
RAC: 6,787
Message 47884 - Posted: 29 Dec 2013, 13:32:16 UTC

These are old models that have been reissued automatically, long after the download files have become inaccessible or been removed. It makes our model histories messy but is otherwise benign.
ID: 47884 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 47886 - Posted: 29 Dec 2013, 20:54:19 UTC - in response to Message 47883.  

There is plenty of discussion on this subject in the �Number Crunching� section in the thread �More Download Errors.�

At the moment there is not real need to worry about reaching you daily limit of download failures as there is little else to download. Hopefully this will change after the 1st. of the year.

As Iain says the are harmless except to the look of your model history page.

ID: 47886 · Report as offensive     Reply Quote
nedsram-cdl

Send message
Joined: 14 Apr 05
Posts: 31
Credit: 16,491,691
RAC: 0
Message 47890 - Posted: 29 Dec 2013, 23:41:04 UTC

Thanks for the answers - never clear where to look for things like this. Clearly a holiday issue. However why was I not notified of the replies when I have subscribed to the topic?
Brian
ID: 47890 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 47892 - Posted: 30 Dec 2013, 2:00:24 UTC

I've just subscribed to this topic and am posting to test whether I receive an email notification.
Cpdn news
ID: 47892 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 47895 - Posted: 30 Dec 2013, 2:18:20 UTC - in response to Message 47890.  

However why was I not notified of the replies when I have subscribed to the topic?
It could depend on how you have the first section of Community preferences set up.

As for why no News announcement, it was asked about in a user section of the forum, and an answer provided.
Both question and answer were simple and straightforward, and left at that.
And then the question was asked again. And again. And again.
It doesn't matter where answers are provided; there's a lot of people who never regularly scan this board for recent posts, or who never search for relevant words; they just ask again. And again.
Sigh.


Backups: Here
ID: 47895 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 47897 - Posted: 30 Dec 2013, 2:32:33 UTC

Some 12 minutes ago I received an email notification re my post two above this, so this does seem to be working.
Cpdn news
ID: 47897 · Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 6 Jul 06
Posts: 141
Credit: 3,511,752
RAC: 144,072
Message 51311 - Posted: 26 Jan 2015, 8:16:53 UTC
Last modified: 26 Jan 2015, 8:17:59 UTC

Rather than start a new thread I am re-using this one as it is related to what I am getting.
I am getting the following error on nearly all downloads to a Windows 32 bit XP machine, machine Host number = 1352573.


app_version download error: couldn't get input files:
<file_xfer_error>
<file_name>hadam3p_afr_7.22_windows_intelx86.exe</file_name>
<error_code>-200</error_code>
</file_xfer_error>

It is not just on the African models but also Pacific North West and Short models.

I did see a message saying I did not have any memory available? I had over 13 GB but this seems to be not enough.
I have detached a number of other projects from this computer, deleted a number of other files and this has now given me around 16 GB of disk space for BOINC to play with.
I have placed Climateprediction.net in my anti-virus (TrendMicro) exclusion area plus each executable.
Of all the executable files that have tried to download, not counting the graphic files, 3 have consistently failed to download, always just 23.6 kB in size and therefore generating checksum errors due to the wrong size.
It is only this one file that wont download as all the other files download even if the main one fails.

I have the following files that appear to be correct size

hadam3p_anz_6.10_windows_intelx86.exe
hadam3p_anz_um_6.10_windows_intelx86.exe
hadcm3n_6.07_windows_intelx86.exe
hadcm3n_um_6.07_windows_intelx86.exe
hadrm3p_anz_um_6.10_windows_intelx86.exe

The following files all have just 23.6 kB in size and fail every download

hadam3p_afr_7.22_windows_intelx86.exe
hadam3p_pnw_7.22_windows_intelx86.exe
hadcm3s_7.24_windows_intelx86.exe

I have managed to actually start running a few of the Full models and even got to the first trickle on one of them but they all then failed with errors.

My other Windows machine had similar errors for a few work units then downloaded and started running one without further problems, they are both AMD Phenom CPUs both with 4 GB of RAM, the 6 core is running OK the 4 core is the problem and it also only has an 80 GB hard drive.

Any help would be appreciated.

Thanks
Conan
ID: 51311 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,376,846
RAC: 3,590
Message 51312 - Posted: 26 Jan 2015, 9:53:03 UTC

Guessing a bit here as I have been windows free this century. Having freed up space, check how much space BOINC thinks is available. It may be that the default settings in computing preferences are the problem.

Second thought is that there may be a corrupted file somewhere causing the problem in which case either reset the project or detach then re-attach which will clear all CPDN files from your BOINC installation and download fresh copies.
ID: 51312 · Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 6 Jul 06
Posts: 141
Credit: 3,511,752
RAC: 144,072
Message 51313 - Posted: 26 Jan 2015, 11:56:06 UTC

Thanks for the reply Dave.

Unfortunately doing a detach and reattach (which I had done a few days ago) did not make any difference, still can't download a Short model.

BOINC shows that I have over 23 GB available and I can't see any problems with my preferences that would cause a download issue.

It is strange, as all the support files that get downloaded with each work unit, download without an issue, but the main file dies.

Conan
ID: 51313 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,376,846
RAC: 3,590
Message 51314 - Posted: 26 Jan 2015, 16:36:39 UTC

Feeling as stumped as you are now Conan,

If "Free available to BOINC" is over 20GB that should be ample for four cores and leads me to think the problem must be elsewhere. I notice you are using quite an old version of BOINC and wonder if there is a problem with CPDN tasks unless you upgrade to 7.x? 7.4.36 being the recommended version for windows?
ID: 51314 · Report as offensive     Reply Quote
Profile Thyme Lawn
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1283
Credit: 15,824,334
RAC: 0
Message 51316 - Posted: 26 Jan 2015, 19:05:41 UTC - in response to Message 51311.  

What happens if you try to download the files using your browser?

The URLs are:

http://climateapps2.oerc.ox.ac.uk/cpdnboinc/download/mirror.php?file=/hadam3p_afr_7.22_windows_intelx86.exe

http://climateapps2.oerc.ox.ac.uk/cpdnboinc/download/mirror.php?file=/hadam3p_pnw_7.22_windows_intelx86.exe

http://climateapps2.oerc.ox.ac.uk/cpdnboinc/download/mirror.php?file=/hadcm3s_7.24_windows_intelx86.exe

If that works you should be able to move the file to <BOINC data directory>\projects\climateprediction.net

If you're running BOINC as a service you should check that the files have the right access permissions ("Full control" for the "boinc_admins" and "boinc_projects" groups and "Read & execute" for the "boinc_users" group). They'll probably inherit the right permissions from the directory, but I always check just in case.
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer
ID: 51316 · Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 6 Jul 06
Posts: 141
Credit: 3,511,752
RAC: 144,072
Message 51318 - Posted: 27 Jan 2015, 0:01:09 UTC

Thanks Thyme Lawn, those links you have posted are they safe?
My antivirus (TrendMicro) claims that they are Dangerous Web Pages and involved in scams and malicious activity, advising me to not to go to that web page.

Conan
ID: 51318 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 51319 - Posted: 27 Jan 2015, 1:06:36 UTC

Sounds like you need a different AV program.

ID: 51319 · Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 6 Jul 06
Posts: 141
Credit: 3,511,752
RAC: 144,072
Message 51325 - Posted: 27 Jan 2015, 5:54:57 UTC

I downloaded the links and sent a link to TrendMicro to re-evaluate the download site.
I was then able to get a Short work unit to download and start running.
Unfortunately it was one of the ones from October and failed just like it has for all who have processed this WU.

Trying for another download to see if I can get one to run full term.

Conan
ID: 51325 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 51328 - Posted: 27 Jan 2015, 6:24:21 UTC - in response to Message 51325.  

Sometimes you just can't win. :(

I wish there was a way to locate and change the settings for the faulty ones "on the fly", so that they think that they're run their full number of re-tries, but apparently that part is built in.
Perhaps yet another flag, that CAN be located and changed easily.
I'll mention it, but ...

ID: 51328 · Report as offensive     Reply Quote

Questions and Answers : Windows : Multiple download errors

©2024 climateprediction.net