climateprediction.net home page
MORE DOWNLOAD ERRORS

MORE DOWNLOAD ERRORS

Message boards : Number crunching : MORE DOWNLOAD ERRORS
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3

AuthorMessage
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1045
Credit: 16,506,818
RAC: 5,001
Message 47910 - Posted: 1 Jan 2014, 20:55:54 UTC - in response to Message 47909.  

Otherwise, it's "Start from (about) Maximum daily WU quota per CPU of 16, and count down for each failure without a success".


So that explains why the count is now down to zero.

I do not seriously want the code changed, just to understand it better.

I hope that at least once a day it will try for a new work unit because sometimes good work units come along. I even got one a while ago: Workunit 8643285 that is one of these: hadam3p_eu_j0hf_1986_1_008492472 and numerous UK Met Office Coupled Model Full Resolution Ocean v6.07 ones.
ID: 47910 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 47911 - Posted: 1 Jan 2014, 21:23:39 UTC - in response to Message 47910.  

Fair enough.
It's only the regional models that suffer from the problem, so they can be stopped by deselecting all of them, and only allowing the longer models.
(Also deselect If no work for selected applications is available, accept work from other applications?, otherwise this won't work.)


Backups: Here
ID: 47911 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 47912 - Posted: 1 Jan 2014, 21:33:34 UTC - in response to Message 47910.  

I noticed the limit as well, but ignored it. Given that the hadcm3n tasks (main ones running at the moment) take about 300 hrs to run on my PC and that the project status shows no tasks available, the PC just keeps chugging away on what it has. Even so it rarely runs at below its full complement of tasks, for like you Jean-David, the odd task becomes available after it fails elsewhere, and if you're lucky it is downloaded. Given that the limit is reset each day, one will be picked up sooner or later. I'm happy as long as something is working away.

We ALL hope that the issue with the regional models will be sorted in the new year - as I'm sure it will be.
ID: 47912 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 47927 - Posted: 4 Jan 2014, 2:38:41 UTC
Last modified: 4 Jan 2014, 2:40:26 UTC

Since CPDN installed its current BOINC server version, which was rather a long time ago, I believe that something has been wrong with the number displayed for a computer's daily permitted task quota. This happened so long ago (when Milo installed this version) that I can't remember his explanation. I think the quota number we see on a computer page (the displayed quota number) is random. However, the server knows what the quota number should be and applies that. What we see is not necessarily what we get.

For example, both my computers currently show a daily quota of 0 but they have done nothing to deserve this punishment and when tasks become available I expect both computers to be allowed some.

The only quota number to display correctly is -1 which appears when Andy manually minusses a computer that's a serial model killer.

When Andy and Jonathan install a new BOINC server version we may have an interesting week. At a meeting a while ago in London I told Andy that Carl and Tolu (CPDN's original programmers) kept a list of CPDN customisations for BOINC. He didn't know about this list. It's so long since CPDN upgraded its BOINC that I now think it might be better if the list is lost forever.
Cpdn news
ID: 47927 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 47928 - Posted: 4 Jan 2014, 5:13:53 UTC - in response to Message 47927.  

[When Andy and Jonathan install a new BOINC server version we may have an interesting week.

Any idea what decade the server upgrade will occur in. We have been hearing about this new server version since the last ice age (the geological event, not the movie). ;-)

ID: 47928 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 47929 - Posted: 4 Jan 2014, 6:40:40 UTC - in response to Message 47928.  

All that's know is that it'll be this century.

It's possible that nobody knows when, with the constant string of things going wrong. "When it's hoped for" may be all that they knew/know.

There will be posts though, so everyone will know at the time.

ID: 47929 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,380,160
RAC: 3,563
Message 48229 - Posted: 25 Feb 2014, 9:03:57 UTC
Last modified: 25 Feb 2014, 9:19:10 UTC

Not sure if this is part of a dodgy batch (Created August last year or if there is something funny with the servers? I see one of the servers is red at the moment. Not sure if that is relevant or not.

Tue 25 Feb 2014 08:26:58 GMT | climateprediction.net | Requesting new tasks for CPU
Tue 25 Feb 2014 08:27:00 GMT | climateprediction.net | Scheduler request completed: got 1 new tasks
Tue 25 Feb 2014 08:27:02 GMT | climateprediction.net | Started upload of hadam3p_pnw_ubg0_2001_1_008507884_2_6.zip
Tue 25 Feb 2014 08:27:02 GMT | climateprediction.net | Started download of hadcm3n_82nw_1980_40_008461391.zip
Tue 25 Feb 2014 08:27:02 GMT | climateprediction.net | Started download of SPARC_O3_RCP4.5_1979_2021_bs.gz
Tue 25 Feb 2014 08:27:04 GMT | climateprediction.net | Giving up on download of hadcm3n_82nw_1980_40_008461391.zip: permanent HTTP error
Tue 25 Feb 2014 08:27:04 GMT | climateprediction.net | Giving up on download of SPARC_O3_RCP4.5_1979_2021_bs.gz: permanent HTTP error
Tue 25 Feb 2014 08:27:04 GMT | climateprediction.net | Started download of zjkt_1980.astart.gz
Tue 25 Feb 2014 08:27:04 GMT | climateprediction.net | Started download of DMSSO2NH3_1970_2030_32.gz
Tue 25 Feb 2014 08:27:05 GMT | climateprediction.net | Giving up on download of zjkt_1980.astart.gz: permanent HTTP error
Tue 25 Feb 2014 08:27:05 GMT | climateprediction.net | Giving up on download of DMSSO2NH3_1970_2030_32.gz: permanent HTTP error
Tue 25 Feb 2014 08:27:05 GMT | climateprediction.net | Started download of sulpc_oxidants_19_A2_1990f.gz
Tue 25 Feb 2014 08:27:05 GMT | climateprediction.net | Started download of zjkt_1980.ostart.gz
Tue 25 Feb 2014 08:27:07 GMT | climateprediction.net | Giving up on download of sulpc_oxidants_19_A2_1990f.gz: permanent HTTP error
Tue 25 Feb 2014 08:27:07 GMT | climateprediction.net | Giving up on download of zjkt_1980.ostart.gz: permanent HTTP error
Tue 25 Feb 2014 08:28:15 GMT | climateprediction.net | Finished upload of hadam3p_pnw_ubg0_2001_1_008507884_2_6.zip
ID: 48229 · Report as offensive     Reply Quote
Cipsik

Send message
Joined: 7 Jan 14
Posts: 1
Credit: 67,191
RAC: 0
Message 48283 - Posted: 5 Mar 2014, 7:05:25 UTC

It's the same problem as yours, guys, isn't it? What we have to do? Ignore and wait for good one?

5.3.2014 7:06:13 | climateprediction.net | update requested by user
5.3.2014 7:06:14 | climateprediction.net | Sending scheduler request: Requested by user.
5.3.2014 7:06:14 | climateprediction.net | Requesting new tasks for CPU
5.3.2014 7:06:16 | climateprediction.net | Scheduler request completed: got 1 new tasks
5.3.2014 7:06:18 | climateprediction.net | Started download of hadam3p_eu_6.09_windows_intelx86.exe
5.3.2014 7:06:18 | climateprediction.net | Started download of hadam3p_eu_graphics_6.09_windows_intelx86.exe
5.3.2014 7:06:20 | climateprediction.net | Giving up on download of hadam3p_eu_6.09_windows_intelx86.exe: permanent HTTP error
5.3.2014 7:06:20 | climateprediction.net | Giving up on download of hadam3p_eu_graphics_6.09_windows_intelx86.exe: permanent HTTP error
5.3.2014 7:06:20 | climateprediction.net | Started download of hadam3p_eu_data_6.09_windows_intelx86.zip
5.3.2014 7:06:20 | climateprediction.net | Started download of hadrm3p_eu_um_6.09_windows_intelx86.zip
5.3.2014 7:06:21 | climateprediction.net | Giving up on download of hadam3p_eu_data_6.09_windows_intelx86.zip: permanent HTTP error
5.3.2014 7:06:21 | climateprediction.net | Giving up on download of hadrm3p_eu_um_6.09_windows_intelx86.zip: permanent HTTP error
5.3.2014 7:06:21 | climateprediction.net | Started download of hadam3p_eu_um_6.09_windows_intelx86.zip
5.3.2014 7:06:21 | climateprediction.net | Started download of hadam3p_eu_se_6.09_windows_intelx86.zip
5.3.2014 7:06:23 | climateprediction.net | Giving up on download of hadam3p_eu_um_6.09_windows_intelx86.zip: permanent HTTP error
5.3.2014 7:06:23 | climateprediction.net | Giving up on download of hadam3p_eu_se_6.09_windows_intelx86.zip: permanent HTTP error
5.3.2014 7:06:23 | climateprediction.net | Started download of hadam3p_eu_f1bi_2013_1_008525086.zip
5.3.2014 7:06:23 | climateprediction.net | Started download of o3_n96_pers_1959_1999_2020.gz
5.3.2014 7:06:24 | climateprediction.net | Giving up on download of hadam3p_eu_f1bi_2013_1_008525086.zip: permanent HTTP error
5.3.2014 7:06:24 | climateprediction.net | Giving up on download of o3_n96_pers_1959_1999_2020.gz: permanent HTTP error
5.3.2014 7:06:24 | climateprediction.net | Started download of ic19610406_16_N96.gz
5.3.2014 7:06:24 | climateprediction.net | Started download of atmos_n09f.day.gz
5.3.2014 7:06:25 | climateprediction.net | Giving up on download of ic19610406_16_N96.gz: permanent HTTP error
5.3.2014 7:06:25 | climateprediction.net | Giving up on download of atmos_n09f.day.gz: permanent HTTP error
5.3.2014 7:06:25 | climateprediction.net | Started download of oxi.addfa.gz
5.3.2014 7:06:25 | climateprediction.net | Started download of so2dms_N96_2013_12_2015_02f_1900rescale.gz
5.3.2014 7:06:26 | climateprediction.net | Giving up on download of oxi.addfa.gz: permanent HTTP error
5.3.2014 7:06:26 | climateprediction.net | Giving up on download of so2dms_N96_2013_12_2015_02f_1900rescale.gz: permanent HTTP error
5.3.2014 7:06:26 | climateprediction.net | Started download of region_n09f.day.gz
5.3.2014 7:06:26 | climateprediction.net | Started download of OSICE_natural_2013_12_2014_12.gz
5.3.2014 7:06:27 | climateprediction.net | Giving up on download of region_n09f.day.gz: permanent HTTP error
5.3.2014 7:06:27 | climateprediction.net | Giving up on download of OSICE_natural_2013_12_2014_12.gz: permanent HTTP error
5.3.2014 7:06:27 | climateprediction.net | Started download of ancil_OSTIA_deltaSST_2014_CCSM4.gz
5.3.2014 7:06:28 | climateprediction.net | Giving up on download of ancil_OSTIA_deltaSST_2014_CCSM4.gz: permanent HTTP error
ID: 48283 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 48284 - Posted: 5 Mar 2014, 7:27:14 UTC - in response to Message 48283.  

No, this is a brand new problem with a brand new batch of models for a brand new experiment.

The problem is being discussed in this thread for some reason.
It should have been in a new thread, but that's how it goes. :(

The experiment is talked about in this thread, which has links to the Science pages.


ID: 48284 · Report as offensive     Reply Quote
Profile Ananas
Volunteer moderator

Send message
Joined: 31 Oct 04
Posts: 336
Credit: 3,316,482
RAC: 0
Message 48298 - Posted: 5 Mar 2014, 21:50:51 UTC - in response to Message 48284.  

No, this is a brand new problem with a brand new batch of models for a brand new experiment.

The problem is being discussed in this thread for some reason.
It should have been in a new thread, but that's how it goes. :(
...


In the other thread, Dave Jackson has posted that a core client restart fixed his download problem, which sounds very much as if it might have been a problem of an old cached IP, so the download went to an outdated server.

... it cannot hurt to have the possible solution in the right thread too ;-)
ID: 48298 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,380,160
RAC: 3,563
Message 48306 - Posted: 6 Mar 2014, 8:11:31 UTC

It should have been in a new thread, but that's how it goes. :(


Guilty as charged. Next time I will start a new thread. And also try out solution first so if relevant I can post the solution with the problem.
ID: 48306 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3

Message boards : Number crunching : MORE DOWNLOAD ERRORS

©2024 climateprediction.net