climateprediction.net home page
MORE DOWNLOAD ERRORS

MORE DOWNLOAD ERRORS

Message boards : Number crunching : MORE DOWNLOAD ERRORS
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · Next

AuthorMessage
Profile Bonsai911

Send message
Joined: 9 Sep 04
Posts: 228
Credit: 30,229,255
RAC: 3,258
Message 47839 - Posted: 22 Dec 2013, 17:45:19 UTC

No more timeouts, so everything is working again.
ID: 47839 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 47846 - Posted: 23 Dec 2013, 15:47:04 UTC

The server is throwing bad downloads of hadam3p_eu again. I have received 2 this morning on 2 different machines. More reissues of old timed out failures. Isn�t this fun. A least in America we don�t pay for bandwidth by the Mb.

12/23/2013 10:34:53 AM | climateprediction.net | Scheduler request completed: got 1 new tasks
12/23/2013 10:34:55 AM | climateprediction.net | Started download of hadam3p_eu_d068_2005_1_008073956.zip
12/23/2013 10:34:55 AM | climateprediction.net | Started download of atmos_d068_2005_1_008073956_0.gz
12/23/2013 10:34:56 AM | climateprediction.net | Giving up on download of hadam3p_eu_d068_2005_1_008073956.zip: permanent HTTP error
12/23/2013 10:34:56 AM | climateprediction.net | Giving up on download of atmos_d068_2005_1_008073956_0.gz: permanent HTTP error
12/23/2013 10:34:56 AM | climateprediction.net | Started download of eu_d068_2005_1_008073956_0.gz
12/23/2013 10:34:56 AM | climateprediction.net | Started download of ic19610208_11_N96.gz
12/23/2013 10:34:57 AM | climateprediction.net | Giving up on download of eu_d068_2005_1_008073956_0.gz: permanent HTTP error
12/23/2013 10:34:57 AM | climateprediction.net | Started download of HadISST_SST_N96_2004_12_2006_nat.gz
12/23/2013 10:35:00 AM | climateprediction.net | Finished download of ic19610208_11_N96.gz
12/23/2013 10:35:00 AM | climateprediction.net | Started download of HadISST_SICE_N96_2004_12_2006_nat_cal.gz
12/23/2013 10:35:02 AM | climateprediction.net | Finished download of HadISST_SICE_N96_2004_12_2006_nat_cal.gz
12/23/2013 10:35:02 AM | climateprediction.net | Started download of so2dms_N96_2004_12_2006_02f_1900rescale.gz
12/23/2013 10:35:07 AM | climateprediction.net | Finished download of HadISST_SST_N96_2004_12_2006_nat.gz
12/23/2013 10:35:07 AM | climateprediction.net | Started download of o3_N96_pers_1959_1998_2011.gz
12/23/2013 10:35:12 AM | climateprediction.net | Finished download of so2dms_N96_2004_12_2006_02f_1900rescale.gz
12/23/2013 10:35:12 AM | climateprediction.net | Finished download of o3_N96_pers_1959_1998_2011.gz
12/23/2013 10:35:12 AM | climateprediction.net | [error] MD5 check failed for so2dms_N96_2004_12_2006_02f_1900rescale.gz
12/23/2013 10:35:12 AM | climateprediction.net | [error] expected 93e8f41abb88e3b76e2249b6e2b4cbc1, got 1e7125269e6930d6bfb900baf48503e7
12/23/2013 10:35:12 AM | climateprediction.net | [error] Checksum or signature error for so2dms_N96_2004_12_2006_02f_1900rescale.gz

ID: 47846 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 47847 - Posted: 23 Dec 2013, 16:42:00 UTC

Success! 1 hadam3p_eu successfully downloaded. I take it this is a new batch not more retreads.

ID: 47847 · Report as offensive     Reply Quote
Professor Desty Nova
Avatar

Send message
Joined: 19 Sep 04
Posts: 92
Credit: 1,926,211
RAC: 254
Message 47848 - Posted: 23 Dec 2013, 17:07:23 UTC

Today I got 3 of these "Zombie EU" WU. All failed downloading. Hope I get lucky and get a working WU.


Professor Desty Nova
Researching Karma the Hard Way
ID: 47848 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 0
Message 47849 - Posted: 23 Dec 2013, 17:41:03 UTC
Last modified: 23 Dec 2013, 17:41:28 UTC

I've also just had a zombie d/l failure. Again, the task numbers within this workunit are not as they should be.
Cpdn news
ID: 47849 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 47850 - Posted: 23 Dec 2013, 19:27:44 UTC

Looks like I posted to soon. The WU mentioned above seemed to download fine, but, crashed after running only 39 seconds.

ID: 47850 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 47851 - Posted: 23 Dec 2013, 19:40:49 UTC - in response to Message 47849.  

Had a look at the work units of my download failures, and I notice that quite a few (around half) succeeded on the second try a few hours later with another PC. e.g. 8229457
ID: 47851 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 47852 - Posted: 23 Dec 2013, 19:47:05 UTC - in response to Message 47850.  

... crashed after running only 39 seconds.

With the same error as the original cruncher had, because it was a faulty model.
And has been reissued for the 3rd and last time, where it'll fail again.

The next batch of work should be the long RAPID models, but when is anyone's guess.

ID: 47852 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 47853 - Posted: 23 Dec 2013, 20:40:35 UTC - in response to Message 47852.  

... crashed after running only 39 seconds.

With the same error as the original cruncher had, because it was a faulty model.
And has been reissued for the 3rd and last time, where it'll fail again.

The next batch of work should be the long RAPID models, but when is anyone's guess.



With the Christmas Holiday coming up it could be a while. Let�s hope that the staff doesn�t dip too deep into the Eggnog. And what the heck is Thiggy Pudding anyway.

ID: 47853 · Report as offensive     Reply Quote
MartinNZ

Send message
Joined: 22 Mar 06
Posts: 144
Credit: 24,695,428
RAC: 0
Message 47857 - Posted: 23 Dec 2013, 23:21:14 UTC - in response to Message 47851.  

Hmmm. Just had another look at my failed downloads referred to below, and pretty well all the WUs have now failed in the download, or failed as they cannot get an input file or have not yet produced trickles (and are likely to fail?).

Roll on the new year ;-)

Personally Jim, I go for Pavlova and Barbeques at Xmas - along with the obligatory shorts and jandals - and warm weather :-)
ID: 47857 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 47858 - Posted: 23 Dec 2013, 23:58:19 UTC - in response to Message 47857.  

Personally Jim, I go for Pavlova and Barbeques at Xmas - along with the obligatory shorts and jandals - and warm weather :-)


The problem is that it�s Winter here in the North Temperate Zone.
ID: 47858 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 47859 - Posted: 24 Dec 2013, 5:21:36 UTC

So far today I have downloaded about 2 dozen of these defective hadam3p_eu WU�s.

Can�t someone at Oxford hunt down the Ghost of Work Units Past and boil him with his own pudding and bury him with a stake of Holly through his heart. Bah Humbug.

ID: 47859 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 47860 - Posted: 24 Dec 2013, 5:41:13 UTC - in response to Message 47859.  

This was discussed way back in a private chat area by the mods and project people.
To cure the problem requires version 7 server code, which is what the project people have been working towards for a long time.

ID: 47860 · Report as offensive     Reply Quote
Carolina Calling

Send message
Joined: 22 Jun 09
Posts: 8
Credit: 1,760,735
RAC: 0
Message 47873 - Posted: 26 Dec 2013, 8:37:00 UTC - in response to Message 47853.  
Last modified: 26 Dec 2013, 8:38:09 UTC

I believe that's "figgy pudding"... as in made from figs.

A belated Merry Christmas to all (who care to hear it)!
May your New Year be more fruitful (pun intended) than
the last!
ID: 47873 · Report as offensive     Reply Quote
Profile ex_brit
Avatar

Send message
Joined: 26 Aug 04
Posts: 84
Credit: 351,331
RAC: 0
Message 47887 - Posted: 29 Dec 2013, 21:38:13 UTC - in response to Message 47653.  
Last modified: 29 Dec 2013, 21:40:13 UTC

Similar result here today with hadam3p_pnw_b1th_1997_1_008092419_2

Pity there isn't a facility to restart a download after a failure rather than having to Abort.
ID: 47887 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 47888 - Posted: 29 Dec 2013, 22:15:21 UTC - in response to Message 47887.  

You do release that's impossible because the files are missing, don't you?

See this post way down this thread about this.
And I've recently made a post about this somewhere, because the subject just keeps coming up.


Backups: Here
ID: 47888 · Report as offensive     Reply Quote
Profile ex_brit
Avatar

Send message
Joined: 26 Aug 04
Posts: 84
Credit: 351,331
RAC: 0
Message 47889 - Posted: 29 Dec 2013, 22:47:35 UTC - in response to Message 47888.  

Yes, I realise that......it was simply to add a voice to the thread, that's all.
ID: 47889 · Report as offensive     Reply Quote
Profile ex_brit
Avatar

Send message
Joined: 26 Aug 04
Posts: 84
Credit: 351,331
RAC: 0
Message 47899 - Posted: 30 Dec 2013, 11:17:03 UTC - in response to Message 47889.  

It's explained rather well by Moderator Les Bayliss here:

Basically, it's an old task from July 2012, and, while the task zip is still on the server, all of the support files are long gone, and it's those missing files that causes the download failure.
You can see when a task was originally created by looking at the Work unit ID column of the model of interest.

As for why this type of model gets put into the download queue again, see Thyme Lawn's post here in the middle of the thread mentioned above.


ID: 47899 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1045
Credit: 16,506,818
RAC: 5,001
Message 47908 - Posted: 1 Jan 2014, 20:13:44 UTC

I am still receiving these work units, and it is OK, though disappointing that there are so many.

However, I just got a new message in my logfile:

01-Jan-2014 14:50:02 [climateprediction.net] Sending scheduler request: To fetch work.
01-Jan-2014 14:50:02 [climateprediction.net] Requesting new tasks
01-Jan-2014 14:50:07 [climateprediction.net] Scheduler request completed: got 0 new tasks
01-Jan-2014 14:50:07 [climateprediction.net] Message from server: No work sent
01-Jan-2014 14:50:07 [climateprediction.net] Message from server: This computer has finished a daily quota of 1 tasks)

The first lines I am used to, but the last one is disappointing. I infer that it is counting these and after I get one, it thinks I am taking too many. I think it would be more fair (if that is the objective) to count only those that downloaded correctly. Unless they infer that it my fault that the downloads are failing. I infer this means that even if a new good work unit becomes available to me today, I will not get it because I am over my quota for this machine.

It is acting as though this line were 1/day, or so it seems to me. I realize I am unlikely to complete more than one work climateprediction work unit a day even with a 4-core processor.
Maximum daily WU quota per CPU 0/day
ID: 47908 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 47909 - Posted: 1 Jan 2014, 20:36:51 UTC - in response to Message 47908.  

If you want the BOINC code changed, then you'll need to talk to the BOINC people here.

Otherwise, it's "Start from (about) Maximum daily WU quota per CPU of 16, and count down for each failure without a success".

Personally, I've shut down 2 machines until "later", and Exited from BOINC on this machine.


Backups: Here
ID: 47909 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · Next

Message boards : Number crunching : MORE DOWNLOAD ERRORS

©2024 climateprediction.net