climateprediction.net home page
A different upload problem -- out of disk space on rapid-watch.badc.rl.ac.uk

A different upload problem -- out of disk space on rapid-watch.badc.rl.ac.uk

Message boards : Number crunching : A different upload problem -- out of disk space on rapid-watch.badc.rl.ac.uk
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · Next

AuthorMessage
Profile tullio

Send message
Joined: 6 Aug 04
Posts: 264
Credit: 965,476
RAC: 0
Message 47519 - Posted: 10 Nov 2013, 11:19:09 UTC

I am running 6 BOINC projects, including Test4Theory@home, which runs CERN jobs inside a BOINC_VM window and requires a connection to a server every time a CERN job is completed and a new one is needed, inside the same BOINC unit. So I am connected 24/7.
Tullio
ID: 47519 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 47521 - Posted: 10 Nov 2013, 16:02:13 UTC
Last modified: 10 Nov 2013, 16:53:52 UTC

While we are at it, does anyone have any idea when more disc space will become available. I have a 4.zip waiting in the transfer tab and 3 more zips will be coming tomorrow.

And yes, as I am only running CPDN I have set my machine to suspend network activity until such time as I can upload the results. I see no use in wasting bandwidth trying to upload files to nowhere.
ID: 47521 · Report as offensive     Reply Quote
Profile astroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 47522 - Posted: 10 Nov 2013, 17:55:50 UTC

We have no specific information other than that our techs are shaking the trees at RL for those techs to fix the problem. (These tasks are not uploaded to an Oxford server.) It's a weekend, so expect nothing to be done until Monday -- at the earliest.

These things get sorted out eventually. As Les counseled, patience.

You are not alone, we are many in this boat. For example, I have five waiting to upload and another task due to finish in an hour.

"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 47522 · Report as offensive     Reply Quote
Profile Byron Leigh Hatch @ team Carl ...
Avatar

Send message
Joined: 17 Aug 04
Posts: 289
Credit: 44,103,664
RAC: 0
Message 47523 - Posted: 10 Nov 2013, 19:06:40 UTC - in response to Message 47522.  

astroWX thank you for that information.
ID: 47523 · Report as offensive     Reply Quote
SandJ

Send message
Joined: 4 Jan 07
Posts: 9
Credit: 575,832
RAC: 0
Message 47524 - Posted: 10 Nov 2013, 21:13:08 UTC
Last modified: 10 Nov 2013, 21:14:41 UTC

I suppose, for a research project, having so many people round the world helping do your processing that you cannot handle all the incoming results, is a nice problem to have.
ID: 47524 · Report as offensive     Reply Quote
Profile astroWX
Volunteer moderator

Send message
Joined: 5 Aug 04
Posts: 1496
Credit: 95,522,203
RAC: 0
Message 47525 - Posted: 10 Nov 2013, 22:52:17 UTC
Last modified: 10 Nov 2013, 22:56:42 UTC

Well, as we have seen over the years, with upload servers scattered across the globe, coupled with occasional additions and deletions, there are also scattered problems -- e.g., floods at U.Bern caused an extended outage years ago. Oxford gets most of the fun, of course, but there are servers at Penn State U. and U.Oregon in the US, one in southern Africa and possibly another in Africa when the Model for the full continent goes live, not to mention one for the forthcoming AusNZ Model. Many complications...

(No, I don't have target dates.)

When we think "distributed computing," volunteers aren't the only distributed element!

[Edited for typo.]
"We have met the enemy and he is us." -- Pogo
Greetings from coastal Washington state, the scenic US Pacific Northwest.
ID: 47525 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 47528 - Posted: 11 Nov 2013, 4:05:34 UTC

Nice to know that there are several new projects in the works. It would be nice to have a steady stream of work again.

ID: 47528 · Report as offensive     Reply Quote
Profile The Ancient One

Send message
Joined: 5 Sep 04
Posts: 21
Credit: 1,765,986
RAC: 2,364
Message 47534 - Posted: 11 Nov 2013, 14:43:26 UTC

I too have this problem. see below

11/11/2013 14:35:03 | climateprediction.net | Started upload of hadcm3n_823a_1980_40_008460649_1_3.zip
11/11/2013 14:35:03 | climateprediction.net | Started upload of hadcm3n_823a_1980_40_008460649_1_4.zip
11/11/2013 14:35:05 | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
11/11/2013 14:35:05 | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
11/11/2013 14:35:05 | climateprediction.net | Temporarily failed upload of hadcm3n_823a_1980_40_008460649_1_3.zip: transient upload error
11/11/2013 14:35:05 | climateprediction.net | Backing off 4 hr 5 min 45 sec on upload of hadcm3n_823a_1980_40_008460649_1_3.zip
11/11/2013 14:35:05 | climateprediction.net | Temporarily failed upload of hadcm3n_823a_1980_40_008460649_1_4.zip: transient upload error
11/11/2013 14:35:05 | climateprediction.net | Backing off 7 min 31 sec on upload of hadcm3n_823a_1980_40_008460649_1_4.zip

Has anyone any idea when this problem will be resolved?
"All man born has a right to life and no man born has the right to take that life"
ID: 47534 · Report as offensive     Reply Quote
Jacob Klein

Send message
Joined: 28 Mar 13
Posts: 16
Credit: 5,383,625
RAC: 0
Message 47535 - Posted: 11 Nov 2013, 14:45:14 UTC - in response to Message 47534.  

It'll be resolved before 2/4/2014, but hopefully within a couple days/weeks.
ID: 47535 · Report as offensive     Reply Quote
Profile MikeMarsUK
Volunteer moderator
Avatar

Send message
Joined: 13 Jan 06
Posts: 1498
Credit: 15,613,038
RAC: 0
Message 47536 - Posted: 11 Nov 2013, 14:47:15 UTC - in response to Message 47534.  

...11/11/2013 14:35:05 | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space
...
Has anyone any idea when this problem will be resolved?


Nope, this server is hosted by a third-party establishment outside the Oxford University. They've been notified, but it could take quite a while.


I'm a volunteer and my views are my own.
News and Announcements and FAQ
ID: 47536 · Report as offensive     Reply Quote
STE\/E

Send message
Joined: 15 Aug 04
Posts: 57
Credit: 10,344,905
RAC: 2,733
Message 47540 - Posted: 11 Nov 2013, 19:16:15 UTC

I have 3087 Hr's of the hadcm3n type model's that have been trying to Upload for a week now & another 1531 Hr's so far in running CPDN Wu's ...
ID: 47540 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 47547 - Posted: 12 Nov 2013, 5:06:32 UTC

Dear Steve:

Chill out. Your 3000+ hours of crunching will not be lost. All you need to do is wait until the server problem is sorted out. This problem happens frequently and always gets fixed within a week or so (weekends not included). Right now I have 5 zip files waiting to upload, 2 of them are from finished WU�s.

In the mean time if you do not have any other work from CPDN try one of the other projects. MalariaControl is favorite of mine.

ID: 47547 · Report as offensive     Reply Quote
STE\/E

Send message
Joined: 15 Aug 04
Posts: 57
Credit: 10,344,905
RAC: 2,733
Message 47548 - Posted: 12 Nov 2013, 7:16:08 UTC
Last modified: 12 Nov 2013, 7:21:17 UTC

Dear Steve


In my 70 Years on this Earth I've never had anyone start a Message to me with Dear other than my Wife, so I suppose that makes us SweetHearts now ... haha

Chill out


It's 23 Degree's here right now so I'm chilled out ... :P

In the mean time if you do not have any other work from CPDN try one of the other projects. MalariaControl is favorite of mine


Gee Thank's, I would never had known there were other Projects in BOINC if you hadn't told me ... lol
ID: 47548 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 925
Credit: 34,100,818
RAC: 11,270
Message 47549 - Posted: 12 Nov 2013, 12:47:22 UTC

Uploads are starting to trickle through the system. Please don't all click 'retry' at the same time - the server is having a bit of a struggle to keep up with demand.
ID: 47549 · Report as offensive     Reply Quote
STE\/E

Send message
Joined: 15 Aug 04
Posts: 57
Credit: 10,344,905
RAC: 2,733
Message 47550 - Posted: 12 Nov 2013, 13:33:20 UTC - in response to Message 47549.  

Uploads are starting to trickle through the system. Please don't all click 'retry' at the same time - the server is having a bit of a struggle to keep up with demand.


Thank's, Checked my Uploads & a few have gotten thru, the rest are trying to Upload too ... :)
ID: 47550 · Report as offensive     Reply Quote
seigell

Send message
Joined: 22 Aug 09
Posts: 5
Credit: 1,783,296
RAC: 0
Message 47551 - Posted: 12 Nov 2013, 16:44:25 UTC

I can see that this is a different model and different error, but is the same destination server involved ??

11/12/2013 9:00:51 AM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_qdje_2005_1_008343335_1_13.zip: No such file or directory
11/12/2013 9:00:51 AM | climateprediction.net | Temporarily failed upload of hadam3p_eu_qdje_2005_1_008343335_1_13.zip: transient upload error
11/12/2013 9:00:51 AM | climateprediction.net | Backing off 5 hr 57 min 56 sec on upload of hadam3p_eu_qdje_2005_1_008343335_1_13.zip

The .zip file in question is "healthy" at this end, being able to open via Win7 and WinZip and 7Zip as well as "Test" as OK in both the latter two apps.
ID: 47551 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 47552 - Posted: 12 Nov 2013, 17:55:53 UTC - in response to Message 47551.  

It's a completely different problem, for one of the other threads.

The data for EU models goes to 2 servers at Oxford Uni.
As the error messages say, the zip in question is 13, the re-start file. This goes to a separate server, where a program uses the data to automatically create a new data set for the next part of the sequence for that set of start values.

I'm send them an email, but it's night time there now.

ID: 47552 · Report as offensive     Reply Quote
Art Masson
Avatar

Send message
Joined: 16 Oct 11
Posts: 254
Credit: 15,954,577
RAC: 19
Message 47554 - Posted: 13 Nov 2013, 2:22:07 UTC

My four outstanding uploads have all now completed
ID: 47554 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,378,503
RAC: 3,632
Message 47559 - Posted: 13 Nov 2013, 11:42:41 UTC - in response to Message 47554.  

I assume it is only to stop me missing crunching CPDN so much but I now have another project telling me it is out of disk space :)
ID: 47559 · Report as offensive     Reply Quote
Profile MikeMarsUK
Volunteer moderator
Avatar

Send message
Joined: 13 Jan 06
Posts: 1498
Credit: 15,613,038
RAC: 0
Message 47560 - Posted: 13 Nov 2013, 13:18:52 UTC - in response to Message 47559.  

I assume it is only to stop me missing crunching CPDN so much but I now have another project telling me it is out of disk space :)


They must be jealous! :-)

I'm a volunteer and my views are my own.
News and Announcements and FAQ
ID: 47560 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · Next

Message boards : Number crunching : A different upload problem -- out of disk space on rapid-watch.badc.rl.ac.uk

©2024 climateprediction.net