climateprediction.net home page
data transfer (upload) failure & re-tries

data transfer (upload) failure & re-tries

Questions and Answers : Windows : data transfer (upload) failure & re-tries
Message board moderation

To post messages, you must log in.

AuthorMessage
old_user635060

Send message
Joined: 29 Sep 10
Posts: 3
Credit: 203,683
RAC: 0
Message 43403 - Posted: 16 Nov 2011, 13:20:39 UTC

Hi. My computer finished a task titled hadam3p_eu_wa5c_1959_1_006808504_1. This was right around the time when the servers were down for relocation or maintenance or something over the weekend. So when the completed work could not be uploaded and kept retrying I just assumed it was because the servers were offline. Now that the servers are online again, the data is still not uploading. I also do Einstein@Home and that seems to upload fine. Any help is appreciated. Thanks.
ID: 43403 · Report as offensive     Reply Quote
Profile Iain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1049
Credit: 6,463,915
RAC: 33
Message 43404 - Posted: 16 Nov 2011, 14:19:14 UTC

I've not been able to upload anything to climateapps1.oerc.ox.ac.uk and have reported that to the project team. A variety of HADAM3P and HADCM3N zip files did upload, but to other upload servers.

If there's any news, I'll report back here. More likely, however, the machine will just start working again when someone flicks a metaphorical switch somewhere.
ID: 43404 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1146
Credit: 21,159,011
RAC: 141
Message 43405 - Posted: 16 Nov 2011, 16:17:31 UTC

I noticed that all through the outage I could upload anything except the 12.zip and 13.zip files from the hadam3p WUs. I still have 4 stuck of these (one 12.zip and three 13.zips) stuck in the transfer tabs of my 2 machines. Hopefully it will get sorted out soon.

ID: 43405 · Report as offensive     Reply Quote
old_user635060

Send message
Joined: 29 Sep 10
Posts: 3
Credit: 203,683
RAC: 0
Message 43406 - Posted: 16 Nov 2011, 16:59:43 UTC

Thanks for replying (both of you). Since I had never seen this happen before I was worried that it had something to do with my PC - glad to know this is a known issue.
ID: 43406 · Report as offensive     Reply Quote
old_user635060

Send message
Joined: 29 Sep 10
Posts: 3
Credit: 203,683
RAC: 0
Message 43407 - Posted: 16 Nov 2011, 17:54:04 UTC - in response to Message 43404.  

How do you report this other than post here?
ID: 43407 · Report as offensive     Reply Quote
Profile mo.v
Volunteer moderator
Avatar

Send message
Joined: 29 Sep 04
Posts: 2363
Credit: 14,611,758
RAC: 18
Message 43409 - Posted: 16 Nov 2011, 18:15:26 UTC
Last modified: 16 Nov 2011, 18:17:09 UTC

Thanks for the report, Danish. Fortunately we did already know about this problem of some regional model (hadam3P) files. If you look at the News and Announcements thread at the top of the Number Crunching section you'll see a post about it. And there's a link in my signature.

It's worth subscribing to that News thread for email notification of new posts (as long as in your account you have email notification enabled).

When Jonathan gets the last server problems sorted out your files will upload. Having to wait a while in the Transfers tab won't do them any harm.
Cpdn news
ID: 43409 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1146
Credit: 21,159,011
RAC: 141
Message 43410 - Posted: 16 Nov 2011, 18:59:03 UTC

As you can see the problem is: can't resolve hostname. I don?t know if this helps.

11/16/2011 1:44:24 PM Project communication failed: attempting access to reference site
11/16/2011 1:44:24 PM climateprediction.net Temporarily failed upload of hadam3p_eu_6i74_2007_1_007490853_0_12.zip: can't resolve hostname
11/16/2011 1:44:24 PM climateprediction.net Backing off 24 min 49 sec on upload of hadam3p_eu_6i74_2007_1_007490853_0_12.zip
11/16/2011 1:44:25 PM Internet access OK - project servers may be temporarily down.
11/16/2011 1:48:50 PM climateprediction.net Started upload of hadam3p_eu_6h23_2005_1_007533045_0_13.zip
11/16/2011 1:48:51 PM Project communication failed: attempting access to reference site
11/16/2011 1:48:51 PM climateprediction.net Temporarily failed upload of hadam3p_eu_6h23_2005_1_007533045_0_13.zip: can't resolve hostname
11/16/2011 1:48:51 PM climateprediction.net Backing off 3 hr 43 min 10 sec on upload of hadam3p_eu_6h23_2005_1_007533045_0_13.zip
11/16/2011 1:48:52 PM Internet access OK - project servers may be temporarily down.


ID: 43410 · Report as offensive     Reply Quote
Profile Iain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1049
Credit: 6,463,915
RAC: 33
Message 43411 - Posted: 16 Nov 2011, 19:27:27 UTC - in response to Message 43410.  

As you can see the problem is: can't resolve hostname. I don?t know if this helps. ...

Looks like some changes are taking place:

Wed Nov 16 06:37:54 2011 | climateprediction.net | Temporarily failed upload of hadam3p_eu_6523_2009_1_007468568_2_11.zip: connect() failed

... has become ...

Wed Nov 16 15:14:46 2011 | climateprediction.net | Temporarily failed upload of hadam3p_eu_6523_2009_1_007468568_2_11.zip: can't resolve hostname
ID: 43411 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1146
Credit: 21,159,011
RAC: 141
Message 43414 - Posted: 17 Nov 2011, 15:22:46 UTC

Any progress with the: Can?t resolve host name problem? I still have four Hadam3p zip filed from finished WUs that I can?t upload. There is no point in running the WUs if we can?t send the results back. In fact the project will grind to a halt without the 13.zip files needed to generate the next segment of each model.

ID: 43414 · Report as offensive     Reply Quote
Profile Iain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1049
Credit: 6,463,915
RAC: 33
Message 43416 - Posted: 17 Nov 2011, 17:24:20 UTC - in response to Message 43414.  

Any progress with the: Can?t resolve host name problem? ...

The project staff are waiting for the university's IT people to update the relevant DNS records. As I understand it, this will solve some of the upload problems but not all, as two old machines (climateapps1 and climateapps3) are to be replaced by new or better existing hardware. It's not clear to me whether there will be a window in which the old hardware can collect some uploads before being re-configured or replaced.
ID: 43416 · Report as offensive     Reply Quote
Belfry

Send message
Joined: 19 Apr 08
Posts: 179
Credit: 4,306,992
RAC: 0
Message 43422 - Posted: 18 Nov 2011, 21:11:57 UTC

Any workaround for this? Such as an edit to client_state.xml.
ID: 43422 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7481
Credit: 23,579,860
RAC: 2,360
Message 43428 - Posted: 19 Nov 2011, 8:34:28 UTC - in response to Message 43422.  

Some editing may work. Or it may not.
Both of these applied to the 16 zips that I had waiting.


Backups: Here
ID: 43428 · Report as offensive     Reply Quote
Belfry

Send message
Joined: 19 Apr 08
Posts: 179
Credit: 4,306,992
RAC: 0
Message 43432 - Posted: 19 Nov 2011, 14:29:25 UTC

Alrighty then! It works.

I will post details in the number crunching section.
ID: 43432 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7481
Credit: 23,579,860
RAC: 2,360
Message 43449 - Posted: 21 Nov 2011, 21:47:10 UTC

When I said it may work, I meant changing oerc to oucs, NOT changing it to use a different upload server.


In my case, this allowed all except 2 files to upload. All were zips 10-13.
And for the last 2, both zip10, I had to change the url back to oerc.

But the best advice is JUST BE PATIENT!!!!


Backups: Here
ID: 43449 · Report as offensive     Reply Quote
Paul Bowyer

Send message
Joined: 1 Sep 04
Posts: 3
Credit: 5,837,226
RAC: 0
Message 43461 - Posted: 22 Nov 2011, 17:53:46 UTC - in response to Message 43449.  

But the best advice is JUST BE PATIENT!!!!

[/quote]

I have an additional problem with the 4 finished WUs that are stuck in my queue. Every time an upload is attempted, my network connection stops working - I can't can't get onto the internet at all until I disable/enable the connection. Is there any way I can stop BOINC Manager from attempting the upload?

I tried the workaround listed in this thread and it worked for 6 or 8 other files that had been stuck, but these 4 refuse to budge.
ID: 43461 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 3136
Credit: 8,577,104
RAC: 7,103
Message 43462 - Posted: 22 Nov 2011, 18:23:20 UTC - in response to Message 43461.  

Different files go to different servers, there is one server not running @ the moment. If they are due to go there it would explain it.
ID: 43462 · Report as offensive     Reply Quote

Questions and Answers : Windows : data transfer (upload) failure & re-tries

©2021 climateprediction.net