climateprediction.net home page
ANOTHER UPLOAD PROBLEM

ANOTHER UPLOAD PROBLEM

Message boards : Number crunching : ANOTHER UPLOAD PROBLEM
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 29 · 30 · 31 · 32 · 33 · Next

AuthorMessage
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 55076 - Posted: 2 Nov 2016, 2:56:58 UTC

I see that upload server “srv1.cpdn.psu.edu” is shown as being down. Does anyone know were this server is and what Wu’s it uploads.
ID: 55076 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 484
Credit: 29,579,234
RAC: 4,572
Message 55080 - Posted: 2 Nov 2016, 10:20:38 UTC - in response to Message 55076.  

The server is in Penn State University. Don't know which WUs it deals with.
ID: 55080 · Report as offensive     Reply Quote
Profile Bonsai911

Send message
Joined: 9 Sep 04
Posts: 228
Credit: 30,230,084
RAC: 3,092
Message 55112 - Posted: 8 Nov 2016, 22:26:14 UTC

...and it's strange.

This happened for the first time.

08.11.2016 23:20:42 | climateprediction.net | Started upload of wah2_sas50_ldvc_201512_8_462_010770845_0_r1065613461_7.zip
08.11.2016 23:20:42 | climateprediction.net | [file_xfer] URL: http://upload2.cpdn.org/cgi-bin/file_upload_handler
08.11.2016 23:20:43 | climateprediction.net | [file_xfer] http op done; retval 0 (Success)
08.11.2016 23:20:43 | climateprediction.net | [error] Error reported by file upload server: [wah2_sas50_ldvc_201512_8_462_010770845_0_r1065613461_7.zip] locked by file_upload_handler PID=3630
08.11.2016 23:20:43 | climateprediction.net | [file_xfer] parsing upload response: <data_server_reply> <status>1</status> <message>[wah2_sas50_ldvc_201512_8_462_010770845_0_r1065613461_7.zip] locked by file_upload_handler PID=3630</message></data_server_reply>
08.11.2016 23:20:43 | climateprediction.net | [file_xfer] parsing status: -127
08.11.2016 23:20:43 | climateprediction.net | [file_xfer] file transfer status -127 (transient upload error)
08.11.2016 23:20:43 | climateprediction.net | Temporarily failed upload of wah2_sas50_ldvc_201512_8_462_010770845_0_r1065613461_7.zip: transient upload error
08.11.2016 23:20:43 | climateprediction.net | Backing off 00:25:44 on upload of wah2_sas50_ldvc_201512_8_462_010770845_0_r1065613461_7.zip
08.11.2016 23:20:47 | climateprediction.net | [fxd] starting upload, upload_offset -1
08.11.2016 23:20:47 | climateprediction.net | Started upload of wah2_sas50_ldvc_201512_8_462_010770845_0_r1065613461_7.zip
08.11.2016 23:20:47 | climateprediction.net | [file_xfer] URL: http://upload2.cpdn.org/cgi-bin/file_upload_handler
08.11.2016 23:20:48 | climateprediction.net | [file_xfer] http op done; retval 0 (Success)
08.11.2016 23:20:48 | climateprediction.net | [error] Error reported by file upload server: [wah2_sas50_ldvc_201512_8_462_010770845_0_r1065613461_7.zip] locked by file_upload_handler PID=3630
08.11.2016 23:20:48 | climateprediction.net | [file_xfer] parsing upload response: <data_server_reply> <status>1</status> <message>[wah2_sas50_ldvc_201512_8_462_010770845_0_r1065613461_7.zip] locked by file_upload_handler PID=3630</message></data_server_reply>
08.11.2016 23:20:48 | climateprediction.net | [file_xfer] parsing status: -127
08.11.2016 23:20:48 | climateprediction.net | [file_xfer] file transfer status -127 (transient upload error)
08.11.2016 23:20:48 | climateprediction.net | Temporarily failed upload of wah2_sas50_ldvc_201512_8_462_010770845_0_r1065613461_7.zip: transient upload error
08.11.2016 23:20:48 | climateprediction.net | Backing off 00:44:46 on upload of wah2_sas50_ldvc_201512_8_462_010770845_0_r1065613461_7.zip

I've never seen "locked" at anytime:

locked by file_upload_handler PID=3630</message></data_server_reply

Greetings,

bonsai911
ID: 55112 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 55113 - Posted: 8 Nov 2016, 23:55:33 UTC - in response to Message 55112.  

I've seen that on numerous occasions, when I've tried a "Retry now".
It's some sort of back off interval.

I've found that usually, uploads will start again in their own good time.
(But I have on occasions tried another little helping push after 10 minutes or so.)


ID: 55113 · Report as offensive     Reply Quote
Art Masson
Avatar

Send message
Joined: 16 Oct 11
Posts: 254
Credit: 15,954,577
RAC: 19
Message 55192 - Posted: 26 Nov 2016, 2:32:19 UTC

Getting Connection failed errors on uploads the last 24 hours or so....
ID: 55192 · Report as offensive     Reply Quote
Andrew Sanchez
Avatar

Send message
Joined: 28 May 14
Posts: 34
Credit: 705,936
RAC: 0
Message 55194 - Posted: 26 Nov 2016, 4:38:19 UTC - in response to Message 55192.  

I'm having the same issue. zips aren't uploading. connect()failed error message.
ID: 55194 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 55196 - Posted: 26 Nov 2016, 4:48:54 UTC

Uploads; lucky you. :)

The project's infrastructure had a problem recently, and it was taken off line while IT investigated.

Not sure what the situation is right now, because I finished all my tasks ages ago. :(
ID: 55196 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 55211 - Posted: 27 Nov 2016, 2:11:46 UTC - in response to Message 55196.  

For an upload problem that was supposed to be solved this morning I don’t see any sign of progress. I still have 50+ zip files sitting on my three machines.
ID: 55211 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 55212 - Posted: 27 Nov 2016, 2:16:39 UTC - in response to Message 55211.  

P.S. I also have one wah2_eu25 stuck in the transfer tab along with all those upbound zip file.
ID: 55212 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 55214 - Posted: 27 Nov 2016, 3:22:47 UTC

The problem that was under investigation, was the failure of 2 computers running VMs, some of which were cpdn VM "servers".

There's no information about Upload server problems.
ID: 55214 · Report as offensive     Reply Quote
Ryusennin
Avatar

Send message
Joined: 7 Dec 06
Posts: 3
Credit: 838,289
RAC: 975
Message 55221 - Posted: 28 Nov 2016, 12:41:26 UTC

Hi,

Same issue here. Two wah2_sas50 and wah2_cam50 zips have been stuck in "upload: retry" limbo for a couple of days since the completion of the WU.
ID: 55221 · Report as offensive     Reply Quote
Oxford_US01902

Send message
Joined: 10 Nov 16
Posts: 2
Credit: 0
RAC: 0
Message 55222 - Posted: 28 Nov 2016, 14:11:27 UTC

From my Boinc log the server appears to have some kind of disk quota exceeded error. For most of the weekend the uploads would fail instantly. This morning they appear to upload fully but then can't write whatever they were creating for a temp file on the server to whereever its permanent home is to be.

Mon 28 Nov 2016 09:04:06 AM EST | climateprediction.net | [error] Error reported by file upload server: can't write file wah2_sas50_ldmr_201512_8_462_010770536_2_r1588852436_4.zip: Disk quota exceeded
ID: 55222 · Report as offensive     Reply Quote
Andrew Sanchez
Avatar

Send message
Joined: 28 May 14
Posts: 34
Credit: 705,936
RAC: 0
Message 55223 - Posted: 28 Nov 2016, 14:26:54 UTC - in response to Message 55222.  
Last modified: 28 Nov 2016, 14:29:37 UTC

zips are 100% uploaded but stuck in BOINC Manager's "Transfers" screen and the event log says:

11/28/2016 9:23:59 AM | climateprediction.net | [error] Error reported by file upload server: can't write file
wah2_cam50_lfaz_194112_13_455_010756208_0_r1010598403_9.zip: Disk quota exceeded

11/28/2016 9:23:59 AM | climateprediction.net | Temporarily failed upload of wah2_cam50_lfaz_194112_13_455_010756208_0_r1010598403_9.zip: transient upload error
ID: 55223 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 484
Credit: 29,579,234
RAC: 4,572
Message 55224 - Posted: 28 Nov 2016, 15:42:28 UTC - in response to Message 55223.  

Same here:

28/11/2016 13:40:34 | climateprediction.net | [error] Error reported by file upload server: can't write file wah2_cafr25_a034_201212_13_468_010778820_0_r1768797414_10.zip: Disk quota exceeded
28/11/2016 13:40:34 | climateprediction.net | Temporarily failed upload of wah2_cafr25_a034_201212_13_468_010778820_0_r1768797414_10.zip: transient upload error
28/11/2016 13:40:34 | climateprediction.net | Backing off 04:44:14 on upload of wah2_cafr25_a034_201212_13_468_010778820_0_r1768797414_10.zip
ID: 55224 · Report as offensive     Reply Quote
Oxford_US01902

Send message
Joined: 10 Nov 16
Posts: 2
Credit: 0
RAC: 0
Message 55225 - Posted: 28 Nov 2016, 17:13:55 UTC - in response to Message 55223.  

In the dialup days this would be more of a problem. They're not really completing, just wasting bandwidth because they're all going to have to transfer again. A future update should check there's somewhere for the transfer to go before you start accepting it. Looks like we need a cloud plumber, it's all stopped up.
ID: 55225 · Report as offensive     Reply Quote
Alex Plantema

Send message
Joined: 3 Sep 04
Posts: 126
Credit: 26,363,193
RAC: 0
Message 55227 - Posted: 28 Nov 2016, 19:41:59 UTC

As soon as results cannot be uploaded, the tasks should be withdrawn for download. That's the only method that helps.
ID: 55227 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 55228 - Posted: 28 Nov 2016, 20:35:51 UTC

There's a News item about the problem, based on an email from Andy.

PS
The new News section should be bookmarked.
ID: 55228 · Report as offensive     Reply Quote
Andrew Sanchez
Avatar

Send message
Joined: 28 May 14
Posts: 34
Credit: 705,936
RAC: 0
Message 55234 - Posted: 28 Nov 2016, 21:58:19 UTC - in response to Message 55228.  

There's a News item about the problem, based on an email from Andy.


I guess the redirect was successful. My transfers cache is cleared now. No zips awaiting upload.
ID: 55234 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 55235 - Posted: 28 Nov 2016, 23:44:35 UTC - in response to Message 55234.  

That's good to know.
Good news is few and far between at the moment.
ID: 55235 · Report as offensive     Reply Quote
Ryusennin
Avatar

Send message
Joined: 7 Dec 06
Posts: 3
Credit: 838,289
RAC: 975
Message 55240 - Posted: 29 Nov 2016, 21:14:26 UTC - in response to Message 55235.  

Upload problem solved for me too. Thanks!
ID: 55240 · Report as offensive     Reply Quote
Previous · 1 . . . 29 · 30 · 31 · 32 · 33 · Next

Message boards : Number crunching : ANOTHER UPLOAD PROBLEM

©2024 climateprediction.net