Message boards : Number crunching : Stuck upload issue
Message board moderation
Previous · 1 · 2 · 3 · 4 · 5 · Next
Author | Message |
---|---|
Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
Uploading eas50 7,2GB data at the moment.. Its going fine! Speed 2MiB/s per file.. total speed 8MiB/s :D Great job guys! |
Send message Joined: 15 May 09 Posts: 4541 Credit: 19,039,635 RAC: 18,944 |
Looks as if there is a problem with upload6 as well: On investigation this one seems to be working. The transient http error may be just coincidence of lots of uploads going to it. If problem is widespread someone will increase the timeout value on the server which should deal with it. Good news that the other uploads are going through. - Some may experience transient errors on upload7 as well with lots of people's uploads trying to get through. |
Send message Joined: 28 Aug 04 Posts: 2 Credit: 2,606,665 RAC: 2,749 |
Excellent, thank you! Mine are all uploaded now. |
Send message Joined: 3 Sep 04 Posts: 126 Credit: 26,610,380 RAC: 3,377 |
My files have been uploaded except one, which got stuck at 14.96%: https://www.cpdn.org/cpdnboinc/result.php?resultid=20936151 vr 05-01-2018 16:22:13 | climateprediction.net | Started upload of wah2_cam25_a07g_200405_18_689_011368712_1_r81990675_6.zip vr 05-01-2018 16:22:38 | | Project communication failed: attempting access to reference site vr 05-01-2018 16:22:38 | climateprediction.net | Temporarily failed upload of wah2_cam25_a07g_200405_18_689_011368712_1_r81990675_6.zip: transient HTTP error vr 05-01-2018 16:22:38 | climateprediction.net | Backing off 04:46:18 on upload of wah2_cam25_a07g_200405_18_689_011368712_1_r81990675_6.zip vr 05-01-2018 16:22:40 | | Internet access OK - project servers may be temporarily down. |
Send message Joined: 29 Nov 17 Posts: 82 Credit: 15,581,279 RAC: 75,682 |
I still have one task that is stuck uploading to upload6, it has sent 6.66/104.92MB so far... 06/01/2018 08:54:02 | climateprediction.net | [fxd] starting upload, upload_offset -1 06/01/2018 08:54:02 | climateprediction.net | Started upload of wah2_cam25_a03y_200405_18_689_011368586_0_r102364835_9.zip 06/01/2018 08:54:02 | climateprediction.net | [file_xfer] URL: http://upload6.cpdn.org/cgi-bin/file_upload_handler 06/01/2018 08:54:03 | climateprediction.net | [file_xfer] http op done; retval 0 (Success) 06/01/2018 08:54:03 | climateprediction.net | [file_xfer] parsing upload response: <data_server_reply> <status>0</status> <file_size>6964580</file_size></data_server_reply> 06/01/2018 08:54:03 | climateprediction.net | [file_xfer] parsing status: 0 06/01/2018 08:54:03 | climateprediction.net | [fxd] starting upload, upload_offset 6964580 06/01/2018 08:54:27 | climateprediction.net | [file_xfer] http op done; retval -184 (transient HTTP error) 06/01/2018 08:54:27 | climateprediction.net | [file_xfer] file transfer status -184 (transient HTTP error) 06/01/2018 08:54:27 | climateprediction.net | Temporarily failed upload of wah2_cam25_a03y_200405_18_689_011368586_0_r102364835_9.zip: transient HTTP error 06/01/2018 08:54:27 | climateprediction.net | Backing off 03:42:03 on upload of wah2_cam25_a03y_200405_18_689_011368586_0_r102364835_9.zip |
Send message Joined: 5 Sep 07 Posts: 9 Credit: 10,783,131 RAC: 0 |
All stuck ones are uploaded now.Thanks. |
Send message Joined: 9 Dec 05 Posts: 116 Credit: 12,547,934 RAC: 2,738 |
I also have one of those wah2_cam25... files stuck in upload (_2.zip). It has been at 42.3% for over a week now. The task is otherwise finished and all other zips have uploaded but this one is not budging. When it retries it starts from about 42.1% and stops again at 42.3%. Restarting Boinc, cable modem or the Host does not help. Here's the task: https://www.cpdn.org/cpdnboinc/result.php?resultid=20921964 |
Send message Joined: 15 May 09 Posts: 4541 Credit: 19,039,635 RAC: 18,944 |
I will let the project people know. (First will check on relevant board to see if anyone else has.) |
Send message Joined: 29 Nov 17 Posts: 82 Credit: 15,581,279 RAC: 75,682 |
I still have one task that is stuck uploading to upload6, it has sent 6.66/104.92MB so far... This one is still stuck, I'll post when it has gone rather than keep saying it hasn't. PS. Thanks for the credit export done this morning. |
Send message Joined: 15 May 09 Posts: 4541 Credit: 19,039,635 RAC: 18,944 |
I have let Sarah know that at least 5 people have one or more stuck uploads from the cam25 batches. I have checked out a few of them myself and the tasks should have finished as all 18 trickle files have been uploaded. I haven't been able to work out any pattern as the numbers of the zip files that are stuck differ between computers. My guess is the server involved is connected via a connection that can't handle the amount of data being thrown at it and the overload may well be nothing to do with CPDN but something else going through it. The project may decide on their own to do a temporary re-direct to Oxford. If not, I may suggest it in a few days time if nothing improves. |
Send message Joined: 16 Jan 10 Posts: 1084 Credit: 7,879,198 RAC: 4,930 |
The CAM25 upload error I'm getting is: 07/01/2018 16:07:47 | climateprediction.net | [error] Error reported by file upload server: [wah2_cam25_a033_200405_18_689_011368555_0_r1524206355_14.zip] locked by file_upload_handler PID=102372 Maybe just an upload server reboot to clear the locks? Subsequent Zips from that model have uploaded without any problem. |
Send message Joined: 9 Dec 05 Posts: 116 Credit: 12,547,934 RAC: 2,738 |
I also have one of those wah2_cam25... files stuck in upload (_2.zip). It has been at 42.3% for over a week now. The task is otherwise finished and all other zips have uploaded but this one is not budging. When it retries it starts from about 42.1% and stops again at 42.3%. Restarting Boinc, cable modem or the Host does not help. Here's the task: https://www.cpdn.org/cpdnboinc/result.php?resultid=20921964 The stuck file I reported before has been uploaded only to be replaced with an other stuck one from cam25 (_3.zip) here: https://www.cpdn.org/cpdnboinc/result.php?resultid=20921445 |
Send message Joined: 22 Feb 06 Posts: 491 Credit: 31,215,522 RAC: 15,476 |
I have a stuck zip from this lot - has been for 6 days now on 38% (40Mb out of 105). Its _17.zip. |
Send message Joined: 4 Nov 06 Posts: 5 Credit: 3,764,885 RAC: 296 |
I've been having upload/download issues for a while now... I have a 16-core (32 w/ HT) system I'm trying to keep busy, and CPDN just barely trickles me any work with its priority of 1500. The computer has another pairing with World Community Grid set to priority 0, and its task list is consistently full of either "Uploading" CPDN tasks, or running WCG tasks... but rarely ever more than a couple CPDN tasks. The uploads of tasks takes days, not just hours, because of the constant failures. Is there just not enough work to do...? tech details: I've got 200405_18_691..._*.zip items queued: wah2_cam25_a0ib_18_691_011370208_0_r706661527_12.zip - 30.03% (31.56/105.10 MB) wah2_cam25_a0ib_18_691_011370208_0_r706661527_13.zip - 9.93% (10.45/105.17 MB) wah2_cam25_a0jx_18_691_011370266_0_r76671198_10.zip - 52.51% (55.16/105.13 MB) wah2_cam25_a0ea_18_691_011370063_0_r1526698435_14.zip - 31.20% (32.83/105.20 MB) wah2_cam25_a0ht_18_691_011370190_0_r177040747_1.zip - 21.42% (22.56/105.30 MB) |
Send message Joined: 15 May 09 Posts: 4541 Credit: 19,039,635 RAC: 18,944 |
I will post another message to the project about the stuck uploads though it won't be seen till Monday probably. If you click on main page at the bottom of this page, then on server status on the right, you will see that there is currently no work waiting to go out. (look at the number of tasks by model type rather than the 27 towards the top which really means zero. This seems to be a BOINC server bug as other projects that go down to zero tasks in the queue show it as well. There is stuff happening in the testing branch (where crunchers don't even get credit for their work) and I hope some of it will make it across to the main site next week but I don't have an inside track on how likely that is. |
Send message Joined: 22 Feb 06 Posts: 491 Credit: 31,215,522 RAC: 15,476 |
Still waiting to finish upload though all 18 trickles are present. Server has an .mx location and just gives an Apache test page when looked at in a browser. |
Send message Joined: 16 Jan 10 Posts: 1084 Credit: 7,879,198 RAC: 4,930 |
Still waiting to finish upload though all 18 trickles are present. Server has an .mx location and just gives an Apache test page when looked at in a browser. Thanks, Alan. The request for the server to be fixed has been made again, but no news yet. The '.mx' makes sense as CAM is central America. There's clearly a significant problem server-side. |
Send message Joined: 15 May 09 Posts: 4541 Credit: 19,039,635 RAC: 18,944 |
The batch gong to a korean server was redirected to Oxford. This could be done with these as well though I don't know how much leeway there is for this if any more servers away from UK stop working! |
Send message Joined: 15 May 09 Posts: 4541 Credit: 19,039,635 RAC: 18,944 |
Still waiting to finish upload though all 18 trickles are present. Server has an .mx location and just gives an Apache test page when looked at in a browser. Is this the link you are using? http://upload6.cpdn.org/cgi-bin/file_upload_handler - Andy says that is the address to look at. If so, it is now giving, <data_server_reply> If it was the address you looked at, things may now be working. |
Send message Joined: 22 Feb 06 Posts: 491 Credit: 31,215,522 RAC: 15,476 |
Log file extract: 16/01/2018 20:36:28 | climateprediction.net | [http] [ID#5] Info: Connected to upload6.cpdn.org (158.97.9.11) port 80 (#5) 16/01/2018 20:36:28 | climateprediction.net | [http] [ID#5] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1 16/01/2018 20:36:28 | climateprediction.net | [http] [ID#5] Sent header to server: Host: upload6.cpdn.org 16/01/2018 20:36:28 | climateprediction.net | [http] [ID#5] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.8.3) 16/01/2018 20:36:28 | climateprediction.net | [http] [ID#5] Sent header to server: Accept: */* 16/01/2018 20:36:28 | climateprediction.net | [http] [ID#5] Sent header to server: Accept-Encoding: deflate, gzip 16/01/2018 20:36:28 | climateprediction.net | [http] [ID#5] Sent header to server: Content-Type: application/x-www-form-urlencoded 16/01/2018 20:36:28 | climateprediction.net | [http] [ID#5] Sent header to server: Accept-Language: en_GB 16/01/2018 20:36:28 | climateprediction.net | [http] [ID#5] Sent header to server: Content-Length: 68301092 16/01/2018 20:36:28 | climateprediction.net | [http] [ID#5] Sent header to server: Expect: 100-continue 16/01/2018 20:36:28 | climateprediction.net | [http] [ID#5] Sent header to server: 16/01/2018 20:36:28 | climateprediction.net | [http] [ID#5] Received header from server: HTTP/1.1 100 Continue 16/01/2018 20:36:51 | climateprediction.net | [http] [ID#5] Info: Recv failure: Connection was reset 16/01/2018 20:36:51 | climateprediction.net | [http] [ID#5] Info: Closing connection 5 16/01/2018 20:36:51 | climateprediction.net | [http] HTTP error: Failure when receiving data from the peer 16/01/2018 20:36:52 | climateprediction.net | [file_xfer] http op done; retval -184 (transient HTTP error) 16/01/2018 20:36:52 | climateprediction.net | [file_xfer] file transfer status -184 (transient HTTP error) 16/01/2018 20:36:52 | climateprediction.net | Temporarily failed upload of wah2_cam25_a0ds_200405_18_691_011370045_1_r1231016019_17.zip: transient HTTP error so I think Andy is correct. Maybe there is a large backlog. |
©2024 cpdn.org