|
Message boards :
Number crunching :
Upload failures
Message board moderation
Previous · 1 . . . 12 · 13 · 14 · 15 · 16 · 17 · 18 . . . 19 · Next
Author | Message |
---|---|
Mephist0 Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
I will move my boinc installation to another computer that does not need a proxy server in between to see if the behaviour changes since i have had issues a long time now... :) |
Mephist0 Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
Ok, so now on a new computer.. But still same issue.. Good now atleast i know its not the proxy server :) So i guess the project still have issues with transient HTTP errors. :( |
Mephist0 Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
OK, update: Out of curiosity.. How much bandwidth does this server / or connection have available? Is there some load graph available to view? :) I wanted to know if there is any hour during the day where it might be easier to upload results (since im manually uploading). |
Mephist0 Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
Sorry for all the posts.. My issues is resolved now. Turns out the network i ran all my computers on have a proxy and that one interferes with the transfers in some way. When i moved the files to my laptop and connected direct to the internet instead of my work network problem was resolved! My 98 files are on the way to upload now. Getting around 10 Mbit in speed on a 100 Mbit line :) Hope they will register since they will upload on another machine... |
Mephist0 Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
For everyones info.. sam50 units are limited to 1 MiB/s in upload speed anz50 units are limitet to 100 KiB/s in upload speed.. Observed sitting waiting for 98 files to upload :D |
![]() Volunteer moderator Send message Joined: 15 May 09 Posts: 3339 Credit: 9,948,339 RAC: 1,581 |
For everyones info.. So for me, my bored band is the limiting factor. |
Mephist0 Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
For everyones info.. So whats your connection speed? A while ago i had only mobile dongle to upload from a server park.. 3 Mbit (aprox 300KB/s).. THAT took a LOOOOONG time.... :D |
Les Bayliss Volunteer moderator Send message Joined: 5 Sep 04 Posts: 7578 Credit: 24,034,754 RAC: 140 |
Ha! You call that slow? For years I was getting about 40 KB/s on a good day, and around 10-14 KB/s on a bad day. Now that I've got super fast fiber, I get somewhere over a 100KB/s. (It's been so long since there was work that I've forgotten the exact number.) |
![]() Send message Joined: 22 Feb 06 Posts: 419 Credit: 18,919,008 RAC: 2,525 |
Rercent (today) upload to Jasmin: 30/07/2019 23:13:05 | climateprediction.net | Finished upload of wah2_sam50_n6no_201612_25_822_011884633_0_r2139349355_23.zip 30/07/2019 23:13:05 | climateprediction.net | [file_xfer] Throughput 744183 bytes/sec |
Speedy Send message Joined: 20 Jul 05 Posts: 25 Credit: 409,712 RAC: 0 |
For everyones info.. To see if you can increase your upload speed you could try changing Max files per project to 1. It may not have any effect but it's worth a try <max_file_xfers_per_project>1</max_file_xfers_per_project> |
Jean-David Beyer Send message Joined: 5 Aug 04 Posts: 601 Credit: 9,422,989 RAC: 753 |
Right now, according to climateprediction.net I am getting: Average upload rate 195.4 KB/sec Average download rate 3390.97 KB/sec Now my Verizon FiOS Internet connection gets: Date Download Upload Test Server 7/30/2019 8:18:57 PM 81.62 Mbps 86.98 Mbps New York City, NY 6/25/2019 9:03:54 AM 82.02 Mbps 87.87 Mbps New York City, NY 6/14/2019 11:56:38 PM 82.44 Mbps 87.53 Mbps New York City, NY 6/1/2019 4:43:44 PM 82.44 Mbps 88.74 Mbps New York City, NY ![]() |
![]() Volunteer moderator Send message Joined: 15 May 09 Posts: 3339 Credit: 9,948,339 RAC: 1,581 |
Right now I am getting 88KB/s upload. I get about 5MB/s download on a clear day with a following wind. |
Mephist0 Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
For everyones info.. Yeah i had it at 1 when i was trying to fix my problems to not cause to many attempts on the climate servers. i got Max 1 MiB/s .. I had to increase the transfers slots to 10 since i was uploading both anz50 and sam50 units and it was taking forever. When i was transfering sam50 units only i got 10 MiB/s upload speed when i only were transfering anz50 i got a total of 1 MiB/s for all 10 transfers so there is defenatly a cap :) I normally have my transfers set to 2 (default) |
Mephist0 Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
Ha! You call that slow? Haha.. Yeah it was slow for me since i had to be in the datacenter until the uploads completed and it was hundreds of files to upload at once ;) You say "super fast fiber" ... Now i guess that the bottleneck is not your fibre connection but the CPDN bandwith cap instead :) I'm on fibre too. I can get 1 Gbit/s but i dont need that kind of speed. I'm paying 25$/month for 100 Mbit down and 10 Mbit up. I don't need faster than that.. An awesome plus for this connection is that my real speed is 135/17 Mbit so a lot more than i pay for :) |
Misty Send message Joined: 14 Feb 06 Posts: 50 Credit: 8,082,893 RAC: 0 |
All zips for this cam25 model are failing to upload. Should I wait or abort? Aborted stuck zips (##13 & 14) & now showing as Success/Completed. I hope no data were lost. |
![]() Volunteer moderator Send message Joined: 16 Jan 10 Posts: 1058 Credit: 6,463,915 RAC: 0 |
All zips for this cam25 model are failing to upload. Should I wait or abort? I sympathise with your position, having had a CAM25 stuck for weeks. However, on 27th July some of the Zips uploaded successfully so I’m leaving the remaining three transfers to continue attempting to upload. Aborting the transfer does destroy the data but I don’t blame anyone for doing that - it is the (sub-)project’s responsibility to provide the resources to accept data and if they don’t then they may lose data. Their fault I would say. |
ian Send message Joined: 23 Feb 06 Posts: 20 Credit: 6,280,897 RAC: 0 |
my last running work unit (on all of my machines) -a cam25 - is now stuck on trickle up!! suppose I will just have to sit and wait AGAIN for it to clear and for more work. |
Les Bayliss Volunteer moderator Send message Joined: 5 Sep 04 Posts: 7578 Credit: 24,034,754 RAC: 140 |
Are your SURE that it's a trickle, and not a zip file? Vast difference, and instructions for dealing with this Cam zip problem have been posted a number of times. Reports say that Aborting the stuck zip upload and then waiting, have resulted in a Successful completion. |
Mario Send message Joined: 30 Apr 18 Posts: 3 Credit: 242,814 RAC: 0 |
I have 5 zip files that have become stuck in the transfer cue. I'm trying to be patient and not abort anything prematurly. 9/2/2019 5:21:21 PM | climateprediction.net | Started upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_15.zip 9/2/2019 5:21:43 PM | | Project communication failed: attempting access to reference site 9/2/2019 5:21:43 PM | climateprediction.net | Temporarily failed upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_15.zip: transient HTTP error 9/2/2019 5:21:43 PM | climateprediction.net | Backing off 03:33:21 on upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_15.zip 9/2/2019 5:21:45 PM | | Internet access OK - project servers may be temporarily down. 9/2/2019 6:56:35 PM | | Suspending computation - CPU is busy 9/2/2019 6:56:45 PM | | Resuming computation 9/2/2019 6:57:05 PM | | Suspending computation - CPU is busy 9/2/2019 6:57:35 PM | | Resuming computation 9/2/2019 8:06:31 PM | | Suspending GPU computation - computer is in use 9/2/2019 8:08:23 PM | climateprediction.net | Started upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_13.zip 9/2/2019 8:08:33 PM | | Resuming GPU computation 9/2/2019 8:08:45 PM | climateprediction.net | Temporarily failed upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_13.zip: transient HTTP error 9/2/2019 8:08:45 PM | climateprediction.net | Backing off 03:05:48 on upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_13.zip 9/2/2019 8:08:46 PM | | Project communication failed: attempting access to reference site 9/2/2019 8:08:48 PM | | Internet access OK - project servers may be temporarily down. 9/2/2019 9:27:06 PM | | Suspending computation - CPU is busy 9/2/2019 9:27:16 PM | | Resuming computation 9/2/2019 9:43:27 PM | climateprediction.net | Started upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_3.zip 9/2/2019 9:43:27 PM | climateprediction.net | Started upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_15.zip 9/2/2019 9:43:50 PM | | Project communication failed: attempting access to reference site 9/2/2019 9:43:50 PM | climateprediction.net | Temporarily failed upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_3.zip: transient HTTP error 9/2/2019 9:43:50 PM | climateprediction.net | Backing off 04:28:27 on upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_3.zip 9/2/2019 9:43:50 PM | climateprediction.net | Temporarily failed upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_15.zip: transient HTTP error 9/2/2019 9:43:50 PM | climateprediction.net | Backing off 03:32:43 on upload of wah2_cam25_a08d_200405_18_691_011369850_0_r1625567930_15.zip 9/2/2019 9:43:52 PM | | Internet access OK - project servers may be temporarily down. Mario |
Les Bayliss Volunteer moderator Send message Joined: 5 Sep 04 Posts: 7578 Credit: 24,034,754 RAC: 140 |
As has been said, CAMS are a pain. The only real "cure" is to wait until a zip has uploaded, and then tries another upload from scratch. At that point, assume that it got through the previous time, and Abort it. Do the same for each of your 5 files. At this point, BOINC should wake up to the fact that everything has "uploaded", and finish off the transfer process. Perhaps not immediately. It's been so long since I had to do this that I forget the timings of what happens. |
©2022 climateprediction.net