Message boards : Number crunching : Upload failures
Message board moderation
Previous · 1 . . . 5 · 6 · 7 · 8 · 9 · 10 · 11 . . . 19 · Next
Author | Message |
---|---|
Send message Joined: 15 May 09 Posts: 4541 Credit: 19,039,635 RAC: 18,944 |
From David Wallom We have migrated the scheduler to the backup system this morning though this means that Andy is doing some fiddling with the https configuration at the moment. My sam25 uploads that were stuck while the site was down have all uploaded now but I don't know what effect the fiddling will have with anything else just that the transitioner is showing red on the Project Status page currently. |
Send message Joined: 18 Jul 13 Posts: 438 Credit: 25,646,207 RAC: 1,928 |
Thanks Dave, zips going to Oxford seem to be uploading, however JASMIN is still out of disk space. |
Send message Joined: 15 Jan 06 Posts: 637 Credit: 26,751,529 RAC: 653 |
All of my Linux zips on three machines have gone, so that is progress. But I have over 50 WAH2 zips on my windows machine still stuck. It seems to be discrimination against North America. |
Send message Joined: 13 Jan 07 Posts: 195 Credit: 10,581,566 RAC: 0 |
My SAM25 zips have all gone but my SAM50 zips are all still stuck. |
Send message Joined: 28 May 17 Posts: 49 Credit: 17,405,877 RAC: 5,319 |
All of my Linux zips on three machines have gone, so that is progress. But I have over 50 WAH2 zips on my windows machine still stuck. It seems to be discrimination against North America. Same here. SAM50 and SAFR50 are pending. Those files are several times as big. ~17MB compared to 76/92MB each. |
Send message Joined: 7 Jun 19 Posts: 1 Credit: 9,899 RAC: 0 |
Server is out of disk space 25.06.2019 08:16:44 | climateprediction.net | Started upload of wah2_safr50_n1vt_201112_13_818_011862688_0_r392739119_8.zip 25.06.2019 08:16:46 | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space I have 2 files 89MB and 90MB |
Send message Joined: 13 Jul 18 Posts: 38 Credit: 62,933,508 RAC: 84,702 |
sam50 uploads have started and are slowing down all other communication. 15 GBytes to go, should take at least two days. Edit: They stopped again. Out of disk space. |
Send message Joined: 27 Feb 08 Posts: 41 Credit: 1,402,356 RAC: 0 |
One wonders if these issues could have been anticipated. We have done our part! |
Send message Joined: 15 Jan 06 Posts: 637 Credit: 26,751,529 RAC: 653 |
One wonders if these issues could have been anticipated. They are hoping to do better with the climate. |
Send message Joined: 15 May 09 Posts: 4541 Credit: 19,039,635 RAC: 18,944 |
One wonders if these issues could have been anticipated. I suspect they are anticipated but there isn't enough redundancy in the systems of the universities who receive the data to cope with problems. In the past, this has been true of Oxford too. My guess is that the universities receiving the data have a standard protocol of how much space they give researchers irrespective of how much space they actually need. Of course it may be nothing to do with bureaucracy and I am just letting my 30+ years working for the NHS show. ;) |
Send message Joined: 5 Jun 09 Posts: 97 Credit: 3,736,855 RAC: 4,073 |
I've just looked - two tasks waiting to upload, a total of 23 zip files mostly around 90Mb each. Surely, when sending work out one would have an idea of the returned file sizes, and either think about not sending a particular job out if there might be a space issue, or make sure that there is more than sufficient space available for the return files. |
Send message Joined: 4 Nov 18 Posts: 4 Credit: 1,329,613 RAC: 0 |
I am having the same problem, but I have 35 zip files waiting. My log says your server is out of space. 6/26/2019 10:21:56 AM | climateprediction.net | Started upload of wah2_sam50_n59k_200612_24_822_011881979_0_r1523546388_3.zip 6/26/2019 10:21:56 AM | climateprediction.net | Started upload of wah2_sam50_n59k_200612_24_822_011881979_0_r1523546388_5.zip 6/26/2019 10:21:59 AM | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space 6/26/2019 10:21:59 AM | climateprediction.net | [error] Error reported by file upload server: Server is out of disk space 6/26/2019 10:21:59 AM | climateprediction.net | Temporarily failed upload of wah2_sam50_n59k_200612_24_822_011881979_0_r1523546388_3.zip: transient upload error 6/26/2019 10:21:59 AM | climateprediction.net | Backing off 04:27:47 on upload of wah2_sam50_n59k_200612_24_822_011881979_0_r1523546388_3.zip 6/26/2019 10:21:59 AM | climateprediction.net | Temporarily failed upload of wah2_sam50_n59k_200612_24_822_011881979_0_r1523546388_5.zip: transient upload error 6/26/2019 10:21:59 AM | climateprediction.net | Backing off 05:49:53 on upload of wah2_sam50_n59k_200612_24_822_011881979_0_r1523546388_5.zip |
Send message Joined: 28 Dec 17 Posts: 18 Credit: 1,097,261 RAC: 147 |
Some have said that if you have many zip files to upload but they're not getting through to put your tasks on suspended status so they won't fail and wait until the zip files have been successfully uploaded. I only have about 12 files pending, but I've suspended mine until they make enough server space. Moderators, is this what you would suggest? |
Send message Joined: 22 Feb 06 Posts: 491 Credit: 31,254,540 RAC: 15,497 |
From the length of time this has been going on with Jasmin I would guess (perhaps incorrectly) that this is more than just a re-adjustment of quotas but an actual lack of physical hard drive space which of course takes time and money to solve. |
Send message Joined: 21 Feb 08 Posts: 47 Credit: 7,929,915 RAC: 0 |
Do we have any indication how it is going with the storage space problem? When will it be fixed? |
Send message Joined: 15 Jan 06 Posts: 637 Credit: 26,751,529 RAC: 653 |
From the length of time this has been going on with Jasmin I would guess (perhaps incorrectly) that this is more than just a re-adjustment of quotas but an actual lack of physical hard drive space which of course takes time and money to solve. I expect it is worse than that. I fear a repeat of the Big One last year. When it crashes, it crashes. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Apparently the people who look after "jasmin" have been having problems for some time. I don't know the fine details and I don't intend to ask. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Yes, Suspending all of the tasks so that you don't get even more zips in the queue is definitely recommended. |
Send message Joined: 1 Jun 17 Posts: 13 Credit: 30,617,511 RAC: 21,536 |
Wow, I picked a bad time to return to CPDN. My upload queues are choked with work that can't go anywhere. Hopefully suspending the project will help retain completed work on local machines. There are disk space warnings that make me think some work may end up being lost for good. |
Send message Joined: 13 Jul 18 Posts: 38 Credit: 62,933,508 RAC: 84,702 |
These are from the same computer. sam50 downloads are forbidden, anz50 are allowed? 2019-06-27 07:17:52 | climateprediction.net | Giving up on download of wah2_sam50_n4k0_200912_13_809_011823386.zip: permanent HTTP error 2019-06-27 08:18:30 | climateprediction.net | Finished download of wah2_anz50_n27g_201612_20_794_011765246.zip |
©2024 cpdn.org