Message boards :
Number crunching :
Unable to upload 2 zip files
Message board moderation
Previous · 1 · 2 · 3
Author | Message |
---|---|
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
About the only help available at present, is to suggest that you read the last half dozen or so posts in the News and Announcements thread at the top of this section of the board. |
Send message Joined: 20 Feb 06 Posts: 158 Credit: 1,251,176 RAC: 0 |
I had 2 zip files held in the transfer tab for phases 1 & 2. After several failures, they have now both been uploaded -- that's great. But phase 3 zip is now held there. Is the 14 day deadline still set from the original failed upload? Or is it reset to the attempt on the 3rd phase failed upload attempt? If the latter is not so, it looks as though I will have to resort to the file editing. Trickles record is at: http://climateapps2.oucs.ox.ac.uk/cpdnboinc/trickle.php?resultid=7793392 Keith |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
The timer starts at the first attempt to upload a given zip. If this gets through, then the timer for that file is deleted. In both "slab" and mid-holocene models for instance, zips are created at intervals through the modelling, so it's possible to upload the first one or two, and then turn off the Network access and prevent the 3rd (and 4th), zips from starting. If they don't start, then neither does the timer. And you can have the situation where the 1st zip fails because Network access was on, but this was turned off before the subsequent zips were created. So only the 1st zip will be lost. But the problem with this is that loss of any data reduces the usefulness of the model. Why not just make a copy of the client_state.xml file, and have a look at the copy? If the word "persistent" is in there, then the associated zip will be lost. |
Send message Joined: 20 Feb 06 Posts: 158 Credit: 1,251,176 RAC: 0 |
The timer starts at the first attempt to upload a given zip. If this gets through, then the timer for that file is deleted. My xml file shows only one persistent occurrence:- <persistent_file_xfer> <num_retries>9</num_retries> <first_request_time>1245038889.928497</first_request_time> <next_request_time>1245110912.641051</next_request_time> <time_so_far>682.988051</time_so_far> <last_bytes_xferred>0.000000</last_bytes_xferred> </persistent_file_xfer> I have set my preferences to Network activity only from 2330 BST to 0100 BST.  (This equates to 2230-0000 UTC in summer and 2330-0100 UTC in winter.) This usually gives 4 time steps per day on each task running and monitors for me that all is OK. I assume that 683 seconds is the time elapsed, but would have thought it should be 2 or 3 days. I can look up how to translate the first and next dates, but am confident I will find I have some time still to spare. Thanks for your help, as ever. Keith |
Send message Joined: 9 Jan 07 Posts: 467 Credit: 14,549,176 RAC: 317 |
I assume that 683 seconds is the time elapsed, but would have thought it should be 2 or 3 days.The 683 seconds is the time spent trying to upload (I think): as you say, it doesn't seem to relate to the time since the upload was created. I can look up how to translate the first and next dates, but am confident I will find I have some time still to spare.Don't bother: just delete everything between and including <persistent_file_xfer> and </persistent_file_xfer> - it's a lot easier! |
Send message Joined: 1 Jan 07 Posts: 943 Credit: 34,360,365 RAC: 9,337 |
First request: Mon, 15 Jun 2009 04:08:09 UTC Next request: Tue, 16 Jun 2009 00:08:32 UTC Courtesy of http://www.onlineconversion.com/unix_time.htm |
Send message Joined: 20 Feb 06 Posts: 158 Credit: 1,251,176 RAC: 0 |
I assume that 683 seconds is the time elapsed, but would have thought it should be 2 or 3 days.The 683 seconds is the time spent trying to upload (I think): as you say, it doesn't seem to relate to the time since the upload was created. Iain Quite correct. It is the 11 mins 22 secs which shows appear in the BOINC Manager Transfers log. I have tried unsuccessfully to find the right formula in Excel to convert those decimal numbers, but as you say, it will be easier to edit the XML file, and is only of academic interest. But Richard has now satisfied my curiosity ( Thank, Richard). And it seems I have until 29th June to spare, so I am fully confident that all "at the office" be running smoothly again by then!!! Keith |
Send message Joined: 7 Sep 05 Posts: 12 Credit: 601,646 RAC: 0 |
This 2 weeks long chaos reminds me of this. I wonder if O'rily works for a delivery company nowadays? |
Send message Joined: 7 Mar 06 Posts: 5 Credit: 4,085,123 RAC: 0 |
OK, Oxford has their priorities, well, I have a lot of results to upload and going on a vacation now so I guess most of them will be lost, well well Sorry, might be too late yet but I forgot to mention something important. You have to delete all CPDN related files and folders before you restart the client, remember, you've got a back up. Sorry for that. |
Send message Joined: 17 Feb 09 Posts: 31 Credit: 1,413,015 RAC: 58 |
Looks like I lost one of those files on Day 12; 17/06/2009 12:00:36 PM climateprediction.net Started upload of hadam3p_mwsa_1997_2_006074684_3_3.zip 17/06/2009 12:00:41 PM climateprediction.net [error] Error reported by file upload server: no command 17/06/2009 12:00:41 PM climateprediction.net Giving up on upload of hadam3p_mwsa_1997_2_006074684_3_3.zip: permanent upload error (Times above are UTC-4) I thought I had a couple more days as mo.v said Its PSU failed on Friday 5 June, so the 2-week BOINC time limit for retrying failed uploads won't be reached until Friday 19 June It is no longer in my transfer tab and the work unit is no longer on my task list but I did get these messages a few hours later ... 17/06/2009 7:54:16 PM climateprediction.net Reporting 1 completed tasks, not requesting new tasks 17/06/2009 7:56:23 PM Project communication failed: attempting access to reference site 17/06/2009 7:56:24 PM Internet access OK - project servers may be temporarily down. 17/06/2009 7:56:26 PM climateprediction.net Scheduler request failed: Failure when receiving data from the peer 17/06/2009 7:57:26 PM climateprediction.net Sending scheduler request: To send trickle-up message. 17/06/2009 7:57:26 PM climateprediction.net Reporting 1 completed tasks, not requesting new tasks 17/06/2009 8:00:01 PM climateprediction.net Scheduler request completed: got 0 new tasks I will suspend the next one before it finishes but where do we stand currently with the server issues here at CPDN? Edit: ... I have to learn to read the News and Announcement Thread first! Rick |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
1) There is still a server problem. 2) Milo was attempting to reroute the url to another server so that he could work on the faulty server. 3) The reroute didn't work. 4) Anyone rushing in to upload because they saw that the server status was green has probably lost the file. 5) Appache has been turned off on the servers to stop people sending more files. 6) Working hours start again soon at Oxford. 7) People WILL be told in the News threads here and here when it's OK to upload again. Backups: Here |
Send message Joined: 6 Aug 04 Posts: 264 Credit: 965,476 RAC: 0 |
I just leave BOINC do its work and never interfere. It started an upload of file hadam3p_n3k9_1970_2_006153107_2_3.zip which disappeared from my BOINC manager tab and I assumed all had gone well. Now I read that this file may have been lost because the upload server was not really working. I had to restart the manager due to a CPDN Beta bug and cannot check its past messages. But Task id 9057337 was received at 14:57:43 UTC on June 17 and was granted 1,982.64 credits, so all seems to be OK. Is it? Tullio |
Send message Joined: 2 Mar 06 Posts: 253 Credit: 363,646 RAC: 0 |
But Task id 9057337 was received at 14:57:43 UTC on June 17 and was granted 1,982.64 credits, so all seems to be OK. Is it? Trickles go to a different server and so you'll get credits, although that particular file seems to have been lost along with a small number of others. Please don't worry about this missing data as we should still have enough; a very small percentage of files are occasionally lost or corrupted on upload anyway and this is not an insurmountable problem for the physicists. |
Send message Joined: 6 Aug 04 Posts: 264 Credit: 965,476 RAC: 0 |
Thanks Milo. I am glad to know that nothing gets lost. CPDN tasks are among he longest running and I backup the BOINC directory every week on a flash memory cartridge. But I still miss the "dump" and "restore" commands of Berkeley UNIX I had in the eighties on an ONYX computer. Tullio |
Send message Joined: 29 Sep 04 Posts: 2363 Credit: 14,611,758 RAC: 0 |
Milo now has a replacement server for uploader1.atm up and running. Please see the News thread for updates on the current much improved situation and changed advice. Cpdn news |
Send message Joined: 5 Aug 04 Posts: 1496 Credit: 95,522,203 RAC: 0 |
. . . I had to restart the manager due to a CPDN Beta bug and cannot check its past messages. . . Tullio, Old Messages are archived in stdoutdae.txt file in the boinc data folder. The file can get quote large. (When the file gets too big, boinc renames it stdoutdae.old and starts a new one.) |
Send message Joined: 6 Aug 04 Posts: 264 Credit: 965,476 RAC: 0 |
Tullio, Yes, thanks. It had signaled an error. Tullio |
©2024 climateprediction.net