Message boards : Number crunching : ANOTHER UPLOAD PROBLEM
Message board moderation
Author | Message |
---|---|
Send message Joined: 31 Dec 07 Posts: 1152 Credit: 22,363,583 RAC: 5,022 |
Upload problem. Last week I downloaded a WU hadam3p_pnw_7028_2003_1_007595320_2. It is a reissue on its third go round. Everything went fine and it finished crunching in 121 hours. The problem is that zip file 13 is stuck in the transfer tab. Relevant messages are as follows: 11/20/2013 2:20:45 PM | climateprediction.net | Started upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip 11/20/2013 2:22:41 PM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_7028_2003_1_007595320_2_13.zip: No such file or directory 11/20/2013 2:22:41 PM | climateprediction.net | Temporarily failed upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip: transient upload error 11/20/2013 2:22:41 PM | climateprediction.net | Backing off 04:20:03 on upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip 11/20/2013 2:51:08 PM | climateprediction.net | Sending scheduler request: To send trickle-up message. 11/20/2013 2:51:08 PM | climateprediction.net | Requesting new tasks for CPU 11/20/2013 2:51:11 PM | climateprediction.net | Scheduler request completed: got 0 new tasks 11/20/2013 2:51:11 PM | climateprediction.net | Project has no tasks available 11/20/2013 3:51:51 PM | climateprediction.net | Sending scheduler request: To send trickle-up message. 11/20/2013 3:51:51 PM | climateprediction.net | Requesting new tasks for CPU 11/20/2013 3:51:54 PM | climateprediction.net | Scheduler request completed: got 0 new tasks 11/20/2013 3:51:54 PM | climateprediction.net | Project has no tasks available 11/20/2013 6:42:45 PM | climateprediction.net | Started upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip 11/20/2013 6:44:52 PM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_7028_2003_1_007595320_2_13.zip: No such file or directory 11/20/2013 6:44:52 PM | climateprediction.net | Temporarily failed upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip: transient upload error 11/20/2013 6:44:52 PM | climateprediction.net | Backing off 05:26:44 on upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip 11/20/2013 7:04:09 PM | climateprediction.net | Sending scheduler request: To send trickle-up message. 11/20/2013 7:04:09 PM | climateprediction.net | Requesting new tasks for CPU 11/20/2013 7:04:13 PM | climateprediction.net | Scheduler request completed: got 0 new tasks 11/20/2013 7:04:13 PM | climateprediction.net | Project has no tasks available 11/21/2013 12:11:37 AM | climateprediction.net | Started upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip 11/21/2013 12:13:37 AM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_7028_2003_1_007595320_2_13.zip: No such file or directory 11/21/2013 12:13:37 AM | climateprediction.net | Temporarily failed upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip: transient upload error 11/21/2013 12:13:37 AM | climateprediction.net | Backing off 04:02:29 on upload of hadam3p_pnw_7028_2003_1_007595320_2_13.zip As you can see file seems to upload fine, reaching the 100% mark and then the upload fails with the can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_7028_2003_1_007595320_2_13.zip: No such file or directory message. Is there a way to save this WU or is it another case of the server sending old reissues that are missing files. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
That is a problem with the re-start server at Oxford. I'll send them an email, but in the meantime, the thing to remember is: DON'T PANIC (In big friendly letters). (The Hitch Hiker's Guide to the Galaxy.) |
Send message Joined: 31 Dec 07 Posts: 1152 Credit: 22,363,583 RAC: 5,022 |
DON'T PANIC (In big friendly letters). [/quote] Thanks Les. I�ll take my own advise to someone else and �Chill Out.� There is no hurry and hopefully they can sort it out at Oxford. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Andy is looking into this. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Andy says: This restart server has now been rebooted, could you confirm with them whether they are still have an issue. So, how is it now? |
Send message Joined: 31 Dec 07 Posts: 1152 Credit: 22,363,583 RAC: 5,022 |
Sorry, no joy. The file is still stuck in the transfer tab. Same error messages. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Another email then. Sigh. |
Send message Joined: 22 Aug 09 Posts: 5 Credit: 1,783,296 RAC: 0 |
AHA !! Another CPDN User to commiserate over the same Error Condition... One that I've been afflicted with for the better part of a Month, and posted about on a pair of occasions... Upload starts - 33.96MB size Upload progressing at ~150KBps Upload progresses to 100.00% Upload FAILED - Retry in xx:xx:xx Log Excerpt: 11/22/2013 9:30:53 AM | climateprediction.net | Started upload of hadam3p_eu_qdje_2005_1_008343335_1_13.zip 11/22/2013 9:34:39 AM | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_qdje_2005_1_008343335_1_13.zip: No such file or directory 11/22/2013 9:34:39 AM | climateprediction.net | Temporarily failed upload of hadam3p_eu_qdje_2005_1_008343335_1_13.zip: transient upload error 11/22/2013 9:34:39 AM | climateprediction.net | Backing off 5 hr 26 min 21 sec on upload of hadam3p_eu_qdje_2005_1_008343335_1_13.zip It hasn't harmed my CPDN efforts, nor pushed me over any ISP Data Limits, but it would be GREAT to see it resolved... |
Send message Joined: 31 Dec 07 Posts: 1152 Credit: 22,363,583 RAC: 5,022 |
Yes, it does seem to be the same problem. It is a bit discouraging that it has going on for a month without resolution. Maybe now that it is no longer lumped in with the problem in �persistent upload problems� we can find a fix for this one. We are going to need it if more Hadam3p�s are coming as rumored. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
OK. No "good news, bad news". More like "interesting observation, bad news". Jim Your model was first issued back at the end of 2011, where, I suspect, the first person to get it had the same problem as you, and it timed out. seigell Yours is "more interesting". If you look at the trickle list, you'll see an extra trickle near the start. And if you look at the trickle list for the other person that ran it, there were 2 extra trickles at the end. And it crashed at the end too, possible saving having to work out what was wrong then. My guess is that both of these data sets had/have a problem, and that both of them should be aborted. In the case of Jim's, it shouldn't be re-issued again. But there's one more re-issue due for seigell's model, so this will probably get revisited in a years time. Unless the server upgrade allows for these old data sets to be blocked. |
Send message Joined: 31 Dec 07 Posts: 1152 Credit: 22,363,583 RAC: 5,022 |
Done, task aborted. Shame it couldn't be saved. Thanks for the help. |
Send message Joined: 22 Aug 09 Posts: 5 Credit: 1,783,296 RAC: 0 |
Comparing the Trickle list of my execution of this WU to that of the other Computer, there are a few oddities as well as what you called out:
Both Computers produced same initial and "near-final" Trickles at same Timesteps. My Computer performed 1 Trickle at a Timestep beyond where the Other Computer stopped.
|
Send message Joined: 21 Aug 11 Posts: 10 Credit: 26,553,404 RAC: 1,491 |
Same issue with this unit. Should I abort? http://climateapps2.oerc.ox.ac.uk/cpdnboinc/workunit.php?wuid=7768213 mar 26 nov 2013 15:28:08 CET climateprediction.net Started upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip mar 26 nov 2013 15:28:44 CET climateprediction.net [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: No such file or directory mar 26 nov 2013 15:28:44 CET climateprediction.net Temporarily failed upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: transient upload error mar 26 nov 2013 15:28:44 CET climateprediction.net Backing off 2 hr 6 min 9 sec on upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip mar 26 nov 2013 17:34:53 CET climateprediction.net Started upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip mar 26 nov 2013 17:35:30 CET climateprediction.net [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: No such file or directory mar 26 nov 2013 17:35:30 CET climateprediction.net Temporarily failed upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: transient upload error mar 26 nov 2013 17:35:30 CET climateprediction.net Backing off 2 hr 38 min 0 sec on upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip mar 26 nov 2013 20:13:31 CET climateprediction.net Started upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip mar 26 nov 2013 20:14:07 CET climateprediction.net [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: No such file or directory mar 26 nov 2013 20:14:07 CET climateprediction.net Temporarily failed upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: transient upload error mar 26 nov 2013 20:14:07 CET climateprediction.net Backing off 1 hr 34 min 2 sec on upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip mar 26 nov 2013 21:35:50 CET climateprediction.net Started upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip mar 26 nov 2013 21:36:24 CET climateprediction.net [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: No such file or directory mar 26 nov 2013 21:36:24 CET climateprediction.net Temporarily failed upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip: transient upload error mar 26 nov 2013 21:36:24 CET climateprediction.net Backing off 8 min 55 sec on upload of hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Now that more people are reporting on this, I'm going to have a think about it for a while. There may be something subtle going on. (The server is reported as working.) |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Trotador Could you please have a look in client_state.xml with notepad, (better still, a copy of it :) ), look for the string 6w0r, and keep looking until you reach the line for zip13. Then, a few lines earlier, there'll be a line ending in file_upload_handler. Copy this line and paste it here. This will tell me the exact url to which BOINC is trying to send the file. Thanks. |
Send message Joined: 21 Aug 11 Posts: 10 Credit: 26,553,404 RAC: 1,491 |
Trotador this one? <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083.zip</name> <nbytes>12766.000000</nbytes> <max_nbytes>0.000000</max_nbytes> <md5_cksum>582a163389f911283352728c384377d6</md5_cksum> <status>1</status> <url>http://cpdn-downloads.oerc.ox.ac.uk/download/hadam3p/hadam3p_pnw_6w0r_2002_1_007590083.zip</url> </file_info> <file_info> <name>ic19611201_10_N96.gz</name> <nbytes>1312884.000000</nbytes> <max_nbytes>0.000000</max_nbytes> <md5_cksum>aec9660d191182affe1d98eeda2d6abe</md5_cksum> <status>1</status> <url>http://cpdn-downloads.oerc.ox.ac.uk/download/hadam3p/ancil/mirror.php?file=ic19611201_10_N96.gz</url> </file_info> <file_info> <name>xaclfa.start.0000.gz</name> <nbytes>26657809.000000</nbytes> <max_nbytes>0.000000</max_nbytes> <md5_cksum>a4a3d4947da96f3f37dff5c0878407c0</md5_cksum> <status>1</status> <url>http://cpdn-downloads.oerc.ox.ac.uk/download/hadam3p/ancil/mirror.php?file=xaclfa.start.0000.gz</url> </file_info> <file_info> <name>dchaba.start.pnw.b.0000.gz</name> <nbytes>6083952.000000</nbytes> <max_nbytes>0.000000</max_nbytes> <md5_cksum>2f3d1c3e97c7eb668d15f3cb4e7e5fbc</md5_cksum> <status>1</status> <url>http://cpdn-downloads.oerc.ox.ac.uk/download/hadam3p/ancil/mirror.php?file=dchaba.start.pnw.b.0000.gz</url> </file_info> <file_info> <name>HadISST_SI_N96_2002_12_2004_01f.gz</name> <nbytes>1085060.000000</nbytes> <max_nbytes>0.000000</max_nbytes> <md5_cksum>ca7d7f7c03b72c5b027071ce157bbe86</md5_cksum> <status>1</status> <url>http://cpdn-downloads.oerc.ox.ac.uk/download/hadam3p/ancil/mirror.php?file=HadISST_SI_N96_2002_12_2004_01f.gz</url> </file_info> <file_info> <name>HadISST_SST_N96_2002_12_2004_01f.gz</name> <nbytes>3893018.000000</nbytes> <max_nbytes>0.000000</max_nbytes> <md5_cksum>8b234747ed142e60d75242a5b2cf1c3f</md5_cksum> <status>1</status> <url>http://cpdn-downloads.oerc.ox.ac.uk/download/hadam3p/ancil/mirror.php?file=HadISST_SST_N96_2002_12_2004_01f.gz</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_1.zip</name> <nbytes>7563497.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>339d82aa5b1763cde20d2388681a5f39</md5_cksum> <generated_locally/> <status>0</status> <uploaded/> <upload_when_present/> <url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_2.zip</name> <nbytes>7577967.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>9e280e9af5046245a5681f1f95bc1d9d</md5_cksum> <generated_locally/> <status>0</status> <uploaded/> <upload_when_present/> <url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_3.zip</name> <nbytes>7657353.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>a20b7679b13537c530b5595b3113b464</md5_cksum> <generated_locally/> <status>0</status> <uploaded/> <upload_when_present/> <url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_4.zip</name> <nbytes>7737615.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>07595e77fffc4033bfaacba8d6597597</md5_cksum> <generated_locally/> <status>0</status> <uploaded/> <upload_when_present/> <url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_5.zip</name> <nbytes>7785628.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>0e9e3fe10610d31f93d4224d11a3bfba</md5_cksum> <generated_locally/> <status>0</status> <uploaded/> <upload_when_present/> <url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_6.zip</name> <nbytes>7713417.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>1e736f1ea5006028fcf796ae5cf2df53</md5_cksum> <generated_locally/> <status>0</status> <uploaded/> <upload_when_present/> <url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_7.zip</name> <nbytes>7711829.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>296ef500ea92f563f31340e80b2a68e9</md5_cksum> <generated_locally/> <status>0</status> <uploaded/> <upload_when_present/> <url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_8.zip</name> <nbytes>7707894.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>9b091c143608b03a7ba633cac0dccfd3</md5_cksum> <generated_locally/> <status>0</status> <uploaded/> <upload_when_present/> <url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_9.zip</name> <nbytes>7800310.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>9ec5a615dfcac482a7e7c93cf421607d</md5_cksum> <generated_locally/> <status>0</status> <uploaded/> <upload_when_present/> <url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_10.zip</name> <nbytes>7853736.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>602dc898a4537497b79d4c39b9f583e9</md5_cksum> <generated_locally/> <status>0</status> <uploaded/> <upload_when_present/> <url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_11.zip</name> <nbytes>7896535.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>f36058919a4a856648010be9e23e2139</md5_cksum> <generated_locally/> <status>0</status> <uploaded/> <upload_when_present/> <url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_12.zip</name> <nbytes>8044336.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>1fea2126fd65965d676e4e60ef50fdfe</md5_cksum> <generated_locally/> <status>0</status> <uploaded/> <upload_when_present/> <url>http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler</url> </file_info> <file_info> <name>hadam3p_pnw_6w0r_2002_1_007590083_2_13.zip</name> <nbytes>33737443.000000</nbytes> <max_nbytes>150000000.000000</max_nbytes> <md5_cksum>44c55ea026ea604749cc9ff8592c7fad</md5_cksum> <generated_locally/> <status>1</status> <upload_when_present/> <url>http://cpdn-restarts.oerc.ox.ac.uk/cgi-bin/file_upload_handler</url> <persistent_file_xfer> <num_retries>28</num_retries> <first_request_time>1385379856.550667</first_request_time> <next_request_time>1385534194.430921</next_request_time> <time_so_far>1044.810202</time_so_far> <last_bytes_xferred>33737658.000000</last_bytes_xferred> </persistent_file_xfer> </file_info> |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
Yes, that's it. Unfortunately it looks OK, so I'm now out of ideas. I've just posted to our email forum, so I'll now wait to see if anyone else has an idea. |
Send message Joined: 27 Aug 04 Posts: 15 Credit: 1,163,443 RAC: 0 |
Hello! Looks like I'm having the same problem like the others. After there seems to be no conclusion in almost two weeks and the file already tried to upload for 15 hours I finally came to look here if there's something I can do. 27.11.2013 08:18:18 | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/cpdn-restarts/incoming/uploader/hadam3p_eu_qic1_1999_1_008397041_0_13.zip: No such file or directory 27.11.2013 08:18:18 | climateprediction.net | Temporarily failed upload of hadam3p_eu_qic1_1999_1_008397041_0_13.zip: transient upload error I assume I can cancel the unit also? Edit: I finally see that the referring task already has it's full credits, so I guess the upload really isn't necessary anymore. Life is Science, and Science rules. To the universe and beyond Proud member of BOINC@Heidelberg My BOINCstats-Sig |
Send message Joined: 9 Sep 04 Posts: 228 Credit: 30,808,817 RAC: 3,394 |
My wu (and Trickle 13) http://climateapps2.oerc.ox.ac.uk/cpdnboinc/result.php?resultid=16078667 has been sent. Thanks |
Send message Joined: 1 Jan 07 Posts: 1061 Credit: 36,748,059 RAC: 5,647 |
Edit: The upload file contains the scientific information of use to the researchers, so the awarding of credit is very far from the end of the story - please give it at least one more try. Andy Bowery has written: I think this has been fixed now. The server which receives these files wasn't correctly mounting the directory where these files are received. It is mounted now so these should be coming in correctly now. (that was about 2 hours ago. I suspect the server may have switched from 'not responding' to 'very busy' in the meantime - check for changed error messages if it doesn't go at the next attempt, and please keep trying if that message shows that things have changed) |
©2024 cpdn.org