Message boards :
Number crunching :
Upload problem
Message board moderation
Previous · 1 · 2 · 3 · 4 · Next
Author | Message |
---|---|
Send message Joined: 31 Aug 04 Posts: 1 Credit: 36,628 RAC: 0 |
Perhaps it could help the debugging process if you (temporarily) turn on some other logging flags. I'm afraid that I'll not be able to help analyzing the output, but perhaps someone else is. I did use the following flags: <log_flags> <file_xfer_debug>1</file_xfer_debug> <http_debug>1</http_debug> <http_xfer_debug>1</http_xfer_debug> </log_flags> Gruß, Gundolf PS: you can use the "quote" link to get the formatting. [pre] and [code] don't work correctly here at CPDN ;-)[edit]Turned the flags on[/edit] Computer sind nicht alles im Leben. (Kleiner Scherz) |
Send message Joined: 9 Aug 04 Posts: 25 Credit: 4,756,979 RAC: 0 |
Most of the time the upload goes up to 1.09 MB when it stucks, so smaller zip files will upload without problems. I don't know if this will help, but I had a similar problem a year or two ago. It turned out to be with a device called a Riverbed, which is a network caching server, which needed to be reset. This was installed to cut down on interoffice network traffic (a lot of it repetitive), but it was also set inadvertently to cache internet traffic, and started causing trouble with CPDN uploads. If you have one of these at your location, maybe it could be the problem. |
Send message Joined: 31 Aug 04 Posts: 27 Credit: 1,523,155 RAC: 0 |
Here is the debug-info for one upload try with all debugging switches on: Perhaps someone can read this? The error occurs at 21:57:41 after 30 seconds of transferring 1.09 MB data. The whole transfer volume should be 5.503.377 bytes 07.08.2010 21:57:09 climateprediction.net [fxd] starting upload, upload_offset -1 07.08.2010 21:57:09 [http_debug] HTTP_OP::libcurl_exec(): ca-bundle 'C:\Program Files\BOINC\ca-bundle.crt' 07.08.2010 21:57:09 [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set 07.08.2010 21:57:09 climateprediction.net Started upload of famous_u4hm_1799_200_006638661_0_3.zip 07.08.2010 21:57:09 climateprediction.net [file_xfer_debug] URL: http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler 07.08.2010 21:57:10 [http_debug] [ID#30] Info: timeout on name lookup is not supported 07.08.2010 21:57:10 [http_debug] [ID#30] Info: About to connect() to uploader.oerc.ox.ac.uk port 80 (#0) 07.08.2010 21:57:10 [http_debug] [ID#30] Info: Trying 163.1.124.170... 07.08.2010 21:57:10 [http_debug] [ID#30] Info: Connected to uploader.oerc.ox.ac.uk (163.1.124.170) port 80 (#0) 07.08.2010 21:57:10 [http_debug] [ID#30] Sent header to server: POST /cpdn_cgi/file_upload_handler HTTP/1.0 07.08.2010 21:57:10 [http_debug] [ID#30] Sent header to server: User-Agent: BOINC client (windows_intelx86 6.10.58) 07.08.2010 21:57:10 [http_debug] [ID#30] Sent header to server: Host: uploader.oerc.ox.ac.uk 07.08.2010 21:57:10 [http_debug] [ID#30] Sent header to server: Accept: */* 07.08.2010 21:57:10 [http_debug] [ID#30] Sent header to server: Accept-Encoding: deflate, gzip 07.08.2010 21:57:10 [http_debug] [ID#30] Sent header to server: Content-Type: application/x-www-form-urlencoded 07.08.2010 21:57:10 [http_debug] [ID#30] Sent header to server: Content-Length: 292 07.08.2010 21:57:10 [http_debug] [ID#30] Sent header to server: 07.08.2010 21:57:10 [http_debug] [ID#30] Received header from server: HTTP/1.1 200 OK 07.08.2010 21:57:10 [http_debug] [ID#30] Received header from server: Date: Sat, 07 Aug 2010 19:57:15 GMT 07.08.2010 21:57:10 [http_debug] [ID#30] Received header from server: Server: Apache/2.2.13 (Linux/SUSE) 07.08.2010 21:57:10 [http_debug] [ID#30] Received header from server: Connection: close 07.08.2010 21:57:10 [http_debug] [ID#30] Received header from server: Content-Type: text/plain 07.08.2010 21:57:10 [http_debug] [ID#30] Received header from server: 07.08.2010 21:57:10 [http_xfer_debug] [ID#30] HTTP: wrote 93 bytes 07.08.2010 21:57:10 [http_debug] [ID#30] Info: Expire cleared 07.08.2010 21:57:10 [http_debug] [ID#30] Info: Closing connection #0 07.08.2010 21:57:11 climateprediction.net [file_xfer_debug] FILE_XFER_SET::poll(): http op done; retval 0 07.08.2010 21:57:11 climateprediction.net [file_xfer_debug] parsing upload response: <data_server_reply> <status>0</status> <file_size>0</file_size></data_server_reply> 07.08.2010 21:57:11 climateprediction.net [file_xfer_debug] parsing status: 0 07.08.2010 21:57:11 climateprediction.net [fxd] starting upload, upload_offset 0 07.08.2010 21:57:11 [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set 07.08.2010 21:57:11 [http_debug] [ID#30] Info: timeout on name lookup is not supported 07.08.2010 21:57:11 [http_debug] [ID#30] Info: About to connect() to uploader.oerc.ox.ac.uk port 80 (#0) 07.08.2010 21:57:11 [http_debug] [ID#30] Info: Trying 163.1.124.170... 07.08.2010 21:57:11 [http_debug] [ID#30] Info: Connected to uploader.oerc.ox.ac.uk (163.1.124.170) port 80 (#0) 07.08.2010 21:57:11 [http_debug] [ID#30] Sent header to server: POST /cpdn_cgi/file_upload_handler HTTP/1.0 07.08.2010 21:57:11 [http_debug] [ID#30] Sent header to server: User-Agent: BOINC client (windows_intelx86 6.10.58) 07.08.2010 21:57:11 [http_debug] [ID#30] Sent header to server: Host: uploader.oerc.ox.ac.uk 07.08.2010 21:57:11 [http_debug] [ID#30] Sent header to server: Accept: */* 07.08.2010 21:57:11 [http_debug] [ID#30] Sent header to server: Accept-Encoding: deflate, gzip 07.08.2010 21:57:11 [http_debug] [ID#30] Sent header to server: Content-Type: application/x-www-form-urlencoded 07.08.2010 21:57:11 [http_debug] [ID#30] Sent header to server: Content-Length: 5503377 07.08.2010 21:57:11 [http_debug] [ID#30] Sent header to server: 07.08.2010 21:57:41 [http_debug] [ID#30] Info: Expire cleared 07.08.2010 21:57:41 [http_debug] [ID#30] Info: Closing connection #0 07.08.2010 21:57:41 [http_debug] HTTP error: Failure when receiving data from the peer 07.08.2010 21:57:42 Project communication failed: attempting access to reference site 07.08.2010 21:57:42 [http_debug] HTTP_OP::init_get(): http://www.google.com/ 07.08.2010 21:57:42 [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set 07.08.2010 21:57:42 climateprediction.net [file_xfer_debug] FILE_XFER_SET::poll(): http op done; retval -184 07.08.2010 21:57:42 climateprediction.net [file_xfer_debug] file transfer status -184 07.08.2010 21:57:42 climateprediction.net Temporarily failed upload of famous_u4hm_1799_200_006638661_0_3.zip: HTTP error 07.08.2010 21:57:42 climateprediction.net [file_xfer_debug] project-wide xfer delay for 4627.819721 sec 07.08.2010 21:57:42 climateprediction.net Backing off 2 hr 47 min 46 sec on upload of famous_u4hm_1799_200_006638661_0_3.zip |
Send message Joined: 31 Aug 04 Posts: 27 Credit: 1,523,155 RAC: 0 |
Is there anybody who can have a look at the debug of the uploading error, please? Now there are 10 files which stuck. :-( |
Send message Joined: 3 Oct 06 Posts: 43 Credit: 8,017,057 RAC: 0 |
This thread suggests it could be a server-problem. http://128.32.18.189/dev/forum_thread.php?id=5541 |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
The debug messages don't mean anything to me, but I'm not too familiar with network problems. I'm not having any problems uploading zips to cpdn. |
Send message Joined: 31 Aug 04 Posts: 27 Credit: 1,523,155 RAC: 0 |
Now I tried the same with my VPN connection and a proxy server defined: Same result :-( 12.08.2010 19:13:15 climateprediction.net [fxd] starting upload, upload_offset 2932378 12.08.2010 19:13:15 [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set 12.08.2010 19:13:15 [http_debug] [ID#35] Info: timeout on name lookup is not supported 12.08.2010 19:13:15 [http_debug] [ID#35] Info: About to connect() to proxy 195.127.234.115 port 8080 (#0) 12.08.2010 19:13:15 [http_debug] [ID#35] Info: Trying 195.127.234.115... 12.08.2010 19:13:16 [http_debug] [ID#35] Info: Connected to 195.127.234.115 (195.127.234.115) port 8080 (#0) 12.08.2010 19:13:16 [http_debug] [ID#35] Sent header to server: POST http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler HTTP/1.0 12.08.2010 19:13:16 [http_debug] [ID#35] Sent header to server: User-Agent: BOINC client (windows_intelx86 6.10.58) 12.08.2010 19:13:16 [http_debug] [ID#35] Sent header to server: Host: cpdn-upload1.comlab.ox.ac.uk 12.08.2010 19:13:16 [http_debug] [ID#35] Sent header to server: Accept: */* 12.08.2010 19:13:16 [http_debug] [ID#35] Sent header to server: Accept-Encoding: deflate, gzip 12.08.2010 19:13:16 [http_debug] [ID#35] Sent header to server: Proxy-Connection: Keep-Alive 12.08.2010 19:13:16 [http_debug] [ID#35] Sent header to server: Content-Type: application/x-www-form-urlencoded 12.08.2010 19:13:16 [http_debug] [ID#35] Sent header to server: Content-Length: 2568847 12.08.2010 19:13:16 [http_debug] [ID#35] Sent header to server: 12.08.2010 19:13:43 [http_debug] [ID#35] Info: Expire cleared 12.08.2010 19:13:43 [http_debug] [ID#35] Info: Closing connection #0 12.08.2010 19:13:43 [http_debug] HTTP error: Failure when receiving data from the peer 12.08.2010 19:13:44 Project communication failed: attempting access to reference site 12.08.2010 19:13:44 [http_debug] HTTP_OP::init_get(): http://www.google.com/ 12.08.2010 19:13:44 [http_debug] HTTP_OP::libcurl_exec(): ca-bundle set 12.08.2010 19:13:44 climateprediction.net [file_xfer_debug] FILE_XFER_SET::poll(): http op done; retval -184 12.08.2010 19:13:44 climateprediction.net [file_xfer_debug] file transfer status -184 12.08.2010 19:13:44 climateprediction.net Temporarily failed upload of famous_u4hm_1799_200_006638661_0_11.zip: HTTP error so I think it has nothing to do with MY internet connection but with the upload servers. Other uploads and downloads work fine with this proxy server and VPN, i.e. to Chess960@home. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
|
Send message Joined: 31 Aug 04 Posts: 27 Credit: 1,523,155 RAC: 0 |
Sometimes it works, so this night one upload file (2.5 MB, HADAM) was sucessfully uploaded. :-) But still 10 stuck. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
|
Send message Joined: 31 Aug 04 Posts: 27 Credit: 1,523,155 RAC: 0 |
On boincsimap I got the same problem that the upload (~ 25 MB) stucks after a while. But on this site the next try started where the previous stuck, so the file has been uploaded completely after several tries. On CPDN the next try starts most the time at the beginning so that I'm not able to upload the files completely. Perhaps this could be the solution to do it the same way as boincsimap does or is there an error in this mechanism? |
Send message Joined: 31 Aug 04 Posts: 27 Credit: 1,523,155 RAC: 0 |
I made a strange observation today: when I throttle down the upload speed to 15 Kbps, I was able to upload all of the 7 files after a while and several tries. Normally the upload speed with my home internet connection is about 95 Kbps. Perhaps this gives you an idea what is going wrong with the upload. So at the moment all files have been uploaded and I think that is the solution for the moment. |
Send message Joined: 4 Oct 09 Posts: 73 Credit: 7,242,427 RAC: 0 |
A server is out of disk space - when trying to upload final zip file #13 for task "v5q2". Error first appeared 7 hours ago. But note that an intermediate zip file (#3) uploaded ok for task "v5me" presumably to a different server. 09/09/2010 07:29:04 climateprediction.net Sending scheduler request: To send trickle-up message. 09/09/2010 07:29:04 climateprediction.net Not reporting or requesting tasks 09/09/2010 07:29:05 climateprediction.net Started upload of hadam3p_pnw_v5me_1998_1_006723343_0_3.zip 09/09/2010 07:29:05 climateprediction.net Scheduler request completed 09/09/2010 07:30:04 climateprediction.net Finished upload of hadam3p_pnw_v5me_1998_1_006723343_0_3.zip 09/09/2010 07:31:42 climateprediction.net Started upload of hadam3p_pnw_v5q2_1985_1_006681048_0_13.zip 09/09/2010 07:31:43 climateprediction.net [error] Error reported by file upload server: Server is out of disk space 09/09/2010 07:31:43 climateprediction.net Temporarily failed upload of hadam3p_pnw_v5q2_1985_1_006681048_0_13.zip: transient upload error 09/09/2010 07:31:43 climateprediction.net Backing off 2 hr 25 min 55 sec on upload of hadam3p_pnw_v5q2_1985_1_006681048_0_13.zip Is the target upload server name recorded somewhere in the BOINC files? Pity there is no way to suspend transfers only without having to disable the network. Even better, suspending individual files so active servers can still receive other files (as in above example). Server status all green (otherwise would have known which server is down!). |
Send message Joined: 16 Jan 10 Posts: 1081 Credit: 7,079,827 RAC: 6,030 |
A server is out of disk space - when trying to upload final zip file #13 for task "v5q2". Error first appeared 7 hours ago. Thanks, Ian. Message passed on. |
Send message Joined: 5 Sep 04 Posts: 7629 Credit: 24,240,330 RAC: 0 |
"iansm" wrote: Is the target upload server name recorded somewhere in the BOINC files?Yes. In client_state.xml 1st, search for the model name. Then keep doing this, but look at the lines above until you see upload towards the right hand end. Keep going until you are just past the relevant zip file number, then look at the 1st part of the upload line. This will have the server name. e.g. oerc |
Send message Joined: 4 Oct 09 Posts: 73 Credit: 7,242,427 RAC: 0 |
Thanks, Les. Now located the upload server URL lines in every zip file (in the file_info blocks). Should have known this. The URL in the "file upload_handler" line (for the stuck task) does not appear to be included in the server status page. viz. <url> http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler </url> Did further searches using the "file upload_handler" string. Examples found: <url>http://cpdn-upload1.comlab.ox.ac.uk/cgi-bin/file_upload_handler</url> <url>http://uploader.oerc.ox.ac.uk/cpdn_cgi/file_upload_handler</url> <url>http://uploader1.atm.ox.ac.uk/cpdn_cgi/file_upload_handler</url> <url>http://climateapps1.oucs.ox.ac.uk/cgi-bin/file_upload_handler</url> That's 4 from the 7 upload servers listed. All Oxford servers. So zip files may go elsewhere then. Directly to the customer. Next, I entered the entire URL in the browser and got this <data_server_reply> <status>1</status> <message>no command</message> </data_server_reply> which may suggest the server is "awake"? Then forced a file transfer...and it's going again...now finished. 3 cheers. Another one bites the dust. Good, learned something new - remote servers (outside Oxford) may cause hold-ups (as servers do) but not reported on the status page. Thanks again for pointing me to the server url lines. |
Send message Joined: 2 Mar 06 Posts: 253 Credit: 363,646 RAC: 0 |
I've added that one to the status page, although I can't guarantee that the result will always be accurate. |
Send message Joined: 12 Mar 10 Posts: 4 Credit: 455,298 RAC: 0 |
Hi there I am trying to upload result files: Fri 10 Sep 2010 23:49:42 NZST climateprediction.net Started upload of hadam3p_pnw_v45i_1965_1_006679012_0_1.zip Fri 10 Sep 2010 23:49:44 NZST climateprediction.net Project file upload handler is missing Fri 10 Sep 2010 23:49:44 NZST climateprediction.net Backing off 2 hr 26 min 5 sec on upload of hadam3p_pnw_v45i_1965_1_006679012_0_1.zip Fri 10 Sep 2010 23:55:46 NZST climateprediction.net Started upload of hadam3p_pnw_v45i_1965_1_006679012_0_1.zip Fri 10 Sep 2010 23:55:48 NZST climateprediction.net Project file upload handler is missing Fri 10 Sep 2010 23:55:48 NZST climateprediction.net Backing off 3 min 21 sec on upload of hadam3p_pnw_v45i_1965_1_006679012_0_1.zip Fri 10 Sep 2010 23:56:00 NZST climateprediction.net Started upload of hadam3p_pnw_v45i_1965_1_006679012_0_1.zip Fri 10 Sep 2010 23:56:01 NZST climateprediction.net Project file upload handler is missing Fri 10 Sep 2010 23:56:01 NZST climateprediction.net Backing off 1 hr 11 min 24 sec on upload of hadam3p_pnw_v45i_1965_1_006679012_0_1.zip Fri 10 Sep 2010 23:56:02 NZST climateprediction.net Started upload of hadam3p_pnw_v45i_1965_1_006679012_0_2.zip Fri 10 Sep 2010 23:56:03 NZST climateprediction.net Project file upload handler is missing Fri 10 Sep 2010 23:56:03 NZST climateprediction.net Backing off 2 hr 13 min 0 sec on upload of hadam3p_pnw_v45i_1965_1_006679012_0_2.zip Fri 10 Sep 2010 23:56:04 NZST climateprediction.net Started upload of hadam3p_pnw_v45i_1965_1_006679012_0_3.zip Fri 10 Sep 2010 23:56:05 NZST climateprediction.net Project file upload handler is missing Fri 10 Sep 2010 23:56:05 NZST climateprediction.net Backing off 9 min 58 sec on upload of hadam3p_pnw_v45i_1965_1_006679012_0_3.zip Fri 10 Sep 2010 23:56:06 NZST climateprediction.net Started upload of hadam3p_pnw_v45i_1965_1_006679012_0_4.zip Fri 10 Sep 2010 23:56:07 NZST climateprediction.net Project file upload handler is missing Fri 10 Sep 2010 23:56:07 NZST climateprediction.net Backing off 3 hr 22 min 31 sec on upload of hadam3p_pnw_v45i_1965_1_006679012_0_4.zip Fri 10 Sep 2010 23:56:08 NZST climateprediction.net Started upload of hadam3p_pnw_v45i_1965_1_006679012_0_5.zip Fri 10 Sep 2010 23:56:09 NZST climateprediction.net Project file upload handler is missing Fri 10 Sep 2010 23:56:09 NZST climateprediction.net Backing off 1 hr 19 min 0 sec on upload of hadam3p_pnw_v45i_1965_1_006679012_0_5.zip Fri 10 Sep 2010 23:56:10 NZST climateprediction.net Started upload of hadam3p_pnw_v45i_1965_1_006679012_0_6.zip Fri 10 Sep 2010 23:56:12 NZST climateprediction.net Project file upload handler is missing Fri 10 Sep 2010 23:56:12 NZST climateprediction.net Backing off 30 min 29 sec on upload of hadam3p_pnw_v45i_1965_1_006679012_0_6.zip Fri 10 Sep 2010 23:56:12 NZST climateprediction.net Started upload of hadam3p_pnw_v45i_1965_1_006679012_0_7.zip Fri 10 Sep 2010 23:56:14 NZST climateprediction.net Project file upload handler is missing Fri 10 Sep 2010 23:56:14 NZST climateprediction.net Backing off 2 hr 39 min 53 sec on upload of hadam3p_pnw_v45i_1965_1_006679012_0_7.zip Fri 10 Sep 2010 23:56:16 NZST climateprediction.net Started upload of hadam3p_pnw_v45i_1965_1_006679012_0_8.zip Fri 10 Sep 2010 23:56:18 NZST climateprediction.net Project file upload handler is missing Fri 10 Sep 2010 23:56:18 NZST climateprediction.net Backing off 3 hr 38 min 11 sec on upload of hadam3p_pnw_v45i_1965_1_006679012_0_8.zip Looking in the client_state.xml file the server is http://boinc1.coas.oregonstate.edu/cpdn_cgi_main/file_upload_handler Tried entering the URL in the browser and got: <data_server_reply> <status>1</status> <message>no command</message> </data_server_reply> So server is up but forcing an upload does not work. Greg |
Send message Joined: 4 Oct 09 Posts: 73 Credit: 7,242,427 RAC: 0 |
Thanks, Milo. |
Send message Joined: 6 Apr 05 Posts: 17 Credit: 744,057 RAC: 0 |
I also need to report a problem with PNW uploads. I've had one retrying for two days: Sat Sep 11 13:12:04 2010 climateprediction.net Started upload of hadam3p_pnw_v3pu_1977_1_006678448_1_13.zip Sat Sep 11 13:12:11 2010 Project communication failed: attempting access to reference site Sat Sep 11 13:12:11 2010 climateprediction.net Temporarily failed upload of hadam3p_pnw_v3pu_1977_1_006678448_1_13.zip: connect() failed Sat Sep 11 13:12:11 2010 climateprediction.net Backing off 2 hr 36 min 44 sec on upload of hadam3p_pnw_v3pu_1977_1_006678448_1_13.zip Sat Sep 11 13:12:13 2010 Internet access OK - project servers may be temporarily down. What bugs me about it is that I live 15 minutes away from Oregon State. I could go over and knock on their door if I knew who they were. =Mike |
©2024 climateprediction.net