climateprediction.net home page
Project communication failed: attempting access to reference site
Project communication failed: attempting access to reference site
log in

Advanced search

Message boards : Number crunching : Project communication failed: attempting access to reference site

1 · 2 · 3 · Next
Author Message
Vitalii Koshura
Send message
Joined: 25 Mar 09
Posts: 11
Credit: 2,277,510
RAC: 2,521
Message 54787 - Posted: 18 Sep 2016, 12:29:10 UTC

Hello,

I have this error for a two weeks on one of my hosts.

18.09.2016 13:26:46 | climateprediction.net | Started upload of wah2_mex25_c0fh_199012_13_410_010609033_1_5.zip 18.09.2016 13:27:15 | | Project communication failed: attempting access to reference site 18.09.2016 13:27:15 | climateprediction.net | Temporarily failed upload of wah2_mex25_c0fh_199012_13_410_010609033_1_5.zip: transient HTTP error 18.09.2016 13:27:15 | climateprediction.net | Backing off 05:23:40 on upload of wah2_mex25_c0fh_199012_13_410_010609033_1_5.zip 18.09.2016 13:27:18 | | Internet access OK - project servers may be temporarily down.


I've tried to restart my PC but this didn't help.

How can I resolve this?

Thanks

Profile Byron Leigh Hatch @ team Carl Sagan
Avatar
Send message
Joined: 17 Aug 04
Posts: 280
Credit: 43,277,847
RAC: 5,991
Message 54788 - Posted: 18 Sep 2016, 15:15:52 UTC - in response to Message 54787.

Les Bayliss ... Forum moderator
has made a sticky post at the top of the Number crunching section called:
Uploading Mexico models - here -
summarising the Mexico problem,
Note that this is only affecting some people.

I hope this might will help you?

Vitalii Koshura
Send message
Joined: 25 Mar 09
Posts: 11
Credit: 2,277,510
RAC: 2,521
Message 54789 - Posted: 18 Sep 2016, 18:59:12 UTC - in response to Message 54788.

Thank you for this advice. I tried this but the result is still the same :(

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6866
Credit: 20,843,205
RAC: 216
Message 54790 - Posted: 18 Sep 2016, 19:54:31 UTC - in response to Message 54789.

Then you're one of a few people who wont be able to upload these.
I don't know what causes the problem in this case, but I suspect that the only reasonable solution is to Abort that model.

For what it's worth, there were 2 more batches of Mex models in August, and I ran about a dozen over 3 computers, and uploaded all files without any problems.
And all without having to use a cc_config file.

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6866
Credit: 20,843,205
RAC: 216
Message 54791 - Posted: 19 Sep 2016, 0:30:13 UTC - in response to Message 54789.

On second thoughts, don't do anything for now.
I've got a vague idea that I'd like to discuss with some people.

Vitalii Koshura
Send message
Joined: 25 Mar 09
Posts: 11
Credit: 2,277,510
RAC: 2,521
Message 54792 - Posted: 19 Sep 2016, 1:11:39 UTC - in response to Message 54791.

OK. I'll wait for some new ideas. Thanks!

Profile Thyme Lawn
Volunteer moderator
Send message
Joined: 5 Aug 04
Posts: 1276
Credit: 15,490,488
RAC: 4,728
Message 54794 - Posted: 19 Sep 2016, 11:41:19 UTC - in response to Message 54792.

In BOINC Manager you can enable debugging of HTTP conversations by typing <Ctrl>+<Shift>+F, clicking on the "http_debug" checkbox to make it ticked and clicking OK (to disable the debug repeat that process, this time removing the "http_debug" checkbox tick).

A successful file transfer will result in an event log sequence similar to the following:

19/09/2016 11:11:32 | climateprediction.net | Started upload of wah2_sas50_ky74_200912_13_448_010718036_0_r921421034_1.zip 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info: Trying 129.67.195.140... 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info: Connected to upload2.cpdn.org (129.67.195.140) port 80 (#627) 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Host: upload2.cpdn.org 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.6.22) 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Accept: */* 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Accept-Encoding: deflate, gzip 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Content-Type: application/x-www-form-urlencoded 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Accept-Language: en_GB 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Content-Length: 311 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info: We are completely uploaded and fine 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: HTTP/1.1 200 OK 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: Date: Mon, 19 Sep 2016 10:10:26 GMT 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: Server: Apache/2.4.6 (CentOS) 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: Content-Length: 93 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: Content-Type: text/plain; charset=UTF-8 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info: Connection #627 to host upload2.cpdn.org left intact 19/09/2016 11:11:34 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Info: Found bundle for host upload2.cpdn.org: 0x1c365e04cb0 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Info: Re-using existing connection! (#627) with host upload2.cpdn.org 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Info: Connected to upload2.cpdn.org (129.67.195.140) port 80 (#627) 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Host: upload2.cpdn.org 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.6.22) 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Accept: */* 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Accept-Encoding: deflate, gzip 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Content-Type: application/x-www-form-urlencoded 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Accept-Language: en_GB 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Content-Length: 23198108 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Expect: 100-continue 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Received header from server: HTTP/1.1 100 Continue 19/09/2016 11:18:04 | climateprediction.net | [http] [ID#9825] Info: We are completely uploaded and fine 19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: HTTP/1.1 200 OK 19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: Date: Mon, 19 Sep 2016 10:10:28 GMT 19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: Server: Apache/2.4.6 (CentOS) 19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: Transfer-Encoding: chunked 19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: Content-Type: text/plain; charset=UTF-8 19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: 19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Info: Connection #627 to host upload2.cpdn.org left intact 19/09/2016 11:18:07 | climateprediction.net | Finished upload of wah2_sas50_ky74_200912_13_448_010718036_0_r921421034_1.zip


The upload messages will be preceded with those for the associated trickle:

19/09/2016 11:11:30 | climateprediction.net | Sending scheduler request: To send trickle-up message. 19/09/2016 11:11:30 | climateprediction.net | Not requesting tasks: don't need (not highest priority project) 19/09/2016 11:11:30 | climateprediction.net | [http] HTTP_OP::init_post(): http://climateapps2.oerc.ox.ac.uk/cpdnboinc_cgi/cgi 19/09/2016 11:11:30 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Info: Trying 129.67.195.185... 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Info: Connected to climateapps2.oerc.ox.ac.uk (129.67.195.185) port 80 (#626) 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: POST /cpdnboinc_cgi/cgi HTTP/1.1 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Host: climateapps2.oerc.ox.ac.uk 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.6.22) 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Accept: */* 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Accept-Encoding: deflate, gzip 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Content-Type: application/x-www-form-urlencoded 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Accept-Language: en_GB 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Content-Length: 37921 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Expect: 100-continue 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Received header from server: HTTP/1.1 100 Continue 19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Info: We are completely uploaded and fine 19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: HTTP/1.1 200 OK 19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: Date: Mon, 19 Sep 2016 10:11:33 GMT 19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: Server: Apache 19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: Connection: close 19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: Transfer-Encoding: chunked 19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: Content-Type: text/xml 19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: 19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Info: Closing connection 626 19/09/2016 11:11:32 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle 'C:\Program Files\BOINC\ca-bundle.crt' 19/09/2016 11:11:32 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set 19/09/2016 11:11:32 | climateprediction.net | Scheduler request completed

____________
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer

Lockleys
Send message
Joined: 13 Jan 07
Posts: 183
Credit: 9,541,689
RAC: 4,256
Message 54795 - Posted: 19 Sep 2016, 15:14:08 UTC

I have applied Thyme Lawn's debug instruction and attempted an upload of a MEX25 zip that has been stuck with me for weeks. However, when I include the Event Log readout in my post to this thread, I get disconnected from the forum with an error message. Is this in itself a clue?

Vitalii Koshura
Send message
Joined: 25 Mar 09
Posts: 11
Credit: 2,277,510
RAC: 2,521
Message 54796 - Posted: 19 Sep 2016, 19:51:34 UTC

19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Info: Found bundle for host upload6.cpdn.org: 0x42257d0
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Info: Re-using existing connection! (#35) with host upload6.cpdn.org
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Info: Connected to upload6.cpdn.org (158.97.9.11) port 80 (#35)
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: Host: upload6.cpdn.org
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.6.22)
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: Accept: */*
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: Accept-Encoding: deflate, gzip
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: Content-Type: application/x-www-form-urlencoded
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: Accept-Language: ru_RU
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: Content-Length: 4540690
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: Expect: 100-continue
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server:
19.09.2016 22:49:39 | climateprediction.net | [http] [ID#9] Received header from server: HTTP/1.1 100 Continue
19.09.2016 22:50:05 | climateprediction.net | [http] [ID#9] Info: Recv failure: Connection was reset
19.09.2016 22:50:05 | climateprediction.net | [http] [ID#9] Info: Closing connection 35
19.09.2016 22:50:05 | climateprediction.net | [http] HTTP error: Failure when receiving data from the peer
19.09.2016 22:50:05 | | Project communication failed: attempting access to reference site
19.09.2016 22:50:05 | | [http] HTTP_OP::init_get(): http://www.google.com/
19.09.2016 22:50:05 | | [http] HTTP_OP::libcurl_exec(): ca-bundle set
19.09.2016 22:50:05 | climateprediction.net | Temporarily failed upload of wah2_mex25_c0fh_199012_13_410_010609033_1_5.zip: transient HTTP error
19.09.2016 22:50:05 | climateprediction.net | Backing off 03:55:34 on upload of wah2_mex25_c0fh_199012_13_410_010609033_1_5.zip
19.09.2016 22:50:06 | | [http] [ID#0] Info: Connection 38 seems to be dead!
19.09.2016 22:50:06 | | [http] [ID#0] Info: Closing connection 38
19.09.2016 22:50:06 | | [http] [ID#0] Info: Trying 173.194.113.212...
19.09.2016 22:50:06 | | [http] [ID#0] Info: Connected to www.google.com (173.194.113.212) port 80 (#40)
19.09.2016 22:50:06 | | [http] [ID#0] Sent header to server: GET / HTTP/1.1
19.09.2016 22:50:06 | | [http] [ID#0] Sent header to server: Host: www.google.com
19.09.2016 22:50:06 | | [http] [ID#0] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.6.22)
19.09.2016 22:50:06 | | [http] [ID#0] Sent header to server: Accept: */*
19.09.2016 22:50:06 | | [http] [ID#0] Sent header to server: Accept-Encoding: deflate, gzip
19.09.2016 22:50:06 | | [http] [ID#0] Sent header to server: Content-Type: application/x-www-form-urlencoded
19.09.2016 22:50:06 | | [http] [ID#0] Sent header to server: Accept-Language: ru_RU
19.09.2016 22:50:06 | | [http] [ID#0] Sent header to server:
19.09.2016 22:50:06 | | [http] [ID#0] Received header from server: HTTP/1.1 302 Found
19.09.2016 22:50:06 | | [http] [ID#0] Received header from server: Cache-Control: private
19.09.2016 22:50:06 | | [http] [ID#0] Received header from server: Content-Type: text/html; charset=UTF-8
19.09.2016 22:50:06 | | [http] [ID#0] Received header from server: Location: http://www.google.com.ua/?gfe_rd=cr&ei=dUHgV5WuBNLEtAHt_LqACw
19.09.2016 22:50:06 | | [http] [ID#0] Received header from server: Content-Length: 262
19.09.2016 22:50:06 | | [http] [ID#0] Received header from server: Date: Mon, 19 Sep 2016 19:50:13 GMT
19.09.2016 22:50:06 | | [http] [ID#0] Received header from server:
19.09.2016 22:50:06 | | [http] [ID#0] Info: Ignoring the response-body
19.09.2016 22:50:06 | | [http] [ID#0] Info: Connection #40 to host www.google.com left intact
19.09.2016 22:50:06 | | [http] [ID#0] Info: Issue another request to this URL: 'http://www.google.com.ua/?gfe_rd=cr&ei=dUHgV5WuBNLEtAHt_LqACw'
19.09.2016 22:50:07 | | [http] [ID#0] Info: Trying 173.194.113.215...
19.09.2016 22:50:07 | | [http] [ID#0] Info: Connected to www.google.com.ua (173.194.113.215) port 80 (#41)
19.09.2016 22:50:07 | | [http] [ID#0] Sent header to server: GET /?gfe_rd=cr&ei=dUHgV5WuBNLEtAHt_LqACw HTTP/1.1
19.09.2016 22:50:07 | | [http] [ID#0] Sent header to server: Host: www.google.com.ua
19.09.2016 22:50:07 | | [http] [ID#0] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.6.22)
19.09.2016 22:50:07 | | [http] [ID#0] Sent header to server: Accept: */*
19.09.2016 22:50:07 | | [http] [ID#0] Sent header to server: Accept-Encoding: deflate, gzip
19.09.2016 22:50:07 | | [http] [ID#0] Sent header to server: Referer: http://www.google.com/
19.09.2016 22:50:07 | | [http] [ID#0] Sent header to server: Content-Type: application/x-www-form-urlencoded
19.09.2016 22:50:07 | | [http] [ID#0] Sent header to server: Accept-Language: ru_RU
19.09.2016 22:50:07 | | [http] [ID#0] Sent header to server:
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server: HTTP/1.1 200 OK
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server: Date: Mon, 19 Sep 2016 19:50:13 GMT
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server: Expires: -1
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server: Cache-Control: private, max-age=0
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server: Content-Type: text/html; charset=windows-1251
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server: P3P: CP="This is not a P3P policy! See https://www.google.com/support/accounts/answer/151657?hl=en for more info."
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server: Content-Encoding: gzip
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server: Server: gws
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server: Content-Length: 5119
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server: X-XSS-Protection: 1; mode=block
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server: X-Frame-Options: SAMEORIGIN
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server: Set-Cookie: NID=86=Lbhj7H-9Qvh23C0JhVsTY9EmLiIptomaGfmN6d7dvxXRcP3vqoN6Cn3sBVkgq3zMY19-3tAgQogMgW0s68XVSo0pIpcAk_YIxsRLLC-j-WrGOlJLLi413tDCfG11czYe; expires=Tue, 21-Mar-2017 19:50:13 GMT; path=/; domain=.google.com.ua; HttpOnly
19.09.2016 22:50:07 | | [http] [ID#0] Received header from server:
19.09.2016 22:50:07 | | [http] [ID#0] Info: Connection #41 to host www.google.com.ua left intact
19.09.2016 22:50:08 | | Internet access OK - project servers may be temporarily down.

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6866
Credit: 20,843,205
RAC: 216
Message 54797 - Posted: 19 Sep 2016, 21:05:05 UTC - in response to Message 54796.

Hi Vitalii


That contains this line:

19.09.2016 22:50:06 | | [http] [ID#0] Received header from server: HTTP/1.1 302 Found

It should say HTTP/1.0
(As per the 'title' of that option.)

Which means that the cc_config isn't correct.

1) You may have the file in the wrong place, or
2) You may have used a word processor type editor, which inserts extra linefeed/carriage characters at the end of lines.

Either way, you should now have a single cc_config file, with the manually entered code PLUS the new code inserted by clicking on that new option.

If not, perhaps you can use the BOINC option to locate the one that I originally posted, and click on it to add it to the cc_config file.

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6866
Credit: 20,843,205
RAC: 216
Message 54798 - Posted: 19 Sep 2016, 21:13:44 UTC - in response to Message 54795.

Hi Lockleys

It probably means that you tried to post the entire Event Log here, and exceeded a limit.

Use the Windows short cuts to select a small, relevant section.

Click on the 1st line
Scroll down to the last line.
Press and hold the Shift key.
Click on the last line that you want.

Then use the option:
Copy selected lines.

It should only be necessary to copy 20-30 lines at most.

Also see my previous reply to Vitalii.

Profile Thyme Lawn
Volunteer moderator
Send message
Joined: 5 Aug 04
Posts: 1276
Credit: 15,490,488
RAC: 4,728
Message 54799 - Posted: 20 Sep 2016, 0:13:05 UTC - in response to Message 54797.
Last modified: 20 Sep 2016, 0:19:52 UTC

That contains this line:

19.09.2016 22:50:06 | | [http] [ID#0] Received header from server: HTTP/1.1 302 Found

That's not where the problem lies Les. The 302 is the response from google.com to BOINC's internet connectivity check telling it to redirect the request to google.com.ua.

The relevant lines from Vitali's output are:

19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Info: Connected to upload6.cpdn.org (158.97.9.11) port 80 (#35) 19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: Content-Length: 4540690 19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: Expect: 100-continue 19.09.2016 22:49:39 | climateprediction.net | [http] [ID#9] Received header from server: HTTP/1.1 100 Continue 19.09.2016 22:50:05 | climateprediction.net | [http] [ID#9] Info: Recv failure: Connection was reset 19.09.2016 22:50:05 | climateprediction.net | [http] [ID#9] Info: Closing connection 35 19.09.2016 22:50:05 | climateprediction.net | [http] HTTP error: Failure when receiving data from the peer


The "HTTP/1.1 100 Continue" response indicates that an HTTP/1.1 connection has been successfully made to the upload server, the file offset to start uploading from has been determined and BOINC has started sending 4,540,690 bytes of data (if the file being sent is larger than that it's indicating that some data has successfully been transferred to upload6). The next line is indicating that the connection was reset 26 seconds later due to a receive failure. My guess is that it's indicating a problem on that upload server (upload6.cpdn.org (158.97.9.11)).

Enabling "http_xfer_debug" will directly indicate whether any data has being transferred. I didn't suggest it earlier because it generates a message for each section of data sent to the server which very quickly mounts up (in my case it's about 180 messages per second for an upload). The messages don't identify the project and the ID# is the only way to tie them to the original request (i.e. enabling http_xfer_debug with http_debug disabled is meaningless). The following messages are selected from my previous post with a couple of http_xfer_debug messages included and lots of lines removed. The first POST sequence determines how many bytes the server has already received and the second is transferring the file from that offset:

19/09/2016 11:11:32 | climateprediction.net | Started upload of wah2_sas50_ky74_200912_13_448_010718036_0_r921421034_1.zip 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info: Connected to upload2.cpdn.org (129.67.195.140) port 80 (#627) 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Content-Length: 311 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info: We are completely uploaded and fine 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: HTTP/1.1 200 OK 19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info: Connection #627 to host upload2.cpdn.org left intact 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Info: Re-using existing connection! (#627) with host upload2.cpdn.org 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Info: Connected to upload2.cpdn.org (129.67.195.140) port 80 (#627) 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Content-Length: 23198108 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Expect: 100-continue 19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Received header from server: HTTP/1.1 100 Continue 19/09/2016 11:11:35 | | [http_xfer] [ID#9825] HTTP: wrote 2956 bytes 19/09/2016 11:11:35 | | [http_xfer] [ID#9825] HTTP: wrote 2441 bytes 19/09/2016 11:18:04 | climateprediction.net | [http] [ID#9825] Info: We are completely uploaded and fine 19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: HTTP/1.1 200 OK 19/09/2016 11:18:07 | climateprediction.net | Finished upload of wah2_sas50_ky74_200912_13_448_010718036_0_r921421034_1.zip

____________
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6866
Credit: 20,843,205
RAC: 216
Message 54800 - Posted: 20 Sep 2016, 3:18:10 UTC

I was mostly interested in the HTTP level, but I should have chosen one of the others.

I'd really like a clue to where the problem(s) is/are.
It seems to only have affected the big Mex25 zips, unless lots of people are aborting them silently.

Vitalii Koshura
Send message
Joined: 25 Mar 09
Posts: 11
Credit: 2,277,510
RAC: 2,521
Message 54801 - Posted: 20 Sep 2016, 7:07:31 UTC

Here's the log with checked http_debug & http_xfer_debug:
http://pastebin.com/5ty6H1HU

Lockleys
Send message
Joined: 13 Jan 07
Posts: 183
Credit: 9,541,689
RAC: 4,256
Message 54802 - Posted: 20 Sep 2016, 7:24:12 UTC

Here is a link to my debug log. My mex25 has been stuck at 37.64% uploaded for many weeks. Hope this run may give some clues alongside Vitalii's inputs.
http://pastebin.com/5Jk3cmwG

Profile Thyme Lawn
Volunteer moderator
Send message
Joined: 5 Aug 04
Posts: 1276
Credit: 15,490,488
RAC: 4,728
Message 54803 - Posted: 20 Sep 2016, 8:07:12 UTC - in response to Message 54801.

Thanks Vitalii, that's definitely appears to be a server problem (there are no [http_xfer] messages when the file content should be being transmitted to the server). I'll notify the project team.
____________
"The ultimate test of a moral society is the kind of world that it leaves to its children." - Dietrich Bonhoeffer

Vitalii Koshura
Send message
Joined: 25 Mar 09
Posts: 11
Credit: 2,277,510
RAC: 2,521
Message 54804 - Posted: 20 Sep 2016, 10:09:50 UTC - in response to Message 54803.

Thank you!

Les Bayliss
Volunteer moderator
Send message
Joined: 5 Sep 04
Posts: 6866
Credit: 20,843,205
RAC: 216
Message 54805 - Posted: 20 Sep 2016, 21:10:05 UTC

Progress so far:

Vitalii is still using HTTP 1.1
Lockleys are now using HTTP 1.0, which is the point of that cc_config option.

But both have:
HTTP error: Failure when receiving data from the peer

So it's either 2 problems, or it's been something more subtle all along.

Back to thinking and talking. :(

Vitalii Koshura
Send message
Joined: 25 Mar 09
Posts: 11
Credit: 2,277,510
RAC: 2,521
Message 54806 - Posted: 21 Sep 2016, 6:04:07 UTC - in response to Message 54805.

I tried to use HTTP 1.0 but the result is the same. I can attach those logs too if it could help you: http://pastebin.com/NP3hAjZS

Lockleys
Send message
Joined: 13 Jan 07
Posts: 183
Credit: 9,541,689
RAC: 4,256
Message 54807 - Posted: 21 Sep 2016, 7:01:45 UTC

I have updated my contribution to include http_debug and http_xfer_debug.
Still at http://pastebin.com/5Jk3cmwG

1 · 2 · 3 · Next

Message boards : Number crunching : Project communication failed: attempting access to reference site


Main page · Your account · Message boards


Copyright © 2019 climateprediction.net