climateprediction.net home page
Upload issue.

Upload issue.

Questions and Answers : Windows : Upload issue.
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · Next

AuthorMessage
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4346
Credit: 16,541,921
RAC: 6,087
Message 69484 - Posted: 17 Aug 2023, 14:09:11 UTC - in response to Message 69483.  

I had quite a few files upload but I have 3 left that are stuck with a transient HTTP error.
The issue is being looked at Richard has done quite a bit of work and will when he gets time go through his findings directly with Andy. He has posted in the number crunching forum on this that there is some non-BOINC stuff going on in his life that might stop him doing that till after the bank holiday. (Last Monday in August for non UK readers.)
ID: 69484 · Report as offensive     Reply Quote
Profile adrianxw
Avatar

Send message
Joined: 31 Aug 04
Posts: 145
Credit: 2,021,020
RAC: 816
Message 69485 - Posted: 17 Aug 2023, 14:18:34 UTC

I said this earlier, the deadline for these jobs is wwwwwaaaaaaayyyyyyyyyyy off. Let him do his stuff in his own time. Better it gets done correctly, and ideally, with as much information learnt as possible to circumvent future issues.

Best wishes.
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 69485 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 943
Credit: 34,302,382
RAC: 11,182
Message 69487 - Posted: 17 Aug 2023, 15:59:38 UTC - in response to Message 69484.  

The issue is being looked at Richard ...
That's me. Actually, my intrusive issues aren't that immediate, and I can carry on in the gaps - but at some point, I'll have to start making gaps to travel to meetings in London. Since I posted the warning, it's become apparent they may not start until mid-September.

And Joseph Waggy's post has already proved quite useful. It led me to host 1536355. He has a number of tasks, all from the same batch 994 'wah2_eas25' grouping: that seems to be the only one affected so far. One of the tasks has already completed, telling me the final trickle expected, and the final credit score (information I hadn't been able to track down yesterday). That, in turn, confirms that the three "in progress" tasks have all finished properly, and the only thing preventing them reporting success is the pesky upload failure. We don't know exactly which upload is failing, but he must have tried to send it the first time before 17 July. Actually, he's already posted once before, on 8 August, when he said they'd already been trying for 23 days.

That's quite important. Adrianxw is quite right: the final deadline for reporting isn't until July next year, which seems plenty: but BOINC has another trick up its sleeve. It will cancel the upload if it's not completed within 90 days from the first attempt, and destroy the scientific data that the files contain. We've used a third of that grace period already.
ID: 69487 · Report as offensive     Reply Quote
Karen

Send message
Joined: 12 Jul 19
Posts: 9
Credit: 178,633
RAC: 793
Message 69488 - Posted: 17 Aug 2023, 16:21:19 UTC - in response to Message 69487.  

Hello Richard,
Thanks for all your efforts. I also posted (on 28 July) that I had been having trouble uploading files from that same WAH2 batch. I'm happy to report that nearly all my files have now uploaded (today), except the last one:
17/08/2023 16:16:25 | climateprediction.net | Started upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
17/08/2023 16:16:35 | climateprediction.net | [error] Error reported by file upload server: [wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip] locked by file_upload_handler PID=249928
17/08/2023 16:16:35 | climateprediction.net | Temporarily failed upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip: transient upload error
17/08/2023 16:16:35 | climateprediction.net | Backing off 03:07:40 on upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
17/08/2023 16:17:38 | climateprediction.net | Started upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
17/08/2023 16:17:40 | climateprediction.net | [error] Error reported by file upload server: [wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip] locked by file_upload_handler PID=249928
17/08/2023 16:17:40 | climateprediction.net | Temporarily failed upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip: transient upload error
17/08/2023 16:17:40 | climateprediction.net | Backing off 04:34:43 on upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
ID: 69488 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 943
Credit: 34,302,382
RAC: 11,182
Message 69490 - Posted: 17 Aug 2023, 16:35:10 UTC - in response to Message 69488.  

That's actually quite a benign, and temporary, error. The file is automatically locked while an upload is in progress. If something goes wrong, the lock is kept in place for an interval (possibly an hour, maybe longer), and then automatically released. If your files have gone through today, that's a good sign: but it means that the others will have started too, and the server will be very busy, as will the intercontinental cables leading to it.

It's worth retrying the stuck uploads every few hours, and keeping an eye on the error messages. If you ever see one that ends

Received header from server: HTTP/1.1 100 Continue
Info: Recv failure: Connection was reset
give us a shout.
ID: 69490 · Report as offensive     Reply Quote
Karen

Send message
Joined: 12 Jul 19
Posts: 9
Credit: 178,633
RAC: 793
Message 69491 - Posted: 17 Aug 2023, 16:43:39 UTC - in response to Message 69490.  

Will do, thanks! And thanks for the explanation about the file lock.
ID: 69491 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 807
Credit: 13,593,584
RAC: 7,495
Message 69493 - Posted: 17 Aug 2023, 21:32:54 UTC - in response to Message 69487.  

That's quite important. Adrianxw is quite right: the final deadline for reporting isn't until July next year, which seems plenty: but BOINC has another trick up its sleeve. It will cancel the upload if it's not completed within 90 days from the first attempt, and destroy the scientific data that the files contain. We've used a third of that grace period already.
And as I've said before the task deadline should be ignored for WaH tasks. The returned data is needed long before that deadline. It's there because no-one has changed it since the original days of CPDN. Task deadlines for OpenIFS were shortened on my request. When everyone is back from holidays, it's on my list to get them changed for more realistic values for the Hadley models.

The problem with these 1yr deadlines comes if the batch is left open rather than closed (which sometimes happens because CPDN get busy). Then resends go out long after the project has actually finished wasting volunteer computer time.
---
CPDN Visiting Scientist
ID: 69493 · Report as offensive     Reply Quote
Karen

Send message
Joined: 12 Jul 19
Posts: 9
Credit: 178,633
RAC: 793
Message 69496 - Posted: 21 Aug 2023, 8:56:21 UTC - in response to Message 69490.  

Hello,
I've been retrying the final stuck upload for the past three days, but it keeps failing. It uploads for a few minutes, but when the file gets to approx. 85-87% (110/112 out of 128.8 MB), the upload stalls.
Here are some of the error messages:
19/08/2023 18:58:26 | climateprediction.net | Started upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
19/08/2023 19:01:05 | climateprediction.net | Temporarily failed upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip: transient HTTP error
19/08/2023 19:01:05 | climateprediction.net | Backing off 05:40:05 on upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
19/08/2023 19:01:06 | | Project communication failed: attempting access to reference site
19/08/2023 19:01:08 | | Internet access OK - project servers may be temporarily down.

20/08/2023 05:19:07 | climateprediction.net | Started upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
20/08/2023 05:20:34 | climateprediction.net | Temporarily failed upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip: transient HTTP error
20/08/2023 05:20:34 | climateprediction.net | Backing off 05:27:01 on upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
20/08/2023 05:20:35 | | Project communication failed: attempting access to reference site
20/08/2023 05:20:37 | | Internet access OK - project servers may be temporarily down.

20/08/2023 20:08:53 | climateprediction.net | Started upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
20/08/2023 20:09:24 | climateprediction.net | Temporarily failed upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip: transient HTTP error
20/08/2023 20:09:24 | climateprediction.net | Backing off 05:29:31 on upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
20/08/2023 20:09:25 | | Project communication failed: attempting access to reference site
20/08/2023 20:09:27 | | Internet access OK - project servers may be temporarily down.

21/08/2023 01:23:15 | climateprediction.net | Started upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
21/08/2023 01:25:44 | climateprediction.net | Temporarily failed upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip: transient HTTP error
21/08/2023 01:25:44 | climateprediction.net | Backing off 03:27:03 on upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
21/08/2023 01:25:44 | | Project communication failed: attempting access to reference site
21/08/2023 01:25:46 | | Internet access OK - project servers may be temporarily down.

21/08/2023 08:41:16 | climateprediction.net | Started upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
21/08/2023 08:45:46 | climateprediction.net | Temporarily failed upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip: transient HTTP error
21/08/2023 08:45:46 | climateprediction.net | Backing off 04:00:49 on upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
21/08/2023 08:45:47 | | Project communication failed: attempting access to reference site
21/08/2023 08:45:49 | | Internet access OK - project servers may be temporarily down.
ID: 69496 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 943
Credit: 34,302,382
RAC: 11,182
Message 69497 - Posted: 21 Aug 2023, 9:33:09 UTC - in response to Message 69496.  

Hello,
I've been retrying the final stuck upload for the past three days, but it keeps failing. It uploads for a few minutes, but when the file gets to approx. 85-87% (110/112 out of 128.8 MB), the upload stalls.
Thanks - that's interesting additional information, that we haven't been told before. It probably rules out the 'missing blank line' theory.

Please could you try it one last time, with some additional logging information? It would help to try and get a better handle on this.

Open BOINC Manager, and switch to Advanced view if you're not using it already.
From the 'Options' menu, choose 'Event Log options...'
In the new window, tick 'http_debug', then 'Save'.
Then retry just one transfer.
When it finishes or fails, go back to the Event Log options window and clear the http_debug tick. Save it again.

Please show us the resulting log in full, even though it may be quite long. We can pick through it for any more morsels of information.
ID: 69497 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4346
Credit: 16,541,921
RAC: 6,087
Message 69498 - Posted: 21 Aug 2023, 9:59:57 UTC
Last modified: 21 Aug 2023, 10:02:00 UTC

Edit: I will hold off emailing Andy as Richard understands this far better than I do and the extra information he is after may be what's needed to give to Andy.
ID: 69498 · Report as offensive     Reply Quote
Profile adrianxw
Avatar

Send message
Joined: 31 Aug 04
Posts: 145
Credit: 2,021,020
RAC: 816
Message 69499 - Posted: 21 Aug 2023, 14:40:30 UTC

The problem I mentioned above, (10th I think), where I reported one eas successful transfer, and one that did not complete is still present here.
I added the log flags and tried again now, this is the result. I don't know if that helps at all. It appears to transfer, but does not get an ack back.

21/08/2023 16:26:34 | climateprediction.net | [http] [ID#13343] Sent header to server: Host: upload7.cpdn.org
21/08/2023 16:26:34 | climateprediction.net | [http] [ID#13343] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.22.2)
21/08/2023 16:26:34 | climateprediction.net | [http] [ID#13343] Sent header to server: Accept: */*
21/08/2023 16:26:34 | climateprediction.net | [http] [ID#13343] Sent header to server: Accept-Encoding: deflate, gzip
21/08/2023 16:26:34 | climateprediction.net | [http] [ID#13343] Sent header to server: Accept-Language: en_GB
21/08/2023 16:26:34 | climateprediction.net | [http] [ID#13343] Sent header to server: Content-Length: 313
21/08/2023 16:26:34 | climateprediction.net | [http] [ID#13343] Sent header to server: Content-Type: application/x-www-form-urlencoded
21/08/2023 16:26:34 | climateprediction.net | [http] [ID#13343] Sent header to server:
21/08/2023 16:26:34 | climateprediction.net | [http] [ID#13343] Info: We are completely uploaded and fine
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server: HTTP/1.1 200 OK
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server: Date: Mon, 21 Aug 2023 14:26:08 GMT
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server: Server: Apache/2.4.37 (centos)
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server: Transfer-Encoding: chunked
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server: Content-Type: text/plain; charset=UTF-8
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server:
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server: 5d
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server: <data_server_reply>
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server: <status>0</status>
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server: <file_size>0</file_size>
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server: </data_server_reply>
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server:
21/08/2023 16:26:35 | | [http_xfer] [ID#13343] HTTP: wrote 93 bytes
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Info: Connection #18779 to host upload7.cpdn.org left intact
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Info: Found bundle for host: 0xebb6113500 [serially]
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Info: Re-using existing connection #18779 with host upload7.cpdn.org
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Sent header to server: Host: upload7.cpdn.org
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.22.2)
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Sent header to server: Accept: */*
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Sent header to server: Accept-Encoding: deflate, gzip
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Sent header to server: Accept-Language: en_GB
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Sent header to server: Content-Length: 123723914
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Sent header to server: Content-Type: application/x-www-form-urlencoded
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Sent header to server: Expect: 100-continue
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Sent header to server:
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server: HTTP/1.1 100 Continue
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Info: We are completely uploaded and fine
21/08/2023 16:27:58 | | Re-reading cc_config.xml
21/08/2023 16:27:58 | | Config: GUI RPC allowed from any host
21/08/2023 16:27:58 | | Config: don't use coprocessors
21/08/2023 16:27:58 | | log flags: file_xfer, sched_ops, task
21/08/2023 16:31:42 | climateprediction.net | Temporarily failed upload of wah2_eas25_a0p4_199111_25_994_012216342_0_r1775509966_14.zip: transient HTTP error
21/08/2023 16:31:42 | climateprediction.net | Backing off 03:22:01 on upload of wah2_eas25_a0p4_199111_25_994_012216342_0_r1775509966_14.zip
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 69499 · Report as offensive     Reply Quote
Karen

Send message
Joined: 12 Jul 19
Posts: 9
Credit: 178,633
RAC: 793
Message 69500 - Posted: 21 Aug 2023, 18:38:33 UTC - in response to Message 69497.  

Hello Richard,
I turned on the debug flag and retried the upload. It again stalled at 87.25%, but this time, BOINC was acting strangely after it failed. The upload disappeared from the Transfers tab, the Tasks tab went blank, and Climate Prediction repeatedly disappeared and re-appeared on the Projects tab. After a few minutes, things returned to normal. Here is the full log. I now see that it is indeed showing the "Recv failure: connection reset" error that you mentioned before, and which I did not previously see without the debug flag.
21/08/2023 18:22:33 | | Re-reading cc_config.xml
21/08/2023 18:22:33 | | log flags: file_xfer, sched_ops, task, http_debug
21/08/2023 18:22:49 | climateprediction.net | Started upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Info: Too old connection (2671 seconds idle), disconnect it
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Info: Connection 168 seems to be dead
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Info: Closing connection 168
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Info: schannel: shutting down SSL/TLS connection with scheduler.worldcommunitygrid.org port 443
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Info: Trying 141.223.16.156:80...
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Info: Connected to upload7.cpdn.org (141.223.16.156) port 80 (#169)
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Sent header to server: Host: upload7.cpdn.org
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.20.2)
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Sent header to server: Accept: */*
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Sent header to server: Accept-Encoding: deflate, gzip
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Sent header to server: Accept-Language: en_GB
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Sent header to server: Content-Length: 317
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Sent header to server: Content-Type: application/x-www-form-urlencoded
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Sent header to server:
21/08/2023 18:22:50 | climateprediction.net | [http] [ID#157] Info: We are completely uploaded and fine
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Info: Mark bundle as not supporting multiuse
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Received header from server: HTTP/1.1 200 OK
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Received header from server: Date: Mon, 21 Aug 2023 18:22:24 GMT
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Received header from server: Server: Apache/2.4.37 (centos)
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Received header from server: Transfer-Encoding: chunked
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Received header from server: Content-Type: text/plain; charset=UTF-8
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Received header from server:
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Received header from server: 5d
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Received header from server: <data_server_reply>
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Received header from server: <status>0</status>
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Received header from server: <file_size>0</file_size>
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Received header from server: </data_server_reply>
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Received header from server:
21/08/2023 18:22:51 | climateprediction.net | [http] [ID#157] Info: Connection #169 to host upload7.cpdn.org left intact
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Info: Found bundle for host: 0x244ba451b20 [serially]
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Info: Re-using existing connection #169 with host upload7.cpdn.org
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Info: Connected to upload7.cpdn.org (141.223.16.156) port 80 (#169)
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Sent header to server: Host: upload7.cpdn.org
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.20.2)
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Sent header to server: Accept: */*
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Sent header to server: Accept-Encoding: deflate, gzip
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Sent header to server: Accept-Language: en_GB
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Sent header to server: Content-Length: 135052214
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Sent header to server: Content-Type: application/x-www-form-urlencoded
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Sent header to server: Expect: 100-continue
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Sent header to server:
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Info: Mark bundle as not supporting multiuse
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Received header from server: HTTP/1.1 100 Continue
21/08/2023 18:25:25 | climateprediction.net | [http] [ID#157] Info: Recv failure: Connection was reset
21/08/2023 18:25:25 | climateprediction.net | [http] [ID#157] Info: Closing connection 169
21/08/2023 18:25:25 | climateprediction.net | [http] HTTP error: Failure when receiving data from the peer
21/08/2023 18:25:25 | climateprediction.net | Temporarily failed upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip: transient HTTP error
21/08/2023 18:25:25 | climateprediction.net | Backing off 05:58:00 on upload of wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip
21/08/2023 18:25:26 | | Project communication failed: attempting access to reference site
21/08/2023 18:25:26 | | [http] HTTP_OP::init_get(): https://www.ibm.com
21/08/2023 18:25:27 | | [http] [ID#0] Info: Trying 23.51.110.156:443...
21/08/2023 18:25:27 | | [http] [ID#0] Info: Connected to www.ibm.com (23.51.110.156) port 443 (#170)
21/08/2023 18:25:27 | | [http] [ID#0] Info: schannel: disabled automatic use of client certificate
21/08/2023 18:25:27 | | [http] [ID#0] Info: ALPN: offers http/1.1
21/08/2023 18:25:28 | | [http] [ID#0] Info: ALPN: server accepted http/1.1
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: GET / HTTP/1.1
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Host: www.ibm.com
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.20.2)
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept: */*
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept-Encoding: deflate, gzip
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept-Language: en_GB
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server:
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </project_name>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <name>wah2_eas25_a1om_199911_25_994_012217620_1_r405956311_restart.zip</name>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <nbytes>135051726.000000</nbytes>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <max_nbytes>150000000.000000</max_nbytes>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <status>1</status>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <persistent_file_xfer>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <num_retries>107</num_retries>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <first_request_time>1688825632.654633</first_request_time>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <next_request_time>1692663806.542822</next_request_time>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <time_so_far>7835.600470</time_so_far>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <last_bytes_xferred>117833728.000000</last_bytes_xferred>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <is_upload>1</is_upload>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </persistent_file_xfer>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </file_transfer>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </file_transfers>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </boinc_gui_rpc_reply>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: 
21/08/2023 18:25:28 | | [http] [ID#0] Info: Mark bundle as not supporting multiuse
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: HTTP/1.1 303 See Other
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Server: AkamaiGHost
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Content-Length: 0
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Location: https://www.ibm.com/ci-en
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Date: Mon, 21 Aug 2023 18:25:30 GMT
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Connection: keep-alive
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: x-content-type-options: nosniff
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: X-XSS-Protection: 1; mode=block
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Content-Security-Policy: upgrade-insecure-requests
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Strict-Transport-Security: max-age=31536000
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Set-Cookie: _abck=BD701D10A7A3C615A4CBD23556E372B5~-1~YAAQyONIF2A4CQGKAQAAxkZYGQos5FOCO1wJaa1ddNBJ8Kr5ugTECcUNk30p9SUhneboN0MZHgGXGmauokNBdY0eJiKnNEuwUT/rcMu7bXiTLkj/w7IxVwFojqWVqJ+K5ct08PQVaIhVj9lhsDunDFkl15oPxA0778VNDzqJfF6rtsnl9d93WdOKHTrtVGBLkldBx+JRoUjFufDSzGcLDu3yQtCe5LshfePAagv6qiBeKdsA7F84kKa+fU0jBHogX3yqLrBSNcxOWfFeA5PWM2pufs1KsuEVlhbePkIOQ03jIkRTWIfAMDCH45zOk9cWT8P8QTNJ2h1ze0wt9fpLbkUlfoJ/pe+Qp/eA4vIDshzguSvPn9s=~-1~-1~-1; Domain=.ibm.com; Path=/; Expires=Tue, 20 Aug 2024 18:25:30 GMT; Max-Age=31536000; Secure
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Set-Cookie: bm_sz=C5CD1366FB8EF73FD5422F4E33C63284~YAAQyONIF2E4CQGKAQAAxkZYGRSh229FWaq84WkuGqmElAGEYlTSEQc8980f4M8l4D+DwRlMiB3+hqwkf1D/ZSiIC7mIkJMrfd0lj1aSl4G8xi/T1hLvXrYMtuTKwIzVVLot5AWPOb3yoZgHHnteHUGXPea38YeujwSpoC5RS7lYvuH2yMtc7laZp3cJrqEt7ZO0YbWaZrmdTGOzbHjnuCT37uEPxDAudU40x57Um9eRPVAtkHqnCeUAgvVqhZegfHOcwIN6rRYOJcLJlMLmn6iJZR52mK8WtaejjK5VksY=~3749939~3355702; Domain=.ibm.com; Path=/; Expires=Mon, 21 Aug 2023 22:25:30 GMT; Max-Age=14400
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server:
21/08/2023 18:25:28 | | [http] [ID#0] Info: Connection #170 to host www.ibm.com left intact
21/08/2023 18:25:28 | | [http] [ID#0] Info: Issue another request to this URL: 'https://www.ibm.com/ci-en'
01/01/1970 00:00:00 | |
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: x-powered-by: Express
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Location: https://www.ibm.com/fr-fr
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Server-Timing: dtSInfo;desc="0", dtRpid;desc="1811996199"
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Cache-Control: private
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Content-Length: 229
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Date: Mon, 21 Aug 2023 18:25:31 GMT
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Connection: keep-alive
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: X-IBM-From-Redirect: Yes
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server:
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: {"matched_rule":{"source":"/(bf|cd|cg|ci|cm|dz|ga|ma|mg|mu|ne|sc|sn|td|tn)-fr(([\\?].*)?)","target":"//www.ibm.com/fr-fr","target_rule":"//www.ibm.com/fr-fr","status":301,"hostname":"www.ibm.com","extracted_host":"www.ibm.com"}}
21/08/2023 18:25:28 | | [http] [ID#0] Info: Ignoring the response-body
21/08/2023 18:25:28 | | [http] [ID#0] Info: Connection #170 to host www.ibm.com left intact
21/08/2023 18:25:28 | | [http] [ID#0] Info: Issue another request to this URL: 'https://www.ibm.com/fr-fr'
21/08/2023 18:25:28 | | [http] [ID#0] Info: Found bundle for host: 0x244ba451de0 [serially]
21/08/2023 18:25:28 | | [http] [ID#0] Info: Re-using existing connection #170 with host www.ibm.com
21/08/2023 18:25:28 | | [http] [ID#0] Info: Connected to www.ibm.com (23.51.110.156) port 443 (#170)
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: GET /fr-fr HTTP/1.1
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Host: www.ibm.com
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.20.2)
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept: */*
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept-Encoding: deflate, gzip
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Referer: https://www.ibm.com/ci-fr
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept-Language: en_GB
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server:
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: _199911_25_994_012217620_1_r405956311_restart.zip</name>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <nbytes>135051726.000000</nbytes>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <max_nbytes>150000000.000000</max_nbytes>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <status>1</status>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <persistent_file_xfer>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <num_retries>107</num_retries>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <first_request_time>1688825632.654633</first_request_time>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <next_request_time>1692663806.542822</next_request_time>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <time_so_far>7835.600470</time_so_far>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <last_bytes_xferred>117833728.000000</last_bytes_xferred>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <is_upload>1</is_upload>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </persistent_file_xfer>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </file_transfer>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </file_transfers>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </boinc_gui_rpc_reply>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: 
21/08/2023 18:25:29 | | [http] [ID#0] Info: schannel: failed to decrypt data, need more data
21/08/2023 18:25:29 | | [http] [ID#0] Info: schannel: failed to decrypt data, need more data
21/08/2023 18:25:29 | | [http] [ID#0] Info: schannel: failed to decrypt data, need more data
21/08/2023 18:25:29 | | [http] [ID#0] Info: schannel: failed to decrypt data, need more data
21/08/2023 18:25:29 | | [http] [ID#0] Info: Mark bundle as not supporting multiuse
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: HTTP/1.1 200 OK
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Server: Apache
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: x-drupal-dynamic-cache: UNCACHEABLE
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: x-ua-compatible: IE=edge
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Content-Language: fr-fr
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: x-generator: Drupal 9 (https://www.drupal.org)
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Link: <//1.cms.s81c.com>; rel=preconnect; crossorigin, <//1.cms.s81c.com>; rel=dns-prefetch
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: x-dns-prefetch-control: on
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: x-drupal-cache: HIT
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Last-Modified: Mon, 21 Aug 2023 09:15:09 GMT
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: ETag: "1692609309"
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Content-Type: text/html; charset=UTF-8
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Cache-Control: public, max-age=300
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Expires: Mon, 21 Aug 2023 18:30:31 GMT
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: X-Akamai-Transformed: 9 12437 0 pmb=mTOE,2
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Content-Encoding: gzip
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Date: Mon, 21 Aug 2023 18:25:31 GMT
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Content-Length: 12618
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Connection: keep-alive
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Vary: Accept-Encoding
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Set-Cookie: ak_bmsc=273D26092684D7F28E1BE9AA40A37AEA~000000000000000000000000000000~YAAQyONIF9o4CQGKAQAAakpYGRQ5q99c9VGX+aAoFt/8uyEZ7mAvGFL24pyFwNR0dUH+bLARtpx56mAWi5pE4J7U6PtxZnEksafP1KhoKuLaZRjAKD1ivp/xGdddytQCgH2A9BBFXo9qJYu+pEUpPtSSCkRmfGyKM/MqJOXblNrV1c085I8zexv3OtL70T/mK5cfv7rM4lOjwizMgkAx9s8wg/M3xc5wjCN+7ajs+guhln0vJ1NlieqGFxIHsl7xcJy38A/U2BE2Pt1/sGu4y98bvUJQ16dA5ydcINpTC1UFtMsoaoY0sRlNCpEtWIfjkDL0pZ097rHNbY2bs1+eP2kYnImmfUotPWcxHZe/OVpWO82VwZ6MnZLR5nXotUqfxTtBOlB33Mx1kA4=; Domain=.common.ak.origins.s81c.com; Path=/; Expires=Mon, 21 Aug 2023 20:25:31 GMT; Max-Age=7200; HttpOnly
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: x-content-type-options: nosniff
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: X-XSS-Protection: 1; mode=block
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Content-Security-Policy: upgrade-insecure-requests
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Strict-Transport-Security: max-age=31536000
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: x-ibm-trace: www-dipatcher: dynamic rule
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Set-Cookie: _abck=B9BBB26C29DC64ED4D35B1C29FE79459~-1~YAAQyONIF9s4CQGKAQAAbkpYGQo/QrganlRKsh2G5K+TeWem3ywBBhv25Tk6iDR3owGtRgzQk6pFgISoElqs8+z6GqbpUKWVyQ1KeZ8qxtvC6GA5U4EGhl49PRqRG4T53P+fuiRZ0NremwrGtYRmEJ4Y30EkDUsMN0Dmprl7WxzBiXOAQwVxF49KJ0/Q0gs6F+KZ6+CYL8kkekQRany2hYJqoYbCPFf4BAjPQUNffdO3aSzHwT7GZOllPEh4hiRHxKXMlq52DF6Kv3KOEU9jM+6AAYNMp7Y10Vk5lsYza/ObHqYe2OTiTqnyt5dBYsUR1m5TYN99fm1b1FKOWPdSBsquHAHFQHAO/r+Ymr2iKOh7MwOaZ40=~-1~-1~-1; Domain=.ibm.com; Path=/; Expires=Tue, 20 Aug 2024 18:25:31 GMT; Max-Age=31536000; Secure
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Set-Cookie: ak_bmsc=4B1118632B171F7D2972648255AAF4C1~000000000000000000000000000000~YAAQyONIF9w4CQGKAQAAbkpYGRQY+RqBoLPKen2D1hnpywzceAe3mAcE3P2uLSy3+c8FREzsVDViQKRTj2PQEzC0as2ROqAymAayHkO2NjK+mXgtMfzy2hl16Flk9lDeAcUK7TaVrrM/SAHR06gCuF1/Is/glidfYWL7XadFgER7uvaS0sUfFKb8E9ev3U9C/HEOHuOwTOyRmkdpZUivtcw8ZvLeDS9jrChkxFqnzIc+8iMGeaItNwqptEpdC5vpCGseP4sJXsStpcxNpEYWZJAMxWFS2WFMOyCvZNRD/ButstPPDcV2T1N246vf3+cBWs8KaH3ojcS10ROGuIIoVvilJV1yhMKx7JX0MVyzusWgyARncQUpe+Fq; Domain=.ibm.com; Path=/; Expires=Mon, 21 Aug 2023 20:25:31 GMT; Max-Age=7200; HttpOnly
01/01/1970 00:00:00 | |
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: x-powered-by: Express
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Location: https://www.ibm.com/ci-fr
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Server-Timing: dtSInfo;desc="0", dtRpid;desc="215614056"
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Content-Length: 234
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: X-IBM-From-Redirect: Yes
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Cache-Control: private, max-age=0
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Expires: Mon, 21 Aug 2023 18:25:30 GMT
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Date: Mon, 21 Aug 2023 18:25:30 GMT
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Connection: keep-alive
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: x-content-type-options: nosniff
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: X-XSS-Protection: 1; mode=block
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Content-Security-Policy: upgrade-insecure-requests
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Strict-Transport-Security: max-age=31536000
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: x-ibm-trace: www-dipatcher: dynamic rule
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Set-Cookie: _abck=2926F9B59E7974023B210EA07BDFA962~-1~YAAQyONIF3g4CQGKAQAArEdYGQoaWbexL+1bgRueGVZP2v+/xzwW9QbqmyIF7w/CszzulGJeiFfBbMMyffP95hkZ2infAQns9j46ZcIGBHkMlkfco0GTjA/uywK1ByG7+C5Zm8dODUpsTenkIIMNWFaUrNRq+QO+oSBSPgaoU8R23tPwV/nu/7LUwPj9t1yO9+MoCONLMh4tfKdmI+s7glyClEBIUSS0d4/bZiHdtmoa045VtAmaLx6XrDCnodaarxhEWJiS7/jb4FCiBMQ+3Tn53VpJqXMlMg8jNeZ+bBqM7GKQxuWNgkTywrWudughnpShfz5XsDZnIcUMighJW1pKDq6QKsowzF1yta3SB1TO4obwnGM=~-1~-1~-1; Domain=.ibm.com; Path=/; Expires=Tue, 20 Aug 2024 18:25:30 GMT; Max-Age=31536000; Secure
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Set-Cookie: bm_sz=F000307FD3D2767AE4238A9A4401F9BB~YAAQyONIF3k4CQGKAQAArEdYGRRmrCPsc8AOcbq+rFrmfMHSjgdVKQ22NVIm5UY2ogVosVdG8NQihByhocGQycxwKoooJ7Y/vTdz7ouPPe8HXlhRVPNU8BI6YMdbYPyLdEvgXTSSmsk0hTKXU3fTnWPneGG2d5eYfGji6BsNKwBDsy1hdtIARbDjXT7ORrU1vZSJ584LpxuXgz+FgzRnU7Hffz7aCjcGeo/TsPB4NiWbZZwe3DTw+8hNjuVMmQ1SlXowsHTbDJH7YKAS0HVSxpiKkT/i1YuNm79nQ6iPCz0=~3749939~3355702; Domain=.ibm.com; Path=/; Expires=Mon, 21 Aug 2023 22:25:30 GMT; Max-Age=14400
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server:
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: {"matched_rule":{"source":"/(bf|cd|cg|ci|cm|dz|fr|ga|ma|mg|mu|ne|sc|sn|td|tn)-en(([\\?].*)?)","target":"//www.ibm.com/ci-fr","target_rule":"//www.ibm.com/$1-fr$3","status":301,"hostname":"www.ibm.com","extracted_host":"www.ibm.com"}}
21/08/2023 18:25:28 | | [http] [ID#0] Info: Ignoring the response-body
21/08/2023 18:25:28 | | [http] [ID#0] Info: Connection #170 to host www.ibm.com left intact
21/08/2023 18:25:28 | | [http] [ID#0] Info: Issue another request to this URL: 'https://www.ibm.com/ci-fr'
21/08/2023 18:25:28 | | [http] [ID#0] Info: Found bundle for host: 0x244ba451de0 [serially]
21/08/2023 18:25:28 | | [http] [ID#0] Info: Re-using existing connection #170 with host www.ibm.com
21/08/2023 18:25:28 | | [http] [ID#0] Info: Connected to www.ibm.com (23.51.110.156) port 443 (#170)
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: GET /ci-fr HTTP/1.1
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Host: www.ibm.com
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.20.2)
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept: */*
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept-Encoding: deflate, gzip
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Referer: https://www.ibm.com/ci-en
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept-Language: en_GB
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server:
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: _199911_25_994_012217620_1_r405956311_restart.zip</name>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <nbytes>135051726.000000</nbytes>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <max_nbytes>150000000.000000</max_nbytes>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <status>1</status>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <persistent_file_xfer>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <num_retries>107</num_retries>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <first_request_time>1688825632.654633</first_request_time>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <next_request_time>1692663806.542822</next_request_time>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <time_so_far>7835.600470</time_so_far>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <last_bytes_xferred>117833728.000000</last_bytes_xferred>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <is_upload>1</is_upload>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </persistent_file_xfer>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </file_transfer>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </file_transfers>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </boinc_gui_rpc_reply>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: 
21/08/2023 18:25:28 | | [http] [ID#0] Info: Mark bundle as not supporting multiuse
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: HTTP/1.1 301 Moved Permanently
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: x-powered-by: Express
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Location: https://www.ibm.com/fr-fr
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Server-Timing: dtSInfo;desc="0", dtRpid;desc="1811996199"
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Cache-Control: private
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Content-Length: 229
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Date: Mon, 21 Aug 2023 18:25:31 GMT
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Connection: keep-alive
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: X-IBM-From-Redirect: Yes
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server:
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: {"matched_rule":{"source":"/(bf|cd|cg|ci|cm|dz|ga|ma|mg|mu|ne|sc|sn|td|tn)-fr(([\\?].*)?)","target":"//www.ibm.com/fr-fr","target_rule":"//www.ibm.com/fr-fr","status":301,"hostname":"www.ibm.com","extracted_host":"www.ibm.com"}}
21/08/2023 18:25:28 | | [http] [ID#0] Info: Ignoring the response-body
21/08/2023 18:25:28 | | [http] [ID#0] Info: Connection #170 to host www.ibm.com left intact
21/08/2023 18:25:28 | | [http] [ID#0] Info: Issue another request to this URL: 'https://www.ibm.com/fr-fr'
21/08/2023 18:25:28 | | [http] [ID#0] Info: Found bundle for host: 0x244ba451de0 [serially]
21/08/2023 18:25:28 | | [http] [ID#0] Info: Re-using existing connection #170 with host www.ibm.com
21/08/2023 18:25:28 | | [http] [ID#0] Info: Connected to www.ibm.com (23.51.110.156) port 443 (#170)
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: GET /fr-fr HTTP/1.1
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Host: www.ibm.com
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.20.2)
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept: */*
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept-Encoding: deflate, gzip
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Referer: https://www.ibm.com/ci-fr
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept-Language: en_GB
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server:
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: _199911_25_994_012217620_1_r405956311_restart.zip</name>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <nbytes>135051726.000000</nbytes>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <max_nbytes>150000000.000000</max_nbytes>
01/01/1970 00:00:00 | |
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Content-Length: 12618
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Connection: keep-alive
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Vary: Accept-Encoding
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Set-Cookie: ak_bmsc=273D26092684D7F28E1BE9AA40A37AEA~000000000000000000000000000000~YAAQyONIF9o4CQGKAQAAakpYGRQ5q99c9VGX+aAoFt/8uyEZ7mAvGFL24pyFwNR0dUH+bLARtpx56mAWi5pE4J7U6PtxZnEksafP1KhoKuLaZRjAKD1ivp/xGdddytQCgH2A9BBFXo9qJYu+pEUpPtSSCkRmfGyKM/MqJOXblNrV1c085I8zexv3OtL70T/mK5cfv7rM4lOjwizMgkAx9s8wg/M3xc5wjCN+7ajs+guhln0vJ1NlieqGFxIHsl7xcJy38A/U2BE2Pt1/sGu4y98bvUJQ16dA5ydcINpTC1UFtMsoaoY0sRlNCpEtWIfjkDL0pZ097rHNbY2bs1+eP2kYnImmfUotPWcxHZe/OVpWO82VwZ6MnZLR5nXotUqfxTtBOlB33Mx1kA4=; Domain=.common.ak.origins.s81c.com; Path=/; Expires=Mon, 21 Aug 2023 20:25:31 GMT; Max-Age=7200; HttpOnly
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: x-content-type-options: nosniff
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: X-XSS-Protection: 1; mode=block
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Content-Security-Policy: upgrade-insecure-requests
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Strict-Transport-Security: max-age=31536000
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: x-ibm-trace: www-dipatcher: dynamic rule
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Set-Cookie: _abck=B9BBB26C29DC64ED4D35B1C29FE79459~-1~YAAQyONIF9s4CQGKAQAAbkpYGQo/QrganlRKsh2G5K+TeWem3ywBBhv25Tk6iDR3owGtRgzQk6pFgISoElqs8+z6GqbpUKWVyQ1KeZ8qxtvC6GA5U4EGhl49PRqRG4T53P+fuiRZ0NremwrGtYRmEJ4Y30EkDUsMN0Dmprl7WxzBiXOAQwVxF49KJ0/Q0gs6F+KZ6+CYL8kkekQRany2hYJqoYbCPFf4BAjPQUNffdO3aSzHwT7GZOllPEh4hiRHxKXMlq52DF6Kv3KOEU9jM+6AAYNMp7Y10Vk5lsYza/ObHqYe2OTiTqnyt5dBYsUR1m5TYN99fm1b1FKOWPdSBsquHAHFQHAO/r+Ymr2iKOh7MwOaZ40=~-1~-1~-1; Domain=.ibm.com; Path=/; Expires=Tue, 20 Aug 2024 18:25:31 GMT; Max-Age=31536000; Secure
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Set-Cookie: ak_bmsc=4B1118632B171F7D2972648255AAF4C1~000000000000000000000000000000~YAAQyONIF9w4CQGKAQAAbkpYGRQY+RqBoLPKen2D1hnpywzceAe3mAcE3P2uLSy3+c8FREzsVDViQKRTj2PQEzC0as2ROqAymAayHkO2NjK+mXgtMfzy2hl16Flk9lDeAcUK7TaVrrM/SAHR06gCuF1/Is/glidfYWL7XadFgER7uvaS0sUfFKb8E9ev3U9C/HEOHuOwTOyRmkdpZUivtcw8ZvLeDS9jrChkxFqnzIc+8iMGeaItNwqptEpdC5vpCGseP4sJXsStpcxNpEYWZJAMxWFS2WFMOyCvZNRD/ButstPPDcV2T1N246vf3+cBWs8KaH3ojcS10ROGuIIoVvilJV1yhMKx7JX0MVyzusWgyARncQUpe+Fq; Domain=.ibm.com; Path=/; Expires=Mon, 21 Aug 2023 20:25:31 GMT; Max-Age=7200; HttpOnly
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server: Set-Cookie: bm_sz=9DAFBF6A0116649148D366979DECC044~YAAQyONIF904CQGKAQAAbkpYGRTM4EDBLaln0PiTXYmjkgrWmKl/V0JdjRXz5UV2Z/B6BW1N2vx6XHIqNx2Sxj66KgtzealFysbl+E5BOS9muXZsW4ulLhRDLLPWY0NWDz0f9BJun46J2BQSofedfqKF7df/tFkabIJT6OrgggFqbdYqhIDEqjX4cOyVgNJsI0Kawh8BvA0rn/Ckg0ICwrWwm6aCz25tbADxE21jy5mJiKZes26GloUNJ7A9VZJUcZ+fHDGB2ebny10NoQTFUWjay3fhyXNVu6mMxI1JWEE=~3356738~4601158; Domain=.ibm.com; Path=/; Expires=Mon, 21 Aug 2023 22:25:31 GMT; Max-Age=14400
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server:
21/08/2023 18:25:29 | |
21/08/2023 18:25:29 | | [http] [ID#0] Info: Connection #170 to host www.ibm.com left intact
21/08/2023 18:25:29 | | Internet access OK - project servers may be temporarily down.
21/08/2023 18:25:28 | | [http] [ID#0] Info: Issue another request to this URL: 'https://www.ibm.com/ci-en'
21/08/2023 18:25:28 | | [http] [ID#0] Info: Found bundle for host: 0x244ba451de0 [serially]
21/08/2023 18:25:28 | | [http] [ID#0] Info: Re-using existing connection #170 with host www.ibm.com
21/08/2023 18:25:28 | | [http] [ID#0] Info: Connected to www.ibm.com (23.51.110.156) port 443 (#170)
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: GET /ci-en HTTP/1.1
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Host: www.ibm.com
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.20.2)
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept: */*
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept-Encoding: deflate, gzip
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Referer: https://www.ibm.com/
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: Accept-Language: en_GB
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server:
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: _a1om_199911_25_994_012217620_1_r405956311_restart.zip</name>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <nbytes>135051726.000000</nbytes>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <max_nbytes>150000000.000000</max_nbytes>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <status>1</status>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <persistent_file_xfer>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <num_retries>107</num_retries>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <first_request_time>1688825632.654633</first_request_time>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <next_request_time>1692663806.542822</next_request_time>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <time_so_far>7835.600470</time_so_far>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <last_bytes_xferred>117833728.000000</last_bytes_xferred>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: <is_upload>1</is_upload>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </persistent_file_xfer>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </file_transfer>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </file_transfers>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: </boinc_gui_rpc_reply>
21/08/2023 18:25:28 | | [http] [ID#0] Sent header to server: 
21/08/2023 18:25:28 | | [http] [ID#0] Info: schannel: failed to decrypt data, need more data
21/08/2023 18:25:28 | | [http] [ID#0] Info: Mark bundle as not supporting multiuse
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: HTTP/1.1 301 Moved Permanently
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: x-powered-by: Express
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Location: https://www.ibm.com/ci-fr
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Server-Timing: dtSInfo;desc="0", dtRpid;desc="215614056"
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Content-Length: 234
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: X-IBM-From-Redirect: Yes
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Cache-Control: private, max-age=0
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Expires: Mon, 21 Aug 2023 18:25:30 GMT
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Date: Mon, 21 Aug 2023 18:25:30 GMT
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: Connection: keep-alive
21/08/2023 18:25:28 | | [http] [ID#0] Received header from server: x-content-type-options: nosniff
01/01/1970 00:00:00 | | [http] [ID#0] Received header from server: X-XSS-Protection: 1; mode=block
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server:
21/08/2023 18:25:29 | |
21/08/2023 18:25:29 | | [http] [ID#0] Info: Connection #170 to host www.ibm.com left intact
21/08/2023 18:25:29 | | Internet access OK - project servers may be temporarily down.
21/08/2023 18:25:29 | | [http] [ID#0] Received header from server:
21/08/2023 18:25:29 | |
21/08/2023 18:25:29 | | [http] [ID#0] Info: Connection #170 to host www.ibm.com left intact
21/08/2023 18:25:29 | | Internet access OK - project servers may be temporarily down.
ID: 69500 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 943
Credit: 34,302,382
RAC: 11,182
Message 69501 - Posted: 21 Aug 2023, 18:51:39 UTC - in response to Message 69500.  

Thanks. I'm just going out for the evening now, but I'll give it a thorough read-through later - probably in the morning.

I think all the flickering and blanks were probably because BOINC finds it hard to keep up with all those log messages flying around in such a short space of time. Shouldn't be a problem under normal running - just don't turn on too many debug flags at once!
ID: 69501 · Report as offensive     Reply Quote
Profile adrianxw
Avatar

Send message
Joined: 31 Aug 04
Posts: 145
Credit: 2,021,020
RAC: 816
Message 69502 - Posted: 22 Aug 2023, 7:49:40 UTC - in response to Message 69501.  

This line is possibly interesting on my logs...
>>>
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Info: We are completely uploaded and fine
<<<
... this, presumably means that the file is uploading correctly, and that the problem is server side because it is not sending some kind of acknowledgement to satisfy the sending task.
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 69502 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 943
Credit: 34,302,382
RAC: 11,182
Message 69503 - Posted: 22 Aug 2023, 7:59:36 UTC - in response to Message 69502.  

Depends where it occurs in the log - the context. There are several sub-conversations that go on during the process - negotiating a security protocol, telling the server what the file to be uploaded is called, how big it is, etc.

Any 'upload complete' message that relates to actual data will take a while to appear - 2.5 minutes in Karen's case. Does that match what you're seeing?
ID: 69503 · Report as offensive     Reply Quote
Profile adrianxw
Avatar

Send message
Joined: 31 Aug 04
Posts: 145
Credit: 2,021,020
RAC: 816
Message 69504 - Posted: 22 Aug 2023, 8:40:48 UTC - in response to Message 69503.  
Last modified: 22 Aug 2023, 8:42:49 UTC

The entire session is included in the message I posted yesterday, it is a couple of messages back. I've turned the log switches off again now. If you want any more, just say, happy to help.
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 69504 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 943
Credit: 34,302,382
RAC: 11,182
Message 69505 - Posted: 22 Aug 2023, 11:11:29 UTC

OK, thanks both. I've now filleted both files, and can report:

Karen's exactly matches the file I extracted earlier and posted in Number Crunching, at message 69475. It ends (our bit of it, anyway) with:

21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Info: Mark bundle as not supporting multiuse
21/08/2023 18:22:52 | climateprediction.net | [http] [ID#157] Received header from server: HTTP/1.1 100 Continue
21/08/2023 18:25:25 | climateprediction.net | [http] [ID#157] Info: Recv failure: Connection was reset
21/08/2023 18:25:25 | climateprediction.net | [http] [ID#157] Info: Closing connection 169
That's an exact match, but coupled with the additional information about the upload actually proceeding, forces us to consider alternative explanations.

Adrianxw's is subtly different. It ends:

21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Received header from server: HTTP/1.1 100 Continue
21/08/2023 16:26:35 | climateprediction.net | [http] [ID#13343] Info: We are completely uploaded and fine
21/08/2023 16:31:42 | climateprediction.net | Temporarily failed upload of wah2_eas25_a0p4_199111_25_994_012216342_0_r1775509966_14.zip: transient HTTP error
21/08/2023 16:31:42 | climateprediction.net | Backing off 03:22:01 on upload of wah2_eas25_a0p4_199111_25_994_012216342_0_r1775509966_14.zip
It doesn't include the note about "not supporting multiuse" - perhaps you are using an older version of BOINC, I'll check - but it does include "We are completely uploaded and fine", in the right place. (there's one of the meaningless ones higher up as well, but we can ignore that).

I'm in touch with the project staff, so we'll mull it over.
ID: 69505 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 807
Credit: 13,593,584
RAC: 7,495
Message 69506 - Posted: 22 Aug 2023, 11:13:35 UTC - in response to Message 69504.  

Following a meeting yesterday, I've been asked by the CPDN Project Director to pass on a message.

If anyone is having problems with 'stuck uploads', then Abort the task. This batch is of questionable scientific quality because of the very high number of failures.

As this batch is now closed, no resends for any Aborted tasks will be sent out to others.

Problems on the server have been investigated. One of their disks filled completely resulting in a move of data, which may be causing the problem. The server will be looked at again before any more batches go out (hopefully in the next couple of weeks when folk return from holiday).
---
CPDN Visiting Scientist
ID: 69506 · Report as offensive     Reply Quote
Profile adrianxw
Avatar

Send message
Joined: 31 Aug 04
Posts: 145
Credit: 2,021,020
RAC: 816
Message 69508 - Posted: 22 Aug 2023, 11:18:43 UTC - in response to Message 69505.  
Last modified: 22 Aug 2023, 11:24:40 UTC

My BOINC is 7.22.2 (x64).

Then he says to abort it. Grrrrrrr!!!!! That ran for 17d 09:44.24 on my 4GHz i7. Yes, you're right, I AM really annoyed. I'd set no new tasks earlier when this problem started, I'm not considering taking that off.
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.
ID: 69508 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 943
Credit: 34,302,382
RAC: 11,182
Message 69510 - Posted: 22 Aug 2023, 11:35:00 UTC - in response to Message 69506.  

Please DON'T do that. Instead, cancel the TRANSFER only - in the transfers tab - and the task should become 'ready to report'. Update the project as normal, and you'll get a lot of disk space freed up, without a blot on your account record.
ID: 69510 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · Next

Questions and Answers : Windows : Upload issue.

©2024 climateprediction.net