climateprediction.net home page
Posts by rob

Posts by rob

1) Message boards : Number crunching : NZ25 file upload server problems? (Message 65833)
Posted 13 Aug 2022 by rob
Post:
BOINC reported all the files to be in the mid to high 80Mb.

At the time of me seeing your comment I had one being uploaded, BOINC reported as ~86Mb, and was about the same when file was on the disc (needless to say it uploaded as I was looking at it and your message so I didn't catch the right sets of digits.....)
2) Message boards : Number crunching : NZ25 file upload server problems? (Message 65828)
Posted 13 Aug 2022 by rob
Post:
Dialogue around a zip upload stalling:
13/08/2022 10:56:38 | climateprediction.net | 
13/08/2022 10:56:38 | climateprediction.net | [http] [ID#257] Info:  Connection #56 to host upload4.cpdn.org left intact
13/08/2022 10:56:39 | climateprediction.net | [error] Error reported by file upload server: EOF on socket read : asked for 262144, got 159040
13/08/2022 10:56:39 | climateprediction.net | Temporarily failed upload of wah2_nz25_a1g2_199805_25_936_012151636_0_r1401480091_4.zip: transient upload error
13/08/2022 10:56:39 | climateprediction.net | Backing off 00:02:05 on upload of wah2_nz25_a1g2_199805_25_936_012151636_0_r1401480091_4.zip
13/08/2022 10:57:01 | climateprediction.net | [http] [ID#265] Info:  We are completely uploaded and fine
13/08/2022 10:57:01 | climateprediction.net | [http] [ID#265] Received header from server: HTTP/1.1 200 OK
13/08/2022 10:57:01 | climateprediction.net | [http] [ID#265] Received header from server: Date: Sat, 13 Aug 2022 09:46:57 GMT
13/08/2022 10:57:01 | climateprediction.net | [http] [ID#265] Received header from server: Server: Apache/2.4.7 (Ubuntu)
13/08/2022 10:57:01 | climateprediction.net | [http] [ID#265] Received header from server: Vary: Accept-Encoding
13/08/2022 10:57:01 | climateprediction.net | [http] [ID#265] Received header from server: Content-Encoding: gzip
13/08/2022 10:57:01 | climateprediction.net | [http] [ID#265] Received header from server: Content-Length: 123
13/08/2022 10:57:01 | climateprediction.net | [http] [ID#265] Received header from server: Content-Type: text/plain
13/08/2022 10:57:01 | climateprediction.net | [http] [ID#265] Received header from server:
13/08/2022 10:57:01 | climateprediction.net |


Edit to add:
A bit more arrived as I was typing:
13/08/2022 10:57:01 | climateprediction.net | [http] [ID#265] Info:  Connection #72 to host upload4.cpdn.org left intact
13/08/2022 10:57:02 | climateprediction.net | [error] Error reported by file upload server: EOF on socket read : asked for 262144, got 157592
13/08/2022 10:57:02 | climateprediction.net | Temporarily failed upload of wah2_nz25_a1k4_199905_25_936_012151782_0_r706971930_4.zip: transient upload error
13/08/2022 10:57:02 | climateprediction.net | Backing off 00:04:34 on upload of wah2_nz25_a1k4_199905_25_936_012151782_0_r706971930_4.zip
3) Message boards : Number crunching : NZ25 file upload server problems? (Message 65827)
Posted 13 Aug 2022 by rob
Post:
Richard - I just set http_debug....
"Instantly" all the tasks in transfer vanished from view, some of them reappeared about half a minute later.
One thing I noticed was a number of blank lines - here's a sample @ 10:23:23:
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Received header from server: Server: Apache/2.4.7 (Ubuntu)
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Received header from server: Vary: Accept-Encoding
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Received header from server: Content-Encoding: gzip
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Received header from server: Content-Length: 84
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Received header from server: Content-Type: text/plain
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Received header from server:
13/08/2022 10:23:23 | climateprediction.net | 
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Info:  Connection #57 to host upload4.cpdn.org left intact
13/08/2022 10:23:23 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Info:  Found bundle for host upload4.cpdn.org: 0x43d7230 [can pipeline]
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Info:  Re-using existing connection! (#57) with host upload4.cpdn.org
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Info:  Connected to upload4.cpdn.org (131.217.169.79) port 80 (#57)
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Sent header to server: Host: upload4.cpdn.org
13/08/2022 10:23:23 | climateprediction.net | [http] [ID#228] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.16.20)



Scrolling back in time to just before I set http_debug:
13/08/2022 10:13:36 | climateprediction.net | [sched_op] Starting scheduler request
13/08/2022 10:13:37 | climateprediction.net | Sending scheduler request: To send trickle-up message.
13/08/2022 10:13:37 | climateprediction.net | Not requesting tasks: don't need (CPU: job cache full; NVIDIA GPU: )
13/08/2022 10:13:37 | climateprediction.net | [sched_op] CPU work request: 0.00 seconds; 0.00 devices
13/08/2022 10:13:37 | climateprediction.net | [sched_op] NVIDIA GPU work request: 0.00 seconds; 0.00 devices
13/08/2022 10:13:41 | climateprediction.net | Scheduler request completed
13/08/2022 10:13:41 | climateprediction.net | [sched_op] Server version 715
13/08/2022 10:13:41 | climateprediction.net | Project requested delay of 3636 seconds
13/08/2022 10:13:41 | climateprediction.net | [sched_op] Deferring communication for 01:00:36
13/08/2022 10:13:41 | climateprediction.net | [sched_op] Reason: requested by project
13/08/2022 10:13:45 | climateprediction.net | Started upload of wah2_nz25_a1i4_199805_25_936_012151710_0_r2018106213_4.zip
13/08/2022 10:18:53 |  | Project communication failed: attempting access to reference site
13/08/2022 10:18:53 | climateprediction.net | Temporarily failed upload of wah2_nz25_a1i4_199805_25_936_012151710_0_r2018106213_4.zip: transient HTTP error
13/08/2022 10:18:53 | climateprediction.net | Backing off 00:03:35 on upload of wah2_nz25_a1i4_199805_25_936_012151710_0_r2018106213_4.zip



Then:
13/08/2022 10:20:09 |  | Internet access OK - project servers may be temporarily down.
13/08/2022 10:20:37 |  | Re-reading cc_config.xml
13/08/2022 10:20:37 |  | Using proxy info from GUI
13/08/2022 10:20:37 |  | Config: don't compute while Cities.exe is running
13/08/2022 10:20:37 |  | Config: event log limit 20000 lines
13/08/2022 10:20:37 |  | Config: use all coprocessors
13/08/2022 10:20:37 |  | log flags: file_xfer, sched_ops, task, http_debug, sched_op_debug
13/08/2022 10:20:37 | DENIS@home | Found app_config.xml
13/08/2022 10:20:37 | Einstein@Home | Found app_config.xml
13/08/2022 10:20:37 | LHC@home | Found app_config.xml
13/08/2022 10:20:40 |  | Re-reading cc_config.xml
13/08/2022 10:20:40 |  | Using proxy info from GUI
13/08/2022 10:20:40 |  | Config: don't compute while Cities.exe is running
13/08/2022 10:20:40 |  | Config: event log limit 20000 lines
13/08/2022 10:20:40 |  | Config: use all coprocessors
13/08/2022 10:20:40 |  | log flags: file_xfer, sched_ops, task, http_debug, sched_op_debug
13/08/2022 10:20:40 | DENIS@home | Found app_config.xml
13/08/2022 10:20:40 | Einstein@Home | Found app_config.xml
13/08/2022 10:20:40 | LHC@home | Found app_config.xml


Followed by a block like this (trying to upload the files that vanished from view?):
13/08/2022 10:21:51 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle 'C:\Program Files\BOINC\ca-bundle.crt'
13/08/2022 10:21:51 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
13/08/2022 10:21:51 | climateprediction.net | Started upload of wah2_nz25_a1ga_199805_25_936_012151644_0_r2029078922_2.zip
13/08/2022 10:21:51 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle 'C:\Program Files\BOINC\ca-bundle.crt'
13/08/2022 10:21:51 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
13/08/2022 10:21:51 | climateprediction.net | Started upload of wah2_nz25_a1ga_199805_25_936_012151644_0_r2029078922_3.zip
13/08/2022 10:21:51 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle 'C:\Program Files\BOINC\ca-bundle.crt'
13/08/2022 10:21:51 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
13/08/2022 10:21:51 | climateprediction.net | Started upload of wah2_nz25_a1i4_199805_25_936_012151710_0_r2018106213_2.zip
13/08/2022 10:21:51 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle 'C:\Program Files\BOINC\ca-bundle.crt'
13/08/2022 10:21:51 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
13/08/2022 10:21:51 | climateprediction.net | Started upload of wah2_nz25_a1k4_199905_25_936_012151782_0_r706971930_2.zip
13/08/2022 10:21:51 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle 'C:\Program Files\BOINC\ca-bundle.crt'
13/08/2022 10:21:51 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
13/08/2022 10:21:51 | climateprediction.net | Started upload of wah2_nz25_a1g2_199805_25_936_012151636_0_r1401480091_2.zip


And:
13/08/2022 10:21:51 | climateprediction.net | [http] [ID#220] Info:  Found bundle for host upload4.cpdn.org: 0x43d7230 [serially]
13/08/2022 10:21:51 | climateprediction.net | [http] [ID#221] Info:  Found bundle for host upload4.cpdn.org: 0x43d7230 [serially]
13/08/2022 10:21:51 | climateprediction.net | [http] [ID#222] Info:  Found bundle for host upload4.cpdn.org: 0x43d7230 [serially]
13/08/2022 10:21:51 | climateprediction.net | [http] [ID#223] Info:  Found bundle for host upload4.cpdn.org: 0x43d7230 [serially]
13/08/2022 10:21:51 | climateprediction.net | [http] [ID#224] Info:  Found bundle for host upload4.cpdn.org: 0x43d7230 [serially]
13/08/2022 10:21:51 | climateprediction.net | [http] [ID#225] Info:  Found bundle for host upload4.cpdn.org: 0x43d7230 [serially]
13/08/2022 10:21:51 | climateprediction.net | [http] [ID#226] Info:  Found bundle for host upload4.cpdn.org: 0x43d7230 [serially]


Then a lad of lines like these:
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#219] Info:    Trying 131.217.169.79...
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#220] Info:  Hostname was found in DNS cache
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#220] Info:    Trying 131.217.169.79...
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Info:  Hostname was found in DNS cache
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Info:    Trying 131.217.169.79...
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#222] Info:  Hostname was found in DNS cache


Then another block of lies like these:
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Info:  Connected to upload4.cpdn.org (131.217.169.79) port 80 (#56)
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Sent header to server: Host: upload4.cpdn.org
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.16.20)
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Sent header to server: Accept: */*
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Sent header to server: Accept-Encoding: deflate, gzip
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Sent header to server: Accept-Language: en_GB
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Sent header to server: Content-Length: 312
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Sent header to server: Content-Type: application/x-www-form-urlencoded
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Sent header to server:
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Sent header to server: poll_debug>
13/08/2022 10:21:52 | climateprediction.net | [http] [ID#221] Sent header to server:         <priority_debug>0</priority_debug>


Loads more lines - the last few are:
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Info:  Connection #55 to host upload4.cpdn.org left intact
13/08/2022 10:32:18 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
13/08/2022 10:32:18 | climateprediction.net | Finished upload of wah2_nz25_a1i4_199805_25_936_012151710_0_r2018106213_3.zip
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Info:  Found bundle for host upload4.cpdn.org: 0x43d7230 [can pipeline]
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Info:  Re-using existing connection! (#55) with host upload4.cpdn.org
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Info:  Connected to upload4.cpdn.org (131.217.169.79) port 80 (#55)
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Sent header to server: Host: upload4.cpdn.org
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.16.20)
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Sent header to server: Accept: */*
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Sent header to server: Accept-Encoding: deflate, gzip
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Sent header to server: Accept-Language: en_GB
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Sent header to server: Content-Length: 90401533
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Sent header to server: Content-Type: application/x-www-form-urlencoded
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Sent header to server: Expect: 100-continue
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Sent header to server:
13/08/2022 10:32:18 | climateprediction.net | [http] [ID#246] Received header from server: HTTP/1.1 100 Continue
13/08/2022 10:37:36 | climateprediction.net | [http] [ID#228] Info:  We are completely uploaded and fine


I started with about 20 or so zip files to upload, now down to 7, plus one that's 100% progress, but in "upload: retry in 01:35:xx". Once the rest have cleared I might give that one a nudge....
Have fun
(I should say I'm running BOINC version 7.16.20 on Windows 10 with Virtual box.)
4) Message boards : Number crunching : NZ25 file upload server problems? (Message 65818)
Posted 12 Aug 2022 by rob
Post:
The arthritic snail that is uploads slides slowly up the sandpaper.....
It's very patchy, sometimes a zip will go up up smoothly, but most of the time the snail is being very careful, if not stopped and soothing its painful foot.
5) Questions and Answers : Windows : Cant get any WUs (Message 64738)
Posted 30 Oct 2021 by rob
Post:
Thanks for the explanation - I had a feeling that was the case :-(
I'll just have to have a dig around and see what other project grabs my fancy and has work for a Windows PC.
6) Message boards : Number crunching : Upload failures (Message 60594)
Posted 5 Jul 2019 by rob
Post:
No way I'm going to touch any "social media" stuff, and the BOINC Notices system will only get picked up by people who've not turned them off, and who bother to look at BOINC anyway. (Do they even appear in the simple view?)


The answer to your question is "sort of" - the notices button gains a red border when you hover over it, not very obvious, and not every user will even bother with looking at the simple view to see that.

And last night something stirred in the land of Jasmine - the mountain of my backed up zip files were transferred, stating round about 10pm BST.
7) Message boards : Number crunching : Upload failures (Message 60454)
Posted 26 Jun 2019 by rob
Post:
I've just looked - two tasks waiting to upload, a total of 23 zip files mostly around 90Mb each.
Surely, when sending work out one would have an idea of the returned file sizes, and either think about not sending a particular job out if there might be a space issue, or make sure that there is more than sufficient space available for the return files.
8) Message boards : Number crunching : ANOTHER UPLOAD PROBLEM (Message 54168)
Posted 22 May 2016 by rob
Post:
Today is a somewhat sad day in the land of the CPDN servers - the work (tricle=ups?) gets sent back, or at least the transmit report says 100%, then stalls. Typical message is:

22/05/2016 13:50:31 | climateprediction.net | [error] Error reported by file upload server: can't open file /storage/incoming/uploader/hadam3p_pnw_j3aj_201412_12_405_010573689_0_10.zip: No such file or directory
22/05/2016 13:50:31 | climateprediction.net | Temporarily failed upload of hadam3p_pnw_j3aj_201412_12_405_010573689_0_10.zip: transient upload error
22/05/2016 13:50:31 | climateprediction.net | Backing off 00:02:29 on upload of hadam3p_pnw_j3aj_201412_12_405_010573689_0_10.zip



Oh well, the server might get better without a kick in the nodes, but I suspect it is going to need the well directed application of a size-ten reboot....




©2022 climateprediction.net