climateprediction.net home page
Posts by Thyme Lawn

Posts by Thyme Lawn

1) Message boards : climateprediction.net Science : Myles Allen on The Life Scientific (Message 62133)
Posted 18 Feb 2020 by Profile Thyme Lawn
Post:
CPDN founder Myles Allan was on Jim Al-Khalili's always illuminating BBC Radio 4 programme "The Life Scientific" this morning. Definitely worth a listen.
2) Message boards : Number crunching : Credits (Message 61376)
Posted 24 Oct 2019 by Profile Thyme Lawn
Post:
If CPDN is missing from your list of projects on the credit aggregation sites you'll need to tick the Do you consent to exporting your data to BOINC statistics aggregation Web sites? checkbox on the project preferences page if you want to reappear.
3) Message boards : Number crunching : transient HTTP error (Message 59197)
Posted 17 Dec 2018 by Profile Thyme Lawn
Post:
I have been stuck uploading some zips for batch 691 for several days. Transient HTTP error.

As George mentioned, I also have stuck uploads for a task in this batch. The task has completed and everything has been successfully sent to upload6 except for:

  • wah2_cam25_a0fm_200405_18_691_011370111_2_r66429025_13.zip is stuck at 54.19%, first failed at 13:07:05 on 15th, has been retried 24 times and is getting up to 54.41% on each attempt.

  • wah2_cam25_a0fm_200405_18_691_011370111_2_r66429025_16.zip is stuck at 8.56%, first failed at 05:58:34 on 16th, has been retried 15 times and is getting up to 8.68% on each attempt.

In both cases the BOINC event log shows that the file was "locked by file_upload_handler" for 2 hours after the first attempt and gives no indication why subsequent attempts have been failing.

Wireshark shows that retries are successfully negotiating the restart offset and data is being sent before timing out. The same restart point is negotiated on every retry, indicating that none of the retransmitted data is being received.

4) Message boards : Number crunching : Batch 774 (safr50) (Message 59116)
Posted 27 Nov 2018 by Profile Thyme Lawn
Post:
If you installed BOINC to run as a service the batch 774 tasks seem to get stuck in the initialisation of the regional model instead of crashing out with a Fortran runtime error popup dialog box.

If you are running BOINC as a service BOINC Manager will show the elapsed time and progress increasing as expected, but if you open the task properties dialog box the CPU time isn't changing from "---". If checkpoint or task debug is enabled BOINC's event log shows that no checkpoints are being made and the elapsed time and progress will revert to 0 if you restart BOINC.

If this applies to your system you should abort all of its batch 774 tasks.
5) Message boards : Number crunching : New work Discussion (Message 59115)
Posted 27 Nov 2018 by Profile Thyme Lawn
Post:
BOINC Manager shows the elapsed time and progress increasing as expected, but if you open the task properties dialog box the CPU time isn't changing from "---". If checkpoint or task debug is enabled BOINC's event log shows that no checkpoints are being made. When BOINC is restarted the elapsed time and progress revert to 0.


Do they still use a whole core of cpu time when doing this?

No. SysInternals Process Explorer was showing 2 idle cores of the 8 on my i7 with less than 0.1 seconds of CPU time for both of the batch 774 models' controller + global + regional processes.
6) Message boards : Number crunching : New work Discussion (Message 59108)
Posted 27 Nov 2018 by Profile Thyme Lawn
Post:
@WB8ILI I run BOINC as a service. Yes, it does mean I can't run GPU applications on other projects, but it also means that tasks which fail with a Windows runtime error don't generate the pop-up dialog box you can get in a non-service install.
7) Message boards : Number crunching : New work Discussion (Message 59106)
Posted 27 Nov 2018 by Profile Thyme Lawn
Post:
Batch 774 SAFR50 region. These are using on the restart files from batch 741.

If you are running any tasks from this batch please check them because I have 2 batch 774 tasks stuck in the initialisation of the regional model (project team notified).

BOINC Manager shows the elapsed time and progress increasing as expected, but if you open the task properties dialog box the CPU time isn't changing from "---". If checkpoint or task debug is enabled BOINC's event log shows that no checkpoints are being made. When BOINC is restarted the elapsed time and progress revert to 0.
8) Message boards : Number crunching : Stuck upload issue (Message 57759)
Posted 1 Feb 2018 by Profile Thyme Lawn
Post:
The project team are aware of the upload problem for WAH2 SAS50 batch 706, 707 and 708 files. Upload server upload2.cpdn.org has reached its disk quota and they are making more space available.
9) Message boards : News : Welcome to the News message board! (Message 57217)
Posted 27 Oct 2017 by Profile Thyme Lawn
Post:
The credit problem users have been posting about here has been raised with the project team and I have been assured that all of the information required to calculate credit is intact.

The problem is related to the new daily credit script they're trying to phase in. The old weekly script is being re-run and credits should return to the correct level when it's complete.
10) Message boards : Number crunching : Credit Status (Message 57216)
Posted 27 Oct 2017 by Profile Thyme Lawn
Post:
The credit problem has been raised with the project team and I have been assured that all of the information required to calculate credit is intact.

The current problem is related to the new daily credit script they're trying to phase in. The old weekly script is being re-run and credits should return to the correct level when it's complete.

BTW, the total credit for the project dropped from 32,814,617,008 on Wednesday to 10,938,204,204 yesterday ...
11) Message boards : Number crunching : Meet the CPDN team! (Message 56754)
Posted 30 Aug 2017 by Profile Thyme Lawn
Post:
Curiosity Explorer Tickets can be obtained at https://www.eventbrite.co.uk/e/curiosity-carnival-tickets-33578014746
12) Message boards : Number crunching : No trickles on webpage (Message 55676)
Posted 12 Feb 2017 by Profile Thyme Lawn
Post:
It looks like the project team have forgotten to enable trickle processing for batch 514 on the server.
13) Message boards : Number crunching : Project communication failed: attempting access to reference site (Message 54819)
Posted 21 Sep 2016 by Profile Thyme Lawn
Post:
Thanks a lot Vitalii, your image makes everything much clearer.

Your stuck file is 105.26MB, the server has already received 100.99MB and BOINC can't send the last 4,540,690 bytes of the file. This is very conclusively pointing towards the cause being a file size limit on the server. The project team have been notified and it should hopefully be sorted out tomorrow.
14) Message boards : Number crunching : Project communication failed: attempting access to reference site (Message 54816)
Posted 21 Sep 2016 by Profile Thyme Lawn
Post:
Andy has increased the HTTP timeout on upload6. Could anyone who has a stuck mex25 upload please check if that allows it to complete.
15) Message boards : Number crunching : Project communication failed: attempting access to reference site (Message 54808)
Posted 21 Sep 2016 by Profile Thyme Lawn
Post:
The message logs show that 4,540,690 bytes are being transferred for Vitalii's wah2_mex25_c0fh_199012_13_410_010609033_1_5.zip file and 69,646,991 bytes for Lockley's wah2_mex25_c0il_199112_13_410_010609145_0_12.zip file. What are their sizes showing as on BOINC Manager's Transfers tab? If they're larger it'll indicate that the server has partially accepted them.
16) Message boards : Number crunching : Project communication failed: attempting access to reference site (Message 54803)
Posted 20 Sep 2016 by Profile Thyme Lawn
Post:
Thanks Vitalii, that's definitely appears to be a server problem (there are no [http_xfer] messages when the file content should be being transmitted to the server). I'll notify the project team.
17) Message boards : Number crunching : Project communication failed: attempting access to reference site (Message 54799)
Posted 20 Sep 2016 by Profile Thyme Lawn
Post:
That contains this line:

19.09.2016 22:50:06 | | [http] [ID#0] Received header from server: HTTP/1.1 302 Found

That's not where the problem lies Les. The 302 is the response from google.com to BOINC's internet connectivity check telling it to redirect the request to google.com.ua.

The relevant lines from Vitali's output are:

19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Info: Connected to upload6.cpdn.org (158.97.9.11) port 80 (#35)
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: Content-Length: 4540690
19.09.2016 22:49:38 | climateprediction.net | [http] [ID#9] Sent header to server: Expect: 100-continue
19.09.2016 22:49:39 | climateprediction.net | [http] [ID#9] Received header from server: HTTP/1.1 100 Continue
19.09.2016 22:50:05 | climateprediction.net | [http] [ID#9] Info: Recv failure: Connection was reset
19.09.2016 22:50:05 | climateprediction.net | [http] [ID#9] Info: Closing connection 35
19.09.2016 22:50:05 | climateprediction.net | [http] HTTP error: Failure when receiving data from the peer


The "HTTP/1.1 100 Continue" response indicates that an HTTP/1.1 connection has been successfully made to the upload server, the file offset to start uploading from has been determined and BOINC has started sending 4,540,690 bytes of data (if the file being sent is larger than that it's indicating that some data has successfully been transferred to upload6). The next line is indicating that the connection was reset 26 seconds later due to a receive failure. My guess is that it's indicating a problem on that upload server (upload6.cpdn.org (158.97.9.11)).

Enabling "http_xfer_debug" will directly indicate whether any data has being transferred. I didn't suggest it earlier because it generates a message for each section of data sent to the server which very quickly mounts up (in my case it's about 180 messages per second for an upload). The messages don't identify the project and the ID# is the only way to tie them to the original request (i.e. enabling http_xfer_debug with http_debug disabled is meaningless). The following messages are selected from my previous post with a couple of http_xfer_debug messages included and lots of lines removed. The first POST sequence determines how many bytes the server has already received and the second is transferring the file from that offset:

19/09/2016 11:11:32 | climateprediction.net | Started upload of wah2_sas50_ky74_200912_13_448_010718036_0_r921421034_1.zip
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info: Connected to upload2.cpdn.org (129.67.195.140) port 80 (#627)
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Content-Length: 311
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info: We are completely uploaded and fine
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: HTTP/1.1 200 OK
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info: Connection #627 to host upload2.cpdn.org left intact
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Info: Re-using existing connection! (#627) with host upload2.cpdn.org
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Info: Connected to upload2.cpdn.org (129.67.195.140) port 80 (#627)
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Content-Length: 23198108
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Expect: 100-continue
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Received header from server: HTTP/1.1 100 Continue
19/09/2016 11:11:35 | | [http_xfer] [ID#9825] HTTP: wrote 2956 bytes
19/09/2016 11:11:35 | | [http_xfer] [ID#9825] HTTP: wrote 2441 bytes
19/09/2016 11:18:04 | climateprediction.net | [http] [ID#9825] Info: We are completely uploaded and fine
19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: HTTP/1.1 200 OK
19/09/2016 11:18:07 | climateprediction.net | Finished upload of wah2_sas50_ky74_200912_13_448_010718036_0_r921421034_1.zip
18) Message boards : Number crunching : Project communication failed: attempting access to reference site (Message 54794)
Posted 19 Sep 2016 by Profile Thyme Lawn
Post:
In BOINC Manager you can enable debugging of HTTP conversations by typing <Ctrl>+<Shift>+F, clicking on the "http_debug" checkbox to make it ticked and clicking OK (to disable the debug repeat that process, this time removing the "http_debug" checkbox tick).

A successful file transfer will result in an event log sequence similar to the following:

19/09/2016 11:11:32 | climateprediction.net | Started upload of wah2_sas50_ky74_200912_13_448_010718036_0_r921421034_1.zip
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info:    Trying 129.67.195.140...
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info:  Connected to upload2.cpdn.org (129.67.195.140) port 80 (#627)
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Host: upload2.cpdn.org
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.6.22)
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Accept: */*
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Accept-Encoding: deflate, gzip
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Content-Type: application/x-www-form-urlencoded
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Accept-Language: en_GB
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server: Content-Length: 311
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Sent header to server:
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info:  We are completely uploaded and fine
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: HTTP/1.1 200 OK
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: Date: Mon, 19 Sep 2016 10:10:26 GMT
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: Server: Apache/2.4.6 (CentOS)
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: Content-Length: 93
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server: Content-Type: text/plain; charset=UTF-8
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Received header from server:
19/09/2016 11:11:33 | climateprediction.net | [http] [ID#9825] Info:  Connection #627 to host upload2.cpdn.org left intact
19/09/2016 11:11:34 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Info:  Found bundle for host upload2.cpdn.org: 0x1c365e04cb0
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Info:  Re-using existing connection! (#627) with host upload2.cpdn.org
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Info:  Connected to upload2.cpdn.org (129.67.195.140) port 80 (#627)
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Host: upload2.cpdn.org
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.6.22)
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Accept: */*
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Accept-Encoding: deflate, gzip
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Content-Type: application/x-www-form-urlencoded
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Accept-Language: en_GB
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Content-Length: 23198108
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server: Expect: 100-continue
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Sent header to server:
19/09/2016 11:11:35 | climateprediction.net | [http] [ID#9825] Received header from server: HTTP/1.1 100 Continue
19/09/2016 11:18:04 | climateprediction.net | [http] [ID#9825] Info:  We are completely uploaded and fine
19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: HTTP/1.1 200 OK
19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: Date: Mon, 19 Sep 2016 10:10:28 GMT
19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: Server: Apache/2.4.6 (CentOS)
19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: Transfer-Encoding: chunked
19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server: Content-Type: text/plain; charset=UTF-8
19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Received header from server:
19/09/2016 11:18:06 | climateprediction.net | [http] [ID#9825] Info:  Connection #627 to host upload2.cpdn.org left intact
19/09/2016 11:18:07 | climateprediction.net | Finished upload of wah2_sas50_ky74_200912_13_448_010718036_0_r921421034_1.zip


The upload messages will be preceded with those for the associated trickle:

19/09/2016 11:11:30 | climateprediction.net | Sending scheduler request: To send trickle-up message.
19/09/2016 11:11:30 | climateprediction.net | Not requesting tasks: don't need (not highest priority project)
19/09/2016 11:11:30 | climateprediction.net | [http] HTTP_OP::init_post(): http://climateapps2.oerc.ox.ac.uk/cpdnboinc_cgi/cgi
19/09/2016 11:11:30 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Info:    Trying 129.67.195.185...
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Info:  Connected to climateapps2.oerc.ox.ac.uk (129.67.195.185) port 80 (#626)
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: POST /cpdnboinc_cgi/cgi HTTP/1.1
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Host: climateapps2.oerc.ox.ac.uk
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.6.22)
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Accept: */*
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Accept-Encoding: deflate, gzip
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Content-Type: application/x-www-form-urlencoded
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Accept-Language: en_GB
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Content-Length: 37921
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server: Expect: 100-continue
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Sent header to server:
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Received header from server: HTTP/1.1 100 Continue
19/09/2016 11:11:31 | climateprediction.net | [http] [ID#1] Info:  We are completely uploaded and fine
19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: HTTP/1.1 200 OK
19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: Date: Mon, 19 Sep 2016 10:11:33 GMT
19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: Server: Apache
19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: Connection: close
19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: Transfer-Encoding: chunked
19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server: Content-Type: text/xml
19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Received header from server:
19/09/2016 11:11:32 | climateprediction.net | [http] [ID#1] Info:  Closing connection 626
19/09/2016 11:11:32 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle 'C:\Program Files\BOINC\ca-bundle.crt'
19/09/2016 11:11:32 | climateprediction.net | [http] HTTP_OP::libcurl_exec(): ca-bundle set
19/09/2016 11:11:32 | climateprediction.net | Scheduler request completed
19) Message boards : Number crunching : News and Announcements 2 (Message 53885)
Posted 4 Apr 2016 by Profile Thyme Lawn
Post:
Archived credits have been restored for all users. These aren't included in the total at the moment but should be on completion of the credit script Andy has started.
20) Message boards : Number crunching : Total Credit (Message 53884)
Posted 4 Apr 2016 by Profile Thyme Lawn
Post:
Not sure if I should be posting this as I don't want to raise false hopes but credits are currently being re-calculated and should include archived credit.

Many thanks to Andy for his work on this and to the moderators who have fielded most of the queries/flack on this.

That will with luck leave more time for looking at the posting new topics problem which I am told looks as if it is due to an upgrade from PHP5.4 To PHP.5

I do realise that some like myself may be old enough to remember a different meaning of upgrade which had something to do with an improvement!

Archived credits now appear on user pages but won't be included in the total until the credit script finishes running. My account page currently shows that I'll be getting back more than 5.5 million when it's done:
Computing and credit

Total credit 5,582,914
Recent average credit 2,199.89
Archived results (not viewable) 559
Archived credit (included in total) 5,557,035


Next 20

©2020 climateprediction.net