climateprediction.net home page
Posts by bernard_ivo

Posts by bernard_ivo

1) Message boards : Number crunching : Batch 1005 WAH2 NZ region (Message 70626)
Posted 7 Mar 2024 by bernard_ivo
Post:
There are currently no incidents reported on the JASMIN/CEDA status page, which is where upload11.cpdn.org really is:

https://www.ceda.ac.uk/status/

upload11.cpdn.org resolves ok for me: 192.171.169.187. It's either a local DNS issue or something BOINC related.


Ping and tracert to upload11.cpdn.org, cpdn.org and climateprediction.net timed out at the first hop at the gateway internal IP.

Tracing route to upload11.cpdn.org [192.171.169.187]
over a maximum of 30 hops:

  1    <1 ms    <1 ms    <1 ms  192.168.1.1
  2     *        *        *     Request timed out.
  3     *        *        *     Request timed out.
  4     *        *        *     Request timed out.
  5     *        *        *     Request timed out.
  6     *        *        *     Request timed out.

I can ping and tracert other sites, though with some hops=Request time out after first external server of the ISP - 82-137-110-2.ip.btc-net.bg [82.137.110.2] . Not sure what to do. Maybe call the ISP and check why can't i see the server

C:\Users\10>tracert google.com

Tracing route to google.com [216.58.212.14]
over a maximum of 30 hops:

  1    <1 ms    <1 ms    <1 ms  192.168.1.1
  2     1 ms    <1 ms     1 ms  82-137-110-2.ip.btc-net.bg [82.137.110.2]
  3     *        *        *     Request timed out.
  4     *        *        *     Request timed out.
  5     1 ms     1 ms     1 ms  212-39-66-222.ip.btc-net.bg [212.39.66.222]
  6     1 ms    <1 ms    <1 ms  142.251.243.215
  7     1 ms    <1 ms    <1 ms  142.250.60.19
  8    <1 ms    <1 ms    <1 ms  sof04s01-in-f14.1e100.net [216.58.212.14]

Trace complete
2) Message boards : Number crunching : Batch 1005 WAH2 NZ region (Message 70624)
Posted 7 Mar 2024 by bernard_ivo
Post:
Mine seem to be going OK:-


Not for me though. The same message today. I wonder if i can turn on any other log option to gather more info?
3) Message boards : Number crunching : Batch 1005 WAH2 NZ region (Message 70616)
Posted 6 Mar 2024 by bernard_ivo
Post:
Hi there,

I'm still having problems uploading the NZ unit
06/03/2024 18:03:43 |  | [http] [ID#0] Info:  Connection 1680 seems to be dead
06/03/2024 18:03:43 |  | [http] [ID#0] Info:  Closing connection
06/03/2024 18:03:43 |  | [http] [ID#0] Info:    Trying 142.250.184.132:443...
06/03/2024 18:03:43 |  | [http] [ID#0] Info:  Connected to www.google.com (142.250.184.132) port 443
06/03/2024 18:03:43 |  | [http] [ID#0] Info:  schannel: disabled automatic use of client certificate
06/03/2024 18:03:43 |  | [http] [ID#0] Info:  ALPN: offers http/1.1
06/03/2024 18:03:43 |  | [http] [ID#0] Info:  ALPN: server accepted http/1.1
06/03/2024 18:03:43 |  | [http] [ID#0] Info:  using HTTP/1.1
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server: GET / HTTP/1.1
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server: Host: www.google.com
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.24.1)
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server: Accept: */*
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server: Accept-Encoding: deflate, gzip
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server: Accept-Language: en_GB
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server: roject_name>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <name>wah2_nz25_n0a5_198805_25_1005_012254523_1_r1351571623_1.zip</name>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <nbytes>90462248.000000</nbytes>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <max_nbytes>150000000.000000</max_nbytes>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <status>1</status>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <persistent_file_xfer>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <num_retries>107</num_retries>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <first_request_time>1707778812.154770</first_request_time>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <next_request_time>0.000000</next_request_time>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <time_so_far>2397.318125</time_so_far>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <last_bytes_xferred>0.000000</last_bytes_xferred>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <is_upload>1</is_upload>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     </persistent_file_xfer>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server: </file_transfer>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server: <file_transfer>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <project_url>https://climateprediction.net/</project_url>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <project_name>climateprediction.net</project_name>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <name>wah2_nz25_n0a5_198805_25_1005_012254523_1_r1351571623_2.zip</name>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <nbytes>90443142.000000</nbytes>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <max_nbytes>150000000.000000</max_nbytes>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <status>1</status>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <persistent_file_xfer>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <num_retries>100</num_retries>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <first_request_time>1707820366.499971</first_request_time>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <next_request_time>1709754754.739190</next_request_time>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <time_so_far>2214.724501</time_so_far>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <last_bytes_xferred>0.000000</last_bytes_xferred>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <is_upload>1</is_upload>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     </persistent_file_xfer>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server: </file_transfer>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server: <file_transfer>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <project_url>https://climateprediction.net/</project_url>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <project_name>climateprediction.net</project_name>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <name>wah2_nz25_n0a5_198805_25_1005_012254523_1_r1351571623_3.zip</name>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <nbytes>90381653.000000</nbytes>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <max_nbytes>150000000.000000</max_nbytes>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <status>1</status>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:     <persistent_file_xfer>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <num_retries>95</num_retries>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <first_request_time>1707862198.360235</first_request_time>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <next_request_time>1709741916.170670</next_request_time>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <time_so_far>2150.490557</time_so_far>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:         <last_bytes_xferred>0.000000</last_bytes_xferred>
06/03/2024 18:03:43 |  | [http] [ID#0] Sent header to server:
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: HTTP/1.1 200 OK
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: Date: Wed, 06 Mar 2024 16:03:43 GMT
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: Expires: -1
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: Cache-Control: private, max-age=0
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: Content-Type: text/html; charset=ISO-8859-1
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: Content-Security-Policy-Report-Only: object-src 'none';base-uri 'self';script-src 'nonce-iluVkURiYRTuWjkJQq8qLA' 'strict-dynamic' 'report-sample' 'unsafe-eval' 'unsafe-inline' https: http:;report-uri https://csp.withgoogle.com/csp/gws/other-hp
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: P3P: CP="This is not a P3P policy! See g.co/p3phelp for more info."
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: Content-Encoding: gzip
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: Server: gws
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: X-XSS-Protection: 0
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: X-Frame-Options: SAMEORIGIN
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: Set-Cookie: SOCS=CAAaBgiA5J6vBg; expires=Sat, 05-Apr-2025 16:03:43 GMT; path=/; domain=.google.com; Secure; SameSite=lax
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: Set-Cookie: AEC=Ae3NU9OtMv-AT4puuLtG9-hDGjFWyvGkxmVyNbtg8lB2WvQe8RS7H3wrJVU; expires=Mon, 02-Sep-2024 16:03:43 GMT; path=/; domain=.google.com; Secure; HttpOnly; SameSite=lax
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: Set-Cookie: __Secure-ENID=18.SE=PWV92Q812eZlxzZwIJlCCNHWpH-aP7jKE_OSUX6EKvj4cbJdUJhhOwU0DallQGiVyf8L5NElF8n0FwG6HNWuKrCeu3jBsS6HmUrMtXXsWK_BD-DSoida2VoczQev5-gCtQ3yY5f4GiKIOcNcZTAxqEalZ0rnULkORie0g3XHpCUj3CSO-w; expires=Sun, 06-Apr-2025 08:22:01 GMT; path=/; domain=.google.com; Secure; HttpOnly; SameSite=lax
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: Transfer-Encoding: chunked
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server:
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: 00000001
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: 
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: 01
06/03/2024 18:03:43 |  | 
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: 12b3
06/03/2024 18:03:43 |  | [http] [ID#0] Received header from server: 
06/03/2024 18:03:43 |  | [http] [ID#0] Info:  Connection #1683 to host www.google.com left intact
06/03/2024 18:03:44 |  | Internet access OK - project servers may be temporarily down.
06/03/2024 18:03:44 | climateprediction.net | [http] [ID#9812] Info:  processing: http://upload11.cpdn.org/cgi-bin/file_upload_handler
06/03/2024 18:03:44 | climateprediction.net | [http] [ID#9812] Info:  Hostname upload11.cpdn.org was found in DNS cache
06/03/2024 18:03:44 | climateprediction.net | [http] [ID#9812] Info:    Trying 192.171.169.187:80...
06/03/2024 18:04:05 | climateprediction.net | [http] [ID#9812] Info:  connect to 192.171.169.187 port 80 failed: Timed out
06/03/2024 18:04:05 | climateprediction.net | [http] [ID#9812] Info:  Failed to connect to upload11.cpdn.org port 80 after 21073 ms: Couldn't connect to server
06/03/2024 18:04:05 | climateprediction.net | [http] [ID#9812] Info:  Closing connection
06/03/2024 18:04:05 | climateprediction.net | [http] HTTP error: Timeout was reached
06/03/2024 18:04:05 | climateprediction.net | Backing off 03:20:14 on upload of wah2_nz25_n0a5_198805_25_1005_012254523_1_r1351571623_1.zip
06/03/2024 18:04:06 |  | Project communication failed: attempting access to reference site


Any suggestions? Should I abort? I have 17 zips so far, and the WU is paused
4) Message boards : Number crunching : Batch 1005 WAH2 NZ region (Message 70569)
Posted 28 Feb 2024 by bernard_ivo
Post:
Yes hardware issues at the JASMIN upload have been resolved according to their last email.

I still get the same message from upload 11 as pasted bellow. Transfers are backing off.
5) Message boards : Number crunching : Batch 1005 WAH2 NZ region (Message 70559)
Posted 26 Feb 2024 by bernard_ivo
Post:
I still can't upload the NZ WU.

26/02/2024 10:14:32 | climateprediction.net | [http] [ID#68359] Info:  processing: http://upload11.cpdn.org/cgi-bin/file_upload_handler
26/02/2024 10:14:32 | climateprediction.net | [http] [ID#68360] Info:  processing: http://upload11.cpdn.org/cgi-bin/file_upload_handler
26/02/2024 10:14:33 | climateprediction.net | [http] [ID#68360] Info:  Found bundle for host: 0x1f2939bf8d0 [serially]
26/02/2024 10:14:33 | climateprediction.net | [http] [ID#68360] Info:  Connection #11805 is still name resolving, can't reuse
26/02/2024 10:14:33 | climateprediction.net | [http] [ID#68359] Info:    Trying 192.171.169.187:80...
26/02/2024 10:14:33 | climateprediction.net | [http] [ID#68360] Info:  Hostname 'upload11.cpdn.org' was found in DNS cache
26/02/2024 10:14:33 | climateprediction.net | [http] [ID#68360] Info:    Trying 192.171.169.187:80...
26/02/2024 10:14:55 | climateprediction.net | [http] [ID#68359] Info:  connect to 192.171.169.187 port 80 failed: Timed out
26/02/2024 10:14:55 | climateprediction.net | [http] [ID#68359] Info:  Failed to connect to upload11.cpdn.org port 80 after 21237 ms: Couldn't connect to server
26/02/2024 10:14:55 | climateprediction.net | [http] [ID#68359] Info:  Closing connection
26/02/2024 10:14:55 | climateprediction.net | [http] [ID#68360] Info:  connect to 192.171.169.187 port 80 failed: Timed out
26/02/2024 10:14:55 | climateprediction.net | [http] [ID#68360] Info:  Failed to connect to upload11.cpdn.org port 80 after 21236 ms: Couldn't connect to server
26/02/2024 10:14:55 | climateprediction.net | [http] [ID#68360] Info:  Closing connection
26/02/2024 10:14:55 | climateprediction.net | [http] HTTP error: Timeout was reached
26/02/2024 10:14:55 | climateprediction.net | [http] HTTP error: Timeout was reached
26/02/2024 10:14:55 | climateprediction.net | Backing off 03:19:29 on upload of wah2_nz25_n0a5_198805_25_1005_012254523_1_r1351571623_10.zip
26/02/2024 10:14:55 | climateprediction.net | Backing off 05:00:23 on upload of wah2_nz25_n0a5_198805_25_1005_012254523_1_r1351571623_11.zip
6) Message boards : Number crunching : Batch 1005 WAH2 NZ region (Message 70465)
Posted 20 Feb 2024 by bernard_ivo
Post:
I would suspend computation for the NZ tasks till zips clear. If you run out of work, you can turn them back on long enough to get more work then suspend them again.

Thanks, Dave. Paused it. New task started, all others are EAS25
7) Message boards : Number crunching : Batch 1005 WAH2 NZ region (Message 70463)
Posted 20 Feb 2024 by bernard_ivo
Post:
I still have problems uploading to upload 11. I have two WUs one at 22 zip and these can't get through. I also had two more WUs failing with
<core_client_version>7.24.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
CPDN Monitor - Abort request from BOINC...
22:22:29 (9908): called boinc_finish(10)

</stderr_txt>
]]>


And I have almost 200 GB allocated to BOINC so there is plenty of disk space

Bernard. Just out of curiosity, how much disk space is the entire boinc data directory using?


Currently it uses 13.28 GB, allocated to BOINC 190 GB. I wouldn't adjust the config files, would that be possible server side for the next batches? Some zips have cleared and one WU (batch 1005) uploaded but it gave computation error due the above disc exceed error. Crashed at the 21 zip. The other WU (batch 1005) has stuck 16 zips + restart.zip and I think it will error in few days when hitting the space limit. Other batches seem to upload just fine.
8) Message boards : Number crunching : Batch 1005 WAH2 NZ region (Message 70443)
Posted 19 Feb 2024 by bernard_ivo
Post:
I still have problems uploading to upload 11. I have two WUs one at 22 zip and these can't get through. I also had two more WUs failing with
<core_client_version>7.24.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
CPDN Monitor - Abort request from BOINC...
22:22:29 (9908): called boinc_finish(10)

</stderr_txt>
]]>


And I have almost 200 GB allocated to BOINC so there is plenty of disk space
9) Message boards : Number crunching : Batch 1005 WAH2 NZ region (Message 70322)
Posted 6 Feb 2024 by bernard_ivo
Post:
Only cancel any 1002, 1003 & 1004. Any 1001 & 1005 should be left running/uploading.


Thanks, however upload11 server can't let me upload the zips I have of 1005

06/02/2024 14:07:25 | climateprediction.net | [http] [ID#33153] Info:  processing: http://upload11.cpdn.org/cgi-bin/file_upload_handler
06/02/2024 14:07:25 | climateprediction.net | [http] [ID#33154] Info:  processing: http://upload11.cpdn.org/cgi-bin/file_upload_handler
06/02/2024 14:07:25 | climateprediction.net | [http] [ID#33154] Info:  Found bundle for host: 0x1f293a28eb0 [serially]
06/02/2024 14:07:25 | climateprediction.net | [http] [ID#33154] Info:  Connection #6232 is still name resolving, can't reuse
06/02/2024 14:07:26 | climateprediction.net | [http] [ID#33153] Info:    Trying 192.171.169.187:80...
06/02/2024 14:07:26 | climateprediction.net | [http] [ID#33154] Info:  Hostname 'upload11.cpdn.org' was found in DNS cache
06/02/2024 14:07:26 | climateprediction.net | [http] [ID#33154] Info:    Trying 192.171.169.187:80...
06/02/2024 14:07:47 | climateprediction.net | [http] [ID#33153] Info:  connect to 192.171.169.187 port 80 failed: Timed out
06/02/2024 14:07:47 | climateprediction.net | [http] [ID#33153] Info:  Failed to connect to upload11.cpdn.org port 80 after 21552 ms: Couldn't connect to server
06/02/2024 14:07:47 | climateprediction.net | [http] [ID#33153] Info:  Closing connection
06/02/2024 14:07:47 | climateprediction.net | [http] [ID#33154] Info:  connect to 192.171.169.187 port 80 failed: Timed out
06/02/2024 14:07:47 | climateprediction.net | [http] [ID#33154] Info:  Failed to connect to upload11.cpdn.org port 80 after 21552 ms: Couldn't connect to server
06/02/2024 14:07:47 | climateprediction.net | [http] [ID#33154] Info:  Closing connection
06/02/2024 14:07:47 | climateprediction.net | [http] HTTP error: Timeout was reached
06/02/2024 14:07:47 | climateprediction.net | [http] HTTP error: Timeout was reached
06/02/2024 14:07:47 | climateprediction.net | Backing off 04:43:25 on upload of wah2_nz25_n0kd_199005_25_1005_012254891_0_r710857397_1.zip
06/02/2024 14:07:47 | climateprediction.net | Backing off 05:07:36 on upload of wah2_nz25_n0kd_199005_25_1005_012254891_0_r710857397_2.zip
06/02/2024 14:07:47 | climateprediction.net | [http] [ID#33155] Info:  processing: http://upload11.cpdn.org/cgi-bin/file_upload_handler
06/02/2024 14:07:47 | climateprediction.net | [http] [ID#33156] Info:  processing: http://upload11.cpdn.org/cgi-bin/file_upload_handler
06/02/2024 14:07:48 | climateprediction.net | [http] [ID#33155] Info:  Hostname upload11.cpdn.org was found in DNS cache
06/02/2024 14:07:48 | climateprediction.net | [http] [ID#33155] Info:    Trying 192.171.169.187:80...
06/02/2024 14:07:48 | climateprediction.net | [http] [ID#33156] Info:  Found bundle for host: 0x1f293a28660 [serially]
06/02/2024 14:07:48 | climateprediction.net | [http] [ID#33156] Info:  Connection #6234 is still name resolving, can't reuse
06/02/2024 14:07:48 | climateprediction.net | [http] [ID#33156] Info:  Hostname upload11.cpdn.org was found in DNS cache
06/02/2024 14:07:48 | climateprediction.net | [http] [ID#33156] Info:    Trying 192.171.169.187:80...
06/02/2024 14:07:48 |  | Project communication failed: attempting access to reference site
06/02/2024 14:07:48 |  | [http] HTTP_OP::init_get(): https://www.google.com/
06/02/2024 14:07:48 |  | [http] [ID#0] Info:  processing: https://www.google.com/
06/02/2024 14:07:49 |  | [http] [ID#0] Info:    Trying 172.217.20.68:443...
06/02/2024 14:07:49 |  | [http] [ID#0] Info:  Connected to www.google.com (172.217.20.68) port 443
06/02/2024 14:07:49 |  | [http] [ID#0] Info:  schannel: disabled automatic use of client certificate
06/02/2024 14:07:49 |  | [http] [ID#0] Info:  ALPN: offers http/1.1
06/02/2024 14:07:49 |  | [http] [ID#0] Info:  ALPN: server accepted http/1.1
06/02/2024 14:07:49 |  | [http] [ID#0] Info:  using HTTP/1.1
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server: GET / HTTP/1.1
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server: Host: www.google.com
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.24.1)
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server: Accept: */*
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server: Accept-Encoding: deflate, gzip
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server: Accept-Language: en_GB
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server: roject_name>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <name>wah2_nz25_n0kd_199005_25_1005_012254891_0_r710857397_1.zip</name>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <nbytes>90258709.000000</nbytes>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <max_nbytes>150000000.000000</max_nbytes>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <status>1</status>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <persistent_file_xfer>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <num_retries>15</num_retries>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <first_request_time>1706963052.704195</first_request_time>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <next_request_time>1707238272.680814</next_request_time>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <time_so_far>337.586294</time_so_far>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <last_bytes_xferred>0.000000</last_bytes_xferred>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <is_upload>1</is_upload>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     </persistent_file_xfer>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server: </file_transfer>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server: <file_transfer>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <project_url>https://climateprediction.net/</project_url>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <project_name>climateprediction.net</project_name>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <name>wah2_nz25_n0kd_199005_25_1005_012254891_0_r710857397_2.zip</name>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <nbytes>90517431.000000</nbytes>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <max_nbytes>150000000.000000</max_nbytes>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <status>1</status>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <persistent_file_xfer>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <num_retries>12</num_retries>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <first_request_time>1707005482.908285</first_request_time>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <next_request_time>1707239724.238784</next_request_time>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <time_so_far>271.271139</time_so_far>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <last_bytes_xferred>0.000000</last_bytes_xferred>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <is_upload>1</is_upload>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     </persistent_file_xfer>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server: </file_transfer>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server: <file_transfer>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <project_url>https://climateprediction.net/</project_url>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <project_name>climateprediction.net</project_name>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <name>wah2_nz25_n0kd_199005_25_1005_012254891_0_r710857397_3.zip</name>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <nbytes>90382194.000000</nbytes>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <max_nbytes>150000000.000000</max_nbytes>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <status>1</status>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:     <persistent_file_xfer>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <num_retries>11</num_retries>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <first_request_time>1707047627.895128</first_request_time>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <next_request_time>1707217908.505416</next_request_time>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <time_so_far>248.874489</time_so_far>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:         <last_bytes_xferred>0.000000</last_bytes_xferred>
06/02/2024 14:07:49 |  | [http] [ID#0] Sent header to server:
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: HTTP/1.1 200 OK
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Date: Tue, 06 Feb 2024 12:07:49 GMT
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Expires: -1
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Cache-Control: private, max-age=0
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Content-Type: text/html; charset=ISO-8859-1
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Content-Security-Policy-Report-Only: object-src 'none';base-uri 'self';script-src 'nonce-VWQJlPawV74E_3zTcnJdYw' 'strict-dynamic' 'report-sample' 'unsafe-eval' 'unsafe-inline' https: http:;report-uri https://csp.withgoogle.com/csp/gws/other-hp
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: P3P: CP="This is not a P3P policy! See g.co/p3phelp for more info."
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Content-Encoding: gzip
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Server: gws
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: X-XSS-Protection: 0
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: X-Frame-Options: SAMEORIGIN
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Set-Cookie: SOCS=CAAaBgiA7YWuBg; expires=Fri, 07-Mar-2025 12:07:49 GMT; path=/; domain=.google.com; Secure; SameSite=lax
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Set-Cookie: AEC=Ae3NU9NKF883ga8MHuHKh1r1SY9atTfhu4wRiWDXd6J6WUbvjQr9pgLqlA; expires=Sun, 04-Aug-2024 12:07:49 GMT; path=/; domain=.google.com; Secure; HttpOnly; SameSite=lax
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Set-Cookie: __Secure-ENID=17.SE=mfM3qEBAhbiflfe_MhQU9awPmCSF3l85SGOT8J4-x1W6KIHkohvrYc8PwebTl6eeB_Z1RvZY2yunws1VeUBKG7vSf93m2q8hEyFtJjp-0QGGo4WXU-uDXLcyCKrnNnYst5McT1TwYuXxwl2DOIT-uK0CXzbAIxZ7iHNuX-OgFM0-ojBq0vQ; expires=Sat, 08-Mar-2025 04:26:07 GMT; path=/; domain=.google.com; Secure; HttpOnly; SameSite=lax
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Set-Cookie: CONSENT=PENDING+273; expires=Thu, 05-Feb-2026 12:07:49 GMT; path=/; domain=.google.com; Secure
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: Transfer-Encoding: chunked
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server:
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: 00000001
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: 
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: 00000001
06/02/2024 14:07:49 |  | 
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: 00000001
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: 
06/02/2024 14:07:49 |  | [http] [ID#0] Received header from server: 00000001
06/02/2024 14:07:49 |  | [http] [ID#0] Info:  Connection #6236 to host www.google.com left intact
06/02/2024 14:07:49 |  | Internet access OK - project servers may be temporarily down.
10) Message boards : Number crunching : Batch 1005 WAH2 NZ region (Message 70320)
Posted 6 Feb 2024 by bernard_ivo
Post:
There were only two ghost WUs occupying 0.5 Gb space and there is more than 170 GB available.

It seems though the server abort worked partially. I have pending transfer zips from batch 1005 with no corresponding WU in tasks. It is 12 zips so I will abort them. Additionally I have several 1003, 1004, 1005 who are still running. I guess I should cancel them manually. Or 1005 should be left computing?
11) Message boards : Number crunching : Batch 1005 WAH2 NZ region (Message 70316)
Posted 5 Feb 2024 by bernard_ivo
Post:
Hi I've got this error on several of 1005 WUs I run

<core_client_version>7.24.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
CPDN Monitor - Abort request from BOINC...
00:52:22 (7412): called boinc_finish(10)

</stderr_txt>
]]>
12) Message boards : Number crunching : New Work Announcements 2024 (Message 70261)
Posted 1 Feb 2024 by bernard_ivo
Post:
Do we need to set up some parameters on Linux boxes, to avoid downloading and running too many OIFS at the same time?
13) Message boards : Number crunching : Batch 996 Weather@Home2 East Asia25 (Message 70019)
Posted 30 Oct 2023 by bernard_ivo
Post:
Edit3: Are your uploads still stuck Bernard?

It took a while but all have been uploaded and reported
14) Message boards : Number crunching : Batch 996 Weather@Home2 East Asia25 (Message 70012)
Posted 30 Oct 2023 by bernard_ivo
Post:
Uploads seems to be stuck again.4 WUs are finishing and two can't upload their final OUT zips - they progress to 100% and reset
30/10/2023 07:58:34 | climateprediction.net | Started upload of wah2_eas25_a0mf_198912_24_996_012224355_0_r631448475_out.zip
30/10/2023 07:58:35 | climateprediction.net | [http] [ID#68902] Info:  Too old connection (234 seconds idle), disconnect it
30/10/2023 07:58:35 | climateprediction.net | [http] [ID#68902] Info:  Connection 7986 seems to be dead
30/10/2023 07:58:35 | climateprediction.net | [http] [ID#68902] Info:  Closing connection 7986
30/10/2023 07:58:35 | climateprediction.net | [http] [ID#68902] Info:  schannel: shutting down SSL/TLS connection with www.google.com port 443
30/10/2023 07:58:35 | climateprediction.net | [http] [ID#68902] Info:  Hostname in DNS cache was stale, zapped
30/10/2023 07:58:35 | climateprediction.net | [http] [ID#68902] Info:    Trying 141.223.16.156:80...
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Info:  Connected to upload7.cpdn.org (141.223.16.156) port 80 (#7987)
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Sent header to server: POST /cgi-bin/file_upload_handler HTTP/1.1
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Sent header to server: Host: upload7.cpdn.org
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Sent header to server: User-Agent: BOINC client (windows_x86_64 7.20.2)
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Sent header to server: Accept: */*
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Sent header to server: Accept-Encoding: deflate, gzip
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Sent header to server: Accept-Language: en_GB
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Sent header to server: Content-Length: 313
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Sent header to server: Content-Type: application/x-www-form-urlencoded
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Sent header to server:
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Info:  We are completely uploaded and fine
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Info:  Mark bundle as not supporting multiuse
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Received header from server: HTTP/1.1 200 OK
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Received header from server: Date: Mon, 30 Oct 2023 05:58:27 GMT
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Received header from server: Server: Apache/2.4.37 (centos)
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Received header from server: Transfer-Encoding: chunked
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Received header from server: Content-Type: text/plain; charset=UTF-8
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Received header from server:
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Received header from server: c0
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Received header from server: <data_server_reply>
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Received header from server:     <status>1</status>
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Received header from server:     <message>[wah2_eas25_a0mf_198912_24_996_012224355_0_r631448475_out.zip] locked by file_upload_handler PID=1366078</message>
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Received header from server: </data_server_reply>
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Received header from server:
30/10/2023 07:58:36 | climateprediction.net | [http] [ID#68902] Info:  Connection #7987 to host upload7.cpdn.org left intact
30/10/2023 07:58:36 | climateprediction.net | [error] Error reported by file upload server: [wah2_eas25_a0mf_198912_24_996_012224355_0_r631448475_out.zip] locked by file_upload_handler PID=1366078
30/10/2023 07:58:36 | climateprediction.net | Temporarily failed upload of wah2_eas25_a0mf_198912_24_996_012224355_0_r631448475_out.zip: transient upload error
30/10/2023 07:58:36 | climateprediction.net | Backing off 00:06:36 on upload of wah2_eas25_a0mf_198912_24_996_012224355_0_r631448475_out.zip
15) Message boards : Number crunching : The uploads are stuck (Message 69989)
Posted 26 Oct 2023 by bernard_ivo
Post:
I got one of the HadSM4 at N144 retries from batch 938. It's already at 60%, however zips upload is stuck. It seems it should go to upload11.

Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Too old connection (189 seconds idle), disconnect it
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Connection 2684 seems to be dead!
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Closing connection 2684
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (IN), TLS header, Supplemental data (23):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (OUT), TLS header, Unknown (21):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (OUT), TLS alert, close notify (256):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Too old connection (125 seconds idle), disconnect it
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Connection 2686 seems to be dead!
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Closing connection 2686
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (OUT), TLS header, Unknown (21):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (OUT), TLS alert, close notify (256):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Too old connection (130 seconds idle), disconnect it
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Connection 2685 seems to be dead!
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Closing connection 2685
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (OUT), TLS header, Unknown (21):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (OUT), TLS alert, close notify (256):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  Found bundle for host upload11.cpdn.org: 0x55e3471ea0e0 [serially]
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  Server doesn't support multiplex (yet)
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:    Trying 192.171.169.187:80...
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  Hostname 'upload11.cpdn.org' was found in DNS cache
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:    Trying 192.171.169.187:80...
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  After 119959ms connect time, move on!
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  connect to 192.171.169.187 port 80 failed: Connection timed out
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Connection timeout after 120770 ms
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Closing connection 2687
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  After 119965ms connect time, move on!
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  connect to 192.171.169.187 port 80 failed: Connection timed out
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  Connection timeout after 120764 ms
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  Closing connection 2688
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] HTTP error: Timeout was reached
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] HTTP error: Timeout was reached
Thu 26 Oct 2023 08:30:14 AM EEST |  | Project communication failed: attempting access to reference site
Thu 26 Oct 2023 08:30:14 AM EEST |  | [http] HTTP_OP::init_get(): https://www.google.com/
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | Backing off 03:29:09 on upload of hadsm4_a111_201311_4_938_012155895_1_r2004311976_1.zip
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | Backing off 00:13:24 on upload of hadsm4_a111_201311_4_938_012155895_1_r2004311976_2.zip
Thu 26 Oct 2023 08:30:15 AM EEST |  | [http] [ID#0] Info:    Trying 142.250.187.164:443...
Thu 26 Oct 2023 08:30:15 AM EEST |  | [http] [ID#0] Info:  Connected to www.google.com (142.250.187.164) port 443 (#2689)
............................................
Thu 26 Oct 2023 08:30:15 AM EEST |  | Internet access OK - project servers may be temporarily down.

16) Message boards : Number crunching : New work discussion - 2 (Message 69605)
Posted 7 Sep 2023 by bernard_ivo
Post:
Well, they will run, but whether the task would give the same answer in Wine as it would under Windows on bare metal is still an open question. We haven't made that test.

Will they go to upload7 server which still manifests upload problems as I mentioned in the other thread.
17) Message boards : Number crunching : Upload server is out of disk space (Message 69604)
Posted 7 Sep 2023 by bernard_ivo
Post:
Thanks Richard. I may not have the patience to wait 90 days, though keeping up with CPDN is :) Will see if the zips manage to get through, otherwise will cancel uploads.
18) Message boards : Number crunching : Upload server is out of disk space (Message 69593)
Posted 6 Sep 2023 by bernard_ivo
Post:
Any news on the upload server in Korea. I still keep the last WUs in the queue trying to upload hoping they pass though and results are not wasted. I can wait until they expire.
19) Message boards : Number crunching : Upload server is out of disk space (Message 69540)
Posted 30 Aug 2023 by bernard_ivo
Post:
Somehow 2/4 WUs managed to get through to the server and they've been labelled success. I continue to struggle with the 4 zips left of the other 2 WUs. I may cancel the upload (transfer) only as Richard suggested.
20) Message boards : Number crunching : Upload server is out of disk space (Message 69476)
Posted 16 Aug 2023 by bernard_ivo
Post:
Thanks Richard,

I will suspend network connection for now as I will be off for a week, then will resume and provide more logs if necessary.


Next 20

©2024 climateprediction.net