Upload11 is back up.

As the RAC is a long-term average, month or two I think (someone correct me if I'm wrong), so it's not a great measure of how well the system is performing.

In the BOINC scheme of things, RAC is re-calculated at every "credit event" - often, within a few seconds of a finished task being reported - both to increase RAC with the new credit award (if any), and to decay it with a seven-day halflife.

So, it tends to react quickly, but equally, it takes a long time to reach a genuine stable average.

CPDN, of course, is different, because of the scripts being run periodically to award credit. This was originally done because of the extreme runtime of the early models, and the wish of the early staff teams to provide an early acknowledgement of volunteer achievement at each trickle.

Upload11 is back up.

No movement on my uploads yet.

My lone resend connected by itself while I was away from the machine, and has reported. So, I occupied a connection for about 6 minutes, but I've backed out of the way now.

31/01/2023 16:17:10 | climateprediction.net | Started upload of oifs_43r3_ps_0783_2001050100_123_970_12187427_1_r1449012272_86.zip
31/01/2023 16:22:56 | climateprediction.net | Finished upload of oifs_43r3_ps_0783_2001050100_123_970_12187427_1_r1449012272_122.zip

Yes I see 62 people have managed to report tasks and the number listed as in progress has dropped significantly.

Edit: I see one of my five completed tasks got through.

Upload11 is back up.

It had a little more than 2 hours availability today. Time to celebrate...?

Yes I see 62 people have managed to report tasks and the number listed as in progress has dropped significantly.

From 4192 to 3952 (-240) in the last 24 hours.

________

On the idea of turnaround time based credit: The trick to wean people off month deep work buffers is to set reporting deadlines such that a good compromise between required completion times (includes time needed to get result data offloaded) on one hand, and project goals on the other hand.

________

So there is talk of new oifs_43r3_bl work batches coming up some time soon. Did CPDN engage a new provider for their upload file handler server yet? It can't realistically stay at the current one, can it. (December 24: Server becomes inaccessible to CPDN's admin. January 30: Server becomes inaccessible to CPDN's admin. Not to mention everything else which happened in between, or even the warning signs that showed already before December 24.) It seems almost as if deeper rooted issues of the server implementation keep getting ignored.

On the idea of turnaround time based credit: The trick to wean people off month deep work buffers is to set reporting deadlines such that a good compromise between required completion times (includes time needed to get result data offloaded) on one hand, and project goals on the other hand.

Turnaround based credit is not going to happen with CPDN, it's not priority. One 'trick' to prevent large work buffers is to alter the server scheduling, which is being looked at.

So there is talk of new oifs_43r3_bl work batches coming up some time soon. Did CPDN engage a new provider for their upload file handler server yet? It can't realistically stay at the current one, can it.

There are no other possibilities, CPDN doesn't have deep pockets. CPDN have made it very clear to JASMIN they are not happy with the service.

My uploads have just started again. If they keep working, I should clear them before going to Netherlands tomorrow.

Sorry, but here nothing goes up since yesterday evening.

---

Sorry, but here nothing goes up since yesterday evening.

Same here.

Wed 01 Feb 2023 05:11:46 AM EST | climateprediction.net | Started upload of oifs_43r3_ps_0171_2001050100_123_970_12186815_1_r1404095512_2.zip
Wed 01 Feb 2023 05:11:46 AM EST | climateprediction.net | Started upload of oifs_43r3_ps_0171_2001050100_123_970_12186815_1_r1404095512_3.zip
Wed 01 Feb 2023 05:16:54 AM EST |  | Project communication failed: attempting access to reference site
Wed 01 Feb 2023 05:16:54 AM EST | climateprediction.net | Temporarily failed upload of oifs_43r3_ps_0171_2001050100_123_970_12186815_1_r1404095512_2.zip: transient HTTP error
Wed 01 Feb 2023 05:16:54 AM EST | climateprediction.net | Backing off 05:41:58 on upload of oifs_43r3_ps_0171_2001050100_123_970_12186815_1_r1404095512_2.zip
Wed 01 Feb 2023 05:16:54 AM EST | climateprediction.net | Temporarily failed upload of oifs_43r3_ps_0171_2001050100_123_970_12186815_1_r1404095512_3.zip: transient HTTP error
Wed 01 Feb 2023 05:16:54 AM EST | climateprediction.net | Backing off 03:58:33 on upload of oifs_43r3_ps_0171_2001050100_123_970_12186815_1_r1404095512_3.zip

---

Try again. I've just picked up another resend: the first few uploads failed, but everything has started going through in the last five minutes.

01/02/2023 10:47:38 | climateprediction.net | Finished upload of oifs_43r3_ps_0675_1986050100_123_955_12172319_1_r625013166_5.zip

Try again. I've just picked up another resend: the first few uploads failed, but everything has started going through in the last five minutes.

I just got up this morning (here) and all but three had gone up. I pressed Retry three times, and the last three went up.

---

Try again. I've just picked up another resend: the first few uploads failed, but everything has started going through in the last five minutes.

I just got up this morning (here) and all but three had gone up. I pressed Retry three times, and the last three went up.

There's still a lower limit on incoming http connections. The server is up, but patience is required.

All transfers are gone. Fine (for today :) )

---

All transfers are gone. Fine (for today :) )

Down to my last two tasks, one has all of them still to go, one has got through about eight or nine. With my connection it is still a few hours to go.

Down to my last two tasks, one has all of them still to go, one has got through about eight or nine. With my connection it is still a few hours to go.

With my connection, mine go up as fast as I can generate them.

Average upload rate 3353.35 KB/sec
Average download rate 18057.87 KB/sec

4 to 5 seconds to upload one of these.
Usually 6 to 8 minutes between uploads for the same task.

Wed 01 Feb 2023 02:41:08 PM EST | climateprediction.net | Started upload of oifs_43r3_ps_0546_1996050100_123_965_12182190_2_r995008728_8.zip
Wed 01 Feb 2023 02:41:13 PM EST | climateprediction.net | Finished upload of oifs_43r3_ps_0546_1996050100_123_965_12182190_2_r995008728_8.zip
Wed 01 Feb 2023 02:43:24 PM EST | climateprediction.net | Started upload of oifs_43r3_ps_0828_2013050100_123_982_12199472_2_r1623571569_9.zip
Wed 01 Feb 2023 02:43:29 PM EST | climateprediction.net | Finished upload of oifs_43r3_ps_0828_2013050100_123_982_12199472_2_r1623571569_9.zip
Wed 01 Feb 2023 02:43:54 PM EST | climateprediction.net | Started upload of oifs_43r3_ps_0143_1984050100_123_953_12169787_1_r228140626_8.zip
Wed 01 Feb 2023 02:43:58 PM EST | climateprediction.net | Finished upload of oifs_43r3_ps_0143_1984050100_123_953_12169787_1_r228140626_8.zip
Wed 01 Feb 2023 02:44:11 PM EST | climateprediction.net | Started upload of oifs_43r3_ps_0869_1986050100_123_955_12172513_2_r1568660689_8.zip
Wed 01 Feb 2023 02:44:15 PM EST | climateprediction.net | Finished upload of oifs_43r3_ps_0869_1986050100_123_955_12172513_2_r1568660689_8.zip
Wed 01 Feb 2023 02:48:59 PM EST | climateprediction.net | Started upload of oifs_43r3_ps_0546_1996050100_123_965_12182190_2_r995008728_9.zip
Wed 01 Feb 2023 02:49:04 PM EST | climateprediction.net | Finished upload of oifs_43r3_ps_0546_1996050100_123_965_12182190_2_r995008728_9.zip
Wed 01 Feb 2023 02:51:15 PM EST | climateprediction.net | Started upload of oifs_43r3_ps_0828_2013050100_123_982_12199472_2_r1623571569_10.zip
Wed 01 Feb 2023 02:51:20 PM EST | climateprediction.net | Finished upload of oifs_43r3_ps_0828_2013050100_123_982_12199472_2_r1623571569_10.zip
Wed 01 Feb 2023 02:51:45 PM EST | climateprediction.net | Started upload of oifs_43r3_ps_0143_1984050100_123_953_12169787_1_r228140626_9.zip
Wed 01 Feb 2023 02:51:49 PM EST | climateprediction.net | Finished upload of oifs_43r3_ps_0143_1984050100_123_953_12169787_1_r228140626_9.zip
Wed 01 Feb 2023 02:52:02 PM EST | climateprediction.net | Started upload of oifs_43r3_ps_0869_1986050100_123_955_12172513_2_r1568660689_9.zip
Wed 01 Feb 2023 02:52:07 PM EST | climateprediction.net | Finished upload of oifs_43r3_ps_0869_1986050100_123_955_12172513_2_r1568660689_9.zip

---

All transfers are gone. Fine (for today :) )

Down to my last two tasks, one has all of them still to go, one has got through about eight or nine. With my connection it is still a few hours to go.

All done now so ready for the new ones. I would guess the number of tasks out there now is low enough that data can come off the server as quicklyu as it goes on without issues.

I got several resends, Unfortunately one of my older CPUs got three and the faster machine only one

---

Supporting BOINC, a great concept !

I got one of the HadSM4 at N144 retries from batch 938. It's already at 60%, however zips upload is stuck. It seems it should go to upload11.

Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Too old connection (189 seconds idle), disconnect it
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Connection 2684 seems to be dead!
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Closing connection 2684
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (IN), TLS header, Supplemental data (23):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (OUT), TLS header, Unknown (21):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (OUT), TLS alert, close notify (256):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Too old connection (125 seconds idle), disconnect it
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Connection 2686 seems to be dead!
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Closing connection 2686
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (OUT), TLS header, Unknown (21):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (OUT), TLS alert, close notify (256):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Too old connection (130 seconds idle), disconnect it
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Connection 2685 seems to be dead!
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Closing connection 2685
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (OUT), TLS header, Unknown (21):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  TLSv1.2 (OUT), TLS alert, close notify (256):
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  Found bundle for host upload11.cpdn.org: 0x55e3471ea0e0 [serially]
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  Server doesn't support multiplex (yet)
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:    Trying 192.171.169.187:80...
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  Hostname 'upload11.cpdn.org' was found in DNS cache
Thu 26 Oct 2023 08:28:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:    Trying 192.171.169.187:80...
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  After 119959ms connect time, move on!
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  connect to 192.171.169.187 port 80 failed: Connection timed out
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Connection timeout after 120770 ms
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22122] Info:  Closing connection 2687
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  After 119965ms connect time, move on!
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  connect to 192.171.169.187 port 80 failed: Connection timed out
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  Connection timeout after 120764 ms
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] [ID#22123] Info:  Closing connection 2688
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] HTTP error: Timeout was reached
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | [http] HTTP error: Timeout was reached
Thu 26 Oct 2023 08:30:14 AM EEST |  | Project communication failed: attempting access to reference site
Thu 26 Oct 2023 08:30:14 AM EEST |  | [http] HTTP_OP::init_get(): https://www.google.com/
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | Backing off 03:29:09 on upload of hadsm4_a111_201311_4_938_012155895_1_r2004311976_1.zip
Thu 26 Oct 2023 08:30:14 AM EEST | climateprediction.net | Backing off 00:13:24 on upload of hadsm4_a111_201311_4_938_012155895_1_r2004311976_2.zip
Thu 26 Oct 2023 08:30:15 AM EEST |  | [http] [ID#0] Info:    Trying 142.250.187.164:443...
Thu 26 Oct 2023 08:30:15 AM EEST |  | [http] [ID#0] Info:  Connected to www.google.com (142.250.187.164) port 443 (#2689)
............................................
Thu 26 Oct 2023 08:30:15 AM EEST |  | Internet access OK - project servers may be temporarily down.

I got one of the HadSM4 at N144 retries from batch 938. It's already at 60%, however zips upload is stuck. It seems it should go to upload11.

I will let Andy know.