climateprediction.net home page
Task completed, but not all trickles acknowledged yet. Normal?

Task completed, but not all trickles acknowledged yet. Normal?

Message boards : Number crunching : Task completed, but not all trickles acknowledged yet. Normal?
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 694
Credit: 10,133,158
RAC: 6,135
Message 64803 - Posted: 8 Nov 2021, 22:40:23 UTC

One of my tasks is shown as completed, yet only three of the trickles are acknowledged.
According to the event log, all the trickles have been sent. Here are the last few. I understand that restart.zip and out.zip do not count as trickles, but since today is Monday and 4.zip was sent Saturday,, and 5.zip was sent today, I wonder why they trickles do not all appear yet. Is this normal or is something else going on?

Sat 06 Nov 2021 07:29:40 PM EDT | climateprediction.net | Started upload of hadam4h_b0sx_201211_5_882_012036049_1_r2078399370_4.zip
Sat 06 Nov 2021 07:30:07 PM EDT | climateprediction.net | Finished upload of hadam4h_b0sx_201211_5_882_012036049_1_r2078399370_4.zip
Mon 08 Nov 2021 04:38:03 PM EST | climateprediction.net | Started upload of hadam4h_b0sx_201211_5_882_012036049_1_r2078399370_restart.zip
Mon 08 Nov 2021 04:38:05 PM EST | climateprediction.net | Finished upload of hadam4h_b0sx_201211_5_882_012036049_1_r2078399370_restart.zip
Mon 08 Nov 2021 04:38:23 PM EST | climateprediction.net | Started upload of hadam4h_b0sx_201211_5_882_012036049_1_r2078399370_5.zip
Mon 08 Nov 2021 04:38:47 PM EST | climateprediction.net | Finished upload of hadam4h_b0sx_201211_5_882_012036049_1_r2078399370_5.zip
Mon 08 Nov 2021 05:00:19 PM EST | climateprediction.net | Computation for task hadam4h_b0sx_201211_5_882_012036049_1 finished
Mon 08 Nov 2021 05:00:22 PM EST | climateprediction.net | Started upload of hadam4h_b0sx_201211_5_882_012036049_1_r2078399370_out.zip
Mon 08 Nov 2021 05:00:26 PM EST | climateprediction.net | Finished upload of hadam4h_b0sx_201211_5_882_012036049_1_r2078399370_out.zip


Task 22154264
Name 	hadam4h_b0sx_201211_5_882_012036049_1
Workunit 	12036049

Received 	8 Nov 2021, 22:15:38 UTC
Server state 	Over
Outcome 	Success
Client state 	Done
Exit status 	0 (0x00000000)
Computer ID 	1511241
Run time 	8 days 5 hours 51 min 24 sec
CPU time 	8 days 3 hours 11 min 32 sec
Validate state 	Valid
Credit 	20,375.94
Device peak FLOPS 	6.58 GFLOPS

ID: 64803 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7628
Credit: 24,240,330
RAC: 0
Message 64804 - Posted: 9 Nov 2021, 0:57:05 UTC - in response to Message 64803.  

There's been none for days now. :(

I sent an email 6.5 hours ago, so it'll be a few more hours until their time zone catches up.

**************

Normal?
For this project, it seems so. :) :) :)
ID: 64804 · Report as offensive     Reply Quote
Richard Haselgrove

Send message
Joined: 1 Jan 07
Posts: 531
Credit: 15,649,050
RAC: 1,962
Message 64805 - Posted: 9 Nov 2021, 13:31:22 UTC

Andy has acknowledged the problem, and has taken the necessary steps to fix it.

I can confirm that all my recently-completed tasks are showing the full set of trickles, though not yet the full allocation of credit (that's a separate process, and will arrive later).
ID: 64805 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 694
Credit: 10,133,158
RAC: 6,135
Message 64806 - Posted: 9 Nov 2021, 13:46:37 UTC - in response to Message 64805.  
Last modified: 9 Nov 2021, 13:47:48 UTC

I can confirm that all my recently-completed tasks are showing the full set of trickles, ...


Me too. All my tasks that have so far completed this November have all their trickles recorded.
ID: 64806 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 449
Credit: 19,706,234
RAC: 2,509
Message 65602 - Posted: 29 Jun 2022, 22:16:22 UTC
Last modified: 29 Jun 2022, 22:18:37 UTC

Similar problem but in reverse. All trickles loaded, out and restart zips sent but task showing as not complete. Also showing full credit!


Sat 25 Jun 2022 23:13:48 BST | climateprediction.net | Started upload of hadam4h_a016_200011_5_931_012138604_0_r894199564_restart.zip
Sat 25 Jun 2022 23:13:50 BST | climateprediction.net | Finished upload of hadam4h_a016_200011_5_931_012138604_0_r894199564_restart.zip
Sat 25 Jun 2022 23:13:51 BST | climateprediction.net | Sending scheduler request: To send trickle-up message.
Sat 25 Jun 2022 23:13:51 BST | climateprediction.net | Not requesting tasks: some task is suspended via Manager
Sat 25 Jun 2022 23:13:53 BST | climateprediction.net | Scheduler request completed
Sat 25 Jun 2022 23:13:53 BST | climateprediction.net | Project requested delay of 3636 seconds
Sat 25 Jun 2022 23:14:02 BST | climateprediction.net | Started upload of hadam4h_a016_200011_5_931_012138604_0_r894199564_5.zip
Sat 25 Jun 2022 23:15:45 BST | climateprediction.net | Finished upload of hadam4h_a016_200011_5_931_012138604_0_r894199564_5.zip

Sun 26 Jun 2022 00:01:07 BST | climateprediction.net | Started upload of hadam4h_a016_200011_5_931_012138604_0_r894199564_out.zip
Sun 26 Jun 2022 00:01:09 BST | climateprediction.net | Finished upload of hadam4h_a016_200011_5_931_012138604_0_r894199564_out.zip
ID: 65602 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2126
Credit: 58,267,435
RAC: 8,229
Message 65603 - Posted: 29 Jun 2022, 23:35:57 UTC - in response to Message 65602.  

Similar problem but in reverse. All trickles loaded, out and restart zips sent but task showing as not complete. Also showing full credit!


Sat 25 Jun 2022 23:13:48 BST | climateprediction.net | Started upload of hadam4h_a016_200011_5_931_012138604_0_r894199564_restart.zip
Sat 25 Jun 2022 23:13:50 BST | climateprediction.net | Finished upload of hadam4h_a016_200011_5_931_012138604_0_r894199564_restart.zip
Sat 25 Jun 2022 23:13:51 BST | climateprediction.net | Sending scheduler request: To send trickle-up message.
Sat 25 Jun 2022 23:13:51 BST | climateprediction.net | Not requesting tasks: some task is suspended via Manager
Sat 25 Jun 2022 23:13:53 BST | climateprediction.net | Scheduler request completed
Sat 25 Jun 2022 23:13:53 BST | climateprediction.net | Project requested delay of 3636 seconds
Sat 25 Jun 2022 23:14:02 BST | climateprediction.net | Started upload of hadam4h_a016_200011_5_931_012138604_0_r894199564_5.zip
Sat 25 Jun 2022 23:15:45 BST | climateprediction.net | Finished upload of hadam4h_a016_200011_5_931_012138604_0_r894199564_5.zip

Sun 26 Jun 2022 00:01:07 BST | climateprediction.net | Started upload of hadam4h_a016_200011_5_931_012138604_0_r894199564_out.zip
Sun 26 Jun 2022 00:01:09 BST | climateprediction.net | Finished upload of hadam4h_a016_200011_5_931_012138604_0_r894199564_out.zip

I've infrequently had this happen, but not for a long time. I noted it happening when a task is reported during a particularly busy server time, like when the trickles are being counted for the weekly credit run. At least that's my guess as a possible factor in this issue.
ID: 65603 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 449
Credit: 19,706,234
RAC: 2,509
Message 65606 - Posted: 30 Jun 2022, 22:23:24 UTC - in response to Message 65603.  

Looking at the timing of the uploads that would seem to be a reasonable supposition. Will it rectify itself?
ID: 65606 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2126
Credit: 58,267,435
RAC: 8,229
Message 65607 - Posted: 30 Jun 2022, 23:08:51 UTC - in response to Message 65606.  

Looking at the timing of the uploads that would seem to be a reasonable supposition. Will it rectify itself?

Unfortunately, it didn't for me.
ID: 65607 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7628
Credit: 24,240,330
RAC: 0
Message 65608 - Posted: 30 Jun 2022, 23:40:58 UTC

I have a vague memory of something similar a long time ago.
And it didn't correct itself, so I just put it down as "one of those things".

I think that it was when the servers were busy.
And it affected others as well.
ID: 65608 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 449
Credit: 19,706,234
RAC: 2,509
Message 65609 - Posted: 1 Jul 2022, 22:33:25 UTC - in response to Message 65607.  

Not over worried as I have got the credit for the work. Presumably in about 12months time it will come round again for reissue if the task set hasn't been pulled.
ID: 65609 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2126
Credit: 58,267,435
RAC: 8,229
Message 65610 - Posted: 2 Jul 2022, 5:00:03 UTC - in response to Message 65609.  

Not over worried as I have got the credit for the work. Presumably in about 12months time it will come round again for reissue if the task set hasn't been pulled.

The only way it can be reissued faster would be if you

set no new work for cpdn in boinc manager
let your cpdn tasks finish
detach from cpdn, and reattach

That will set the task state to abandoned, and it will be reissued immediately.
ID: 65610 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7628
Credit: 24,240,330
RAC: 0
Message 65611 - Posted: 2 Jul 2022, 7:08:33 UTC - in response to Message 65609.  

As long as all of the zips got sent, it's only your computer that doesn't have the usual messages on it.
So, No Worries, as we say "down here". :)
ID: 65611 · Report as offensive     Reply Quote
AndreyOR

Send message
Joined: 12 Apr 21
Posts: 105
Credit: 4,621,250
RAC: 21,559
Message 66006 - Posted: 28 Aug 2022, 5:54:48 UTC
Last modified: 28 Aug 2022, 5:57:22 UTC

I've had no trickles show up on the website since the 25th for any of the wah2 or HadCM3 tasks (about 11 in total). Also, seemingly related, the credit for recently completed HadCM3 tasks is much lower than expected and the last wah2 that completed and reported by BOINC is still showing in progress on the website. Anyone else having similar issues?
ID: 66006 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7628
Credit: 24,240,330
RAC: 0
Message 66007 - Posted: 28 Aug 2022, 6:45:15 UTC - in response to Message 66006.  

I've sent an email.
But it's Sunday morning over there.
ID: 66007 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 3560
Credit: 10,761,686
RAC: 5,528
Message 66008 - Posted: 28 Aug 2022, 8:38:43 UTC
Last modified: 28 Aug 2022, 10:15:45 UTC

I can confirm no trickles on WAH2 tasks since the 25th on my box. Also something a little odd.

28/08/2022 09:32:11 | climateprediction.net | Sending scheduler request: To send trickle-up message.
28/08/2022 09:32:11 | climateprediction.net | Not requesting tasks: "no new tasks" requested via Manager
28/08/2022 09:32:11 | climateprediction.net | [http] HTTP_OP::init_post(): https://www.cpdn.org/cpdnboinc_cgi/cgi
28/08/2022 09:32:11 | climateprediction.net | [http] [ID#1] Info:  Too old connection (356 seconds idle), disconnect it
28/08/2022 09:32:11 | climateprediction.net | [http] [ID#1] Info:  Connection 163 seems to be dead
28/08/2022 09:32:11 | climateprediction.net | [http] [ID#1] Info:  Closing connection 163
[b]28/08/2022 09:32:11 | climateprediction.net | [http] [ID#1] Info:  schannel: shutting down SSL/TLS connection with www.worldcommunitygrid.org port 443[/b]
28/08/2022 09:32:11 | climateprediction.net | [http] [ID#1] Info:  schannel: ApplyControlToken failure: SEC_E_UNSUPPORTED_FUNCTION (0x80090302)
28/08/2022 09:32:11 | climateprediction.net | [http] [ID#1] Info:    Trying 129.67.193.7:443...


Why does the event log show shutting down a connection with WCG in an event log entry for CPDN?

Edit: Trickles not showing past 25th August on Linux tasks either.
ID: 66008 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7628
Credit: 24,240,330
RAC: 0
Message 66017 - Posted: 30 Aug 2022, 20:48:33 UTC

This should be fixed now.
ID: 66017 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 3560
Credit: 10,761,686
RAC: 5,528
Message 66018 - Posted: 31 Aug 2022, 6:27:51 UTC

I can confirm that the trickle ups are now showing on both my WAH2 and Linux tasks.
ID: 66018 · Report as offensive     Reply Quote
AndreyOR

Send message
Joined: 12 Apr 21
Posts: 105
Credit: 4,621,250
RAC: 21,559
Message 66020 - Posted: 31 Aug 2022, 19:28:18 UTC

Yes, trickles are showing up now, thank you. I still have a wah2 task that's completed and reported a few days ago by BOINC but is still showing up as in progress on the website: https://www.cpdn.org/workunit.php?wuid=12153917
ID: 66020 · Report as offensive     Reply Quote
Profile Conan
Avatar

Send message
Joined: 6 Jul 06
Posts: 122
Credit: 1,862,002
RAC: 2,345
Message 66561 - Posted: 24 Nov 2022, 12:07:32 UTC

In a similar vein, I have This WU 22236909 that reported all trickles and seems to have been awarded full credit but still says it is on my computer and still running.

It uploaded with the last trickle so does anyone know what has happened to it?

I do not have it on my computer.

(there are 3 failed work units on that same computer reported today but they stem from a power failure which upset them)

Thanks
Conan
ID: 66561 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2126
Credit: 58,267,435
RAC: 8,229
Message 66569 - Posted: 24 Nov 2022, 20:21:58 UTC - in response to Message 66561.  

In a similar vein, I have This WU 22236909 that reported all trickles and seems to have been awarded full credit but still says it is on my computer and still running.

It uploaded with the last trickle so does anyone know what has happened to it?

I do not have it on my computer.

(there are 3 failed work units on that same computer reported today but they stem from a power failure which upset them)

Thanks
Conan

I've occasionally seen this before. It looks like your computer would have reported the success status sometime after 0000 GMT Sunday. This is usually when the credit scripts run and it is database intensive. I've had a few problems with tasks reporting during the credit run, and have read of others that have had the issue during that time as well. It doesn't happen frequently, but every once in awhile, the report status must get lost.
ID: 66569 · Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Task completed, but not all trickles acknowledged yet. Normal?

©2022 climateprediction.net