climateprediction.net home page
Trickle up files

Trickle up files

Message boards : Number crunching : Trickle up files
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 61060 - Posted: 28 Sep 2019, 20:51:22 UTC

Mine for the new hadcm3s models stopped appearing Friday afternoon, UK time.
And it looked like the bug causing the lack of credits was fixed, too.

Waaaaaahhhhhh No fair.
ID: 61060 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,379,331
RAC: 3,596
Message 61067 - Posted: 29 Sep 2019, 6:46:54 UTC - in response to Message 61060.  

Just checked.
Mine too.
ID: 61067 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1045
Credit: 16,506,818
RAC: 5,001
Message 61105 - Posted: 30 Sep 2019, 11:12:47 UTC

According to my account, my last trickles were:

28 Sep 2019 05:40:06 1256552 21743987 hadcm3s_hd57_190012_240_835_011892279_0 1 77,760 211,783 2.7235
28 Sep 2019 04:41:15 1256552 21743985 hadcm3s_hd55_190012_240_835_011892277_0 1 77,760 211,731 2.7229

Yet according to my log, they were

29-Sep-2019 18:36:42 [climateprediction.net] Sending scheduler request: To send trickle-up message.
29-Sep-2019 18:36:42 [climateprediction.net] Not requesting tasks: don't need
29-Sep-2019 18:36:44 [climateprediction.net] Scheduler request completed
29-Sep-2019 18:37:07 [climateprediction.net] Started upload of hadcm3s_hd57_190012_240_835_011892279_0_r993379608_5.zip
29-Sep-2019 18:37:26 [climateprediction.net] Finished upload of hadcm3s_hd57_190012_240_835_011892279_0_r993379608_5.zip
29-Sep-2019 18:38:24 [climateprediction.net] Started upload of hadcm3s_hd55_190012_240_835_011892277_0_r1762533353_5.zip
29-Sep-2019 18:38:42 [climateprediction.net] Finished upload of hadcm3s_hd55_190012_240_835_011892277_0_r1762533353_5.zip
29-Sep-2019 19:37:20 [climateprediction.net] Sending scheduler request: To send trickle-up message.

Is this just another instance of the subject of this thread, or is it something else?
ID: 61105 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 61106 - Posted: 30 Sep 2019, 11:48:13 UTC

Just had a reply to an email.
It's going to take a big re-boot to fix this, and there's more work being readied for the download server.
So it'll get fixed "soon".

Busy, busy, busy.
ID: 61106 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 484
Credit: 29,579,234
RAC: 4,572
Message 61114 - Posted: 30 Sep 2019, 22:11:36 UTC - in response to Message 61105.  

Trickles and zip files are different entities and (I think) go to different places.
ID: 61114 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1045
Credit: 16,506,818
RAC: 5,001
Message 61116 - Posted: 30 Sep 2019, 22:27:01 UTC - in response to Message 61114.  

I am pretty sure you are correct about this.

The only way I can tell what CPDN thinks what trickles I have sent are to look at my page where it reports my tasks. It lists "Latest Trickles Received" but shows the progress files it recognizes as uploaded. The second part of my post lists what my machine thinks I uploaded and this includes BOTH the trickles and the progress files that it thinks it uploaded. The trickles get sent at about (but not exactly) the same time as the progress files are uploaded.

In any case, I have uploaded about 5 progress files for each of the two tasks, and the corresponding trickles. But CPDN thinks I have only uploaded three of each.
ID: 61116 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 61120 - Posted: 30 Sep 2019, 23:33:28 UTC

Please read my previous post, which is about fixing the trickles missing on the user's web pages.
ID: 61120 · Report as offensive     Reply Quote
Profile Dingo

Send message
Joined: 26 Aug 04
Posts: 31
Credit: 1,581,530
RAC: 0
Message 61127 - Posted: 1 Oct 2019, 7:00:31 UTC

I have had a couple of tasks running for over 24 hours and there are no trickle files that I can see ?? How often are the trickle files updated ??

https://www.cpdn.org/workunit.php?wuid=11900585
https://www.cpdn.org/workunit.php?wuid=11900741
ID: 61127 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,379,331
RAC: 3,596
Message 61128 - Posted: 1 Oct 2019, 7:11:21 UTC - in response to Message 61127.  

I have had a couple of tasks running for over 24 hours and there are no trickle files that I can see ?? How often are the trickle files updated ??

https://www.cpdn.org/workunit.php?wuid=11900585
https://www.cpdn.org/workunit.php?wuid=11900741


hadam4_a07r_209310_12_838_011900585_0

The 12 in the task name tells you how many trickle up files there are. so every just over 8.3% of the task.

See Les's earlier post. Them not showing is a server side problem.
ID: 61128 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 61129 - Posted: 1 Oct 2019, 7:39:13 UTC - in response to Message 61127.  

Adding a bit to Dave's post:

For convenience they are created at about the same time as the zip files.
ID: 61129 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1045
Credit: 16,506,818
RAC: 5,001
Message 61130 - Posted: 1 Oct 2019, 12:07:43 UTC

I just noticed my trickles have all caught up last night.
ID: 61130 · Report as offensive     Reply Quote
Profile Dingo

Send message
Joined: 26 Aug 04
Posts: 31
Credit: 1,581,530
RAC: 0
Message 61156 - Posted: 3 Oct 2019, 6:36:27 UTC

I have had one trickle on each work unit as well. Did't know about the 12 in the name, thanks hadam4_a07r_209310_12_838_011900585_0

Proud Founder and member of

Have a look at my WebCam
ID: 61156 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,379,331
RAC: 3,596
Message 61157 - Posted: 3 Oct 2019, 8:55:33 UTC

Didn't know about the 12 in the name, thanks hadam4_a07r_209310_12_838_011900585_0


Not sure if there is a sticky on this but if not there should be and I will look to making one later but
Hadm4 is model type.838 is batch number
209310 is start year and month
The _0 indicates this is the first attempt at the tasks if it fails it goes out another twice _1 and _2 before being labelled a hard fail.
the a07r after the model type is its serial number in the batch.
ID: 61157 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 484
Credit: 29,579,234
RAC: 4,572
Message 61210 - Posted: 10 Oct 2019, 21:57:52 UTC

Interesting that with the new version of BOINC and the new CPDN pages that only the most recent trickle files, not all of them, are shown.
ID: 61210 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 61211 - Posted: 10 Oct 2019, 22:20:32 UTC - in response to Message 61210.  

Mine are showing: here
ID: 61211 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1045
Credit: 16,506,818
RAC: 5,001
Message 61212 - Posted: 11 Oct 2019, 0:16:39 UTC - in response to Message 61210.  

Interesting that with the new version of BOINC and the new CPDN pages that only the most recent trickle files, not all of them, are shown.


All mine show. This is the top of one list. It is one of 17 trickles. The other 16 are there too. I am using an old version of boinc Manager (7.2.33).
Time Sent (UTC) 	 Host ID 	   Result ID 	Result Name 	                       Phase 	Timestep 	CPU Time (sec) 	Average (sec/TS)
10 Oct 2019 19:43:25 1256552   21743985 	hadcm3s_hd55_190012_240_835_011892277_0 	1 	440,640 	1,208,310 	2.7422

ID: 61212 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,379,331
RAC: 3,596
Message 61213 - Posted: 11 Oct 2019, 7:23:25 UTC

All mine show. This is the top of one list. It is one of 17 trickles. The other 16 are there too. I am using an old version of boinc Manager (7.2.33).


All mine are showing too. I am using BOINC7.16.3
ID: 61213 · Report as offensive     Reply Quote
Harri Liljeroos
Avatar

Send message
Joined: 9 Dec 05
Posts: 110
Credit: 12,038,780
RAC: 1,393
Message 61214 - Posted: 11 Oct 2019, 7:51:05 UTC

Only 20 latest trickles are shown. It has been like this for a long time.
ID: 61214 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 61215 - Posted: 11 Oct 2019, 8:25:23 UTC

If people are talking about only seeing the last 20 trickles, then it's ALWAYS been like that.
There is / used to be, another page with all of them, but that disappeared 2-3 years ago, and we haven't been able to get it back. :(
ID: 61215 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 1045
Credit: 16,506,818
RAC: 5,001
Message 61216 - Posted: 11 Oct 2019, 12:25:04 UTC - in response to Message 61214.  

Only 20 latest trickles are shown. It has been like this for a long time


I do not doubt you. There was a long time during which I got no work units (I run Linux), so I do not remember (I am getting old and memory is not what they once were). I have started getting work units again, but most of them generated only 12 trickles. IIRC, some of these work units were only credited with the first trickle on the web page. but the trickle files did get sent. That was perhaps a bug, but it seems to have been fixed. And the recent work units (hadcm3s and hadam4) seem to be working just fine. Five of the hadam4 work units have completed correctly and two more of them are about 70% done. Also, two hadcm3s work units are running and about 90% done.
ID: 61216 · Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Trickle up files

©2024 climateprediction.net