climateprediction.net home page
New work Discussion

New work Discussion

Message boards : Number crunching : New work Discussion
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 58 · 59 · 60 · 61 · 62 · 63 · 64 . . . 91 · Next

AuthorMessage
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4342
Credit: 16,501,246
RAC: 5,648
Message 63559 - Posted: 28 Feb 2021, 20:29:35 UTC - in response to Message 63558.  

There are more UK Met Office HadCM3 shorts available.
I will leave them for the Windows users.
Well that didn't last, I just told 6 machines to grab some, and none are left.

... I'm not sure there were any, as there haven't been any additions to the work unit list.


I will check in the morning UK time) when one of my sources for information will have updated but I suspect these must have been resends, possibly from a computer that has just been turned on after a while that crashed them all due to missing libraries. Another of my sources tells of some HADAM3 that were due to go out, based on batch 888 restarts. Because some of the ancillary files were wrong they didn't go out about a fortnight ago. I will be able to tell if it was these when I look tomorrow morning. If it was, when they complete they should generate some more of the same.
Please do not private message myself or other moderators for help. This limits the number of people who are able to help and deprives others who may benefit from the answer.
ID: 63559 · Report as offensive
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2167
Credit: 64,486,263
RAC: 4,472
Message 63560 - Posted: 28 Feb 2021, 21:03:04 UTC - in response to Message 63559.  

It's additions to batch 837, hadcm3s and there are still lots in the queue. Unfortunately, the application is only available for Linux and Mac at this time.
ID: 63560 · Report as offensive
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 63561 - Posted: 28 Feb 2021, 21:38:30 UTC - in response to Message 63560.  

It's additions to batch 837, hadcm3s and there are still lots in the queue. Unfortunately, the application is only available for Linux and Mac at this time.
[Sulks] When I read "I will leave them for the Windows users" I had a crisis.
ID: 63561 · Report as offensive
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 63562 - Posted: 28 Feb 2021, 21:45:29 UTC - in response to Message 63560.  
Last modified: 28 Feb 2021, 21:48:56 UTC

It's additions to batch 837, hadcm3s and there are still lots in the queue. Unfortunately, the application is only available for Linux and Mac at this time.

Thanks for the clarification. I will have to do some myself.

PS - That would be easier if we could select work units, in which case I could add another machine for them. As it is, I have to wait until the N216s complete to get the right machine with the right memory, etc.
ID: 63562 · Report as offensive
Profile Landjunge

Send message
Joined: 17 Aug 07
Posts: 8
Credit: 35,353,184
RAC: 1,966,142
Message 63563 - Posted: 1 Mar 2021, 5:58:22 UTC - in response to Message 63562.  

Yes, make the workunits selectable please.
ID: 63563 · Report as offensive
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 63564 - Posted: 1 Mar 2021, 9:08:00 UTC

Perhaps it's time to repeat this:

In the past when people could pick and choose, a lot of work got ignored because it didn't suit users.
So now there is NO choice - the server sends what ever is next.
ID: 63564 · Report as offensive
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4342
Credit: 16,501,246
RAC: 5,648
Message 63565 - Posted: 1 Mar 2021, 9:30:27 UTC

Was going to post what the position is but Les has beaten me to it. Please note that this is not at the whim of the moderators. There are arguments on both sides but even as a moderator, unless I have missed something, I don't have access to the figures from the time when we could select task types to judge. As with other projects where decisions are made that (some) crunchers disagree with I have to accept that they know best. I also know that putting the data out there to show the justification would be a lot of work and not a priority for the project. It isn't like most of the information we can all look at which is handled by the BOINC server code.
Please do not private message myself or other moderators for help. This limits the number of people who are able to help and deprives others who may benefit from the answer.
ID: 63565 · Report as offensive
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 63566 - Posted: 1 Mar 2021, 9:41:40 UTC - in response to Message 63565.  
Last modified: 1 Mar 2021, 9:42:09 UTC

Well I tried, and they aren't sending me any, even with six cores free on a Ryzen 3600 (Ubuntu 20.04.1).
Maybe the hadcm3s are too short to mix well with the four hadam4h that I already have running. It could be a BOINC scheduler problem.

But between BOINC and the Oxford researchers who think they know better how to run my machine than I do, I think I can safely say I won't be doing any.
I hope the vaccine works better.
ID: 63566 · Report as offensive
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4342
Credit: 16,501,246
RAC: 5,648
Message 63567 - Posted: 1 Mar 2021, 10:35:07 UTC - in response to Message 63566.  

Well I tried, and they aren't sending me any, even with six cores free on a Ryzen 3600 (Ubuntu 20.04.1).
Maybe the hadcm3s are too short to mix well with the four hadam4h that I already have running. It could be a BOINC scheduler problem.


I think it is just the way the scheduler works. Statistically I expect to get some before they all go unless an army of Mac users turns up soon. If they do, good luck to them. They have had a long dry period so I don't really mind if I just get the Hadam4h tasks for now. There are still lots of them in the hopper which is probably why you didn't get any hadcm3s ones.
Please do not private message myself or other moderators for help. This limits the number of people who are able to help and deprives others who may benefit from the answer.
ID: 63567 · Report as offensive
Profile Iain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1081
Credit: 6,981,170
RAC: 3,836
Message 63568 - Posted: 1 Mar 2021, 10:45:58 UTC

Does anyone have a work unit number for one of these additional HADCM3S models? Because I can't see them!

(I can see on an internal system that the number of work units in batch #837 has been bumped, but don't understand how that can be if the work units aren't visible, and if they aren't visible then how do users get them?)
ID: 63568 · Report as offensive
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4342
Credit: 16,501,246
RAC: 5,648
Message 63569 - Posted: 1 Mar 2021, 11:20:34 UTC

But I get the point that you could be doing more work with a mix because the hadcm3s don't hammer the cache memory like the others. Nor do they require as much RAM. I don't need to be running much else on top of 5 tasks to use up all of my 32GB. - Will be buying another 32 some time to make things a bit more reasonable.
Please do not private message myself or other moderators for help. This limits the number of people who are able to help and deprives others who may benefit from the answer.
ID: 63569 · Report as offensive
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4342
Credit: 16,501,246
RAC: 5,648
Message 63570 - Posted: 1 Mar 2021, 11:24:44 UTC - in response to Message 63568.  
Last modified: 1 Mar 2021, 11:42:06 UTC

Does anyone have a work unit number for one of these additional HADCM3S models? Because I can't see them!

(I can see on an internal system that the number of work units in batch #837 has been bumped, but don't understand how that can be if the work units aren't visible, and if they aren't visible then how do users get them?)


This one Went to batch statistics and looked for running tasks for batch.

Edit: And another one so they are going out to both Mac and Linux hosts. I don't know if there are enough Mac hosts out there for it to be worth deprecating the Linux ones so all the Apple fans can get some?
Please do not private message myself or other moderators for help. This limits the number of people who are able to help and deprives others who may benefit from the answer.
ID: 63570 · Report as offensive
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 63571 - Posted: 1 Mar 2021, 11:52:28 UTC - in response to Message 63568.  

Yes, it's a long list now.

I suspect that the answer is something like:
These will get done when all of those in more recent batches are finished.
Which is going to be a loooooong time from now.
ID: 63571 · Report as offensive
Profile Iain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1081
Credit: 6,981,170
RAC: 3,836
Message 63572 - Posted: 1 Mar 2021, 12:13:03 UTC

Ok: I'll fire up my steam-powered Mac and try to get one.

Reissuing an existing WU makes sense but I still don't understand the increase in the total number of WUs in a batch without those additional WUs being visible unless, as I think Les is suggesting, the increase is being done in chunks: there were 5555 in the original batch #837, which now claims to be 7470 (likewise batch #835, which was previously 1689 WUs).
ID: 63572 · Report as offensive
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 63573 - Posted: 1 Mar 2021, 12:51:21 UTC

I am building another Ryzen 3600 in a few days, and was hoping to put them solely on the UK Met Office HadCM3 short. But since I can't select, I will get whatever they choose to send me, and could end up in the same soup with an unusable mix. It will be a while before they can get them done.
ID: 63573 · Report as offensive
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4342
Credit: 16,501,246
RAC: 5,648
Message 63574 - Posted: 1 Mar 2021, 13:53:27 UTC

It will be a while before they can get them done.

Unless we get an influx of Mac users. Most of whom I suspect have gone elsewhere due to the long drought.
Please do not private message myself or other moderators for help. This limits the number of people who are able to help and deprives others who may benefit from the answer.
ID: 63574 · Report as offensive
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2167
Credit: 64,486,263
RAC: 4,472
Message 63575 - Posted: 1 Mar 2021, 17:01:51 UTC

My Ryzen 3600X picked one up last night to run along with 4 N216 models. The new tasks in batch 837 appear to be 360 month tasks and are taking 0.6 sec/TS on the Ryzen in that configuration. Randomly saw that a couple of these 360 tasks were taken up by Macs, so they are being sent out.
ID: 63575 · Report as offensive
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 690
Credit: 4,391,754
RAC: 6,918
Message 63576 - Posted: 1 Mar 2021, 18:40:55 UTC - in response to Message 63566.  
Last modified: 1 Mar 2021, 18:41:36 UTC

Well I tried, and they aren't sending me any, even with six cores free on a Ryzen 3600 (Ubuntu 20.04.1).
Maybe the hadcm3s are too short to mix well with the four hadam4h that I already have running. It could be a BOINC scheduler problem.
Everything's a Boinc scheduler problem. I see it doing something stupid on one of my 7 machines almost every day. There's meant to be a new version in the pipeline, but I bet they just introduce even more bugs. It took me ages to convince them that it can't tell the difference between time taken on 24 cores and time taken per core.
ID: 63576 · Report as offensive
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4342
Credit: 16,501,246
RAC: 5,648
Message 63577 - Posted: 1 Mar 2021, 19:29:24 UTC - in response to Message 63576.  
Last modified: 1 Mar 2021, 19:32:51 UTC

Everything's a Boinc scheduler problem. I see it doing something stupid on one of my 7 machines almost every day. There's meant to be a new version in the pipeline, but I bet they just introduce even more bugs. It took me ages to convince them that it can't tell the difference between time taken on 24 cores and time taken per core.


I don't see this as a problem except for those who would like to choose which tasks to run and that is a project issue not a scheduler one.
It will be a while before they can get them done.

They seem to be flying off the shelves at quite a decent rate according to the server status page

Edit: #897 that has been poured into the hopper will throw a spanner in the works and slow down the rate they go out to Linux machines though I don't know enough to work out by how much.
Please do not private message myself or other moderators for help. This limits the number of people who are able to help and deprives others who may benefit from the answer.
ID: 63577 · Report as offensive
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 63579 - Posted: 1 Mar 2021, 19:50:53 UTC - in response to Message 63577.  

I don't see this as a problem except for those who would like to choose which tasks to run and that is a project issue not a scheduler one.
It will be a while before they can get them done.

They seem to be flying off the shelves at quite a decent rate according to the server status page

I am inclined to agree with Peter. If the BOINC scheduler simply assigned them in order to available cores, you would get them. It is because it is trying to juggle the miserable resource share (and whatever else it manages to think up) that it gets itself into a dead-end situation. They could do better by getting rid of it entirely.

That is not to say the project should not allow you to choose, but that is a different matter.
I am glad they are flying off to somewhere.
ID: 63579 · Report as offensive
Previous · 1 . . . 58 · 59 · 60 · 61 · 62 · 63 · 64 . . . 91 · Next

Message boards : Number crunching : New work Discussion

©2024 climateprediction.net