climateprediction.net home page
Posts by Les Bayliss
Posts by Les Bayliss
log in
1) Message boards : climateprediction.net Science : Project announcements discussion (Message 60416)
Posted 1 day ago by Les Bayliss
Just OpenIFS.
2) Message boards : climateprediction.net Science : Project announcements discussion (Message 60413)
Posted 1 day ago by Les Bayliss
That's the amount of ram that I'm planning for.
Also, allow 50 Gigs of HD space for BOINC, with the possibility of going to 100 Gigs. Hopefully we won't get to that again, but the future stretches a long way ahead.
3) Message boards : climateprediction.net Science : Project announcements discussion (Message 60410)
Posted 1 day ago by Les Bayliss
This makes the Intel 9700K (Coffee Lake), a good choice for a new build - 8 cores, no hyper-threading, 3.6 GHz.
4) Message boards : Number crunching : Upload failures (Message 60404)
Posted 2 days ago by Les Bayliss
Well it IS the weekend, so the gremlins are having fun.
5) Message boards : climateprediction.net Science : Project announcements discussion (Message 60400)
Posted 2 days ago by Les Bayliss
In Regard to the OpenIFS models, we can now talk about the batch that's been released for the Launch Event at Reading University.

This new endeavour is based on ECMWF work, rather the Uk Met Office models that we're so used to.
There's a description on the front page of the project, under News.
And a larger one, with photos, here

They can range from the small, as at present, to the huge, as with the Mid May Monsters that we were testing at one stage, all by changes to data files.
I'm not going to say much about the big ones, just that they required over 5 Gigs of ram each, and the other requirements were also big.

They're 64 bit Linux models.
For the current models, which are for Tropical storm Karl, I've seen the ram go from just under 2 Gigs, to 2+, and up to 3+ (under Properties).
One zip, of 64+ Megs.
Run time for 4, which is NO hyper-threading, is around 1 hour 13 minutes.

When I changed to all 8 processors, the time went up to 2 hours 28 minutes or so.
So I went back to 4 at a time.

The project person replied:
We normally run IFS with hyper-threading turned off. The model does a lot of data movement which can lead to cache use inefficiencies. I found I got a faster throughout by running 4 tasks on my 8 virtual core machine.

So, best not to use hyper-threading.

I'm using 2 machines with 3.5 GHZ processors.
Another cruncher with a 3.6 GHz processor is running almost right on 1 hour.

I don't know when these will start appearing on the cpdn site.
6) Questions and Answers : Unix/Linux : Benchmarks and other problems (Message 60388)
Posted 3 days ago by Les Bayliss
Are they sending work-units to Linux boxes that are trashing everything?

Projects don't send work, it's requested by computers connected to it.


*******************

It seems to me that if they were sending out 32-bit work units to boxen missing necessary libraries, that I would have been getting some of them too. But I have not.

Your computer got 4 of the latest version of that model on 17 Jun 2019, 12:21:33 UTC. This was 3 days before you posted.

******************

One of the reasons for your low benchmarks, is that your computer is horribily slow compared to the latest computers.

And if you ever expect to get anywhere with the new type of model when it's finally release, (will we EVER get to that point? ), then people should be looking at processor times in the 3 GHz area.
With a lot more memory than you have.

All of which will be posted about when the time comes.
7) Questions and Answers : Unix/Linux : Benchmarks and other problems (Message 60387)
Posted 3 days ago by Les Bayliss
I've moved all of the preceding posts out of the thread intended to discuss the new OpenIFS models.
8) Questions and Answers : Unix/Linux : 8.09 UK Met Office HadAM4 at N144 resolution (Message 60386)
Posted 3 days ago by Les Bayliss
Yes there will.
They're still in development/testing.
Please be patient.
9) Message boards : climateprediction.net Science : Project announcements discussion (Message 60377)
Posted 4 days ago by Les Bayliss
"Front page", right at the bottom on the left.
10) Message boards : Number crunching : Upload failures (Message 60371)
Posted 4 days ago by Les Bayliss
Which, I fear, implies that the problem is at your end.
And I'm out of ideas.
11) Message boards : climateprediction.net Science : Project announcements discussion (Message 60370)
Posted 4 days ago by Les Bayliss
I think that could be called "Getting ready".

It's the wording of the tweet that's a problem. It implies that the IFS models are already being run here, whereas they're for "Display purposes only" at the moment. Or some sort of words like that.

And it's got people banging on doors, wanting to get in and get some.
12) Message boards : climateprediction.net Science : Project announcements discussion (Message 60367)
Posted 4 days ago by Les Bayliss
Reading that tweet, the announcement is a little premature for cpdn.

The "release" is a public announcement by some of the climate people at Oxford, to climate physcists at a week long conference at Reading University.
Masses of models are currently being run by those in the testing area in conjunction with this.

I don't know when they'll get released to the crunchers here at cpdn.
And it probably won't be the same research project as the current test batch.
13) Message boards : climateprediction.net Science : Project announcements discussion (Message 60366)
Posted 4 days ago by Les Bayliss
The reason that there's no announcement here, is that this thread is a matching part of this thread.
If you scroll down the posts here, you'll find my post about why I created this thread.

And in that other, matching thread, you can see that these are about a completely different type of modelling program, which is still be tested.

The new model that's just been released is UK Met Office HadAM4 at N144 resolution, all of which have now gone.
They are Linux only, and are being discussed here in the Linux section.



Hello

I just saw a tweet "new model now available on CPDN" but I see no official announcement here, I see some discussions but no conclusion, only "you will see" kind of posts - or I missed it !

Anything effective ?

Thanks.


edit : or is it the "OpenIFS" I can see in the project selection params ?
14) Message boards : Number crunching : WU pending validation (Message 60360)
Posted 5 days ago by Les Bayliss
Never.
The word "Validation" is a BOINC process where 2 results from 2 different computers are compared to see if they're the same. (And therefore correct.)

ALL climate models using the same starting data, have been shown to produce slightly different results on different computers, so this process isn't used in this project.
It's what we have trickle_up files for; to show that work has been done by a given computer, and therefore deserves credit.
Which is calculated once a week, starting early on Saturday, UK time.
15) Message boards : climateprediction.net Science : Project announcements discussion (Message 60346)
Posted 6 days ago by Les Bayliss
"More of the same." i.e. cpu, and Linux only to start with.
Mostly, they're from a differently source.

As I've hinted elsewhere, these are BIG.
But they're still being developed and tested, so I don't want to say much yet.
16) Questions and Answers : Unix/Linux : 8.09 UK Met Office HadAM4 at N144 resolution (Message 60343)
Posted 6 days ago by Les Bayliss
These are the small ones. The big ones are still being tested.
17) Message boards : Number crunching : Upload failures (Message 60329)
Posted 7 days ago by Les Bayliss
"Server is out of disk space" again. :(

Looks like they need another unsuspecting data center to dump all of this data into.
18) Message boards : Number crunching : Upload failures (Message 60327)
Posted 7 days ago by Les Bayliss
Not too many yet.
Part of the problem could still be "you".
19) Message boards : climateprediction.net Science : Project announcements discussion (Message 60322)
Posted 8 days ago by Les Bayliss
Moved out of the Project announcements thread to de-clutter it.
20) Message boards : Number crunching : Why did I get ZERO credit for these tasks? (Message 60320)
Posted 9 days ago by Les Bayliss
I is a well known fact that this project uses it's own credit system, and that the credit scripts run once per week, starting early Saturday, UK time, and extending well into Sunday.


Next 20

Main page · Your account · Message boards


Copyright © 2019 climateprediction.net