climateprediction.net home page
Little work, yet the most "important" thing in the world?

Little work, yet the most "important" thing in the world?

Message boards : Number crunching : Little work, yet the most "important" thing in the world?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · Next

AuthorMessage
Profile Iain Inglis
Volunteer moderator

Send message
Joined: 16 Jan 10
Posts: 1079
Credit: 6,906,534
RAC: 6,466
Message 63761 - Posted: 1 Apr 2021, 11:59:27 UTC - in response to Message 63735.  

The trajectory of increasing model complexity seems quite natural to me. There were global models and then regional ones; slab oceans and then stratified ones; low resolution and then higher resolution; and who knows what internal changes in the science and the parameters.

On the computer side there has not been a compensating application of Moore’s Law. Computers are faster but not fast enough; disks are certainly larger and I would guess large enough; memory is cheaper but oddly constrained by operating system and supplier (for Windows on my Dell, at least);
Really? I just built a Ryzen 9 3900XT. I put 64GB into it and it will take 128GB. Boinc needs nothing like that.


My point was intended to concern the failure of the speed of PCs to increase "as expected", though I concede that Moore's Law isn't really about speed. The number of processors has indeed increased and that means fewer users are needed for a fixed ensemble size, or if the same number of users carry on with the project then the ensemble sizes could be increased (if that is scientifically interesting). However, ensemble completion times won't have improved proportionally.

Here's a normalised estimate of the speed of the machines on which I have run CPDN models plotted against date of purchase, based on 653 models benchmarked across eight machines. The linear fit has a gradient of ~10%, which is a long way short of a speed version of Moore's Law. That's all I meant to say.

ID: 63761 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,380,160
RAC: 3,563
Message 63762 - Posted: 1 Apr 2021, 14:04:13 UTC - in response to Message 63761.  

An interesting perspective Ian. I have had rather fewer machines since I started with the project and have relatively recently made the jumps from a core2 duo to a ryzen7 which means that as well as being able to run more tasks at once, they are completing in less than a third of the time if I run eight at once. a bit faster if I keep it down to five so over twelve times the throughput. Just a shame more machines aren't running Linux as the current flow of batches means it takes quite a long time to get through them.
ID: 63762 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 63764 - Posted: 2 Apr 2021, 1:44:40 UTC

I have noticed that the performance of laptops (the only kind of PC’s I have personal experience with) hasn’t increased much in the last few years. Going back 12 to15 years, it used to be that every time I replaced a machine (about every 2.5 to 3 years) the clock speed of the chip and amount of RAM were increased for the same money. Recently, this has not been true. Now if you want an increase in speed or RAM the price goes up at more than just the rate of inflation.
ID: 63764 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 669
Credit: 4,391,754
RAC: 6,918
Message 63789 - Posted: 3 Apr 2021, 17:24:44 UTC - in response to Message 63764.  

I have noticed that the performance of laptops (the only kind of PC’s I have personal experience with) hasn’t increased much in the last few years. Going back 12 to15 years, it used to be that every time I replaced a machine (about every 2.5 to 3 years) the clock speed of the chip and amount of RAM were increased for the same money. Recently, this has not been true. Now if you want an increase in speed or RAM the price goes up at more than just the rate of inflation.
The desktop CPUs are way faster than they used to be. Is it just laptops that haven't progressed? I can't see why there would be a difference.
ID: 63789 · Report as offensive     Reply Quote
Profile Alan K

Send message
Joined: 22 Feb 06
Posts: 484
Credit: 29,579,234
RAC: 4,572
Message 63793 - Posted: 3 Apr 2021, 22:54:16 UTC - in response to Message 63789.  
Last modified: 3 Apr 2021, 22:54:42 UTC

The speed difference is probably down to a few parameters to do purely with laptops. The driving forces in this area have been weight and battery life as well as better screen resolution. Since battery life is dependant on size then compromises have to be made with the power that any chips can consume. Therefore the CPUs are lower power consumption and as a knock on effect from that slower or with lower overall computing capacity.
ID: 63793 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 669
Credit: 4,391,754
RAC: 6,918
Message 63795 - Posted: 4 Apr 2021, 17:40:37 UTC - in response to Message 63793.  
Last modified: 4 Apr 2021, 17:41:15 UTC

The speed difference is probably down to a few parameters to do purely with laptops. The driving forces in this area have been weight and battery life as well as better screen resolution. Since battery life is dependant on size then compromises have to be made with the power that any chips can consume. Therefore the CPUs are lower power consumption and as a knock on effect from that slower or with lower overall computing capacity.
So can you actually buy a laptop you can use on your lap now? The last one I used would overheat instantly, since the intake vent was underneath, where your lap is blocking it! It should have been sold as a tabletop.

And I thought a lot of gamers were going for laptops now, so surely they're adding a lot of power for that, or is that all in the GPU?
ID: 63795 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,380,160
RAC: 3,563
Message 63796 - Posted: 4 Apr 2021, 18:10:19 UTC

can you actually buy a laptop you can use on your lap now? The last one I used would overheat instantly, since the intake vent was underneath, where your lap is blocking it! It should have been sold as a tabletop.

And I thou
ght a lot of gamers were going for laptops now, so surely they're adding a lot of power for that, or is that all in the GPU?

Most if running flat out will over heat if sitting on a lap unless you use a tray between the laptop and lap. They are fine for just dealing with emails if air intakes are blocked.

I don't have a working laptop at the moment but wouldn't use one for anything too intensive as the fans get noisy. Liquid cooling means if listening to anything on speakers, I can't hear the fans on my desktop, even with 8 cores on full load. I don't run anything that is intensive on the graphics and have never played any demanding games ona computer so can't answer the last bit.
ID: 63796 · Report as offensive     Reply Quote
Profile JIM

Send message
Joined: 31 Dec 07
Posts: 1152
Credit: 22,053,321
RAC: 4,417
Message 63797 - Posted: 4 Apr 2021, 21:27:11 UTC - in response to Message 63795.  

So can you actually buy a laptop you can use on your lap now? The last one I used would overheat instantly, since the intake vent was underneath, where your lap is blocking it! It should have been sold as a tabletop.

And I thought a lot of gamers were going for laptops now, so surely they're adding a lot of power for that, or is that all in the GPU?


Yeah, they do say not to hold a laptop on your lap because of overheating. The name has stuck from the old days. I think the proper term is notebook.

You can get faster gaming laptops if you are prepared to shell out big bucks. They are in the $1200 USD range. That is out of my price range. Recently, I have been buying “refurbished” laptops in the $350 USD range. These models usually sold originally for about $650 USD.
ID: 63797 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 669
Credit: 4,391,754
RAC: 6,918
Message 63803 - Posted: 5 Apr 2021, 17:30:05 UTC - in response to Message 63797.  

So can you actually buy a laptop you can use on your lap now? The last one I used would overheat instantly, since the intake vent was underneath, where your lap is blocking it! It should have been sold as a tabletop.

And I thought a lot of gamers were going for laptops now, so surely they're adding a lot of power for that, or is that all in the GPU?


Yeah, they do say not to hold a laptop on your lap because of overheating. The name has stuck from the old days. I think the proper term is notebook.

You can get faster gaming laptops if you are prepared to shell out big bucks. They are in the $1200 USD range. That is out of my price range. Recently, I have been buying “refurbished” laptops in the $350 USD range. These models usually sold originally for about $650 USD.
Surely, especially a gaming laptop, could just have the intake and exhaust both on the edge? A very simple and obvious thing to do. Stupid designers.... People put laptops on their lap when sat on the sofa, or they'd use a desktop!
ID: 63803 · Report as offensive     Reply Quote
mikey

Send message
Joined: 18 Nov 18
Posts: 21
Credit: 5,439,444
RAC: 3,273
Message 63812 - Posted: 8 Apr 2021, 2:54:57 UTC - in response to Message 63642.  
Last modified: 8 Apr 2021, 2:56:47 UTC

There's something like 400 CPU-years of work queued.


Yes, and all of it is set to run only on Os’s that are run by only a tiny minority of the public. Windows is run on about 87% of all the home computers in the World.[/quote]

I personally don't have a problem with that, Linux OS's can be burnt onto a dvd and up and running in under 15 minutes, but that's beside my point...my point is I can't find WHERE it says that X type of task is only for 32bit Linux OS's while Y type of task is for 64bit Linux OS's and Z type of task over there is for Windows 7 or 10 pc's. A bit more info instead of guessing would help especially since the default timeout of 3600 seconds makes any kind of figuring out what kind of task will work on my pc useless.
ID: 63812 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 63813 - Posted: 8 Apr 2021, 3:09:03 UTC - in response to Message 63812.  
Last modified: 8 Apr 2021, 3:11:46 UTC

A bit more info


That is a 2 step process:
1. Look at the Project status page, at the Tasks by application section, in the Application column, to find the name of the application in which you're interested.
2. Look on the Applications page to find out which OS's have that Application.

**********************

And don't forget: the tasks are from research groups external to Oxford.
What OS each group uses, is entirely up to them.
ID: 63813 · Report as offensive     Reply Quote
Eirik Redd

Send message
Joined: 31 Aug 04
Posts: 391
Credit: 219,888,554
RAC: 1,481,373
Message 63820 - Posted: 9 Apr 2021, 8:37:57 UTC - in response to Message 63812.  

There's something like 400 CPU-years of work queued.


Yes, and all of it is set to run only on Os’s that are run by only a tiny minority of the public. Windows is run on about 87% of all the home computers in the World.


I personally don't have a problem with that, Linux OS's can be burnt onto a dvd and up and running in under 15 minutes, but that's beside my point...my point is I can't find WHERE it says that X type of task is only for 32bit Linux OS's while Y type of task is for 64bit Linux OS's and Z type of task over there is for Windows 7 or 10 pc's. A bit more info instead of guessing would help especially since the default timeout of 3600 seconds makes any kind of figuring out what kind of task will work on my pc useless.[/quote]

How it is now -- Windows 10 has a subsystem in the windows store for free that makes it easy peasy to run Ubuntu and a few other Linux apps under Windows 10. I myself have tried that. It works reliably but I've not compared efficiency
for a long time Linux has had "not linux - independent FOSS project called "wine" " that has worked for me

Actually on Win 10 or linux it takes a small bit of work --

What I say is , with an hour reading the documentation,
Anybody can run "Windows under Linux" or "Linux under Windows"
Both "just work" -- takes an hour or two -- you can run most apps either way.

If anybody wants it easier than that -- Duh

e
ID: 63820 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 63821 - Posted: 9 Apr 2021, 9:21:45 UTC
Last modified: 9 Apr 2021, 9:22:25 UTC

quote]Windows is run on about 87% of all the home computers in the World.[/quote]

And another thing: climate research is run by people using big Unix / Linux systems, not Windows.
What the public uses to do things is irrelevant.
ID: 63821 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 669
Credit: 4,391,754
RAC: 6,918
Message 63830 - Posted: 10 Apr 2021, 17:03:54 UTC - in response to Message 63821.  

Windows is run on about 87% of all the home computers in the World.
And another thing: climate research is run by people using big Unix / Linux systems, not Windows.
What the public uses to do things is irrelevant.
It's relevant when you're outsourcing the calculations to people with Windows. And it may be fairly easy to run Linux stuff under Windows, but most people won't bother. I'm technically minded and have been in IT support for 11 years officially, and far longer unofficially. I could run the Linux tasks under Windows. But why should I? There are so many projects that have native Windows tasks available, I just do those instead. And most people probably wouldn't be able to or want to run Linux under Windows. Msot users don't know much about the techy stuff.
ID: 63830 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7629
Credit: 24,240,330
RAC: 0
Message 63831 - Posted: 10 Apr 2021, 19:31:16 UTC - in response to Message 63830.  

We're NOT outsourcing work to people with Windows.
It's being provided to people with appropiate computer systems.
And for about a year now, that has NOT been Windows people.
ID: 63831 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Jan 06
Posts: 637
Credit: 26,751,529
RAC: 653
Message 63832 - Posted: 10 Apr 2021, 19:48:58 UTC - in response to Message 63831.  

I expect the researchers do their own thing on their own schedules. They may have no idea what the other researchers are doing.
So it is not surprising that we can for years without any Linux work either, and then it dumps on us all at once.

That does not concern me so much as the lack of selectivity. We have to run all of it or nothing.
ID: 63832 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 4314
Credit: 16,380,160
RAC: 3,563
Message 63834 - Posted: 10 Apr 2021, 20:59:33 UTC - in response to Message 63830.  

And most people probably wouldn't be able to or want to run Linux under Windows. Msot users don't know much about the techy stuff.


Personally, I got involved with CPDN because I believe in the importance of climate research. What you say is no doubt true for those who just want to collect credit. (Though, there are projects which give a higher return/cpu hour than CPDN.) I learned the relatively simple process of running Windows tasks under Linux during the many years when the overwhelming majority of work was for Windows.

The other side of it is that researchers with deadlines for their Masters/PhD who are familiar with Unix/Linux systems probably don't have the time to learn enough to port their applications to Windows, especially if it is the task type that runs well under Linux that is best suited to their research. I would guess they have enough other work to be getting on with while waiting the two or three months for enough results to come back when there aren't enough Linux machines to finish them more quickly.
ID: 63834 · Report as offensive     Reply Quote
KAMasud

Send message
Joined: 6 Oct 06
Posts: 204
Credit: 7,608,986
RAC: 0
Message 63841 - Posted: 12 Apr 2021, 4:16:53 UTC - in response to Message 63834.  

And most people probably wouldn't be able to or want to run Linux under Windows. Msot users don't know much about the techy stuff.

Personally, I got involved with CPDN because I believe in the importance of climate research. What you say is no doubt true for those who just want to collect credit. (Though, there are projects which give a higher return/cpu hour than CPDN.) I learned the relatively simple process of running Windows tasks under Linux during the many years when the overwhelming majority of work was for Windows.

The other side of it is that researchers with deadlines for their Masters/PhD who are familiar with Unix/Linux systems probably don't have the time to learn enough to port their applications to Windows, especially if it is the task type that runs well under Linux that is best suited to their research. I would guess they have enough other work to be getting on with while waiting the two or three months for enough results to come back when there aren't enough Linux machines to finish them more quickly.

___________________________

Kudos to Dave for a concise answer.
Peter, for credits, compute "Collapsed Conjecture". We compute this project for the love of the subject. Climate. So, if love demands we run Linux on Virtual Box, so be it.
And most people probably wouldn't be able to or want to run Linux under Windows. Msot users don't know much about the techy stuff.
. You will be surprised how many are.
ID: 63841 · Report as offensive     Reply Quote
[SG]Felix

Send message
Joined: 4 Oct 15
Posts: 34
Credit: 9,069,332
RAC: 14,637
Message 63847 - Posted: 12 Apr 2021, 16:58:02 UTC

It took me about 45 minutes to set up a VM with 64bit Ubuntu Mate 20.04 LTS, installing Boinc, installing the needed libraries with
sudo apt install lib32ncurses6 lib32z1 lib32stdc++-7-dev

and add CPDN to my Boinc Manager. To be fair, i have installed Linux with a GUI, because i cannot work just with a console. But when you install Linux with an GUI, the navigation is nearly the same as in Windows. Yes, it depends on which Linux distribution you use, thats why i mentioned, that I use Ubuntu Mate.

Greets from Germany
Felix
ID: 63847 · Report as offensive     Reply Quote
Mr. P Hucker

Send message
Joined: 9 Oct 20
Posts: 669
Credit: 4,391,754
RAC: 6,918
Message 63848 - Posted: 12 Apr 2021, 17:06:48 UTC - in response to Message 63841.  

Peter, for credits, compute "Collapsed Conjecture". We compute this project for the love of the subject. Climate. So, if love demands we run Linux on Virtual Box, so be it.
This isn't the only worthy project. And it isn't the only climate project. I'll just pick the ones that use Windows.

And most people probably wouldn't be able to or want to run Linux under Windows. Msot users don't know much about the techy stuff.
.You will be surprised how many are.
Most people can't even use windows. If you've ever worked in IT support, you'll know most computer users are like most car drivers, they have no idea how it works inside.
ID: 63848 · Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · Next

Message boards : Number crunching : Little work, yet the most "important" thing in the world?

©2024 climateprediction.net