climateprediction.net home page
Posts by lazlo_vii

Posts by lazlo_vii

41) Message boards : Number crunching : Uploading files fails (Message 62580)
Posted 12 Jun 2020 by lazlo_vii
Post:
Or if the router has some bugs in it's firmware. I don't know if NetGear ever released an official fix for it or not, but this issue is why my NetGear R6400 now runs a third party (DD-WRT) firmware.


Yes, updating firmware can make a difference. When I got my current Asus router, it refused to upload tasks when connected via wireless to CPDN main site but uploading to testing site worked fine. Also worked fine if connected to router via cable. One day after applying a firmware update everything was sorted.


Hello,

to update.

The router has no rules to block uploads ( default with no rules is to allow outgoing traffic ), no time restrictions, and no available firmware upgrades

However, I did add a rule for the site allowing outgoing traffic. The backlog of updates was cleared. I then removed the rule, and so far today uploads have worked. But the problem is intermittent. Will update again if failures happen.

Thanks for the replies,
Ron.



I can say with almost 100% certainty that it will continue to be intermittent. A few years ago (I think it was in 2016) I beat my head against this and when I figured out what was going on I looked for official fixes from NetGear but didn't find any. They may have released newer firmware by now so your mileage may vary if you go looking for a fix.
42) Message boards : Number crunching : Uploading files fails (Message 62577)
Posted 12 Jun 2020 by lazlo_vii
Post:
Or if the router has some bugs in it's firmware. I don't know if NetGear ever released an official fix for it or not, but this issue is why my NetGear R6400 now runs a third party (DD-WRT) firmware.
43) Message boards : Number crunching : Uploading files fails (Message 62575)
Posted 11 Jun 2020 by lazlo_vii
Post:
...
...
...
11/06/2020 18:27:57 | climateprediction.net | [http] [ID#95] Received header from server: <html><head><meta http-equiv="content-type" content="text/html;charset=ISO-8859-1"><title>Web Site Blocked</title><style type="text/css">A{text-decoration:none}</style><body bgcolor=black text=white><br><br><br><table border=0 width=100%><tr height=25><td bgcolor=red></td></tr><tr><td><br><center><H2>Web Site Blocked By NETGEAR Firewall</H2><br></td></tr><tr height=25><td bgcolor=red></td></tr></table><p align=right><a href=http://www.netgear.com><font color=white size=5><b>NETGEAR</head></html>
...


This is your problem. It looks like you have a NetGear home router between your PC and the internet that is blocking access to this site.
44) Message boards : climateprediction.net Science : Climate change in the News (Message 62483)
Posted 23 May 2020 by lazlo_vii
Post:
Proactive changes might not preserve existing forests, but they could help transform them into surviving forests:

https://www.washingtonpost.com/graphics/2020/climate-solutions/climate-change-minnesota/
45) Message boards : Number crunching : New work Discussion (Message 62471)
Posted 22 May 2020 by lazlo_vii
Post:
I STRONGLY DISAGREE! I have been running CPDN (almost exclusively) for more than 10 years, since the days of the BBC experiment. I have over 20,000,000 credits. All of this work has been run exclusively on laptops.

The time limit is the point, and also the error rate. If you can get past those, you can do them however you want insofar as I am concerned.
But on Windows, most of the errors I see are for too many suspends. I don't think that is from the desktops.


I think that errors on suspended tasks are far more likely if the suspended tasks are removed from RAM. This is not the default behavior for the BOINC client and must be changed by the user. If the tasks stay in RAM then I would guess (and it's purely a guess) that the error rate drops by at least an order of magnitude.

To find out if most of suspension failures happen on desktops or laptops someone would really need to do a deep dive and look at the machines' specs to see if they are using CPU's designed for desktops or laptops. I think using that metric would give a margin of error of less than five percent.

As far as storing work for later goes, I don't bother with it. I have always believed that a fast turn around is more important to science than a slow, steady trickle of results no matter what projects you are crunching for. No matter what is being modeled faster returns will mean a faster evolution of the models. Getting better models designed means getting real world applications faster.
46) Message boards : climateprediction.net Science : Cold air raising in the tropics due to water vapor (Message 62403)
Posted 6 May 2020 by lazlo_vii
Post:
I don't know how much a study like this could affect the models used here at CPDN, but I found this to an interesting article because I learned something new:

https://phys.org/news/2020-05-cold-air-riseswhat-earth-climate.html
47) Message boards : Number crunching : New work Discussion (Message 62269)
Posted 30 Mar 2020 by lazlo_vii
Post:
Thanks for the new batch of N216 tasks for Linux. I have downloaded one and I am running it now. Because of the COVID-19 lock down I have limited myself to one task at a time for now. I am using most of my system's RAM to host a game server for people like me who are stuck inside.
48) Message boards : Number crunching : CPDN No Longer Supporting Mac BOINC Clients ?? (Message 62200)
Posted 5 Mar 2020 by lazlo_vii
Post:
...Assume there is no plan to enable 64-bit CPDN apps.



I don't think "plan" is the right word because so many different researchers use CPDN now. I think "intention" might be adequate, but it is still not accurate. The researchers will use what works best for them. Until the majority of CPDN clients are running a pure 64bit OS or until the precision of the 32bit models becomes insufficient for the science things may not change much. I am sure most of the research groups intend to switch to 64bit models at some point. I would guess that every group that does so intend has a different plan for when and how to go about it.
49) Message boards : climateprediction.net Science : Climate change in the News (Message 62145)
Posted 20 Feb 2020 by lazlo_vii
Post:
Q: What is a whale worth?

A: Dead, it's worth about $80,000. Alive, it's worth $2,000,000.

https://reasonstobecheerful.world/whale-poop-climate-change
50) Questions and Answers : Windows : Get 0 credits for a valid workunit (Message 62139)
Posted 19 Feb 2020 by lazlo_vii
Post:
It's very difficult to lose credits with this project, because they get re-calculated from scratch every time the scripts run.
All based on the trickle_up files sent back to the server.


And that must be why it takes 12-24 hours for the credit script to complete it's weekly run. ;-)
51) Questions and Answers : Unix/Linux : Privilege escalation bug discovered in sudo. Check your configuration and your distro. (Message 62079)
Posted 5 Feb 2020 by lazlo_vii
Post:
https://www.theregister.co.uk/2020/02/05/sudo_bug_allows_privilege_escalation/
52) Message boards : climateprediction.net Science : Scientists use old school forecasting methods and AI to quickly predict chances of extreme weather (Message 62078)
Posted 5 Feb 2020 by lazlo_vii
Post:
http://news.rice.edu/2020/02/04/deep-learning-accurately-forecasts-heat-waves-cold-spells-2/
53) Questions and Answers : Unix/Linux : Choice of Unix distro? (Message 62070)
Posted 30 Jan 2020 by lazlo_vii
Post:
My systems both run Ubuntu Server 18.04.3. On my desktop system I installed the xubuntu-desktop meta package with apt. I highly recommend XFCE4 if you want a mature desktop environment with low resource use.
54) Message boards : Cafe CPDN : More hardware flaws have been found in Intel CPU's (Message 62060)
Posted 29 Jan 2020 by lazlo_vii
Post:
https://www.theregister.co.uk/2020/01/28/intel_processor_data_leak/
55) Message boards : Number crunching : New work Discussion (Message 62026)
Posted 24 Jan 2020 by lazlo_vii
Post:
According to https://www.cpdn.org/host_stats.php there are 1235 Linux systems with recent credit (the page doesn't define "recent" but I would guess that means credit within 30 or 60 days) and it's been at about 1200 since I started crunching last month. I can't say how many of them are working on the current batch of N216's but I am sure some of them are and others have a backlog of N144's they downloaded.

At any rate most systems built within the last 10 years will be able to run either project as long as they have the 32bit libraries installed. The people that just "set it and forget" might not be getting optimal performance out of their hardware but I am sure these are things the researchers take into account before the public launch of any new model.
56) Questions and Answers : Unix/Linux : hwloc: Block Diagram generation for your system's hardware (Message 62019)
Posted 24 Jan 2020 by lazlo_vii
Post:
Block diagrams are very useful when trying to understand how your hardware works on the lowest levels. I recently came across a utility named hwloc that generates a block diagram of the local system. It can show you how the CPU cores and cache levels are linked and show what devices are attached to which PCIe lanes, including Audio devices, NICs, GPUs, and Storage devices. It can also do much, Much, MUCH more. Most Linux distros will have hwloc in their package repositories. After you install it just run "lstopo" in a terminal to generate a block diagram of the system and attached devices. Then read "man hwloc" and decide how far you want to go down the rabbit hole.
57) Message boards : Number crunching : New work Discussion (Message 62016)
Posted 23 Jan 2020 by lazlo_vii
Post:
For comparison I'm running 3 cores on an i5 in VMware and they are taking about 35sec/ts. That's with 8Gb allocated RAM and 6Mb L3 cache.


Alan, that is impressive when you consider the system overhead for virtualization. What version ESXi are you running? I haven't used it since about 2010 and while it was OK at raw computing back then I still lost over 15% of the CPU cycles to overhead. The real killer back then was IO though. Disk access was horrible and it took 8 hours (yes, 8 hours) to install CentOS in a VM. Once it was done I could just clone the VM instead of reinstalling, thank god.
58) Message boards : Number crunching : New work Discussion (Message 62013)
Posted 22 Jan 2020 by lazlo_vii
Post:
...One thing that I've learned, is that 12 models are too many for an AMD 3900X. :(
Next batch will be 8.



You got a 3900X? Congrats and welcome to the Red Team.

Edit: Les, I just took a look at the trickles from that system and I wanted to say that 45 sec/TS is more than double what I am getting on my systems. You might be better off pausing half of this first batch just to speed things up.
59) Message boards : Number crunching : New work Discussion (Message 62009)
Posted 22 Jan 2020 by lazlo_vii
Post:
...Linux, on the other hand, is hopeless. There used to be people around here who could run them.
Gone with the Wind.


I'm running them. It takes a little time to get between checkpoints on these N216's though. I think that is why the Server Status page is under reporting the number of active users in the last 24 hours. I could be wrong though.
60) Message boards : Number crunching : Lowest common denominator of floating point math instructions? (Message 61999)
Posted 20 Jan 2020 by lazlo_vii
Post:
After a bit of searching I found this:

https://confluence.ecmwf.int/display/OIFS/OpenIFS+Licensing

It seems to me that the license is free (as in "Free beer!") but not free (as in "Free Speech"). While there is no mention of having to pay to use it, researchers are somewhat limited in how they can use it and what they kinds of data they can publish.

OpenIFS does appear to have it's roots in the old school vector math supercomputers sold by Cray which means that AVX instruction support is likely. New versions support symmetric multiprocessing using MPI and OpenMP frameworks. This might mean multi-threaded work units would be possible for CPDN in the future but I am no position to even guess at the odds of that happening.

https://confluence.ecmwf.int/display/OIFS/OpenIFS+user+meeting+2014?preview=%2F31066048%2F36012517%2FIFS_technical.pdf


Previous 20 · Next 20

©2024 climateprediction.net