climateprediction.net home page
Posts by Jonathan Miller

Posts by Jonathan Miller

1) Message boards : climateprediction.net Science : Database Downtime - 15-05-2015 (Message 51967)
Posted 20 May 2015 by Jonathan Miller
Post:
Dear All,

We have finished the scheduled work on the database server. The database is up and running now.

Should there be any issue please let us know.

Rds,

Mamun / Sarah
2) Message boards : climateprediction.net Science : Database Downtime - 15-05-2015 (Message 51966)
Posted 20 May 2015 by Jonathan Miller
Post:
Dear All,

The maintenance work is still on going. You may notice the service is up and down during this period. We will post again as soon as the work is done.

regards,
Sarah / Mamun
3) Message boards : climateprediction.net Science : Database Downtime - 15-05-2015 (Message 51961)
Posted 15 May 2015 by Jonathan Miller
Post:
Hi All,

There will be a further period of down time this morning starting from 09:30 GMT. This is due to ongoing maintenance work.

We will post again when the work is done.

rds,

Sarah / Mamun
4) Message boards : climateprediction.net Science : Database Downtime - 11-05-2015 (Message 51946)
Posted 11 May 2015 by Jonathan Miller
Post:
Hi All,

we have to take the database offline for a few hours this morning.

This should only take a few hours to fix, as it is re-syncing the database slave, not tinkering with the main database.

We will post another message as soon as the work is finished.

Apologies for the inconvenience and late notice.

Rgds,

Sarah & Mamun
5) Message boards : climateprediction.net Science : Database downtime 30 April 2015 07:00 - 12:00 GMT (Message 51901)
Posted 29 Apr 2015 by Jonathan Miller
Post:
Hi Chaps,

we have to take the database offline for a few hours tomorrow morning.

This should only take a few hours to fix, as it is re-syncing the database slave, not tinkering with the main database.

Apologies for the inconvenience.

Jonathan
CPDN Sys-Admin
6) Message boards : Number crunching : Pending Credit Catchup Problem, for me ~150k owed or outstanding (Message 51743)
Posted 2 Apr 2015 by Jonathan Miller
Post:
Hi,

The problem with credit was down to an infrastructure fault on our servers.
The BOINC server could not connect to the database server, which meant that the credit script stalled.

Once the problem was ironed out the credit script was restarted and AFAICS ran successfully.

Jonathan

CPDN Sys-Admin

7) Message boards : Number crunching : Download server down (Message 51578)
Posted 9 Mar 2015 by Jonathan Miller
Post:
The download server is now running again.

The reason for the lack of monitoring for the downloads server on the Server Status page is that we used a load-balancer to distribute work between climateapps2 and other servers (cpdn-downloads and uploader1.atm), but because of the way it was implemented, all requests had to come to climateapps2.

This is yet another legacy issue that is due to be overhauled soon.

Apologies for the inconvenience.

Jonathan

CPDN SysAdmin
8) Message boards : Number crunching : ANOTHER UPLOAD PROBLEM (Message 51442)
Posted 20 Feb 2015 by Jonathan Miller
Post:
Hi,

Sorry about this, I was doing some maintenance on data held by the upload server, which caused apache to crawl along and then crash early this morning.

I have rebooted her and she seems fine now.

I hope your upload makes it in the next few hours :-)

Jonathan
9) Questions and Answers : Windows : why does my anti-virus program think "hadam3p_afr_7.22_windows_intelx86.exe" is malware? (Message 51352)
Posted 2 Feb 2015 by Jonathan Miller
Post:
Cyren have confirmed that this is indeed a false positive, the file is not malicious.

Jonathan Miller
CPDN Sys-Admin
10) Questions and Answers : Windows : Lack of credit for hadam3p_eu Windows version 7.23 (Message 51349)
Posted 2 Feb 2015 by Jonathan Miller
Post:
Hi Chaps, we have been alerted that for this app (Windows hadam3p_eu 7.23) models are not producing trickles. The model outputs do appear to be valid, however, so please don't abort them (see below)

This means that there is no credit for the current batch of workunits.

We will look into why this is happening, and try to correct it and release a corrected Windows app.

Additionally we will be looking to grant the appropriate amount of credit for the models that did not trickle, so please don't abort them.

Jonathan

CPDN Sys-Admin
11) Questions and Answers : Windows : why does my anti-virus program think "hadam3p_afr_7.22_windows_intelx86.exe" is malware? (Message 51338)
Posted 29 Jan 2015 by Jonathan Miller
Post:
I can confirm that we have checked this file, and our procedures to ensure that is virus free.
The file is reported by heuristic scanners as 'virus-like' which is inevitable because of the nature of BOINC.

I have spent quite some time contacting various antivirus vendors alerting them to this particular false positive.

Avast
Symantec
Norman
Cyren
DrWeb
TrendMicro

and the meta site:

https://www.virustotal.com/en-gb/file/07b01fccd043d22519a8cae4cc82c2dd38935463ab5776a63759ced3dbd45cf9/analysis/

I am not sure what else we can do.

Jonathan Miller

CPDN Sys-Admin
12) Message boards : Number crunching : Scheduler process down? (Message 51167)
Posted 8 Jan 2015 by Jonathan Miller
Post:
...fixed this too.

Apologies
13) Message boards : Number crunching : Scheduler process down? (Message 51160)
Posted 7 Jan 2015 by Jonathan Miller
Post:
Hi Chaps, sorry for this, it is my fault.
I have upgraded the database libraries, but forgot to tell the webserver.

I am fixing it now.

Jonathan
14) Message boards : climateprediction.net Science : Climate change in the News (Message 50527)
Posted 13 Oct 2014 by Jonathan Miller
Post:
Myles Allen, the project leader is giving a talk tomorrow morning, and I've been asked to pass this on to anyone who might be interested. Should be good, as Myles is an interesting and thought-provoking speaker.

Live stream: IPCC AR5: Three numbers that matter, and numbers that matter less than you think
A talk by Professor Myles Allen, Tuesday 14 October, 9 am BST


Watch it live. Tweet using #ecilive

What the IPCC 5th Assessment Report has to say to the negotiators in Paris 2015

This lecture provides an overview of the climate change issue, highlighting what are, in my view, the most important findings of the latest IPCC report and their implications for climate negotiations under the United Nations Framework Convention on Climate Change (UNFCCC). We will focus on three numbers that matter a lot, and mention along the way some other numbers that matter rather less than you might think.

The first important number is 95%, the level of confidence the climate science community now has that human influence is the dominant cause of the warming observed over the past 60 years. I will explain where this number comes from, with a quick (and colourful) introduction to the methods used for 'detection and attribution' in the IPCC Working Group I report, and explain why the apparent 'pause' in ocean surface warming over the past decade or so doesn't really change the big picture.

The second important number is 40.3 degrees C (105 degrees F), the national average temperature high over Australia on January 7th, 2013. While bad enough for Australia, the significance of that 'Angry Summer' for the rest of the world is as an example of the kind of damaging weather event that, subsequent studies have shown, was made substantially more probable by human influence on climate. With the IPCC Working Group II finding that the impacts of climate change on human and natural systems are now evident on all continents and across the oceans, understanding the links between climate change and harmful weather events is becoming important for the UNFCCC's new 'Loss and Damage' agenda, and a key focus of Oxford's climateprediction.net/weatherathome project.

The third number is the big one: one trillion tonnes. That is the total amount of fossil carbon that the IPCC estimates can be dumped into the atmosphere over the entire Anthropocene epoch while keeping the resulting warming to likely less than two degrees Celcius. Over half a trillion tonnes has already been emitted, and accounting for warming due to other forms of pollution cuts down the remaining 'carbon budget' further still. This puts the mitigation challenge into perspective, and helps explain why the IPCC Working Group III report found such a pivotal role for carbon capture and storage in scenarios that have some chance of meeting the two degree goal.

What are the numbers that matter less than you might think? One of them, although much tweeted, is '97% of scientists agree'. I'll explain how this kind of opinion poll isn't really relevant to how science, or the IPCC, actually works. Another over-rated number is the Equilibrium Climate Sensitivity (the subject of earlier climateprediction.net experiments), which turns out to matter much less than people thought. Finally, if you are hoping for a purely scientific argument that two degrees is the threshold for dangerous anthropogenic interference in the climate system, you will be disappointed: the IPCC reports make it clear that the assessment of what is dangerous has an ethical and moral dimension and cannot be resolved by any purely technical assessment.
15) Message boards : Number crunching : ANOTHER UPLOAD PROBLEM (Message 50224)
Posted 17 Sep 2014 by Jonathan Miller
Post:
Hi Chaps,

The upload server for ANZ models had to be rebooted yesterday - and with a 12 hour lag between IT suppport staff, it took a while to resolve the issue.

It should now be uploading correctly.

------------------
DUPLICATE TRICKLES
------------------

Some people have received duplicate trickles for hadcm3s WUs.
This was because we corrected a backlog of trickles for these models on Monday. Unfortunately the first run of the script took longer than usual, and these trickles were picked up by a second automated run of the trickle script, which processed them again.

We will be correcting this in due course, but it should not create any actual problems for our crunchers.

Jonathan

CPDN-SysAdmin
16) Message boards : Number crunching : Latest HADCM3S WU's Crashing (Message 50171)
Posted 15 Sep 2014 by Jonathan Miller
Post:
Hi Pete,

I spoke to the scientists on Friday, and they said that they had probably made a mistake with the parameters. There are 5 sets of parameters for each restart file, and they think that 3 or possibly four out of 5 may suffer from this error.

I will speak to Andy and the scientists about recalling and re-issuing this batch.

Jonathan

CPDN Sys-Admin
17) Message boards : Number crunching : Extremely high work units done. (Message 50098)
Posted 10 Sep 2014 by Jonathan Miller
Post:
Hi Chaps,

I am currently trying to work out what is going wrong with the credit scripts.

CPDN uses a bespoke credit system, rather than the traditional BOINC method.
Since we migrated to a new database server we have seen an exponential leap in credits. I suspect that this will be due to a difference in the behaviour of the database maths functions, between the old and new servers.

I am going through the script statement by statement to work out which step is failing, so eventually this will be fixed (yeah, I know, sorry about that :-( ).
However, given the size of the database, each step takes several hours to complete, and produces a ridiculously large amount of data, which takes time to analyse.

Fingers crossed for a good outcome this time.

Jonathan

CPDN Sys-Admin

18) Message boards : Number crunching : Credit updates? (Message 49818)
Posted 21 Aug 2014 by Jonathan Miller
Post:
Hi Everyone,

I have had a go at fixing the problem, and hopefully the credit bonanza is over.

CPDN do their credit a little differently from most other projects, and last night the script ran for the first time on the new database server - suffice to say there were a few glitches :-)

I have checked the script and run it again, and I hope things are back to how they should be.

If there are any disparities, please do let us know.

Jonathan

System Administrator
ClimatePrediction.Net, University of Oxford
19) Message boards : Number crunching : Transient HTTP Error (Message 46600)
Posted 8 Jul 2013 by Jonathan Miller
Post:
This problem was caused by a network failure in our machine room. It should be fixed now.
20) Questions and Answers : Getting started : Cannot attach to climateprediction (Message 46359)
Posted 3 Jun 2013 by Jonathan Miller
Post:
OK Chaps,

I am pretty sure that I know what the problem is, but I will have to write a script tomorrow to work around the current problem.

Long ago someone at CPDN decided not to use a dynamic server_status script, but to write that file out as HTML, and redirect users to that file.
The static page cannot respond to requests for the data to be output as XML, which is what clients request.

...so this problem should be sorted tomorrow.


Next 20

©2024 climateprediction.net