climateprediction.net home page
Posts by BarryAZ

Posts by BarryAZ

41) Message boards : Number crunching : Can't upload for 12 days (Message 41716)
Posted 7 Mar 2011 by BarryAZ
Post:
Just wondering, are the lost credits (I reverted back to where I was around 2/21) going to be found in the restore efforts?

Also, I for one am hoping that a large chunk of the massive data store you folks have was moved to near line storage so that it doesn't have to be backed up with your back up routines. With the multiple TB of data you were trying to backup every day, the backup routine was starting to get like a counterinsurgency operation -- 'sir, we had to destroy the village to save it'.
42) Message boards : Number crunching : CPDN not sync whith BOINCstats (Message 41493)
Posted 17 Jan 2011 by BarryAZ
Post:
Milo, how much of that 70TB is active? Perhaps a large piece of the data could be handled as archived data (near storage rather than live storage), thus simplifying and shortening the backup process and perhaps improve over all performance/


Les' point about data is a good one - CPDN now has about 70TB of stored data files, with multiple database records (file, parameters, workunit details &c.) for each of these.

It seems that the staff are willing to order another database server, which can be configured as a slave to the main BOINC database, and also to consider archiving more results. Meanwhile, I have at least got the stats dump to run, so hopefully boincstats will pick this up.

43) Message boards : Number crunching : CPDN not sync whith BOINCstats (Message 41473)
Posted 13 Jan 2011 by BarryAZ
Post:
Yes,it is for all stats sites, and is Climate specific and has persisted for nearly a week.
44) Message boards : Number crunching : Upload problem (Message 40895)
Posted 21 Oct 2010 by BarryAZ
Post:
OK -- thanks for the answers -- I can certainly hang on to the completed work. As I run multiple projects and suspending network activity is not a project specific option, the alternative is that my other projects will for now pick up the slack if (because of a 'in process' Climate work unit upload) no new Climate work can be downloaded.

And I do appreciate the timeline as to when to expect (or hope for) Kraken to be back online.


As said many times, ALL results are important to whoever's research project it is.
That's why these data transfers take so long; there's Terabytes of data stored here and there now. Unlike other projects, where a "no good" result means that the data can be dumped, here it ALL gets kept.

The many servers here are scattered all through Oxford, in whatever department has space in a server cabinet. When a server needs a hard reset, Milo has to walk to whichever building houses it, and go through a "I need to reset a server. Can I get into your server room please?" routine.

In the case of Kraken, Milo's only allowed to use the network in that area for data transfer during working hours. So, about a third of a day. And, as the full transfer takes a day or two, this is going to take a few more days.

Apologies to all for the problems.


45) Message boards : Number crunching : Upload problem (Message 40892)
Posted 21 Oct 2010 by BarryAZ
Post:
I see that Kraken remains offline and that it went offline due to a lack of disk storage several days ago. I read the update that indicated that Milo does not have regular access to Kraken to be able to resolve this as quickly as we all would like to see.

That being said, is the resolution of this currently a matter of hours, days, weeks? I have a handful of the Famous work units either at 100% (and not uploading) or nearing 100% (and thus also about to not upload).

I realize the trickle credits are still applied, but as these workunits fail to upload it means I likely won't get new work on some workstations. If the outage for Kraken is going to be extended (weeks rather than days), would it be best for those workstations which reach 100% to simply abort the uploads and reset which would result in non-Famous work being downloaded?

The question I guess, is how useful to the project are the completed work units? I can simply leave the completed work on these workstations waiting on the return of Kraken to the living -- it would mean that other projects get an increased processing share by default -- not that big a deal.
46) Message boards : Number crunching : Trickles (Message 40726)
Posted 20 Sep 2010 by BarryAZ
Post:
Did I miss a news announcement regarding 'tricklelessness'. In the past seven days there seems to have been only one update (about four days ago).

47) Message boards : Number crunching : Trickle and credit delays (Message 37632)
Posted 4 Aug 2009 by BarryAZ
Post:
And then went offline overnight and now is seriously slow. Seems the urge for information exchange is something of a rare thing. There are times it seems that the 'under the hood' activity that goes on with climateprediction is an MI-5 operation -- but one with good leak control.



I think the scripts ran about 23 hours ago because this forum slowed down though not for long compared with what happened previously.


48) Message boards : Number crunching : Trickle and credit delays (Message 37611)
Posted 2 Aug 2009 by BarryAZ
Post:
Definitely -- no problem at all with what is getting done. I was just getting a bit antsy with the lack of information but that has been resolved now.


It will be worth waiting for our credits on the stats sites for a week to avoid the terrible slowdowns on this forum and the CPDN database.


49) Message boards : Number crunching : Trickle and credit delays (Message 37607)
Posted 1 Aug 2009 by BarryAZ
Post:
I see the updated news announcement which provides more detailed information and truly appreciate it.

Thanks for the update. Information is a good thing.
50) Questions and Answers : Windows : Running Boinc GPU client w/ CPDN (Message 37597)
Posted 31 Jul 2009 by BarryAZ
Post:

Presently, I am running four computers on various Boinc projects (CPDN and the Clean Energy Project at WCG), but I would love to use the extra GPU power to do some useful work.


You can -- but there can be issues with various iterations of the BOINC 6.x client when doing this. I have found that the 6.4.5 client version is the least problematic in this regard. The 6.6.36 and up versions seem to really have problems dealing with the mix of CPU and GPU projects -- in part because they seem to focus on GPU projects (perhaps that reflects the influence SETI has on client development).

The only projects that currently utilize CUDA enabled work units are GPU Grid and Seti@Home

There is another project that does CUDA work --
AQUA http://aqua.dwavesys.com/

Further, if you have the right ATI GPU (38xx, 47xx or 48xx) you can utilize it with the Milkyway project using a 3rd party developed optimized client.

Milkyway http://milkyway.cs.rpi.edu/milkyway/

The Milkyway folks are just about to provide support for the CUDA GPU as well.



If I am going to run these computers 24/7, I might as well give it all the work it can handle. Does anyone know if they will conflict? How will the other version of Boinc effect the running of my other Boinc projects? Although I can choose to have no screen saver, does anyone know if the two different screen savers will conflict (as it did when I tried to add Folding@home to my GPUs)?


The GPU work units do nothing to change the operation of the CPU work units. The screen saver still functions on the CPU work unit. On my single core CPU and CUDA enabled graphics card 2 work units run, one CUDA and the other CPU based.[/quote]
51) Message boards : Number crunching : Trickle and credit delays (Message 37587)
Posted 30 Jul 2009 by BarryAZ
Post:
Thanks -- information exchange is a good thing.

Something to do with installing new servers, and some rather serious changes to trickles/credits. Including shutting down the BBC CCE project.
As this is being done by the project people, they already know about it.

I'll post something though.


52) Message boards : Number crunching : Trickle and credit delays (Message 37582)
Posted 30 Jul 2009 by BarryAZ
Post:
I see that trickles are not posting again -- past two days anyway. I know they will eventually find their way home. But I've not seen any other comment on this or news information regarding server scripts not running, so I figured to melt the ice as it were.
53) Message boards : Number crunching : Trickle and credit delays (Message 37410)
Posted 30 Jun 2009 by BarryAZ
Post:
If noting that they haven't been posted for several days (the updates did show up yesterday) is defined as obsessed, I suppose an alternative view -- that folks who react and describe that simple posting and civil discussion as obsessive might be considered obsessed in their own way. Just sayin'




For God’s sakes, is everyone obsessed with credits? It’s the work that’s important, not the meaningless cobblestones. If we don't stop global warming we are all in serious trouble.

54) Message boards : Number crunching : Trickle and credit delays (Message 37384)
Posted 29 Jun 2009 by BarryAZ
Post:
OK -- that works -- I think this has been going on now for 4 days (ie starting on Wednesday night back in the UK) and, since the only notice I'd read was how things were working, (posted on Friday), I was a bit bewildered.

We're waiting for Monday to arrive in the UK, so that Milo can look at the server.

55) Message boards : Number crunching : Trickle and credit delays (Message 37383)
Posted 29 Jun 2009 by BarryAZ
Post:
OK -- I mean it has been pretty obvious to me (and I expect others), perhaps there was some gentlemen's agreement not to post anything about it over the past few days, and cad that I must be, I violated that agreement.

In any event, this cad thanks you for the confirmation.

It is just that the only messages I had seen on the news thread were all sorts of rhapsodic about how things had been taken care of and were working fine -- that confused me a bit, guess I didn't understand the code.


I think it's fairly clear that all of us have noticed. The reported values have been a little suspect since 23rd actually.

56) Message boards : Number crunching : Trickle and credit delays (Message 37380)
Posted 28 Jun 2009 by BarryAZ
Post:
Is it just me or have other noticed with all the updates and successes regarding the hardware that trickles haven't updated in several days? I haven't seen any note about this elsewhere, though it may be in some non news thread.
57) Questions and Answers : Wish list : Using GPUs for number crunching (Message 36863)
Posted 5 May 2009 by BarryAZ
Post:
One interesting thing is that the only cards really capable of doing GPU processing for BOINC are pretty much gamer cards (which also are good for photo processing and CAD/CAM work). The large majority of computer users these days don't really need those cards and do well enough with embedded GPU support (particularly with a number of newer AMD processor boards using ATI 3200 or ATI 3300 GPU's).

I picked up a couple of 9400GT cards at a nice price for systems that lacked embedded video, and then the other day for a system rebuild I picked up a 9600GT. I run GPU Grid on these CUDA cards and the 9400GT is truly 'entry level' for this task, the 9600GT is a better fit -- but that's a $100+ video card which is something I'd not deploy for regular business workstations.

One nice thing about the GPUGrid project is, as its name suggests, that it is only for GPU processing (and until the millenial day that the native BOINC client supports ATI cards, only for nVidia cards). On GPUGrid there isn't a CPU versus GPU debate.

Over on MilkyWay there are indeed some 'GPU is the only way folks' and they get a fair amount of pushback from the 'I'm not a gamer and won't buy AMD 48xx cards strictly to generate MilkyWay credits' folks. That debate is an interesting experiment for sociologists to look at (smile).

58) Questions and Answers : Wish list : Using GPUs for number crunching (Message 36857)
Posted 4 May 2009 by BarryAZ
Post:
One of the issues over in Milkyway is that they are the ONLY BOINC project with GPU support for ATI cards. That code was done by volunteers -- MilkyWay clients use 3rd party optimized clients both for CPU and GPU workunits - in fact, at the moment, the same workunits can be done via ATI 38xx and 48xx cards as well as CPU's. Because MilkyWay is the only BOINC project with ATI GPU support, anyone interested in doing BOINC projects who has one of the supported ATI cards is going to gravitate over to MilkyWay.

There are a few projects which support the CUDA applications -- in some ways this is easier since the BOINC client from 6.4.5 and up supports CUDA -- but not ATI. So a large piece of the 'pressure' on MilkyWay is from folks running ATI cards since they are for now, unwanted stepchildren as far as the Anderson BOINC core client code folks are concerned.

I have a few of the supported (double precision) nVidea cards -- I joined GPUGrid to utilize them in a BOINC project.



There's also an elephant in the room.

On a project that has apps for both CPU and GPU, this is what's going on. Until and unless BOINC and the projects find robust ways of dealing with the credit disparities between tasks run on CPU and GPU, the moderators, programmers and researchers here would have no time or inclination to expose CPDN to these shenanigans.


59) Message boards : Number crunching : Trickles and Credits (Message 36541)
Posted 29 Mar 2009 by BarryAZ
Post:
I read that AP work was available, and that some GPU workunits were available, but \'regular\' workunits, are not -- they haven\'t been created for a few days and won\'t be created for a few more days.

Milkyway and Einstein remain offline as of this posting though.

I am getting plenty of work from SETI. All 3 types, MB, AP and AP_V5.

Pirates also started back up.

60) Message boards : Number crunching : Trickles and Credits (Message 36536)
Posted 28 Mar 2009 by BarryAZ
Post:
As an update on the other projects -- Einstein is still offline 24 hours later, SETI still has no new work, and MilkyWay went back online last night and then went offline again about 4 hours ago. I know the Milkyway project was in the process of splitting off their GPU workunits (they are one of the very few projects with an optimized client for ATI GPU\'s) but the double hit has a bit of the unplanned feel to it since there was no discussion of the plan in their message boards.

Climate seems to have run a \'catchup\' update so that one was run around 4PM PDT yesterday and a follow up update around 2AM PDT this morning.

Sort of a bad week for my BOINC projects, SETI is not generating new work nor apparently will it until next week sometime, Malaria has not generated production work for over three months, the Einstein primary server crashed this morning and are completely offline until they get things working again, and about two hours ago, the Milkyway project went offline totally (generating 404 messages on the home page), so the Climate trickles/credits reporting problem (now solved for the moment) was actually the least of the BOINC project woes for me.

I\'ve joined a total of 10 projects -- two closed down (Climate BBC - gracefully and Predictor - ugly), so for this week the only totally clean projects for me have been Spinhenge, POEM, Rosetta and World Grid)




Previous 20 · Next 20

©2024 climateprediction.net