climateprediction.net home page
Posts by ncoded.com

Posts by ncoded.com

1) Message boards : Number crunching : The uploads are stuck (Message 67895)
Posted 19 Jan 2023 by ncoded.com
Post:
Thank you Richard, that is a very useful clarification.
2) Message boards : Number crunching : The uploads are stuck (Message 67881)
Posted 19 Jan 2023 by ncoded.com
Post:
Bunkering is a technique where you get as many tasks as possible. More than one host is normally allowed.
3) Message boards : Number crunching : The uploads are stuck (Message 67877)
Posted 18 Jan 2023 by ncoded.com
Post:
Yeti, If BOINC can generate the content for itself, and auto-populate it into the forums across projects, that would be great.

That would leave each project to only concentrate on its own stuff.

I also agree that competitive crunchers bring far more to the BOINC table than many people realise. Yes to some it does seem like they are gaming the system. But unless the system is clear about what is and what is not acceptable, I don't think think one can say that.

Most techniques, be it running custom software, running update scripts, running multiple disks or instances, or even recompiling and spoofing, all can have valid reasons for them to be used.

Unfortunately I don't think that is the case - though I stand to be corrected.


Alan K, from what we have seen not every task will crash, but many will. And eventually if you will fail too many and that will put your host in Jail.
4) Message boards : Number crunching : The uploads are stuck (Message 67871)
Posted 18 Jan 2023 by ncoded.com
Post:
I agree and partly why I made the point about titles. It's definitely an important subject especially if you want your content to be found inside and outside of BOINC.

But for now we are just talking about which "issues" should even go into a sticky post, if any.

I agree that in some ways having 2 sections is useful, such as A and B. But in otherways many users cannot tell if something is BOINC or CPDN. Which is perhaps an argument for not splitting them up.
5) Message boards : Number crunching : The uploads are stuck (Message 67868)
Posted 18 Jan 2023 by ncoded.com
Post:
Just to be clear, "the 100GB Limit" or "Instant Invalidated Tasks" are just made up titles. It doesn't matter what title you actually use, just that the issue is solvable or explainable in a sticky post, and that post is very easy to find.

Anyway.. "The uploads are stuck"..
6) Message boards : Number crunching : The uploads are stuck (Message 67867)
Posted 18 Jan 2023 by ncoded.com
Post:
SolarSyonyk the hard disk issue may not be widely known.

But every competitive cruncher who uses 'bunkering' knows all about using multiple disks.

And indeed someone said this was the security mechanism to stop that.

Yet again who knows which is the correct answer.

If there were a sticky thread called "Instant Invalidated Tasks" then that would give a definite answer.
7) Message boards : Number crunching : The uploads are stuck (Message 67866)
Posted 18 Jan 2023 by ncoded.com
Post:
WB8ILI I do understand what you are saying.

The value in EditBox will use a default value of 100GB unless you select the checkbox, even if you have entered a value.

The problem we have is you now are saying something slightly different to advice we had previously been given.

So how are we, or any non-technical person meant to decide who is correct?

Is it you? Or is it the boinc developer who said our tweet was accurate?

Or are both correct and we got the wires mixed up?

All I can say is if there were a sticky post "The 100GB Limit" then that would give a definite answer to this.

You have done some serous crunching for CPDN, so I have tried to write a half decent reply.
8) Message boards : Number crunching : If you have used VirtualBox for BOINC and have had issues, please can you share these? (Message 67858)
Posted 18 Jan 2023 by ncoded.com
Post:
Thank you [SG]Felix.

I think the more people that come forward with issues, and/or possible solutions or observations, in the end all of this information will be useful.

And hopefully you will also get a solution, which can be documented, to help others at a later date.
9) Message boards : Number crunching : The uploads are stuck (Message 67855)
Posted 18 Jan 2023 by ncoded.com
Post:
Thank you wujj123456 its interesting hearing about which issues you faced.

But you are right, better to get the post back on track for those having upload issues.

Perhaps a new support/info thread could be setup and the last posts by Glen, Richard, Dave, xii5ku, and wujj123456 on this subject could be moved into it?
10) Message boards : Number crunching : The uploads are stuck (Message 67853)
Posted 18 Jan 2023 by ncoded.com
Post:
Try this.

leave one of these options empty:

Use no more than 420GB
Leave at least 1GB free
Use no more than 8% of the total.


Then get BOINC to use 100GB of storage on a single project.

If you do that, then you will then get the 'lack of storage notification error'.

That is the 100GB Limit.
11) Message boards : Number crunching : The uploads are stuck (Message 67850)
Posted 18 Jan 2023 by ncoded.com
Post:
I agree with Glenn.

Just create sticky posts for all these issues that stop people crunching.

It shouldn't really matter if its a BOINC issue or a CPDN Issue, if it stops someone crunching then it should be in the list.

If you don't install the 32-bit libraries your tasks will eventually keep crashing, and hence your device will get jailed. That stops you crunching so it makes sense it should be in this "essential section".

There cannot be that many issues that stop you crunching. And I would guess most have already been answered in the forums (somewhere). So if these issues could be collated into sticky posts (in this special section) wouldn't this make life much easier for the mods? In the long run you wouldn't have to keep answering some of the same questions, or explanations.

I shudder to think how many times you must have explained "trickles" lol.

If someone does not understand the 100GB Limit, then the post should explain what is this limit, when does it affect the user, and how is it resolved. And what are the long term plans so this issue is removed. To me this is what would be useful to understand and resolve the issue.

Unfortunately sending someone to a CVS (Github) does not do that.

This is how we explained the 100GB limit, and its solution on Twitter. Hopefully Jean-David Beyer finds this slightly more informative.

https://twitter.com/ncoded/status/1608650579412398080

If your running CPDN on BOINC and your getting the 'out of disk storage notification', then (for now) you will need to make sure that each of the 3 options for Disk have a non-zero, non-empty value, as shown in the image.


12) Message boards : Number crunching : The uploads are stuck (Message 67844)
Posted 18 Jan 2023 by ncoded.com
Post:
Dave, just so you know in case I had not made it clear, you and Richard have been really helpful. I really mean this.

Without you Mod's it would be complete anarchy, both in terms of behavior but more importantly in terms of help and content. So to do this unpaid for years is quite remarkable.

The same thing goes for Glenn et al. Most projects you NEVER see the end Researchers so to see this level of involvement is impressive.
13) Message boards : Number crunching : The uploads are stuck (Message 67842)
Posted 18 Jan 2023 by ncoded.com
Post:
Thank you Glenn.
14) Message boards : Number crunching : The uploads are stuck (Message 67839)
Posted 18 Jan 2023 by ncoded.com
Post:
Okay just to stop any further replies.

Yes you are right. I am wrong. I apologise.

I have made my suggestion on making CPDN better. Either take it on board, or don't.
15) Message boards : Number crunching : The uploads are stuck (Message 67837)
Posted 18 Jan 2023 by ncoded.com
Post:
Remember this isn't just an issue about losing 500GB of tasks due to switching out drives, its also about all the other issues.

However perhaps one good thing can come out of all this?

Please think about having one section on your website that lists all the major issues that one could have, with clear solutions.

These are 3 issues I have hit in the last week or so, all of which stopped us crunching

1) 100GB UI Limit
2) 2x core_count, cant download too many uploads Limit
3) Invalidated tasks by switching out HDD

If we have had 3 major issues in such a short amount of time, then clearly there must be many more issues out there.

If you want to keep things simply, easy, and fun for crunchers, then have a list of these issues in one place and their solution(s).
16) Message boards : Number crunching : The uploads are stuck (Message 67834)
Posted 18 Jan 2023 by ncoded.com
Post:
Thank you gemini8. It says a lot when you get more empathy from an average user than you do from the project team.

The truth is I posted that I had just bought a new HD and was about to swap it out due to so many uploads. Not one mod or team member mentioned the problems that would happen if I did this.

I guess if you want a case study in how to lose one of your most loyal supporters (and probably your largest contributor), then this is it.

In terms of this problem, from what I gather this "option" has been turned on by CPDN and GPUGrid, but has been left off by most other projects.

The issue isn't that some projects have settings or workarounds you have to be aware of, its the fact that all this information is not clearly stated in a single place. Instead supporters are expected to go trawl the forums for this information.

PDW can make out this is all obvious stuff and I should have been fully aware of it, but so far everyone that we have reached out to both personally, and across social media, have never heard of this issue. So clearly that is untrue.

Either way it is a bitter pill to swallow which is why there is no point us running this project now.

And obviously now we will also no longer spend money promoting CPDN across social media, although we will continue for all the other projects.
17) Message boards : Number crunching : The uploads are stuck (Message 67803)
Posted 17 Jan 2023 by ncoded.com
Post:
Okay thanks
18) Message boards : Number crunching : The uploads are stuck (Message 67801)
Posted 17 Jan 2023 by ncoded.com
Post:
The thing is, none of this problem is about BOINC instances.

All I did in this case was buy a new drive so I could continue crunching for cpdn as the old drive was full of uploads. I then swapped the drives over, and did a fresh install of Ubuntu and BOINC on the new drive.

As that is now causing loads of problems then clearly CPDN is not the right project for us at this time.
19) Message boards : Number crunching : The uploads are stuck (Message 67798)
Posted 17 Jan 2023 by ncoded.com
Post:
Okay easy solution is just remove CPDN from every device.

Do you want me to abort all the uploads?

Or do nothing and just remove the project?

Or let the uploads complete, and then remove the Project?

I will let any running tasks complete before removing anything.

Let me know if you have a specific preference Glen et al.
20) Message boards : Number crunching : The uploads are stuck (Message 67796)
Posted 17 Jan 2023 by ncoded.com
Post:
I have to wonder why I am bothering to upload 500GB worth of uploads, if they are going to just be abandoned as soon as they get reported.

Also I am not sure if people realise what I am saying here. ANY task I crunch on this server now will just disappear and get stuck In-progress, even after it gets uploaded and reported.


Next 20

©2024 climateprediction.net