climateprediction.net home page
Posts by wateroakley

Posts by wateroakley

61) Questions and Answers : Getting started : Got 0 new tasks (Message 65244)
Posted 8 Mar 2022 by wateroakley
Post:
We now have passed one month since the last post, and apparently there is still no work for Windows PC's.
That's a pity, as I was running climateprediction calculations for around 2 decadeds (!) now.
Boinc and climateprediction is installed on all of our office PC's, and we are #2 in Norway, and #139 worldwide.
If you are familiar with setting up VMs, installing macOS Mojave from the link that Les posted is straightforward. The only issue I've found is that the instructions do not mention screen resolution, which defaults to 1024x768. The VB management command for e.g 1920x1080 is:
VBoxManage setextradata “macname” VBoxInternal2/EfiGraphicsResolution 1920x1080
62) Questions and Answers : Windows : macOS Mojave installation on Windows 10 with VirtualBox (Message 65243)
Posted 8 Mar 2022 by wateroakley
Post:
I'm not burning through that many of them. No idea who is, or if they're just failing quickly with CPU-type errors on other Macs with newer OSes. I can't see that.
Looking at the workunits for the four cm3s tasks I picked up, these users (computers) have crashed over 1,000 cm3s.

546: https://www.cpdn.org/results.php?hostid=1368852
362: https://www.cpdn.org/results.php?hostid=1492772
93: https://www.cpdn.org/results.php?hostid=1489800
87: https://www.cpdn.org/results.php?hostid=1368870
63) Questions and Answers : Windows : macOS Mojave installation on Windows 10 with VirtualBox (Message 65236)
Posted 6 Mar 2022 by wateroakley
Post:
Well, I did it. Quite the series of steps to go through. Mohave is now running in VirtualBox.
Congratulations!
.
@wateroakley
I'm used to pretty good performance of Linux VMware guests on this PC (4 threads of an i7 7700HQ, 16 MB of RAM allocated to VM, 100 GB fixed HD space in VM). I'm noticing considerable mouse lag as I move the cursor around in the VM window. Are you noticing the same thing too? I did perform some of the MacOS tweaks for VM performance listed at https://github.com/sickcodes/osx-optimizer.
The mouse does not lag on this macOS VM. Did you enable the guest additions, which provide better integration for mouse and keyboard ?

I see your CPU is listed as having a boinc benchmark FP score of 1 billion ops/sec. It might be good to get a better initial estimate of task time by running a manual benchmark in boinc.
The mac VM is running at 1.08 s/TS with four HADCM3s, about 4.6 days run time (calculated). I see that your mac VM task is about 15% faster, which is expected for an i7-7700 vs i7-3770.

At the end of the instructions for the VirtualBox VM, I see it links to similar instructions for VMWare. :-) I may give that a go as I'm very used to using that hypervisor, and it would allow me to run both Linux and Mac VMs at the same time (although that i7 doesn't have very many threads for doing that).
Let us know how you get on with the VMWare VM.

Thanks for posting links to the instructions!
You're welcome.
64) Questions and Answers : Windows : macOS Mojave installation on Windows 10 with VirtualBox (Message 65231)
Posted 4 Mar 2022 by wateroakley
Post:
If you are thinking of installing macOS Mojave on Windows 10 with VirtualBox, the instructions in this link worked for me.

These are links to the VB and mac files:
VirtualBox executable 6.1.32 for Windows
VirtualBox Extension Pack
Mojave ISO file download (about 7GB)
Windows commands to set up VirtualBox

Suggested macOS VM settings: Disc (SSD) = 100GB. Memory = 16GB. CPU = 4. Be patient at Step 7 (9) when you install the macOS, it took a lot longer than the suggested 15-29 minutes. I don’t know exactly how long, as I left it running after 60 minutes, with the timer countdown still saying 14 minutes. It was all done when I came back next morning.

Good luck.
65) Questions and Answers : Windows : No tasks (Message 65230)
Posted 4 Mar 2022 by wateroakley
Post:
]For Linux users there is the possibility of Mac emulation though I haven't got it to work yet. I don't know if there is something similar to run the Mac tasks in emulation under Windows?
Ron/Dave, macOS Mojave V10.14.6 is working here, on a Windows 10 PC, with VirtualBox 6.1.32. The Virtual Machine is 16GB RAM, 4 CPU, 100GB disc (SSD), Darwin 18.7.0. After I rebooted, to increase the Virtual Machine cpu count to 4, the first task did the usual 'crash bang wallop' from 'missing output files' (sorry). Four tasks have just downloaded after waiting for the project delay (1 hour) ... Time to take a lunch break.
66) Questions and Answers : Unix/Linux : My first four tasks failed on new machine. (Message 65137)
Posted 10 Feb 2022 by wateroakley
Post:
I have been very careful switching the system off at night and allow Virtualbox box to exit before switching the computer off.


You allow VB to exit. I presume you have also stopped the boinc tasks from running and exited boinc first.

Secondly, closing the computer down and restarting increases the failure rate even without using virtualisation. I don't know if running in VB increases the risk of shutting down causing failure?

Unless the Virtual Machine/CPDN is shut down cleanly, the loss rate is quite high. We found an automatic Windoze update would typically crash 75% of the running CPDN tasks, Precautions to take with a Windoze10 host:running Oracle VirtualBox VM (ubuntu) with BOINC/CPDN.

1. Pause Windows updates (settings, advanced options). The maximum delay in Win10 is 35 days.
1a. If you don't do this, Windoze updates will silently reboot your PC when it's least expected and WILL crash the VM with your long-running CPDN tasks.
1b. At least once a month, carefully close down CPDN/BOINC/VM and run the Windoze updates.

2. Close down CPDN cleanly.
2a. Suspend activity in BOINC manager.
2b. Check that your tasks have been 'suspended'.
2c. 'Power off' the Virtual Machine.
2d. Close down VirtualBox.

3. Then resume the Windoze update to check for updates and let it run.
3a. When Windoze update has done it's thing, pause the updates again (1)
3b. We usually do a post-update power-off and reboot.

4. Restart VirtualBox and the VM.
4a. It's debatable if the VM and CPDN will start cleanly, You may need to power-off the VM and restart. We found that, sometimes, it takes a post-update PC power-off and re-boot (hence 3b).
4b.. Cross your fingers. In the VM, open BOINC Manager, Activity, Restart and check the tasks are 'running'. Keep your fingers crossed, as that's the point when you'll find out if you have a full set of running tasks or three crashes..
4c.. If you look in the Event Log, it may not report the activity restart, just the suspend.

Good luck. Hope this helps.
67) Questions and Answers : Windows : is climate prediction running? (Message 65005)
Posted 25 Jan 2022 by wateroakley
Post:
I just download 7.16.20.0 x64 on win10 and have NOT gotten any work / updates. I assume it is still not offering anything?
I go to update and it says communication deferred (1 hour). I have had this happen for possibly 24 hours now.

Thank you!
For Win10, we run CPDN using an ubuntu OS from inside VirtualBox. If you are thinking of going the virtual OS route have a look at this thread for the limitations we have found::
https://www.cpdn.org/forum_thread.php?id=9025
68) Questions and Answers : Unix/Linux : Run Linux work units with Windows 10 WSL (Message 64962)
Posted 12 Jan 2022 by wateroakley
Post:
Virtual machines. If you are considering running a Linux virtual machine for CPDN using Windows 10 with Oracle VirtualBox 6.1 and ubuntu 20.04 VM, after four months ...

Memory. 16GB physical memory is the bare minimum. The usable VM memory will max out at circa 11GB, leaving 5GB for the M$ OS and bloatware. The Win10 i7-3770 16GB memory PC example, with ubuntu VM and four CPDN tasks, was unworkable for heavy office application users (excel/word/pdf) - the screens would regularly go blank. Resource Manager reported all physical memory was in use. With three CPDN tasks and 10.5GB VM memory it was just about workable, slightly better with two tasks. QED: more physical memory needed.

With 32 GB of physical memory this Win10 PC now runs VitrtualBox with the ubuntu VM and four CPDN tasks; plus heavy office applications and three of the very rare Windows CPDN tasks. The ubuntu VM config is 4 cpu (4 of 8 threads) and 20GB virtual memory. Resource manager reports 28GB physical memory in use, 55% cpu load for VirtualBox and 45% cpu for everything else.

I recall 3GB memory per CPDN task is required? If you don't do anything else on a 4 cpu (8 threads) PC, 24GB physical memory may be enough for running Win10 and VirtualBox with an ubuntu VM and 4 CPDN tasks. If you have a newer multi-processer PC then more memory will be needed,

Virtual Disc. The ubuntu VM will need about 10GB of virtual disc per virtual cpu. That's a virtual disc size of 40GB to run the VM and four CPDN tasks. Youtube videos with tutorials for creating an ubuntu VM in VirtualBox wildly understate the virtual disc storage that is required for CPDN. Schoolboy disc size mistakes in Linux can be fixed with Gparted. If you're worried about Total Bytes Written (TBW) on your expensive SSD, then a small (128GB) SSD is very cheap option.

Old machines, are they worth the effort? We created an ubuntu VM with CPDN on an older headless PC with Win10 and VirtualBox (Q9650 quad cpu, 8GB memory, 128GB SSD). Yes, CPDN worked with two tasks, but there's insufficient memory to run more than 2 tasks on a 4-cpu machine. Not much else would run happily either. QED: Don't bother.

12 Jan 2022.Windows update regularly crashes the VM and tasks. To prevent these crashes: Pause updates in Windows Update, advanced options. You get about one month grace from Windows unexepectedly rebooting.
69) Questions and Answers : Windows : what is the Problem? (Message 64885)
Posted 19 Dec 2021 by wateroakley
Post:
You could try using a virtual machine on computer 1190093. From using a VM for eight months on Win10 - VirtualBox 6.1.22 with ubuntu 20.04 - we'd recommend the minimum physical memory is 24GB, The VM wil probably need about 16 to 18GB memory with no more than 6 processor threads (cores). For six cores and six concurrrent cpdn tasks, the ubuntu VM virtual disc should be at least 60GB. Preferably on an SSD and size the VM virtual disc at least 100GB to allow for extra space when tasks crash and have to be manually cleaned (deleted) later. Good luck with whatever you decide to do.
70) Message boards : Number crunching : Memory speed and hadam4h (N216) performance (Message 64863)
Posted 9 Dec 2021 by wateroakley
Post:
There was no increase in memory speed in this case. Mistakenly I ordered 1333MHz for the extra rather than Assuming the 1600MHz already fitted. Hum ho.
The formula* that calculates the precise RAM speed, or absolute latency,:may well result in finding the 1333MHz memory is theoretically quicker. The 32GB 1600Mhz (CAS 11) memory (in our old i7) runs 2% slower than the 16GB 1333MHz (CAS 9) memory it replaced. From our experience in 2021 we found that 16GB physical memory, with a 10GB VM, would run out of physical memory and result in memory swaps. The biggest win will be from increasing the physical memory to 24GB, which is the minimum we found to allow the VM (with four CPDN tasks) and Windoze enough physical memory to play nicely together.

* Absolute latency = (CAS latency*2000) / Frequency
71) Questions and Answers : Windows : Can climatprediction.net still run on Windows XP? (Message 64836)
Posted 23 Nov 2021 by wateroakley
Post:
What on earth have they done to Word that it is a heavy application?
I've been using Word for documentation and reports ...

1. Creating and editing multiple large-ish documents (10MB to 100MB). With 16GB physical memory and VirtualBox/ubuntu/CPDN running four tasks in a 4-cpu VM (11 GB memory), editing the documents would result in an unpredictable Black Screen of Abeyance. The hypothesis is that the graphics processor would run out of memory and swap to PC memory; as there is no 'available' PC 'memory, it would immediately swap out to the SSD. The display may come back if you are patient, maybe not. Often I'd have to end the Word process and start again. With 32GB of physical memory it's now usable with CPDN running in the 4-cpu VM (20GB memory), Africa Rainfall on three threads in Win10, and Word documents don't disppear into the BSOA.

2. Microsoft PDF reflow. - convert and edit PDF files with Word. A great tool when you don't have the source file and your pdf converter is licenced for Win-XP. However, one processor (thread) runs at 13% and Word ignores you until reflow finishes opening the source file. Small PDFs are quite quick, some files could take up to 30 seconds, however the largest PDFs I've had to regularly open (60MB file, mainly text) takes two-four minutes to open and convert. The design guide PDF (12MB file, 120 pages with lots of images) takes 20 minutes to open and 20 minutes later it's still chuntering away to convert the file to Word. I gave up on the design guide as it's quicker to open the native PDF and then screen grab/paste the words/image ...
72) Questions and Answers : Windows : Can climatprediction.net still run on Windows XP? (Message 64821)
Posted 18 Nov 2021 by wateroakley
Post:
Oracle VM VirtualBox is not supported* on WinXP. The earliest version is Windows.8.1.

On a windoze host, don't bother with VirtualBox to run a Linux virtual host and BOINC/CPDN if you're limited to 8GB memory. It works, but it's probably not worth the effort to run one or two CPDN tasks. You'll need at the very least 16GB memory.

To be usable as a 'puter with four of eight virtual i7-3770 cores running CPDN, in an ubuntu VM hosted by Win10, we have found that 32GB memory is the practical minimum for Win10 to be happy wihen we try to use heavy M$ office applications (excel & word).

Good luck with whatever you choose to do.

* 1.4. Supported Host Operating Systems
https://www.virtualbox.org/manual/ch01.html#hostcpurequirements
73) Message boards : Number crunching : No Work for alomst 5 months (Message 64798)
Posted 7 Nov 2021 by wateroakley
Post:
Thanks Les. Yes, I have read that. I just didn't think that meant zero, especially if your running 24/7. I've read others mentioning running BIONIC on a Linux VM. Is that worth doing or should I stick with another project? Unfortunately, there is no other climate specific project that I am aware of, and that is where I would like to contribute. WCG runs an Africa Rainfall project, but that has wound down and will end next year.
Your machine is specced well enough to run CPDN tasks in Oracle VirtualBox VM with ubuntu. There are lots of tutorials online on how to set up the VirtualBox VM and ubuntu. The tutorials usually create a tiny Virtual Disc, so create the virtual disc with at least 10GB per core. Whilst running CPDN in the VM I also pause Windoze updates for as long as doze lets me. That prevents the monthly updates rebooting the PC unexpectedly and crashing tasks.in the VM. We also run Africa Rainfall in the unused Windoze OS cores.

I posted some VM info to this thread in July: https://www.cpdn.org/forum_thread.php?id=9025

Good luck with whatever you decide.
74) Questions and Answers : Windows : Cant get any WUs (Message 64792)
Posted 5 Nov 2021 by wateroakley
Post:
Thanks for the explanation - I had a feeling that was the case :-(
I'll just have to have a dig around and see what other project grabs my fancy and has work for a Windows PC.

I run Linux work units using Oracle VM Virtualbox on a 3rd Generation i7-based Windows PC. Over circa six months using the VM, 33 completed and 11 crashed (during Windows updates). I have temporarily paused the WinDoze updates to avoid the crashes..
75) Message boards : Number crunching : Tasks by application = hoarding (Message 64529)
Posted 30 Sep 2021 by wateroakley
Post:
Science United has attached 846 computers to this project since 16 Feb 2019. Somebody else can check how many tasks they have in progress at the moment.
With a few minutes of spare time ... rough orders of magnitude:

For the last 30 days ... 847 devices have made contact.
The first 100 computers with a recent credit number, about 75% are M$ and 25% are Linux.
Scanning down the list for credits, a few WAH returns from M$ devices and six Linux devices with more than 1,000 recent credit.
These six Linux devices are trickling 13 tasks to credit with 11 other tasks in the wings.
More than 90% of the 847 do not appear to be doing anything useful, unsurprisingly for the 75% M$ cohort.

Since 2019 ... the user appears to have 4470 devices attached.
Scanning down the sorted list for credits, somewhere around 90% have not successfully returned task completions.
76) Message boards : Number crunching : Tasks by application = hoarding (Message 64428)
Posted 6 Sep 2021 by wateroakley
Post:
If you can't actually complete them in the next 2 weeks you should Abort them and let others run them.
Hmm. This i7-based PC is running four tasks in an ubuntu VM. The timescales range from about 7 days for a hadam4 to 31 days for a hadam4h. In the early days of CPDN, tasks took around 3 months on an Intel P4. I'm quite used to nursing the long deadlines, even though M$ up-chucked today, crashing all bar one of the VM tasks. I can't afford the luxury of a 10th generation AMD or Intel CPU machine. Not sure how many of us would do anything if you want us to abort the long hadam4h's or set the deadline at 2 weeks?

I'd rather not waste my time looking for ET.
77) Message boards : climateprediction.net Science : Climate change in the News (Message 64417)
Posted 30 Aug 2021 by wateroakley
Post:
'Washout' summer actually one of the hottest

The comments of Faceache demonstrate the public's lack of understanding of science with something like 70% of them citing their personal experience as disproving the data.
Mean 2020/21 temperatures in the CET observation record have been within a whisker of the blazing 1976 temperatures in England that anyone over the age of 50 remembers. The mean CET temperature across June and July 2021 has been hotter than 41 of the 45 years since 1976. The jury is out on August. Scarborough in early August was very variable, does that prove that anecdotes can trump the data?
78) Questions and Answers : Unix/Linux : Will start crunching with linux.. Advice starting up? (Message 64337)
Posted 11 Aug 2021 by wateroakley
Post:
Win10, Oracle VirtualBox 6.1 with ubuntu 20.04 VM.
Some tried and tested settings from our i7-3770 with 4 cores (8 threads) and 32GB memory,

Memory. Allow 3GB memory per cpu for CPDN and the VM OS. It may be more than some model types require, but others have suggested 3GB. I have no idea what future needs may be.
32GB physical memory lets you run a VM memory of 20GB and leaves enough room for Windoze to be happy.
We found that 16GB physical memory for four ubuntu VM cpus to run CPDN was too small. CPDN tasks were throttled by about 25%. It became unusable for heavy office applications (Word and Excel).
We tested a Q9650 cpu and 8GB memory with an ubuntu VM running 2 cpus, Yes it ran cpdn, but insufficient memory. Not worth the effort.

CPU. 4 physical cores, 8 threads. We run the ubuntu VM with 4 cpus.
Task manager reports that VirtualBox (running the VM & CPDN) takes about 55% of CPU.
We can run the rare Windows CPDN tasks on 2 or 3 cores in the Win10 host. Otherwise they run the Africa Rainfall tasks.
Trying to put all i7 cores into use (4 VM ubuntu threads with CPDN and 4 Win10 threads for CPDN) is not a good idea. CPDN tasks slowed down by circa 20% The throttle was probably from running out of L3 cache.

Disc. Put the ubuntu VM onto an SSD.
Allow at least 10GB of .vdi virtual disc per VM cpu. Use an expandable .vdi format. Minimum 40GB for 4 cpus.
Beware the generic VM youtubers, they wildly underestimate the disc size in their videos. My new friend is gparted.
If you want to avoid all the extra cpdn processing from continually hitting the data TBW on a large SSD, a 128GB SSD is an inexpensive option.

Good luck.
79) Message boards : Number crunching : Computation Errors (Message 64335)
Posted 11 Aug 2021 by wateroakley
Post:
Is this me or CP???
https://www.cpdn.org/result.php?resultid=22107426
This task was running on computer ID 1521341. i9-10980XE, Linux Mint with 36 cores in just 15GB of memory? 1521341 downloaded 36 tasks on 31/7 and 25 have aborted or crashed fairly quickly with a range of Signal(n) or SIGSEGV errors too.

3GB of memory per cpu is a figure discussed by others. 15GB of memory is way too small for CPDN to be happy with 36 tasks. With insufficient memory, the tasks will be 'swapped' all the time and may be exposed to soft errors in the disc I/O. (Discs will hide these soft errors from users until it's too late!). Task 22131978 (a CM3S) is running at less than half the sec/TS of our older i7, suggesting that tasks are being throttled. The 'Invalid Theta' error may simply be another emanation of the task aborts and crashes.

The Intel specs suggest that i9-10980XE (Core-X) maximum memory size is 256GB? Is 1521341 a Linux virtual machine and you could increase the virtual configuration of memory and reduce the number of cores? Good luck.
80) Questions and Answers : Unix/Linux : ARM application (Message 64306)
Posted 9 Aug 2021 by wateroakley
Post:
The program uses one of the SSE instruction sets.
I forget now whether it's SSE2 or SSE4.


I remember when this came in and older CPU's that didn't support SSE2 became obsolete as far as CPDN is concerned. Not sure whether SSE4 is a requirement now or not. Linux or other OS having SSE2/4 may be needed but the CPU needs to support the instruction set as well.


SSE2 was first supported around 2000 on Pentium devices as part of INTEL proprietary IA-32 architecture, a step beyond the late-1990's INTEL MMX instruction set. AMD provided an emulation of IA-32 instructions on Athlon devices. SSE2 was (IIRC) was the limit to use INTEL P4 and AMD Athlon devices for early CPDN contributors. IIRC the SSE2 instruction set (or emulation by the Hardware Abstraction Layer) of the target CPU is essential for CPDN.


Previous 20 · Next 20

©2024 climateprediction.net