climateprediction.net home page
Request to volunteers to please enable: 'Leave non-GPU tasks in memory'

Request to volunteers to please enable: 'Leave non-GPU tasks in memory'

Message boards : News : Request to volunteers to please enable: 'Leave non-GPU tasks in memory'
Message board moderation

To post messages, you must log in.

AuthorMessage
Andy Bowery
Volunteer moderator
Project administrator

Send message
Joined: 11 Feb 11
Posts: 9
Credit: 53,909
RAC: 0
Message 67368 - Posted: 5 Jan 2023, 16:54:57 UTC

The OpenIFS model batches require the option 'Leave non-GPU in memory while suspended' to be enabled under boincmgr -> Disk&Memory. This will prevent the task from frequently restarting and reduce the risk of task failure.
ID: 67368 · Report as offensive     Reply Quote
Jan Doggen

Send message
Joined: 5 Aug 07
Posts: 1
Credit: 968,695
RAC: 0
Message 67422 - Posted: 8 Jan 2023, 12:07:42 UTC - in response to Message 67368.  

Ok, but that will leave tasks in memory for *all projects*. Let's see if my machine likes that....
ID: 67422 · Report as offensive     Reply Quote
[H]Skillz

Send message
Joined: 4 Jun 17
Posts: 1
Credit: 2,212,888
RAC: 0
Message 67560 - Posted: 11 Jan 2023, 18:54:24 UTC - in response to Message 67422.  

Ok, but that will leave tasks in memory for *all projects*. Let's see if my machine likes that....


It shouldn't really hurt anything. The tasks remain in memory for as long as the tasks are running, so unless you pause/suspend work a lot and try to do other things on the GPU that requires VRAM it shouldn't be an issue.
ID: 67560 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 866
Credit: 10,810,225
RAC: 6
Message 67565 - Posted: 11 Jan 2023, 19:51:05 UTC - in response to Message 67422.  
Last modified: 11 Jan 2023, 19:55:01 UTC

Ok, but that will leave tasks in memory for *all projects*. Let's see if my machine likes that....


I have been doing that for years, without any trouble. My machine now has 64 GigaBytes of RAM, though.
Right now, I am running no CPDN work, while allowing accumulated stuff from the last coupla weeks to upload.
I have been allowing 5 Oidf -ps tasks to run at a time along with other projects. Once those 5 Oidf-ps tasks were running along with one hadsm4 and they all worked out fine.
$ free -hw
              total        used        free      shared     buffers       cache   available
Mem:           62Gi       3.9Gi        24Gi       124Mi       148Mi        34Gi        57Gi
Swap:          15Gi       465Mi        15Gi

ID: 67565 · Report as offensive     Reply Quote
bernard_ivo

Send message
Joined: 18 Jul 13
Posts: 412
Credit: 21,945,813
RAC: 15
Message 67611 - Posted: 12 Jan 2023, 14:31:01 UTC

Finally CPDN has used the BOINC push notification:

climateprediction.net: Request to volunteers to please enable: 'Leave non-GPU tasks in memory'
The OpenIFS model batches require the option 'Leave non-GPU in memory while suspended' to be enabled under boincmgr -> Disk&Memory. This will prevent the task from frequently restarting and reduce the risk of task failure.
Thu 05 Jan 2023 04:54:57 PM EET more... 


It could've been also used for the missing 32 bit libs as well :) But so far so good
ID: 67611 · Report as offensive     Reply Quote
Glenn Carver

Send message
Joined: 29 Oct 17
Posts: 369
Credit: 3,071,639
RAC: 0
Message 67613 - Posted: 12 Jan 2023, 16:44:08 UTC - in response to Message 67422.  

Ok, but that will leave tasks in memory for *all projects*. Let's see if my machine likes that....
It's a good idea to make sure there is sufficient memory anyway, you don't want the OS to start swapping to fulfill memory requirements of the tasks. This is particularly true of the OpenIFS (oifs) tasks, they need ~ 5Gb RAM each to run and will crawl if the system has to start swapping.
ID: 67613 · Report as offensive     Reply Quote
AndreyOR

Send message
Joined: 12 Apr 21
Posts: 203
Credit: 5,146,710
RAC: 31
Message 67621 - Posted: 12 Jan 2023, 22:23:19 UTC - in response to Message 67611.  

Finally CPDN has used the BOINC push notification:

Finally is correct.

It could've been also used for the missing 32 bit libs as well

Couldn't agree more.
ID: 67621 · Report as offensive     Reply Quote
mg13 [HWU]
Avatar

Send message
Joined: 5 Feb 07
Posts: 1
Credit: 1,533,832
RAC: 0
Message 67624 - Posted: 12 Jan 2023, 23:10:19 UTC - in response to Message 67621.  

I wanted to know if this application will be there for the Windows platform in the future?
ID: 67624 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2137
Credit: 58,571,265
RAC: 8
Message 67625 - Posted: 13 Jan 2023, 1:05:54 UTC - in response to Message 67621.  

Finally CPDN has used the BOINC push notification:

Finally is correct.

It could've been also used for the missing 32 bit libs as well

Couldn't agree more.

I thought it was for the third blurb on the front page back in 2019.
https://www.cpdn.org/cpdnboinc/index.php
ID: 67625 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 866
Credit: 10,810,225
RAC: 6
Message 67627 - Posted: 13 Jan 2023, 1:15:07 UTC - in response to Message 67613.  

It's a good idea to make sure there is sufficient memory anyway, you don't want the OS to start swapping to fulfill memory requirements of the tasks. [the system] will crawl if the system has to start swapping.


Amen!

In the very old days. it was suggested to have twice as much disk space for swapping as there was RAM in the system. But when the last of my 32-bit machines had 8 Gigabytes of RAM, I found that it was pointless because if it started swapping, the system response got so bad that I fixed the swapping problem long before I used up the swap space. So I cut it down to make the swap space equal to the RAM size. And now I have 64 GigaBytes of RAM in the machine and am thinking about doubling it if these Oifs programs start to need it. The machine came with 16 GigaBytes of swap space and I have never used more than 1/4 of it; usually much less. At the moment there are 5 oifs_43r3_ps tasks running, 4 WCG tasks, one Einstein, two MilkyWay all running and only 550 MegaBytes of swap space being used.

Back in those old days, DEC was a major manufacturer of mini-computers. At one point, they had a hardware department designing a head-per-track swapping disk, eliminating the seek time (but retaining the rotational latency time). But another department was designing solid state memory to replace the magnetic core memory they had been using. It turned out that in addition to being faster, it was so much cheaper that instead of swapping you just put more RAM in the machine.
ID: 67627 · Report as offensive     Reply Quote
psw

Send message
Joined: 13 May 21
Posts: 1
Credit: 9,210,439
RAC: 11
Message 67629 - Posted: 13 Jan 2023, 1:44:07 UTC - in response to Message 67368.  

 vi /var/lib/boinc-client/global_pref.xml

<leave_apps_in_memory>1</leave_apps_in_memory>

 service boinc-client restart


People who don't speak English but machine languages. This is for Linux/Debian-ish translation.
ID: 67629 · Report as offensive     Reply Quote
Hugo

Send message
Joined: 24 Sep 09
Posts: 2
Credit: 331,703
RAC: 0
Message 67804 - Posted: 17 Jan 2023, 14:41:17 UTC - in response to Message 67368.  

I hope to finally be able to get some task again? Seems like I`m never able to get workunits.
ID: 67804 · Report as offensive     Reply Quote
joey

Send message
Joined: 12 Dec 18
Posts: 2
Credit: 139,266
RAC: 0
Message 67913 - Posted: 19 Jan 2023, 21:27:48 UTC - in response to Message 67368.  

sorry for ignorance: how do i enable the requested command in windows 10?
ID: 67913 · Report as offensive     Reply Quote
AndreyOR

Send message
Joined: 12 Apr 21
Posts: 203
Credit: 5,146,710
RAC: 31
Message 67914 - Posted: 19 Jan 2023, 22:18:12 UTC

The only work currently available is for Linux and the message to enable leave tasks in memory is meant for those users who are able to process these Linux tasks. Windows work is rare although it might become more frequent in the future but only via VBox, not native Windows work. It might happen this year but we'll see. For Windows users interested in doing Linux work, check out WSL2 (Windows Subsystem for LInux). It's part of Windows (10 and 11) and is a very light way to virtualize Linux on Windows.

To enable the leave in memory while suspended feature in Windows, go to Options -> Computing preferences -> Disk and memory and look for it in the Memory section.
ID: 67914 · Report as offensive     Reply Quote
joey

Send message
Joined: 12 Dec 18
Posts: 2
Credit: 139,266
RAC: 0
Message 67921 - Posted: 20 Jan 2023, 15:11:59 UTC - in response to Message 67914.  

thanx for your help
ID: 67921 · Report as offensive     Reply Quote
jacosito

Send message
Joined: 17 Nov 19
Posts: 1
Credit: 108,888
RAC: 0
Message 67975 - Posted: 22 Jan 2023, 15:33:26 UTC
Last modified: 22 Jan 2023, 15:34:05 UTC

I can't download task.
My machine Windows 10 has RAM 64GB.
ID: 67975 · Report as offensive     Reply Quote

Message boards : News : Request to volunteers to please enable: 'Leave non-GPU tasks in memory'

©2023 climateprediction.net