climateprediction.net home page
*** Running 32bit CPDN from 64bit Linux - Discussion ***

*** Running 32bit CPDN from 64bit Linux - Discussion ***

Questions and Answers : Unix/Linux : *** Running 32bit CPDN from 64bit Linux - Discussion ***
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 · Next

AuthorMessage
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2026
Credit: 54,613,990
RAC: 7,755
Message 59939 - Posted: 8 Apr 2019, 17:50:28 UTC
Last modified: 7 May 2020, 17:30:08 UTC

**** IMPORTANT ****

As of October 2019, all cpdn apps are still 32bit. Most/all 64bit Linux distributions do not by default have 32bit compatibility libraries installed. In order to get cpdn models to run on 64bit Linux, you must have these libraries installed. Below is guidance for later versions of Ubuntu and Redhat/CentOS to have compatibility with cpdn.

*********************************************************
For 64bit Ubuntu 19.10 and 20.04, the following command should work to ensure 32 bit compatibility with cpdn apps

sudo  apt-get  install  lib32ncurses6  lib32z1  lib32stdc++-7-dev


For 64bit Ubuntu 18.04 and 19.04, the following command should work to ensure 32bit compatibility with cpdn apps:

sudo  apt-get  install  lib32ncurses5  lib32z1  lib32stdc++-6-dev


For 64bit Ubuntu 16.04, the following command should work:

sudo  apt-get  install  lib32ncurses5  lib32z1  gcc-4.7-multilib


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

For Redhat/CentOS/SciLinux 6, the following command should work:

yum  install  compat-libstdc++-296.i686  compat-libstdc++-33.i686  compat-libstdc++-33.x86_64  zlib.i686  libstdc++.i686


For Redhat/CentOS/SciLinux 7, the following command should work:

yum  install  compat-libstdc++-33.i686  compat-libstdc++-33.x86_64  zlib.i686  libstdc++.i686


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

For recent versions of Debian, try the advice in this post

https://www.cpdn.org/forum_thread.php?id=8008&postid=61468


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

The generic guidance from boinc on running 32bit apps on 64bit Linux is here:

https://boinc.berkeley.edu/wiki/Installing_BOINC#64_Bit_Considerations

It might give you ideas for installing 32bit compatibility libraries on previous versions of Ubuntu or on Fedora/Redhat.

*********************************************************
ID: 59939 · Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 5 Aug 04
Posts: 501
Credit: 7,841,885
RAC: 6,624
Message 59949 - Posted: 9 Apr 2019, 11:34:26 UTC

Currently, on my Red Hat Enterprise Linux Server release 6.10 (Santiago) system, I get:

$ ldd hadam4_8.08_i686-pc-linux-gnu
	linux-gate.so.1 =>  (0x00e47000)
	libpthread.so.0 => /lib/libpthread.so.0 (0x00cef000)
	libdl.so.2 => /lib/libdl.so.2 (0x00d0c000)
	libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x00a5e000)
	libm.so.6 => /lib/libm.so.6 (0x00da1000)
	libgcc_s.so.1 => /lib/libgcc_s.so.1 (0x00440000)
	libc.so.6 => /lib/libc.so.6 (0x00b4b000)
	/lib/ld-linux.so.2 (0x5659a000)


$ ldd hadcm3s_8.34_i686-pc-linux-gnu
	linux-gate.so.1 =>  (0x00235000)
	libpthread.so.0 => /lib/libpthread.so.0 (0x00cef000)
	libdl.so.2 => /lib/libdl.so.2 (0x00d0c000)
	libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x00a59000)
	libm.so.6 => /lib/libm.so.6 (0x00da1000)
	libgcc_s.so.1 => /lib/libgcc_s.so.1 (0x00a21000)
	libc.so.6 => /lib/libc.so.6 (0x00b4b000)
	/lib/ld-linux.so.2 (0x5655d000)


$ rpm -qf /usr/lib/libstdc++.so.6
libstdc++-4.4.7-23.el6.i686
ID: 59949 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 3170
Credit: 8,768,135
RAC: 9,769
Message 59965 - Posted: 11 Apr 2019, 20:05:44 UTC - in response to Message 59939.  

So, just to summarize for Ubuntu 18.04, the following command should work to ensure 32bit compatibility with cpdn apps (or at least it worked in April 2019):

sudo apt-get install lib32ncurses5 lib32z1 lib32stdc++-6-dev


Seems to work for 19.04 as well or at least running ldd on the executables didn't show anything missing afterwards. I have a second machine to upgrade but will play with this one for a while first. Also this one is configured so I can boot from the previous version on another partition if I don't like it.
ID: 59965 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2026
Credit: 54,613,990
RAC: 7,755
Message 59971 - Posted: 12 Apr 2019, 14:37:22 UTC - in response to Message 59965.  

Seems to work for 19.04 as well or at least running ldd on the executables didn't show anything missing afterwards. I have a second machine to upgrade but will play with this one for a while first. Also this one is configured so I can boot from the previous version on another partition if I don't like it.

Good to know. The temperature monitoring on my Ryzen in 18.04 still doesn't look right, and I know later kernels are supposed to have resolved this. So, I'll upgrade to 19.04 when I get a chance and see if it helps.
ID: 59971 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 3170
Credit: 8,768,135
RAC: 9,769
Message 59972 - Posted: 12 Apr 2019, 16:49:26 UTC - in response to Message 59971.  

So, I'll upgrade to 19.04 when I get a chance and see if it helps.


Worth noting that there is a message on the beta download page saying that 19.04 is not a long Term Release.
ID: 59972 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2026
Credit: 54,613,990
RAC: 7,755
Message 59973 - Posted: 12 Apr 2019, 17:23:41 UTC - in response to Message 59972.  

Worth noting that there is a message on the beta download page saying that 19.04 is not a long Term Release.

I want 32bit compatibility, and there's no assurance that the next LTS will have it then, so I'll perhaps just play with 19.04 to see if it gives different system/CPU temps under load.
ID: 59973 · Report as offensive     Reply Quote
wolfman1360

Send message
Joined: 18 Feb 17
Posts: 77
Credit: 9,430,921
RAC: 1,657
Message 60053 - Posted: 2 May 2019, 18:32:59 UTC - in response to Message 59939.  
Last modified: 2 May 2019, 18:44:24 UTC

So, just to summarize for Ubuntu 18.04, the following command should work to ensure 32bit compatibility with cpdn apps (or at least it worked in April 2019):

sudo  apt-get  install  lib32ncurses5  lib32z1  lib32stdc++-6-dev


For Ubuntu 16.04, the following command should work:

sudo  apt-get  install  lib32ncurses5  lib32z1  gcc-4.7-multilib



The generic guidance from boinc on running 32bit apps on 64bit Linux is here:

https://boinc.berkeley.edu/wiki/Installing_BOINC#64_Bit_Considerations

It might give you ideas for installing 32bit compatibility libraries on previous versions of Ubuntu or on Fedora/Redhat.


Thank you. I just gave this a try and will reattach to the project to see if this works on my 16.04 machine. Previously I got the error about 'this project may not have work units for your machine. Attach anyway?'

I'm completely new when it comes to Linux and don't plan to be an expert, but I really like this project and would like to crunch for it on more than just Windows, especially since the Linux machines are crunching constantly and have decent CPUs (well, apart from the core 2 duo...)

Edit: So after following the above steps, got the following. There is work available so I'm not sure what I did wrong here.
2019-05-02 1:36:41 PM | climateprediction.net | Sending scheduler request: Project initialization.
2019-05-02 1:36:41 PM | climateprediction.net | Requesting new tasks for CPU
2019-05-02 1:36:42 PM | climateprediction.net | Scheduler request completed: got 0 new tasks
2019-05-02 1:36:42 PM | climateprediction.net | No tasks sent

Will I get an error if I don't have the correct libraries installed? Or just no tasks sent constantly.

For reference, this is the computer I'm attempting to get it working on. https://www.cpdn.org/cpdnboinc//show_host_detail.php?hostid=1484660
Any help appreciated.
ID: 60053 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2026
Credit: 54,613,990
RAC: 7,755
Message 60056 - Posted: 2 May 2019, 20:22:46 UTC - in response to Message 60053.  
Last modified: 2 May 2019, 20:27:22 UTC

I'm completely new when it comes to Linux and don't plan to be an expert, but I really like this project and would like to crunch for it on more than just Windows, especially since the Linux machines are crunching constantly and have decent CPUs (well, apart from the core 2 duo...)

Edit: So after following the above steps, got the following. There is work available so I'm not sure what I did wrong here.
2019-05-02 1:36:41 PM | climateprediction.net | Sending scheduler request: Project initialization.
2019-05-02 1:36:41 PM | climateprediction.net | Requesting new tasks for CPU
2019-05-02 1:36:42 PM | climateprediction.net | Scheduler request completed: got 0 new tasks
2019-05-02 1:36:42 PM | climateprediction.net | No tasks sent

Will I get an error if I don't have the correct libraries installed? Or just no tasks sent constantly.

For reference, this is the computer I'm attempting to get it working on. https://www.cpdn.org/cpdnboinc//show_host_detail.php?hostid=1484660
Any help appreciated.


You probably did nothing wrong, there is just no work for Linux right now.

Linux has been a part of cpdn since it started running under boinc in 2004. However, in late 2017 model types were separated among operating systems, and the only models that have been able to run on Linux were hadcm3s, of which there have been very few batches.

Right now there is no work for Linux on cpdn. However hadam4 and openifs models are being tested in beta. They have larger memory requirements than the ongoing Windows models, but your PC should do alright with them. Not sure when they will be migrated to the cpdn site for general download by cpdn linux crunchers.
ID: 60056 · Report as offensive     Reply Quote
wolfman1360

Send message
Joined: 18 Feb 17
Posts: 77
Credit: 9,430,921
RAC: 1,657
Message 60058 - Posted: 2 May 2019, 21:15:08 UTC - in response to Message 60056.  

You probably did nothing wrong, there is just no work for Linux right now.

Linux has been a part of cpdn since it started running under boinc in 2004. However, in late 2017 model types were separated among operating systems, and the only models that have been able to run on Linux were hadcm3s, of which there have been very few batches.

Right now there is no work for Linux on cpdn. However hadam4 and openifs models are being tested in beta. They have larger memory requirements than the ongoing Windows models, but your PC should do alright with them. Not sure when they will be migrated to the cpdn site for general download by cpdn linux crunchers.


Thank you! Exactly the info I was looking for. I guess it will just be Windows for now. Even my mac doesn't want to grab tasks.
I'll keep CPD going on this Linux machine just in case, though.
ID: 60058 · Report as offensive     Reply Quote
Les Bayliss
Volunteer moderator

Send message
Joined: 5 Sep 04
Posts: 7501
Credit: 23,647,569
RAC: 2,773
Message 60059 - Posted: 2 May 2019, 22:40:23 UTC - in response to Message 60058.  

wolfman

You can read about the status of Mac's in my post here in the Macintosh section.

As has been said, Linux tasks are few and far between at present, but you can see what is available on the Project status page here. But there's a second step to find out which system they're for.
Use the Applications page here for that.

News about new tasks usually appears in the Number crunching section of this board.
ID: 60059 · Report as offensive     Reply Quote
Profile Dave Jackson
Volunteer moderator

Send message
Joined: 15 May 09
Posts: 3170
Credit: 8,768,135
RAC: 9,769
Message 60061 - Posted: 3 May 2019, 8:37:46 UTC - in response to Message 60058.  

I'll keep CPD going on this Linux machine just in case, though.


My Linux machines are running Windows tasks using WINE at the moment apart from testing tasks. The last few times I tried, I needed to use the 32 bit version of BOINC for Windows. Haven't tried going back to 64bit since upgrading to 19.04
ID: 60061 · Report as offensive     Reply Quote
wolfman1360

Send message
Joined: 18 Feb 17
Posts: 77
Credit: 9,430,921
RAC: 1,657
Message 60076 - Posted: 5 May 2019, 6:05:10 UTC - in response to Message 60061.  

Thank you both for that. WAH seems to be the big thing at least for now and only runs on Windows, so that makes so much more sense.

The only reason I installed Linux on my two machines was due to WCG tasks running about a third or more faster on them. Other projects don't seem to have such an issue so I may just reinstall Windows on them both so they can crunch away at WCG. One of my machines has a full /boot partition so I literally cannot install Linux updates, which is making me enjoy it even less.
ID: 60076 · Report as offensive     Reply Quote
shamil

Send message
Joined: 14 Feb 06
Posts: 5
Credit: 979,249
RAC: 0
Message 60251 - Posted: 8 Jun 2019, 0:35:08 UTC

I'm seeing some apps: UK Met Office HadAM4 at N144 & N216 resolution. Let see see if I can get this working.. annoyingly I've got BOINC setup in a docker container, so let's hope this works. I see that 46 are in progress though, and I didn't get any, so it looks like that's the lot.
ID: 60251 · Report as offensive     Reply Quote
shamil

Send message
Joined: 14 Feb 06
Posts: 5
Credit: 979,249
RAC: 0
Message 60252 - Posted: 8 Jun 2019, 1:40:51 UTC

How on earth am I supposed to know if my machine can deal with 32-bit apps?
ID: 60252 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2026
Credit: 54,613,990
RAC: 7,755
Message 60253 - Posted: 8 Jun 2019, 2:46:21 UTC - in response to Message 60252.  

How on earth am I supposed to know if my machine can deal with 32-bit apps?

If you have Ubuntu 18.04, go to the command line and type

sudo apt-get install lib32ncurses5 lib32z1 lib32stdc++-6-dev

and that should take care of it. A small amount of hadam4 n144 tasks were released Friday. A lot more should be on the way next week unless there are problems. There hasn't been much in the way of Linux tasks for the last couple years. That will change shortly.
ID: 60253 · Report as offensive     Reply Quote
shamil

Send message
Joined: 14 Feb 06
Posts: 5
Credit: 979,249
RAC: 0
Message 60254 - Posted: 8 Jun 2019, 4:03:25 UTC - in response to Message 60253.  

Ah, that makes sense.

I guess I don't need to restart the core/client after installing? I already ran it, but I should retag the docker container so I don't need to keep doing it.
ID: 60254 · Report as offensive     Reply Quote
Doneske

Send message
Joined: 27 Apr 13
Posts: 4
Credit: 7,352,637
RAC: 0
Message 60803 - Posted: 7 Aug 2019, 15:18:15 UTC
Last modified: 7 Aug 2019, 15:24:12 UTC

Haven't contributed since about 2013 and was wanting to return and contribute but before I start adding my machines to the project I was wondering if this project is going to remain 32-bit on Linux for the foreseeable future. Most Linux distributions are going to start dropping support for 32-bit very soon and I have removed the 32-bit architecture from most of my machines.

Ubuntu and their downstream flavors all stopped shipping x86 32-bit images and now for the 19.10 cycle they have decided to stop their i386 support entirely. Beginning with Ubuntu 19.10, the archive/packages will not be built for x86 32-bit.

*** update *** I think I found my answer in another thread from the end of 2018. It seems 64-bit isn't a near term thing for this project. Unfortunately that eliminates me. Good Luck moving forward
ID: 60803 · Report as offensive     Reply Quote
Jim1348

Send message
Joined: 15 Jan 06
Posts: 589
Credit: 25,499,597
RAC: 811
Message 60804 - Posted: 7 Aug 2019, 16:08:07 UTC - in response to Message 60253.  

A small amount of hadam4 n144 tasks were released Friday. A lot more should be on the way next week unless there are problems.

Very good. Just pull the plug on the 289 remaining N144's in process, and we can do them faster.
ID: 60804 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2026
Credit: 54,613,990
RAC: 7,755
Message 60805 - Posted: 7 Aug 2019, 16:09:57 UTC - in response to Message 60803.  
Last modified: 7 Aug 2019, 16:16:14 UTC

Not sure what 32bit libraries Ubuntu will continue to maintain, but this statement seems to indicate some support in 19.10 and 20.04. https://ubuntu.com/blog/statement-on-32-bit-i386-packages-for-ubuntu-19-10-and-20-04-lts

A new type of linux app/model called openifs has been compiled and tested as a 64 bit application on the development site. Not sure where it is at in the process of getting ready to deploy to the main site. It needs to be 64bit because it has very large memory requirements relative to other released cpdn models.
ID: 60805 · Report as offensive     Reply Quote
Profile geophi
Volunteer moderator

Send message
Joined: 7 Aug 04
Posts: 2026
Credit: 54,613,990
RAC: 7,755
Message 60806 - Posted: 7 Aug 2019, 16:15:37 UTC - in response to Message 60804.  

Jim 1348. I think you're replying to my post from early June. The small amount was 10 in one batch. The large amount was 550.

Some changes are being tested on the dev site for this application. Not sure when main site batches will be released, and how big they will be.
ID: 60806 · Report as offensive     Reply Quote
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 · Next

Questions and Answers : Unix/Linux : *** Running 32bit CPDN from 64bit Linux - Discussion ***

©2021 climateprediction.net