== RHEL9 ==

Directory ''/www'' contains all applications, except ''rcdb'' which is located in ''/usr/local/src/rcdb''. Symbolic links in ''/www/html''.

Directory ''/etc/httpd/conf.d/ contains following custom files:

#
# webserver.conf
#
ServerName clonweb.jlab.org
DocumentRoot /www/html
ServerAdmin boiarino@jlab.org
UseCanonicalName On
#
LogLevel warn
ExtendedStatus On
#
DirectoryIndex index.html index.php
#
RewriteEngine On
#
<Directory "/www/html">
DirectoryIndex index.html index.php
Options Indexes FollowSymLinks
# AllowOverride None
AllowOverride All
Require all granted
</Directory>

#
# rcdb.conf
#
# define mysql connection string
SetEnv RCDB_CONNECTION "mysql://rcdb_ro@clondb1/rcdb"
# define rcdb home directory
Define RCDB_HOME /www/html/rcdb
# following makes httpd to execute specified script, when url address is just RCDB_HOME
WSGIScriptAlias /rcdb ${RCDB_HOME}/rcdb_www/rcdb_www.wsgi
# following specify top path to the python scripts, including subdirectories
WSGIPythonPath ${RCDB_HOME}/rcdb_www
#
#### WSGIDaemonProcess rcdb_www threads=5
#### WSGIProcessGroup rcdb_www
#### WSGIApplicationGroup %{GLOBAL}
#
#<Directory "/www/html/rcdb/rcdb_www">
# Options Indexes FollowSymLinks
# AllowOverride All
# Require all granted
#</Directory>

== RHEL6 ==

* yum install httpd-devel php (php-mysql ?)

== old stuff ==

TO BE: Sun X4100 server, currently old desktop.

IP address:
clonweb/129.57.167.42

TO BE IP address:
clonweb-new/129.57.167.26/00:11:43:35:48:4A

''clonweb'' is CLON group web server holding monitoring and utility tools as well as documentation.
It assume to be viewed by everybody but can be modified by CLON system experts only.
It is running RHEL4 in almost standard configuration, with extra 'clonweb' partition from file server
mounted as '/www' where all CLON applications are held. There are some restrictions: 'clonweb' is not
visible from outside of JLAB firewall. Access to 'clonweb' is opened through port 80 only, so only web browsing
shell be used. Main index.html menu contains full list of applications running on 'clonweb'.

Following procedures were used to install an applications:

== apache ==

See [[Apache]] for Apache and PHP installation procedure.

== wiki ==

Wiki were moved to [[Clonwiki]] machine, reference link will point you there.

== phpmyadmin ==

su
download 'phpMyAdmin-2.9.1.1-english.tar.gz' from web to '/usr/local/downloads'
cp phpMyAdmin-2.9.1.1-english.tar.gz /www/apache2.2.3/htdocs
cd /www/apache2.2.3/htdocs
gunzip phpMyAdmin-2.9.1.1-english.tar.gz
tar xvf phpMyAdmin-2.9.1.1-english.tar
mv phpMyAdmin-2.9.1.1-english phpMyAdmin
cd phpMyAdmin
cp config.sample.inc.php config.inc.php

Edit config.inc.php setting following ('controlpass' must be the root password to mysql):
If 'holla' is not set message 'The configuration file now needs a secret passphrase
(blowfish_secret).' will shows up ('holla' can be any word ???):

$cfg['blowfish_secret'] = 'holla'; /* YOU MUST FILL IN THIS FOR COOKIE AUTH! */
$cfg['Servers'][$i]['host'] = 'clondb1.jlab.org';
$cfg['Servers'][$i]['controluser'] = 'root';
$cfg['Servers'][$i]['controlpass'] = '********';

Change config file's owner to 'apache' and set maximum protective mode:

chown apache.apache config.inc.php
chmod 400 config.inc.php

NOTE: make sure that 'mysql -h clondb1 -u root -p' works from clonweb; if not, grant
appropriate mysql privileges.

NOTE: following procedure was recommended but did not worked for me:

mkdir config
chmod 777 config
cp config.sample.inc.php config/config.inc.php
chmod 666 config/config.inc.php
open browser (as 'root' ?), type following URL:
http://clonweb/phpMyAdmin/scripts/setup.php
Click on the "Add" button in the "Servers" section and fill in the following
fields:
Server hostname: clondb1.jlab.org
(This is the host that your MySQL server is running on)
Server port: 3306
(the port your MySQL server is configured to use)
Password for config auth: ....
(the root password for your MySQL server)
Press the button that says "Add" in green. Then press the "Save" button in
the "Configuration" section.
Now copy the configuration file into the main directory and delete the config
directory:
cp config/config.inc.php ./
rm -rf config
Assuming your MySQL server is running, you are now ready to connect to it and
administer it with phpMyAdmin.

Start a Web browser and enter the following URL: http://clonweb/phpMyAdmin/

== preparations for dual apachies ==

from web:

If you need to run two different apache installations on the same box, the quickest way, IMO, is to have two separate conf files for the
servers (/usr/local/apache/conf/httpd-server1.conf and /usr/local/apache/conf/httpd-server2.conf). In your startup script, you will need
to tell apache where to find the conf file, which I think is -f, but that's off the top of my head. The drawback here is that if both servers
need to share the machine name (both departments use http://foo), then at least one server will need to be on a non-standard port,
giving you something like http://foo and http://foo:8080. That's fine. It works. It's just extra work for one department.
Now, if one machine will run both servers, but under different names (i.e., foo1 and foo2) you can use apache's vhosting capabilites. I've
never had to do this, so I don't know how to. :) The conf file that comes with the distro is pretty well documented, so it shouldn't be too
difficult to figure.
A third option is to use .htaccess. I'm going to assume that some form of authentication is going to be used. If not, one department
could just as easily look at http://foo1 as changing from http://foo/dept1 to http://foo/dept2. Using .htaccess, you can restrict access to
the directories on a per-user basis (which can present maintenance issues) and serve all content off one server. I don't know all the
particulars of your situation, but this is what I would lean toward if I could.

see also page http://httpd.apache.org/docs/2.0/vhosts/examples.html, in particular:

The server has two IP addresses. On one (172.20.30.40), we will serve the "main" server, server.domain.com and on the other (172.20.30.50),
we will serve two or more virtual hosts. Server configuration:
Listen 80
# This is the "main" server running on 172.20.30.40
ServerName server.domain.com
DocumentRoot /www/mainserver
# This is the other address
NameVirtualHost 172.20.30.50
<VirtualHost 172.20.30.50>
DocumentRoot /www/example1
ServerName www.example1.com
# Other directives here ...
</VirtualHost>
<VirtualHost 172.20.30.50>
DocumentRoot /www/example2
ServerName www.example2.org
# Other directives here ...
</VirtualHost>
Any request to an address other than 172.20.30.50 will be served from the main server. A request to 172.20.30.50
with an unknown hostname, or no Host: header, will be served from www.example1.com.

The server machine has two IP addresses (192.168.1.1 and 172.20.30.40). The machine is sitting between an internal (intranet)
network and an external (internet) network. Outside of the network, the name server.example.com resolves to the external
address (172.20.30.40), but inside the network, that same name resolves to the internal address (192.168.1.1).
The server can be made to respond to internal and external requests with the same content, with just one VirtualHost section.
Server configuration:
NameVirtualHost 192.168.1.1
NameVirtualHost 172.20.30.40
<VirtualHost 192.168.1.1 172.20.30.40>
DocumentRoot /www/server1
ServerName server.example.com
ServerAlias server
</VirtualHost>
Now requests from both networks will be served from the same VirtualHost.
Note:
On the internal network, one can just use the name server rather than the fully qualified host name server.example.com.
Note also that, in the above example, you can replace the list of IP addresses with *, which will cause the server to respond the same
on all addresses.

NOTES:

smartd fails on boot startup 17-jan-2007

2026-04-01T19:18:26Z

Boiarino:

2026-02-10T22:33:13Z

Boiarino:

== Dell servers hardware trick(s) ==

* '''!!! if BIOS date/time is incorrect, it may prevent redhat subscription and installation to work correctly, set it to correct value !!!'''

* if BIOS does not remember time setting after power unplugged, battery on motherboard may need to be replaced

* if looks dead, remove the power cords, then held in the on button for 30 seconds; then plug it back in and it may boots up fine - known Dell feature

== ARM (CentsOS7) ==

See [[yum]] for specifics.

yum install xauth wget bzip2 xterm expat-devel libX11-devel libXpm-devel motif-devel mariadb-devel

== RHEL9 (64 bit) ==

'''NOTE''': select installation type '''H''', then type '''B'''.

'''NOTE''': during custom disk partitioning, select 'Standard' for every partition, if you want it to be standard, or 'Raid' if applicable

Set root password (see instractions below), if you want to become superuser by typing just ''su''. If becoming superuser by typing ''sudo su'' is good enough, do nothing (in that case graphics will not work in superuser mode).

Install useful pachages:
yum install ncdu mysql

'''NOTE''': graphic screen is disabled, run following command as root:
systemctl set-default graphical.target

== RHEL9 (64 bit) - for machine NOT under puppet control ==

'''NOTE''': select installation type '''D''' (not '''S''', otherwise it will not be level 2 server)

'''NOTE''': during custom disk partitioning, select 'Standard' for every partition, if you want it to be standard, or 'Raid' if applicable

When installation complete, ssh as authorized user and do following:

sudo yum install emacs
cd /etc
sudo chmod a+rw shadow
sudo emacs shadow

Copy to /etc/shadow root and other needed passwords from another clon machine.

sudo chmod a-rw shadow

After that, type ''su'' to become superuser. All following settings can be done now without typing ''sudo'' every time. You still will not be able to ssh remotely as root - always ssh as authorized user and type ''su'' to become root.

Update /etc/passwd and /etc/group using another clon machine as example.

yum install expat-devel libXaw-devel mysql-devel motif-devel ncurses-devel apr-devel net-snmp-utils
yum install xorg-x11-utils # for xprop/xwininfo/etc creg stuff
yum install s-nail # for /usr/bin/mail
yum install ncdu
yum install libconfig-devel # recent addition for CODA libraries

To be able to ssh to old machines (like vme controllers under CentOS5), run following as root:

update-crypto-policies --set LEGACY

and then probably reboot, not sure.

Somebody mentioned also adding ''RequiredRSASize 1024'' to a config file in ''/etc/ssh/ssh_config.d/'', but I did not do it.

Note: this changes all daemons and system settings and is a bit overkill if you only need to adjust the settings for ssh and sshd.

Exclude (only) sshd from the system-wide cryptographic policy. You opt-out by editing /etc/sysconfig/sshd and uncommenting the line # CRYPTO_POLICY= , (if necessary you can then adjust adjust /etc/ssh/sshd_config and add legacy crypto settings) and restart the ssh daemon.

For the ssh command line client on the RHEL 9 system: you're recommended to edit ˜/.ssh/config and override the modern/secure system wide ssh client defaults by adding a Host entry that adds support for suitable legacy encryption options for that particular host:

# ˜/.ssh/config

Host rhel6.example.com
KexAlgorithms +diffie-hellman-group14-sha1
MACs +hmac-sha1
HostKeyAlgorithms +ssh-rsa
PubkeyAcceptedKeyTypes +ssh-rsa
PubkeyAcceptedAlgorithms +ssh-rsa

Prepare auto-mounting directories:

cd /
mv apps apps.orig
mv home home.orig
mv scratch scratch.orig
mv work work.orig
mkdir apps
mkdir home
mkdir scratch
mkdir work
mkdir logs
cd /usr
mv local local.orig
mkdir local
mkdir clas
mkdir clas12
mkdir downloads
cd

== RHEL8 (64 bit) ==

'''NOTE:''' to boot from USB stick, insert USB stick, turn machine ON holding F2, and in BIOS Boot Configuration, set Enable Security Boot to OFF, save and exit, holding F2. When in BIOS again, in Boot Configuration make ''UEFI PHY USB ...'' first in boot sequence, local hard drive second, disable all other boot options, save and exit. Do NOT hold F2, Linux installation from USB stick will start. '''IMPORTANT:''' when asked about D/S options (very first question in installation process), '''REMOVE USB STICK BEFORE ANSWERING QUESTION ABOUT DESKTOP/SERVER''', otherwise it will be destroyed by following installation steps !!!

'''NOTE:''' to disable/enable puppet, do following as root:
puppet agent --disable "temporary"
puppet agent --enable

yum install emacs
yum install xorg-x11-fonts-misc

Move and create some directories in preparation for automounts:

cd /
mv apps apps.orig
mv home home.orig
mv scratch scratch.orig
mkdir apps
mkdir home
mkdir scratch
mkdir work
mkdir logs
cd /usr
mv local local.orig
mkdir local
mkdir clas
mkdir clas12
mkdir downloads
cd

Add line '''+dir:/etc/auto.master.d''' to ''/etc/auto.master''

Create file ''/etc/auto.master.d/direct.autofs'' with the line '''/- /etc/auto.direct'''

Create file ''/etc/auto.direct'' with the following contents:

# machine-dependent system directories
/apps -rw,bg clonfs1:/vol/apps/RHEL8_x86_64
/usr/local -rw,bg clonfs1:/vol/local/RHEL8_x86_64
# machine-independent system directories
/home -rw,bg clonfs1:/vol/home
#/work -rw,bg clonfs1-old:/vol/work
/scratch -rw,bg clonfs1:/vol/scratch
# machine-independent clas directories
/usr/downloads -rw,bg clonfs1:/vol/downloads
/usr/clas -rw,bg clonfs1:/vol/clas
/usr/clas12 -rw,bg clonfs1:/vol/clas12
# Used for data storage before shipping to tape
#/logs -rw,bg clonfs1-old:/vol/logs

Restart autofs:

service autofs reload
service autofs restart

Remove from the end of the ''/etc/passwd'' line '''+::::::''', and add following:

hpsrun:x:8796:9998:hpsrun Account:/home/hpsrun:/bin/tcsh
clasrun:x:2508:9998:Online DAQ:/home/clasrun:/bin/tcsh
clasioc:x:6008:9998:CLAS IOCs:/home/clasioc:/bin/tcsh
clas12run:x:6007:146:clas12run Account:/home/clas12run:/bin/tcsh
clascron:x:3888:146:CLAS Cron Jobs:/home/clascron:/bin/tcsh
clasboot:x:6000:146:Boot Scripts Only:/home/clasboot:/bin/tcsh
clasmail:x:6003:146:CLAS Automated Mail:/home/clasmail:/bin/tcsh
epics:x:5001:146:EPICS Account:/home/epics:/bin/tcsh
nagios:x:6246:9997:Nagios:/home/nagios:/bin/tcsh
+@clon_cluster::::::
+sshd::::::
+::::::/bin/false

Update ''/etc/shadow'', adding passwords for local accounts (copy it from another machine).

Add following to ''/etc/group'':

clon:x:383:clascron
onliners:x:9998:abbottd,avakian,baltzell,battagli,brooksw,bruhwel,boiarino,carman,chen,clasboot,clascron,clasrun,cole,cuevas,davidl,danagu,dugger,elton,epics,fklein,gilfoyle,giovanet,golovach,gurjyan,heddle,heyes,hovanes,jacobsg,jenkins,kliv,lcsmith,marki,mestayer,nerses,parkkj,pasyuk,primex,ripani,rossi,saw,staylor,sytnik,taiuti,taylorw,timmer,wooyoung

== RHEL7 (64 bit) ==

Installed using DVD provided by Computer Center, currently RHEL7.3. Requires MAC address to be registered with Computer Center (using jnet.jlab.org as 'boiarino') because it is network-based installation. On DELL servers, hold F2 after power on and go to 'Device Settings' to see mac address. Remember machine memory size as well, will needed when create partitions, find it in 'System BIOS -> Memory Settings'.

'''NOTE: all disks will be reformatted in a process, all information will be lost !'''

Dialog:

* boot: <enter>

* Please enter the hostname of this system: <hostname> <enter>

* What type of system are you building? (D)esktop: <enter>

* Is this a CUE level 1 or CUE level 2 System build (1/2): 2 <enter>

* Please enter the System Admin's CUE username: boiarino <enter>

* Do you want to use the default partitioning scheme (y/n)? n <enter>

* Are you sure you want to use your own partitioning scheme (y/n)? y <enter>

Choose 'Standard Partition' scheme and create following partitions: /boot - 1GB, swap - double memory size, / - the rest of space.

Installation will proceed. When prompted, remove installation disk and reboot machine if not done automatically.

After reboot patching process will be started and it will take a while, do not interrupt it, otherwise system will not be installed correctly.

When machine reboots for the last time, ask Paul Letta to set usual hallb root password. From now on remote root access is possible. Alternatively, user ''boiarino'' can execute most of actions using ''sudo'',
like ''sudo emacs'' for protected files. ''sudo reboot'' etc.

Go to /boot/grub2 and modify file grub.cfg, Linux kernel boot options, adding options ''net.ifnames=0 biosdevname=0'', so your boot string has following section:

..... rhgb net.ifnames=0 biosdevname=0 quiet .....

so whole line looks something like this:

linux16 /vmlinuz-3.10.0-327.18.2.el7.x86_64 root=UUID=b5d1b5ad-e3f6-4db4-8972-aa9c1a91d116 ro vconsole.keymap=us crashkernel=auto vconsole.font=latarcyrheb-sun16 rhgb net.ifnames=0 biosdevname=0 quiet LANG=en_US.UTF-8

Reboot machine, ethernet ports must be named ''eth0'', ''eth1'' etc.

To update manually, use commands ''yum list updates'' and ''yum update''.

'''NOTE:''' add machine to the appropriate '''puppet''' group, it will do all following automatically (hopefully).

'''NOTE:''' on RHEL7.9, RPM EPEL REPO is not enabled by default, which prevents from installing nload, itcl, itk etc. To bring it back, it can be copied it from older machine, for example:

cd /etc/yum.repos.d
scp clondaq7:/etc/yum.repos.d/epel.repo .
cd /etc/pki/rpm-gpg
scp clondaq7:/etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-7 .

Alternatively, following can be used to add repo's:

subscription-manager repos --enable <repo_id>

In particular, following have to be enabled to get nload, xpdf, python-alembic, tix, itcl, itk etc:

subscription-manager repos --enable JLab_EPEL_EPEL_7
subscription-manager repos --enable rhel-7-workstation-optional-rpms

Repo ID's can be obtained by:

subscription-manager repos --list

Installed repo's can be seen by:

yum repolist

'''Yum updates'''

Edit the ''/etc/yum.conf'' file and add the following line to force installation of the 32bit and 64bit libraries:

multilib_policy=all

Install following packages:

yum install xterm mesa-dri-drivers telnet rsh readline-devel net-snmp-utils tigervnc-server tigervnc xpdf nload mariadb-devel libxml2-devel glibc-devel qt-devel python-alembic openssl-devel apr-devel
yum install libconfig-devel # recent addition for CODA libraries

Fonts for EPICS EDMs:

yum install xorg-x11-fonts-75dpi xorg-x11-fonts-ISO8859-1-75dpi bitmap-miscfixed-fonts
yum install bitmap-console-fonts bitmap-fixed-fonts bitmap-lucida-typewriter-fonts
ln -s /usr/share/X11/fonts/100dpi /etc/X11/fontpath.d/xorg-x11-fonts-100dpi:pri=60
ln -s /usr/share/X11/fonts/75dpi /etc/X11/fontpath.d/xorg-x11-fonts-75dpi:pri=50
ln -s /usr/share/X11/fonts/misc /etc/X11/fontpath.d/xorg-x11-fonts-misc:pri=40
ln -s /usr/share/fonts/bitmap /etc/X11/fontpath.d/bitmap-fonts

Do following to be able to compile and run 32-bit apps on 64-bit machine (for compatibility with 32bit applications):

yum install libXpm-devel libXaw-devel motif-devel glibc-devel ncurses-devel readline-devel

Modify file ''/etc/passwd'' adding following:

hpsrun:x:8796:9998:hpsrun Account:/home/hpsrun:/bin/tcsh
clasrun:x:2508:9998:Online DAQ:/home/clasrun:/bin/tcsh
clasioc:x:6008:9998:CLAS IOCs:/home/clasioc:/bin/tcsh
clas12run:x:6007:146:clas12run Account:/home/clas12run:/bin/tcsh
clascron:x:3888:146:CLAS Cron Jobs:/home/clascron:/bin/tcsh
clasboot:x:6000:146:Boot Scripts Only:/home/clasboot:/bin/tcsh
clasmail:x:6003:146:CLAS Automated Mail:/home/clasmail:/bin/tcsh
epics:x:5001:146:EPICS Account:/home/epics:/bin/tcsh
nagios:x:6246:9997:Nagios:/home/nagios:/bin/tcsh
+@clon_cluster::::::
+sshd::::::
+::::::/bin/false

'''Note''': user-related lines must be removed, like

+boiarino::::::

as well as

+::::::

'''Note''': assumed that following line is in already:

+@ccc::::::

'''Note''': if following line exist, it must be placed in the end, or removed:

+::::::/bin/false

Modify file ''/etc/group'' adding following:

onliners::9998:heyes,hujl,rwm,timmer,wolin,taylorw,cuevas,abbottd,abulafia,anciant,anghi,aswin,auger,avakian,banta,barrow,battagli,bjlee,bogdan,brooksw,bruhwel,boiarino,buckle,burchesk,burin,bzh,cetina,chen,cole,cords,corvi,costy,davidl,costy,davidl,dcarter,dcurry,dennisl,deppman,dhlee,doughty,drago,dytman,dugger,dugger,elton,fedro,ficenec,fklein,france,freyberg,gholden,gilfoyle,golovach,gurjyan,haddock,heddle,jenkins,jhardie,jmorris,kellyk,klusman,kmkim,kossov,lcsmith,longhi,manak,marchand,marki,mastersj,mjohnson,mosbackr,mueller,muguira,murphyl,necaise,odonnell,opper,parkkj,pasyuk,phkim,piot,riccardi,richardt,ripani,rossi,saw,sergpozd,serov,sholt,staylor,taiuti,tang,tedeschi,vineyard,vlassov,vvsap,weygand,wooyoung,burchesk,clasrun,giovanet,clasboot,clascoda,clasroot,clasmail,clascron,trigger,epics,southern,carstens,ccutter,danagu,heyes,huertas,jacobsg,kliv,lachniet,mestayer,primex,hovanes,nerses,sytnik,baltzell,carman
clon::383:clascoda,clascron,clasmail
nagios::9997:nagios

Modify file ''/etc/shadow'' using an example from another RHEL7 clon machine (clonioc2 etc). Do ''chmod 600 shadow'' before editing and ''chmod 000 shadow'' after.

Make sure file ''/etc/ssh/sshd_config'' has following line uncommented (must be pushed in by CC security scripts):

##PermitUserEnvironment yes

NOT NEEDED, DONE IN THE END OF FILE ALREADY !!! Uncomment following in file ''/etc/ssh/ssh_config'':

##Host *
##ForwardX11 yes

Add line 'export NO_AT_BRIDGE=1' to the file '/etc/environment' to suppress annoying messages like '** (emacs:38714): WARNING **: Couldn't register with accessibility bus: Did not receive a reply.'

If big (>2GB) partition to be formated, do following (for example /dev/sdb):

parted /dev/sdb
(parted) print
(parted) mklabel gpt
(parted) print
mkpart primary 0GB 25855.2GB
(parted) print
(parted) quit

mkfs.xfs /dev/sdb1

then create /data and mount it using ''/etc/fstab'':

/dev/sdb1 /data xfs defaults 1 2

'''NOTE:''' sometimes machine can loose NIS connection, then ssh to it becomes intermittent; if it happens ssh as root (may have to try several times) and run command

ypwhich

to shows NIS server. If it returns nothing check file ''/etc/resolv.conf'', it must have following (as on July 2019):

search jlab.org acc.jlab.org
nameserver 129.57.90.255
nameserver 129.57.32.101

If file is empty or does not contain right info, fix it. After that run command

ypbind

It should fix a problem. Run ''ypwhich'' to make sure.

'''Display Setting:''' if machine is multi-head, goto ''Applications->System Tools->Settings->Devices->Displays'' and arrange displays.

Proceed to the [[Linux Customization on CLON Cluster]].

== RHEL6 (64 bit) ==

Installed using CD provided by Computer Center. Requires MAC address to be registered with Computer Center (using jnet.jlab.org as 'boiarino') because it is network-based installation.

'''NOTE: all disks will be reformatted in a process, all information will be lost !'''

Dialog:

* boot: <enter>

* ...[D]esktop: [use 's' for server, 'd' for desktop] <enter>

* root password: enter root password

* admin user: boiarino

Installation will proceed. When prompted, remove installation disk and reboot machine if not done automatically. After reboot patching process will be started and it will take a while, do not interrupt it, otherwise system will not be installed correctly.

To make emacs work, install

yum install libotf

Edit the /etc/yum.conf file and add the following line to force installation of teh 32bit and 64bit libraries:

multilib_policy=all

Install following packages:

yum install openmotif-devel xinetd mysql-devel cmake libXpm-devel net-snmp-utils
yum install mesa-libGL-devel mesa-libGLU-devel mesa-libGLw-devel (for OpenGL, needed by ROOT)
yum install libXaw-devel (for xterm)
yum install expat-devel libgcj-devel (for evio/et)

yum install compat-libtermcap (for xterm)
ln -s /lib/libtermcap.so.2 /usr/lib/libtermcap.so
###ln -s /lib64/libtermcap.so.2 /usr/lib64/libtermcap.so

Install following fonts for EPICS EDMs:

yum install xorg-x11-fonts-75dpi xorg-x11-fonts-ISO8859-1-75dpi bitmap-miscfixed-fonts
yum install bitmap-console-fonts bitmap-fixed-fonts bitmap-lucida-typewriter-fonts
ln -s /usr/share/X11/fonts/100dpi /etc/X11/fontpath.d/xorg-x11-fonts-100dpi:pri=60
ln -s /usr/share/X11/fonts/75dpi /etc/X11/fontpath.d/xorg-x11-fonts-75dpi:pri=50
ln -s /usr/share/X11/fonts/misc /etc/X11/fontpath.d/xorg-x11-fonts-misc:pri=40
ln -s /usr/share/fonts/bitmap /etc/X11/fontpath.d/bitmap-fonts

'''NOTE:''' Useful ''yum'' commands:

yum whatprovides libstdc++.so.5 - show which package contains libstdc++.so.5

== RHEL5 ==

Installed using CD provided by Computer Center. Requires MAC address to be registered with Computer Center (email to helpdesk@jlab.org) because it is network-based installation.

Dialog:

* boot: <enter>

* ...[D]esktop: Server (it is ignored, will do Desktop anyway ...)

* root password: enter root password

* system user: <enter>

* manually partition disk: 100MB /boot, 2048 etc MB swap, the rest /.

'''CFENGINE''': there are procesess restoring some system config files (in particular ''/etc/ssh/sshd_config'') in according to the Computer Center - maintained templete. To shut them down: (1) comment out ''cfengine''-related stuff in root cronjobs; (2) do ''/etc/init.d/cfengine stop''; (3) do ''chkconfig cfengine off''. Ask CC (Sherman White, Paul Letta) to fix templete.

Run ''/usr/bin/system-config-authentication'' and set NIS servers list as ''clon00,clon10,nis1''.

Add following in the end of ''/etc/passwd'':
clasrun:x:2508:9998:Online DAQ:/home/clasrun:/bin/tcsh
clas12run:x:6007:146:clas12run Account:/home/clas12run:/bin/tcsh
clascron:x:6005:146:CLAS Cron Jobs:/home/clascron:/bin/tcsh
clasboot:x:6000:146:Boot Scripts Only:/home/clasboot:/bin/tcsh
clasmail:x:6003:146:CLAS Automated Mail:/home/clasmail:/bin/tcsh
epics:x:5001:146:EPICS Account:/home/epics:/bin/tcsh
nagios:x:6246:9997:Nagios:/home/nagios:/bin/tcsh
+@clon_cluster::::::
+@ccc::::::

Add following in the end of ''/etc/group'':
onliners::9998:heyes,hujl,rwm,timmer,wolin,taylorw,cuevas,abbottd,abulafia,anciant,anghi,aswin,auger,avakian,banta,barrow,battagli,bjlee,bogdan,brooksw,bruhwel,boiarino,buckle,burchesk,burin,bzh,cetina,chen,cole,cords,corvi,costy,davidl,costy,davidl,dcarter,dcurry,dennisl,deppman,dhlee,doughty,drago,dytman,dugger,dugger,elton,fedro,ficenec,fklein,france,freyberg,gholden,gilfoyle,golovach,gurjyan,haddock,heddle,jenkins,jhardie,jmorris,kellyk,klusman,kmkim,kossov,lcsmith,longhi,manak,marchand,marki,mastersj,mjohnson,mosbackr,mueller,muguira,murphyl,necaise,odonnell,opper,parkkj,pasyuk,phkim,piot,riccardi,richardt,ripani,rossi,saw,sergpozd,serov,sholt,staylor,taiuti,tang,tedeschi,vineyard,vlassov,vvsap,weygand,wooyoung,burchesk,clasrun,giovanet,clasboot,clascoda,clasroot,clasmail,clascron,trigger,epics,southern,carstens,ccutter,danagu,heyes,huertas,jacobsg,kliv,lachniet,mestayer,primex,hovanes,nerses,sytnik
clon::383:clascoda,clascron,clasmail
nagios::9997:nagios

Create ''/etc/shadow'' files with entries for users clasrun, epics and nagios (copy from another machine).

Install updates: normally all updates should be installed by now, it can be done manually by commands
yum list updates
yum update

Configure [[SSH]].

Install missing packages:
yum install openmotif-devel xinetd mysql-devel cmake

Some additional packages on request (for EPICS):

yum install mc lapack lapack-devel blas blas-devel giflib-devel

Proceed to the [[Linux Customization on CLON Cluster]].

'''PROBLEMS''':

1. /usr/lib/libg2c.so link is missing

FIXED ??? 2. /usr/lib/libXm.so link is missing

3. Created /etc/shadow file for clasrun, epics and nagios

== RHEL4 ==

Get RHEL4 CDs from Paul Letta.

Connect terminal, keyboard and mouse.

Boot from CD1. Follow instructions. When asked, choose following options:

* Choose 'Manually partition with Disk Druid', set /boot to 100MB, then / to 40GB, then swap to 8192MB or at least double memory size. The rest of disk can be set as /space.

* Network: choose manually, type clonpc2.jlab.org; click 'EDIT', deactivate 'Configure using DHCP',
type IP address and netmask (255.255.255.0), click Ok.
Type Gateway (for example 129.57.167.99) and 3 DNS servers (129.57.167.5,129.57.167.14,129.57.32.100).

* Choose 'No firewall'

* Disable 'SELinux'

* Choose 'Customize software packages to be installed', click 'Everything'.

You will be asked to install CD2, CD3 and CD4, then CD1 again.
Then you will be asked to click 'Reboot'. First remove CD, then click 'Reboot'.
You will be asked few more questions. When asked to activate service, choose
'Tell me why I need to register ..' and click 'Next'. Choose 'I can not complete registration ..'
and click 'Next'. You will see 'System user' screen, click 'Use network login..'.
Choose 'Enable NIS support' and click 'Configure NIS'. Type NIS Domain: 'CCCHP' and NIS Server: clon00.jlab.org.
Finish installation process.

* fix files ''/etc/passwd'', ''/etc/shadow'' and ''/etc/group'' adding clasrun etc (see examples on another machines).

'''NOTE''': if machine has multiple network ports, Linux may not assign them properly to specified IP names and addresses. If problem occures, open network GUI and delete all existing records. After that, click ''New'' and pick hadrware port you want to configure from the list of available ports (tricky part is to know which RJ-45 connector corresponds to which port ..). Configure and activate it, make sure it works. Repeat for other ports. Results will be stored in directory ''/etc/sysconfig/network-scripts'', file names will be ''ifcfg-eth0'', ''ifcfg-eth1'' etc. If modifying those files manually, restart network by ''/etc/init.d/network restart''. Finally, set routing, for example for ''clonmon'' command ''route -n'' shows following:
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
129.57.160.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1
129.57.68.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3
129.57.69.0 0.0.0.0 255.255.255.0 U 0 0 0 dev5937
129.57.64.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0
169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth3
0.0.0.0 129.57.68.100 0.0.0.0 UG 0 0 0 eth3
Run following commands:
/sbin/route add -net 129.57.160.0 netmask 255.255.255.0 gw 129.57.160.5 dev eth1
/sbin/route add -net 129.57.68.0 netmask 255.255.255.0 gw 129.57.68.26 dev eth3
/sbin/route add -net 129.57.69.0 netmask 255.255.255.0 gw 129.57.69.206 dev dev5937
/sbin/route add -net 129.57.64.0 netmask 255.255.255.0 gw 129.57.64.57 dev eth0
Now ''route -n'' shows following:
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
129.57.160.0 129.57.160.5 255.255.255.0 UG 0 0 0 eth1
129.57.160.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1
129.57.68.0 129.57.68.26 255.255.255.0 UG 0 0 0 eth3
129.57.68.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3
129.57.69.0 129.57.69.206 255.255.255.0 UG 0 0 0 dev5937
129.57.69.0 0.0.0.0 255.255.255.0 U 0 0 0 dev5937
129.57.64.0 129.57.64.57 255.255.255.0 UG 0 0 0 eth0
129.57.64.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0
169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth3
0.0.0.0 129.57.68.100 0.0.0.0 UG 0 0 0 eth3
In that example automount will do configured using ''clonmon-daq1'' interface, because default ''clonmon'' interface is on external subnet. To make that routing table permanent (retore it after reboot) I tried to add four files with following contents to the ''/etc/sysconfig/network-scripts'' directory:
route-eth1:
GATEWAY0=129.57.160.5
NETMASK0=255.255.255.0
ADDRESS0=129.57.160.0
route-eth3:
GATEWAY0=129.57.68.26
NETMASK0=255.255.255.0
ADDRESS0=129.57.68.0
route-dev5937:
GATEWAY0=129.57.69.206
NETMASK0=255.255.255.0
ADDRESS0=129.57.69.0
route-eth0:
GATEWAY0=129.57.64.57
NETMASK0=255.255.255.0
ADDRESS0=129.57.64.0
It did not worked. Then I added four ''/sbin/route add ..'' lines to ''/etc/rc.local'' script, and it worked.

From now on you can use remote 'ssh' connection.

* To configure your system to use the patch server, issue the following commands as root:
# mount jlabsite:/site /mnt
# /mnt/CC/linux/satellite-connect --patchall
The script will prompt you for an activation key, but if you don't know what this is, just hit ENTER and it will use a sensible default. Depending on how many patches need to be applied to your system to bring it up to the current level, this script may take a very long time to run. When it finishes, you should reboot your machine to make the new patches take effect.

To install updates later run ''up2date -uf'' as ''root''.

Configure [[SSH]].

* Proceed with [[Linux Customization on CLON Cluster]] if applicable.

To boot Linux in single user mode (no graphics), add ''single'' to the end of boot line during boot process.

== '''background info''' ==

'''Add startup script'''

Create script in ''/etc/init.d/'' directory (use existing scripts as example). Must have a line like
# chkconfig: - 91 09
which specifies start and stop order. Run commands
chkconfig --add <scriptname>
chkconfig --level 3 <scriptname> on
for every level you want that script to be executed (usualy 3 and/or 4 and/or 5). Check if it os done using command
chkconfig --list | grep <scriptname>

'''xxx'''

You can choose to download the RHEL operating system directly from the Red Hat Web site and not receive a media kit from HP containing the software. This scenario occurs when the media option AJR is deselected from the order. (The media kit option is always selected by default. )

It is necessary to register at the Red Hat Web site prior to download. Registration requires the activation code that each customer receives from HP when ordering either RHEL.

You can download RHEL for each available platform as four CD ISO images or one DVD ISO image.

Use the following procedure to download RHEL and create the installation media:

1.

Register and log in at the following Red Hat Web site:

www.redhat.com/rhn
2.

Click on channels and then select Red Hat Enterprise Linux ES (v.4 for 64–bit Intel Itanium).
3.

Select Downloads and then download the ISO images of install, compatibility and source disks

Files with ia64 in the name are for the Itanium platform.
4.

Create the CDs or a DVD from the ISO images.

IMPORTANT: Create the CDs or DVD using the contents of the ISO images. Do not create the CDs or DVD by burning the .iso files themselves to CD or DVD. For example, if you are using K3b to burn a CD, click Tools>CD>Burn CD Image, select the .iso image, then click Burn.

'''Bootup scripts''' for example for level 5 execution (multiuser with X):

cp <script-file> /etc/init.d/
chmod +x /etc/init.d/<script-file>
ln -s /etc/init.d/<scriptfile> /etc/rc.d/rc5.d/S50<scriptfile>
ln -s /etc/init.d/<scriptfile> /etc/rc.d/rc5.d/K50<scriptfile>

'''Changing hostname/IP address'''

Changing hostname on RHEL
1. Change the HOSTNAME line in /etc/sysconfig/network
2. Change the hostname (FQDN and alias) in /etc/hosts
3. Run '/bin/hostname new_hostname' for the hostname change to take effect immediately.
4. Run '/sbin/service syslog restart' for syslog to log using the new hostname.
A reboot is not required to change the system hostname.

IP address: You have to change the IP address entry in
/etc/sysconfig/network-scripts/ifcfg-eth0.

Linux Installation Procedure

2026-02-10T22:32:09Z

Boiarino:

== Dell servers hardware trick(s) ==

* '''!!! if BIOS date/time is incorrect, it may prevent redhat subscription and installation to work correctly. If BIOS does not remember time setting after power unplugged, on-board battery may need to be replaced'''

* if looks dead, remove the power cords, then held in the on button for 30 seconds; then plug it back in and it may boots up fine - known Dell feature

== ARM (CentsOS7) ==

See [[yum]] for specifics.

yum install xauth wget bzip2 xterm expat-devel libX11-devel libXpm-devel motif-devel mariadb-devel

== RHEL9 (64 bit) ==

'''NOTE''': select installation type '''H''', then type '''B'''.

'''NOTE''': during custom disk partitioning, select 'Standard' for every partition, if you want it to be standard, or 'Raid' if applicable

Set root password (see instractions below), if you want to become superuser by typing just ''su''. If becoming superuser by typing ''sudo su'' is good enough, do nothing (in that case graphics will not work in superuser mode).

Install useful pachages:
yum install ncdu mysql

'''NOTE''': graphic screen is disabled, run following command as root:
systemctl set-default graphical.target

== RHEL9 (64 bit) - for machine NOT under puppet control ==

'''NOTE''': select installation type '''D''' (not '''S''', otherwise it will not be level 2 server)

'''NOTE''': during custom disk partitioning, select 'Standard' for every partition, if you want it to be standard, or 'Raid' if applicable

When installation complete, ssh as authorized user and do following:

sudo yum install emacs
cd /etc
sudo chmod a+rw shadow
sudo emacs shadow

Copy to /etc/shadow root and other needed passwords from another clon machine.

sudo chmod a-rw shadow

After that, type ''su'' to become superuser. All following settings can be done now without typing ''sudo'' every time. You still will not be able to ssh remotely as root - always ssh as authorized user and type ''su'' to become root.

Update /etc/passwd and /etc/group using another clon machine as example.

yum install expat-devel libXaw-devel mysql-devel motif-devel ncurses-devel apr-devel net-snmp-utils
yum install xorg-x11-utils # for xprop/xwininfo/etc creg stuff
yum install s-nail # for /usr/bin/mail
yum install ncdu
yum install libconfig-devel # recent addition for CODA libraries

To be able to ssh to old machines (like vme controllers under CentOS5), run following as root:

update-crypto-policies --set LEGACY

and then probably reboot, not sure.

Somebody mentioned also adding ''RequiredRSASize 1024'' to a config file in ''/etc/ssh/ssh_config.d/'', but I did not do it.

Note: this changes all daemons and system settings and is a bit overkill if you only need to adjust the settings for ssh and sshd.

Exclude (only) sshd from the system-wide cryptographic policy. You opt-out by editing /etc/sysconfig/sshd and uncommenting the line # CRYPTO_POLICY= , (if necessary you can then adjust adjust /etc/ssh/sshd_config and add legacy crypto settings) and restart the ssh daemon.

For the ssh command line client on the RHEL 9 system: you're recommended to edit ˜/.ssh/config and override the modern/secure system wide ssh client defaults by adding a Host entry that adds support for suitable legacy encryption options for that particular host:

# ˜/.ssh/config

Host rhel6.example.com
KexAlgorithms +diffie-hellman-group14-sha1
MACs +hmac-sha1
HostKeyAlgorithms +ssh-rsa
PubkeyAcceptedKeyTypes +ssh-rsa
PubkeyAcceptedAlgorithms +ssh-rsa

Prepare auto-mounting directories:

cd /
mv apps apps.orig
mv home home.orig
mv scratch scratch.orig
mv work work.orig
mkdir apps
mkdir home
mkdir scratch
mkdir work
mkdir logs
cd /usr
mv local local.orig
mkdir local
mkdir clas
mkdir clas12
mkdir downloads
cd

== RHEL8 (64 bit) ==

'''NOTE:''' to boot from USB stick, insert USB stick, turn machine ON holding F2, and in BIOS Boot Configuration, set Enable Security Boot to OFF, save and exit, holding F2. When in BIOS again, in Boot Configuration make ''UEFI PHY USB ...'' first in boot sequence, local hard drive second, disable all other boot options, save and exit. Do NOT hold F2, Linux installation from USB stick will start. '''IMPORTANT:''' when asked about D/S options (very first question in installation process), '''REMOVE USB STICK BEFORE ANSWERING QUESTION ABOUT DESKTOP/SERVER''', otherwise it will be destroyed by following installation steps !!!

'''NOTE:''' to disable/enable puppet, do following as root:
puppet agent --disable "temporary"
puppet agent --enable

yum install emacs
yum install xorg-x11-fonts-misc

Move and create some directories in preparation for automounts:

cd /
mv apps apps.orig
mv home home.orig
mv scratch scratch.orig
mkdir apps
mkdir home
mkdir scratch
mkdir work
mkdir logs
cd /usr
mv local local.orig
mkdir local
mkdir clas
mkdir clas12
mkdir downloads
cd

Add line '''+dir:/etc/auto.master.d''' to ''/etc/auto.master''

Create file ''/etc/auto.master.d/direct.autofs'' with the line '''/- /etc/auto.direct'''

Create file ''/etc/auto.direct'' with the following contents:

# machine-dependent system directories
/apps -rw,bg clonfs1:/vol/apps/RHEL8_x86_64
/usr/local -rw,bg clonfs1:/vol/local/RHEL8_x86_64
# machine-independent system directories
/home -rw,bg clonfs1:/vol/home
#/work -rw,bg clonfs1-old:/vol/work
/scratch -rw,bg clonfs1:/vol/scratch
# machine-independent clas directories
/usr/downloads -rw,bg clonfs1:/vol/downloads
/usr/clas -rw,bg clonfs1:/vol/clas
/usr/clas12 -rw,bg clonfs1:/vol/clas12
# Used for data storage before shipping to tape
#/logs -rw,bg clonfs1-old:/vol/logs

Restart autofs:

service autofs reload
service autofs restart

Remove from the end of the ''/etc/passwd'' line '''+::::::''', and add following:

hpsrun:x:8796:9998:hpsrun Account:/home/hpsrun:/bin/tcsh
clasrun:x:2508:9998:Online DAQ:/home/clasrun:/bin/tcsh
clasioc:x:6008:9998:CLAS IOCs:/home/clasioc:/bin/tcsh
clas12run:x:6007:146:clas12run Account:/home/clas12run:/bin/tcsh
clascron:x:3888:146:CLAS Cron Jobs:/home/clascron:/bin/tcsh
clasboot:x:6000:146:Boot Scripts Only:/home/clasboot:/bin/tcsh
clasmail:x:6003:146:CLAS Automated Mail:/home/clasmail:/bin/tcsh
epics:x:5001:146:EPICS Account:/home/epics:/bin/tcsh
nagios:x:6246:9997:Nagios:/home/nagios:/bin/tcsh
+@clon_cluster::::::
+sshd::::::
+::::::/bin/false

Update ''/etc/shadow'', adding passwords for local accounts (copy it from another machine).

Add following to ''/etc/group'':

clon:x:383:clascron
onliners:x:9998:abbottd,avakian,baltzell,battagli,brooksw,bruhwel,boiarino,carman,chen,clasboot,clascron,clasrun,cole,cuevas,davidl,danagu,dugger,elton,epics,fklein,gilfoyle,giovanet,golovach,gurjyan,heddle,heyes,hovanes,jacobsg,jenkins,kliv,lcsmith,marki,mestayer,nerses,parkkj,pasyuk,primex,ripani,rossi,saw,staylor,sytnik,taiuti,taylorw,timmer,wooyoung

== RHEL7 (64 bit) ==

Installed using DVD provided by Computer Center, currently RHEL7.3. Requires MAC address to be registered with Computer Center (using jnet.jlab.org as 'boiarino') because it is network-based installation. On DELL servers, hold F2 after power on and go to 'Device Settings' to see mac address. Remember machine memory size as well, will needed when create partitions, find it in 'System BIOS -> Memory Settings'.

'''NOTE: all disks will be reformatted in a process, all information will be lost !'''

Dialog:

* boot: <enter>

* Please enter the hostname of this system: <hostname> <enter>

* What type of system are you building? (D)esktop: <enter>

* Is this a CUE level 1 or CUE level 2 System build (1/2): 2 <enter>

* Please enter the System Admin's CUE username: boiarino <enter>

* Do you want to use the default partitioning scheme (y/n)? n <enter>

* Are you sure you want to use your own partitioning scheme (y/n)? y <enter>

Choose 'Standard Partition' scheme and create following partitions: /boot - 1GB, swap - double memory size, / - the rest of space.

Installation will proceed. When prompted, remove installation disk and reboot machine if not done automatically.

After reboot patching process will be started and it will take a while, do not interrupt it, otherwise system will not be installed correctly.

When machine reboots for the last time, ask Paul Letta to set usual hallb root password. From now on remote root access is possible. Alternatively, user ''boiarino'' can execute most of actions using ''sudo'',
like ''sudo emacs'' for protected files. ''sudo reboot'' etc.

Go to /boot/grub2 and modify file grub.cfg, Linux kernel boot options, adding options ''net.ifnames=0 biosdevname=0'', so your boot string has following section:

..... rhgb net.ifnames=0 biosdevname=0 quiet .....

so whole line looks something like this:

linux16 /vmlinuz-3.10.0-327.18.2.el7.x86_64 root=UUID=b5d1b5ad-e3f6-4db4-8972-aa9c1a91d116 ro vconsole.keymap=us crashkernel=auto vconsole.font=latarcyrheb-sun16 rhgb net.ifnames=0 biosdevname=0 quiet LANG=en_US.UTF-8

Reboot machine, ethernet ports must be named ''eth0'', ''eth1'' etc.

To update manually, use commands ''yum list updates'' and ''yum update''.

'''NOTE:''' add machine to the appropriate '''puppet''' group, it will do all following automatically (hopefully).

'''NOTE:''' on RHEL7.9, RPM EPEL REPO is not enabled by default, which prevents from installing nload, itcl, itk etc. To bring it back, it can be copied it from older machine, for example:

cd /etc/yum.repos.d
scp clondaq7:/etc/yum.repos.d/epel.repo .
cd /etc/pki/rpm-gpg
scp clondaq7:/etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-7 .

Alternatively, following can be used to add repo's:

subscription-manager repos --enable <repo_id>

In particular, following have to be enabled to get nload, xpdf, python-alembic, tix, itcl, itk etc:

subscription-manager repos --enable JLab_EPEL_EPEL_7
subscription-manager repos --enable rhel-7-workstation-optional-rpms

Repo ID's can be obtained by:

subscription-manager repos --list

Installed repo's can be seen by:

yum repolist

'''Yum updates'''

Edit the ''/etc/yum.conf'' file and add the following line to force installation of the 32bit and 64bit libraries:

multilib_policy=all

Install following packages:

yum install xterm mesa-dri-drivers telnet rsh readline-devel net-snmp-utils tigervnc-server tigervnc xpdf nload mariadb-devel libxml2-devel glibc-devel qt-devel python-alembic openssl-devel apr-devel
yum install libconfig-devel # recent addition for CODA libraries

Fonts for EPICS EDMs:

yum install xorg-x11-fonts-75dpi xorg-x11-fonts-ISO8859-1-75dpi bitmap-miscfixed-fonts
yum install bitmap-console-fonts bitmap-fixed-fonts bitmap-lucida-typewriter-fonts
ln -s /usr/share/X11/fonts/100dpi /etc/X11/fontpath.d/xorg-x11-fonts-100dpi:pri=60
ln -s /usr/share/X11/fonts/75dpi /etc/X11/fontpath.d/xorg-x11-fonts-75dpi:pri=50
ln -s /usr/share/X11/fonts/misc /etc/X11/fontpath.d/xorg-x11-fonts-misc:pri=40
ln -s /usr/share/fonts/bitmap /etc/X11/fontpath.d/bitmap-fonts

Do following to be able to compile and run 32-bit apps on 64-bit machine (for compatibility with 32bit applications):

yum install libXpm-devel libXaw-devel motif-devel glibc-devel ncurses-devel readline-devel

Modify file ''/etc/passwd'' adding following:

hpsrun:x:8796:9998:hpsrun Account:/home/hpsrun:/bin/tcsh
clasrun:x:2508:9998:Online DAQ:/home/clasrun:/bin/tcsh
clasioc:x:6008:9998:CLAS IOCs:/home/clasioc:/bin/tcsh
clas12run:x:6007:146:clas12run Account:/home/clas12run:/bin/tcsh
clascron:x:3888:146:CLAS Cron Jobs:/home/clascron:/bin/tcsh
clasboot:x:6000:146:Boot Scripts Only:/home/clasboot:/bin/tcsh
clasmail:x:6003:146:CLAS Automated Mail:/home/clasmail:/bin/tcsh
epics:x:5001:146:EPICS Account:/home/epics:/bin/tcsh
nagios:x:6246:9997:Nagios:/home/nagios:/bin/tcsh
+@clon_cluster::::::
+sshd::::::
+::::::/bin/false

'''Note''': user-related lines must be removed, like

+boiarino::::::

as well as

+::::::

'''Note''': assumed that following line is in already:

+@ccc::::::

'''Note''': if following line exist, it must be placed in the end, or removed:

+::::::/bin/false

Modify file ''/etc/group'' adding following:

onliners::9998:heyes,hujl,rwm,timmer,wolin,taylorw,cuevas,abbottd,abulafia,anciant,anghi,aswin,auger,avakian,banta,barrow,battagli,bjlee,bogdan,brooksw,bruhwel,boiarino,buckle,burchesk,burin,bzh,cetina,chen,cole,cords,corvi,costy,davidl,costy,davidl,dcarter,dcurry,dennisl,deppman,dhlee,doughty,drago,dytman,dugger,dugger,elton,fedro,ficenec,fklein,france,freyberg,gholden,gilfoyle,golovach,gurjyan,haddock,heddle,jenkins,jhardie,jmorris,kellyk,klusman,kmkim,kossov,lcsmith,longhi,manak,marchand,marki,mastersj,mjohnson,mosbackr,mueller,muguira,murphyl,necaise,odonnell,opper,parkkj,pasyuk,phkim,piot,riccardi,richardt,ripani,rossi,saw,sergpozd,serov,sholt,staylor,taiuti,tang,tedeschi,vineyard,vlassov,vvsap,weygand,wooyoung,burchesk,clasrun,giovanet,clasboot,clascoda,clasroot,clasmail,clascron,trigger,epics,southern,carstens,ccutter,danagu,heyes,huertas,jacobsg,kliv,lachniet,mestayer,primex,hovanes,nerses,sytnik,baltzell,carman
clon::383:clascoda,clascron,clasmail
nagios::9997:nagios

Modify file ''/etc/shadow'' using an example from another RHEL7 clon machine (clonioc2 etc). Do ''chmod 600 shadow'' before editing and ''chmod 000 shadow'' after.

Make sure file ''/etc/ssh/sshd_config'' has following line uncommented (must be pushed in by CC security scripts):

##PermitUserEnvironment yes

NOT NEEDED, DONE IN THE END OF FILE ALREADY !!! Uncomment following in file ''/etc/ssh/ssh_config'':

##Host *
##ForwardX11 yes

Add line 'export NO_AT_BRIDGE=1' to the file '/etc/environment' to suppress annoying messages like '** (emacs:38714): WARNING **: Couldn't register with accessibility bus: Did not receive a reply.'

If big (>2GB) partition to be formated, do following (for example /dev/sdb):

parted /dev/sdb
(parted) print
(parted) mklabel gpt
(parted) print
mkpart primary 0GB 25855.2GB
(parted) print
(parted) quit

mkfs.xfs /dev/sdb1

then create /data and mount it using ''/etc/fstab'':

/dev/sdb1 /data xfs defaults 1 2

'''NOTE:''' sometimes machine can loose NIS connection, then ssh to it becomes intermittent; if it happens ssh as root (may have to try several times) and run command

ypwhich

to shows NIS server. If it returns nothing check file ''/etc/resolv.conf'', it must have following (as on July 2019):

search jlab.org acc.jlab.org
nameserver 129.57.90.255
nameserver 129.57.32.101

If file is empty or does not contain right info, fix it. After that run command

ypbind

It should fix a problem. Run ''ypwhich'' to make sure.

'''Display Setting:''' if machine is multi-head, goto ''Applications->System Tools->Settings->Devices->Displays'' and arrange displays.

Proceed to the [[Linux Customization on CLON Cluster]].

== RHEL6 (64 bit) ==

Installed using CD provided by Computer Center. Requires MAC address to be registered with Computer Center (using jnet.jlab.org as 'boiarino') because it is network-based installation.

'''NOTE: all disks will be reformatted in a process, all information will be lost !'''

Dialog:

* boot: <enter>

* ...[D]esktop: [use 's' for server, 'd' for desktop] <enter>

* root password: enter root password

* admin user: boiarino

Installation will proceed. When prompted, remove installation disk and reboot machine if not done automatically. After reboot patching process will be started and it will take a while, do not interrupt it, otherwise system will not be installed correctly.

To make emacs work, install

yum install libotf

Edit the /etc/yum.conf file and add the following line to force installation of teh 32bit and 64bit libraries:

multilib_policy=all

Install following packages:

yum install openmotif-devel xinetd mysql-devel cmake libXpm-devel net-snmp-utils
yum install mesa-libGL-devel mesa-libGLU-devel mesa-libGLw-devel (for OpenGL, needed by ROOT)
yum install libXaw-devel (for xterm)
yum install expat-devel libgcj-devel (for evio/et)

yum install compat-libtermcap (for xterm)
ln -s /lib/libtermcap.so.2 /usr/lib/libtermcap.so
###ln -s /lib64/libtermcap.so.2 /usr/lib64/libtermcap.so

Install following fonts for EPICS EDMs:

yum install xorg-x11-fonts-75dpi xorg-x11-fonts-ISO8859-1-75dpi bitmap-miscfixed-fonts
yum install bitmap-console-fonts bitmap-fixed-fonts bitmap-lucida-typewriter-fonts
ln -s /usr/share/X11/fonts/100dpi /etc/X11/fontpath.d/xorg-x11-fonts-100dpi:pri=60
ln -s /usr/share/X11/fonts/75dpi /etc/X11/fontpath.d/xorg-x11-fonts-75dpi:pri=50
ln -s /usr/share/X11/fonts/misc /etc/X11/fontpath.d/xorg-x11-fonts-misc:pri=40
ln -s /usr/share/fonts/bitmap /etc/X11/fontpath.d/bitmap-fonts

'''NOTE:''' Useful ''yum'' commands:

yum whatprovides libstdc++.so.5 - show which package contains libstdc++.so.5

== RHEL5 ==

Installed using CD provided by Computer Center. Requires MAC address to be registered with Computer Center (email to helpdesk@jlab.org) because it is network-based installation.

Dialog:

* boot: <enter>

* ...[D]esktop: Server (it is ignored, will do Desktop anyway ...)

* root password: enter root password

* system user: <enter>

* manually partition disk: 100MB /boot, 2048 etc MB swap, the rest /.

'''CFENGINE''': there are procesess restoring some system config files (in particular ''/etc/ssh/sshd_config'') in according to the Computer Center - maintained templete. To shut them down: (1) comment out ''cfengine''-related stuff in root cronjobs; (2) do ''/etc/init.d/cfengine stop''; (3) do ''chkconfig cfengine off''. Ask CC (Sherman White, Paul Letta) to fix templete.

Run ''/usr/bin/system-config-authentication'' and set NIS servers list as ''clon00,clon10,nis1''.

Add following in the end of ''/etc/passwd'':
clasrun:x:2508:9998:Online DAQ:/home/clasrun:/bin/tcsh
clas12run:x:6007:146:clas12run Account:/home/clas12run:/bin/tcsh
clascron:x:6005:146:CLAS Cron Jobs:/home/clascron:/bin/tcsh
clasboot:x:6000:146:Boot Scripts Only:/home/clasboot:/bin/tcsh
clasmail:x:6003:146:CLAS Automated Mail:/home/clasmail:/bin/tcsh
epics:x:5001:146:EPICS Account:/home/epics:/bin/tcsh
nagios:x:6246:9997:Nagios:/home/nagios:/bin/tcsh
+@clon_cluster::::::
+@ccc::::::

Add following in the end of ''/etc/group'':
onliners::9998:heyes,hujl,rwm,timmer,wolin,taylorw,cuevas,abbottd,abulafia,anciant,anghi,aswin,auger,avakian,banta,barrow,battagli,bjlee,bogdan,brooksw,bruhwel,boiarino,buckle,burchesk,burin,bzh,cetina,chen,cole,cords,corvi,costy,davidl,costy,davidl,dcarter,dcurry,dennisl,deppman,dhlee,doughty,drago,dytman,dugger,dugger,elton,fedro,ficenec,fklein,france,freyberg,gholden,gilfoyle,golovach,gurjyan,haddock,heddle,jenkins,jhardie,jmorris,kellyk,klusman,kmkim,kossov,lcsmith,longhi,manak,marchand,marki,mastersj,mjohnson,mosbackr,mueller,muguira,murphyl,necaise,odonnell,opper,parkkj,pasyuk,phkim,piot,riccardi,richardt,ripani,rossi,saw,sergpozd,serov,sholt,staylor,taiuti,tang,tedeschi,vineyard,vlassov,vvsap,weygand,wooyoung,burchesk,clasrun,giovanet,clasboot,clascoda,clasroot,clasmail,clascron,trigger,epics,southern,carstens,ccutter,danagu,heyes,huertas,jacobsg,kliv,lachniet,mestayer,primex,hovanes,nerses,sytnik
clon::383:clascoda,clascron,clasmail
nagios::9997:nagios

Create ''/etc/shadow'' files with entries for users clasrun, epics and nagios (copy from another machine).

Install updates: normally all updates should be installed by now, it can be done manually by commands
yum list updates
yum update

Configure [[SSH]].

Install missing packages:
yum install openmotif-devel xinetd mysql-devel cmake

Some additional packages on request (for EPICS):

yum install mc lapack lapack-devel blas blas-devel giflib-devel

Proceed to the [[Linux Customization on CLON Cluster]].

'''PROBLEMS''':

1. /usr/lib/libg2c.so link is missing

FIXED ??? 2. /usr/lib/libXm.so link is missing

3. Created /etc/shadow file for clasrun, epics and nagios

== RHEL4 ==

Get RHEL4 CDs from Paul Letta.

Connect terminal, keyboard and mouse.

Boot from CD1. Follow instructions. When asked, choose following options:

* Choose 'Manually partition with Disk Druid', set /boot to 100MB, then / to 40GB, then swap to 8192MB or at least double memory size. The rest of disk can be set as /space.

* Network: choose manually, type clonpc2.jlab.org; click 'EDIT', deactivate 'Configure using DHCP',
type IP address and netmask (255.255.255.0), click Ok.
Type Gateway (for example 129.57.167.99) and 3 DNS servers (129.57.167.5,129.57.167.14,129.57.32.100).

* Choose 'No firewall'

* Disable 'SELinux'

* Choose 'Customize software packages to be installed', click 'Everything'.

You will be asked to install CD2, CD3 and CD4, then CD1 again.
Then you will be asked to click 'Reboot'. First remove CD, then click 'Reboot'.
You will be asked few more questions. When asked to activate service, choose
'Tell me why I need to register ..' and click 'Next'. Choose 'I can not complete registration ..'
and click 'Next'. You will see 'System user' screen, click 'Use network login..'.
Choose 'Enable NIS support' and click 'Configure NIS'. Type NIS Domain: 'CCCHP' and NIS Server: clon00.jlab.org.
Finish installation process.

* fix files ''/etc/passwd'', ''/etc/shadow'' and ''/etc/group'' adding clasrun etc (see examples on another machines).

'''NOTE''': if machine has multiple network ports, Linux may not assign them properly to specified IP names and addresses. If problem occures, open network GUI and delete all existing records. After that, click ''New'' and pick hadrware port you want to configure from the list of available ports (tricky part is to know which RJ-45 connector corresponds to which port ..). Configure and activate it, make sure it works. Repeat for other ports. Results will be stored in directory ''/etc/sysconfig/network-scripts'', file names will be ''ifcfg-eth0'', ''ifcfg-eth1'' etc. If modifying those files manually, restart network by ''/etc/init.d/network restart''. Finally, set routing, for example for ''clonmon'' command ''route -n'' shows following:
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
129.57.160.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1
129.57.68.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3
129.57.69.0 0.0.0.0 255.255.255.0 U 0 0 0 dev5937
129.57.64.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0
169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth3
0.0.0.0 129.57.68.100 0.0.0.0 UG 0 0 0 eth3
Run following commands:
/sbin/route add -net 129.57.160.0 netmask 255.255.255.0 gw 129.57.160.5 dev eth1
/sbin/route add -net 129.57.68.0 netmask 255.255.255.0 gw 129.57.68.26 dev eth3
/sbin/route add -net 129.57.69.0 netmask 255.255.255.0 gw 129.57.69.206 dev dev5937
/sbin/route add -net 129.57.64.0 netmask 255.255.255.0 gw 129.57.64.57 dev eth0
Now ''route -n'' shows following:
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
129.57.160.0 129.57.160.5 255.255.255.0 UG 0 0 0 eth1
129.57.160.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1
129.57.68.0 129.57.68.26 255.255.255.0 UG 0 0 0 eth3
129.57.68.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3
129.57.69.0 129.57.69.206 255.255.255.0 UG 0 0 0 dev5937
129.57.69.0 0.0.0.0 255.255.255.0 U 0 0 0 dev5937
129.57.64.0 129.57.64.57 255.255.255.0 UG 0 0 0 eth0
129.57.64.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0
169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth3
0.0.0.0 129.57.68.100 0.0.0.0 UG 0 0 0 eth3
In that example automount will do configured using ''clonmon-daq1'' interface, because default ''clonmon'' interface is on external subnet. To make that routing table permanent (retore it after reboot) I tried to add four files with following contents to the ''/etc/sysconfig/network-scripts'' directory:
route-eth1:
GATEWAY0=129.57.160.5
NETMASK0=255.255.255.0
ADDRESS0=129.57.160.0
route-eth3:
GATEWAY0=129.57.68.26
NETMASK0=255.255.255.0
ADDRESS0=129.57.68.0
route-dev5937:
GATEWAY0=129.57.69.206
NETMASK0=255.255.255.0
ADDRESS0=129.57.69.0
route-eth0:
GATEWAY0=129.57.64.57
NETMASK0=255.255.255.0
ADDRESS0=129.57.64.0
It did not worked. Then I added four ''/sbin/route add ..'' lines to ''/etc/rc.local'' script, and it worked.

From now on you can use remote 'ssh' connection.

* To configure your system to use the patch server, issue the following commands as root:
# mount jlabsite:/site /mnt
# /mnt/CC/linux/satellite-connect --patchall
The script will prompt you for an activation key, but if you don't know what this is, just hit ENTER and it will use a sensible default. Depending on how many patches need to be applied to your system to bring it up to the current level, this script may take a very long time to run. When it finishes, you should reboot your machine to make the new patches take effect.

To install updates later run ''up2date -uf'' as ''root''.

Configure [[SSH]].

* Proceed with [[Linux Customization on CLON Cluster]] if applicable.

To boot Linux in single user mode (no graphics), add ''single'' to the end of boot line during boot process.

== '''background info''' ==

'''Add startup script'''

Create script in ''/etc/init.d/'' directory (use existing scripts as example). Must have a line like
# chkconfig: - 91 09
which specifies start and stop order. Run commands
chkconfig --add <scriptname>
chkconfig --level 3 <scriptname> on
for every level you want that script to be executed (usualy 3 and/or 4 and/or 5). Check if it os done using command
chkconfig --list | grep <scriptname>

'''xxx'''

You can choose to download the RHEL operating system directly from the Red Hat Web site and not receive a media kit from HP containing the software. This scenario occurs when the media option AJR is deselected from the order. (The media kit option is always selected by default. )

It is necessary to register at the Red Hat Web site prior to download. Registration requires the activation code that each customer receives from HP when ordering either RHEL.

You can download RHEL for each available platform as four CD ISO images or one DVD ISO image.

Use the following procedure to download RHEL and create the installation media:

1.

Register and log in at the following Red Hat Web site:

www.redhat.com/rhn
2.

Click on channels and then select Red Hat Enterprise Linux ES (v.4 for 64–bit Intel Itanium).
3.

Select Downloads and then download the ISO images of install, compatibility and source disks

Files with ia64 in the name are for the Itanium platform.
4.

Create the CDs or a DVD from the ISO images.

IMPORTANT: Create the CDs or DVD using the contents of the ISO images. Do not create the CDs or DVD by burning the .iso files themselves to CD or DVD. For example, if you are using K3b to burn a CD, click Tools>CD>Burn CD Image, select the .iso image, then click Burn.

'''Bootup scripts''' for example for level 5 execution (multiuser with X):

cp <script-file> /etc/init.d/
chmod +x /etc/init.d/<script-file>
ln -s /etc/init.d/<scriptfile> /etc/rc.d/rc5.d/S50<scriptfile>
ln -s /etc/init.d/<scriptfile> /etc/rc.d/rc5.d/K50<scriptfile>

'''Changing hostname/IP address'''

Changing hostname on RHEL
1. Change the HOSTNAME line in /etc/sysconfig/network
2. Change the hostname (FQDN and alias) in /etc/hosts
3. Run '/bin/hostname new_hostname' for the hostname change to take effect immediately.
4. Run '/sbin/service syslog restart' for syslog to log using the new hostname.
A reboot is not required to change the system hostname.

IP address: You have to change the IP address entry in
/etc/sysconfig/network-scripts/ifcfg-eth0.

Linux Installation Procedure

2026-02-10T22:31:31Z

Boiarino: /* Dell servers hardware trick(s) */

== Dell servers hardware trick(s) ==

* '''!!! if BIOS date/time is incorrect, it may prevent redhat subscription to work. If BIOS does not remember time setting after power unplugged, on-board battery may need to be replaced'''

* if looks dead, remove the power cords, then held in the on button for 30 seconds; then plug it back in and it may boots up fine - known Dell feature

== ARM (CentsOS7) ==

See [[yum]] for specifics.

yum install xauth wget bzip2 xterm expat-devel libX11-devel libXpm-devel motif-devel mariadb-devel

== RHEL9 (64 bit) ==

'''NOTE''': select installation type '''H''', then type '''B'''.

'''NOTE''': during custom disk partitioning, select 'Standard' for every partition, if you want it to be standard, or 'Raid' if applicable

Set root password (see instractions below), if you want to become superuser by typing just ''su''. If becoming superuser by typing ''sudo su'' is good enough, do nothing (in that case graphics will not work in superuser mode).

Install useful pachages:
yum install ncdu mysql

'''NOTE''': graphic screen is disabled, run following command as root:
systemctl set-default graphical.target

== RHEL9 (64 bit) - for machine NOT under puppet control ==

'''NOTE''': select installation type '''D''' (not '''S''', otherwise it will not be level 2 server)

'''NOTE''': during custom disk partitioning, select 'Standard' for every partition, if you want it to be standard, or 'Raid' if applicable

When installation complete, ssh as authorized user and do following:

sudo yum install emacs
cd /etc
sudo chmod a+rw shadow
sudo emacs shadow

Copy to /etc/shadow root and other needed passwords from another clon machine.

sudo chmod a-rw shadow

After that, type ''su'' to become superuser. All following settings can be done now without typing ''sudo'' every time. You still will not be able to ssh remotely as root - always ssh as authorized user and type ''su'' to become root.

Update /etc/passwd and /etc/group using another clon machine as example.

yum install expat-devel libXaw-devel mysql-devel motif-devel ncurses-devel apr-devel net-snmp-utils
yum install xorg-x11-utils # for xprop/xwininfo/etc creg stuff
yum install s-nail # for /usr/bin/mail
yum install ncdu
yum install libconfig-devel # recent addition for CODA libraries

To be able to ssh to old machines (like vme controllers under CentOS5), run following as root:

update-crypto-policies --set LEGACY

and then probably reboot, not sure.

Somebody mentioned also adding ''RequiredRSASize 1024'' to a config file in ''/etc/ssh/ssh_config.d/'', but I did not do it.

Note: this changes all daemons and system settings and is a bit overkill if you only need to adjust the settings for ssh and sshd.

Exclude (only) sshd from the system-wide cryptographic policy. You opt-out by editing /etc/sysconfig/sshd and uncommenting the line # CRYPTO_POLICY= , (if necessary you can then adjust adjust /etc/ssh/sshd_config and add legacy crypto settings) and restart the ssh daemon.

For the ssh command line client on the RHEL 9 system: you're recommended to edit ˜/.ssh/config and override the modern/secure system wide ssh client defaults by adding a Host entry that adds support for suitable legacy encryption options for that particular host:

# ˜/.ssh/config

Host rhel6.example.com
KexAlgorithms +diffie-hellman-group14-sha1
MACs +hmac-sha1
HostKeyAlgorithms +ssh-rsa
PubkeyAcceptedKeyTypes +ssh-rsa
PubkeyAcceptedAlgorithms +ssh-rsa

Prepare auto-mounting directories:

cd /
mv apps apps.orig
mv home home.orig
mv scratch scratch.orig
mv work work.orig
mkdir apps
mkdir home
mkdir scratch
mkdir work
mkdir logs
cd /usr
mv local local.orig
mkdir local
mkdir clas
mkdir clas12
mkdir downloads
cd

== RHEL8 (64 bit) ==

'''NOTE:''' to boot from USB stick, insert USB stick, turn machine ON holding F2, and in BIOS Boot Configuration, set Enable Security Boot to OFF, save and exit, holding F2. When in BIOS again, in Boot Configuration make ''UEFI PHY USB ...'' first in boot sequence, local hard drive second, disable all other boot options, save and exit. Do NOT hold F2, Linux installation from USB stick will start. '''IMPORTANT:''' when asked about D/S options (very first question in installation process), '''REMOVE USB STICK BEFORE ANSWERING QUESTION ABOUT DESKTOP/SERVER''', otherwise it will be destroyed by following installation steps !!!

'''NOTE:''' to disable/enable puppet, do following as root:
puppet agent --disable "temporary"
puppet agent --enable

yum install emacs
yum install xorg-x11-fonts-misc

Move and create some directories in preparation for automounts:

cd /
mv apps apps.orig
mv home home.orig
mv scratch scratch.orig
mkdir apps
mkdir home
mkdir scratch
mkdir work
mkdir logs
cd /usr
mv local local.orig
mkdir local
mkdir clas
mkdir clas12
mkdir downloads
cd

Add line '''+dir:/etc/auto.master.d''' to ''/etc/auto.master''

Create file ''/etc/auto.master.d/direct.autofs'' with the line '''/- /etc/auto.direct'''

Create file ''/etc/auto.direct'' with the following contents:

# machine-dependent system directories
/apps -rw,bg clonfs1:/vol/apps/RHEL8_x86_64
/usr/local -rw,bg clonfs1:/vol/local/RHEL8_x86_64
# machine-independent system directories
/home -rw,bg clonfs1:/vol/home
#/work -rw,bg clonfs1-old:/vol/work
/scratch -rw,bg clonfs1:/vol/scratch
# machine-independent clas directories
/usr/downloads -rw,bg clonfs1:/vol/downloads
/usr/clas -rw,bg clonfs1:/vol/clas
/usr/clas12 -rw,bg clonfs1:/vol/clas12
# Used for data storage before shipping to tape
#/logs -rw,bg clonfs1-old:/vol/logs

Restart autofs:

service autofs reload
service autofs restart

Remove from the end of the ''/etc/passwd'' line '''+::::::''', and add following:

hpsrun:x:8796:9998:hpsrun Account:/home/hpsrun:/bin/tcsh
clasrun:x:2508:9998:Online DAQ:/home/clasrun:/bin/tcsh
clasioc:x:6008:9998:CLAS IOCs:/home/clasioc:/bin/tcsh
clas12run:x:6007:146:clas12run Account:/home/clas12run:/bin/tcsh
clascron:x:3888:146:CLAS Cron Jobs:/home/clascron:/bin/tcsh
clasboot:x:6000:146:Boot Scripts Only:/home/clasboot:/bin/tcsh
clasmail:x:6003:146:CLAS Automated Mail:/home/clasmail:/bin/tcsh
epics:x:5001:146:EPICS Account:/home/epics:/bin/tcsh
nagios:x:6246:9997:Nagios:/home/nagios:/bin/tcsh
+@clon_cluster::::::
+sshd::::::
+::::::/bin/false

Update ''/etc/shadow'', adding passwords for local accounts (copy it from another machine).

Add following to ''/etc/group'':

clon:x:383:clascron
onliners:x:9998:abbottd,avakian,baltzell,battagli,brooksw,bruhwel,boiarino,carman,chen,clasboot,clascron,clasrun,cole,cuevas,davidl,danagu,dugger,elton,epics,fklein,gilfoyle,giovanet,golovach,gurjyan,heddle,heyes,hovanes,jacobsg,jenkins,kliv,lcsmith,marki,mestayer,nerses,parkkj,pasyuk,primex,ripani,rossi,saw,staylor,sytnik,taiuti,taylorw,timmer,wooyoung

== RHEL7 (64 bit) ==

Installed using DVD provided by Computer Center, currently RHEL7.3. Requires MAC address to be registered with Computer Center (using jnet.jlab.org as 'boiarino') because it is network-based installation. On DELL servers, hold F2 after power on and go to 'Device Settings' to see mac address. Remember machine memory size as well, will needed when create partitions, find it in 'System BIOS -> Memory Settings'.

'''NOTE: all disks will be reformatted in a process, all information will be lost !'''

Dialog:

* boot: <enter>

* Please enter the hostname of this system: <hostname> <enter>

* What type of system are you building? (D)esktop: <enter>

* Is this a CUE level 1 or CUE level 2 System build (1/2): 2 <enter>

* Please enter the System Admin's CUE username: boiarino <enter>

* Do you want to use the default partitioning scheme (y/n)? n <enter>

* Are you sure you want to use your own partitioning scheme (y/n)? y <enter>

Choose 'Standard Partition' scheme and create following partitions: /boot - 1GB, swap - double memory size, / - the rest of space.

Installation will proceed. When prompted, remove installation disk and reboot machine if not done automatically.

After reboot patching process will be started and it will take a while, do not interrupt it, otherwise system will not be installed correctly.

When machine reboots for the last time, ask Paul Letta to set usual hallb root password. From now on remote root access is possible. Alternatively, user ''boiarino'' can execute most of actions using ''sudo'',
like ''sudo emacs'' for protected files. ''sudo reboot'' etc.

Go to /boot/grub2 and modify file grub.cfg, Linux kernel boot options, adding options ''net.ifnames=0 biosdevname=0'', so your boot string has following section:

..... rhgb net.ifnames=0 biosdevname=0 quiet .....

so whole line looks something like this:

linux16 /vmlinuz-3.10.0-327.18.2.el7.x86_64 root=UUID=b5d1b5ad-e3f6-4db4-8972-aa9c1a91d116 ro vconsole.keymap=us crashkernel=auto vconsole.font=latarcyrheb-sun16 rhgb net.ifnames=0 biosdevname=0 quiet LANG=en_US.UTF-8

Reboot machine, ethernet ports must be named ''eth0'', ''eth1'' etc.

To update manually, use commands ''yum list updates'' and ''yum update''.

'''NOTE:''' add machine to the appropriate '''puppet''' group, it will do all following automatically (hopefully).

'''NOTE:''' on RHEL7.9, RPM EPEL REPO is not enabled by default, which prevents from installing nload, itcl, itk etc. To bring it back, it can be copied it from older machine, for example:

cd /etc/yum.repos.d
scp clondaq7:/etc/yum.repos.d/epel.repo .
cd /etc/pki/rpm-gpg
scp clondaq7:/etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-7 .

Alternatively, following can be used to add repo's:

subscription-manager repos --enable <repo_id>

In particular, following have to be enabled to get nload, xpdf, python-alembic, tix, itcl, itk etc:

subscription-manager repos --enable JLab_EPEL_EPEL_7
subscription-manager repos --enable rhel-7-workstation-optional-rpms

Repo ID's can be obtained by:

subscription-manager repos --list

Installed repo's can be seen by:

yum repolist

'''Yum updates'''

Edit the ''/etc/yum.conf'' file and add the following line to force installation of the 32bit and 64bit libraries:

multilib_policy=all

Install following packages:

yum install xterm mesa-dri-drivers telnet rsh readline-devel net-snmp-utils tigervnc-server tigervnc xpdf nload mariadb-devel libxml2-devel glibc-devel qt-devel python-alembic openssl-devel apr-devel
yum install libconfig-devel # recent addition for CODA libraries

Fonts for EPICS EDMs:

yum install xorg-x11-fonts-75dpi xorg-x11-fonts-ISO8859-1-75dpi bitmap-miscfixed-fonts
yum install bitmap-console-fonts bitmap-fixed-fonts bitmap-lucida-typewriter-fonts
ln -s /usr/share/X11/fonts/100dpi /etc/X11/fontpath.d/xorg-x11-fonts-100dpi:pri=60
ln -s /usr/share/X11/fonts/75dpi /etc/X11/fontpath.d/xorg-x11-fonts-75dpi:pri=50
ln -s /usr/share/X11/fonts/misc /etc/X11/fontpath.d/xorg-x11-fonts-misc:pri=40
ln -s /usr/share/fonts/bitmap /etc/X11/fontpath.d/bitmap-fonts

Do following to be able to compile and run 32-bit apps on 64-bit machine (for compatibility with 32bit applications):

yum install libXpm-devel libXaw-devel motif-devel glibc-devel ncurses-devel readline-devel

Modify file ''/etc/passwd'' adding following:

hpsrun:x:8796:9998:hpsrun Account:/home/hpsrun:/bin/tcsh
clasrun:x:2508:9998:Online DAQ:/home/clasrun:/bin/tcsh
clasioc:x:6008:9998:CLAS IOCs:/home/clasioc:/bin/tcsh
clas12run:x:6007:146:clas12run Account:/home/clas12run:/bin/tcsh
clascron:x:3888:146:CLAS Cron Jobs:/home/clascron:/bin/tcsh
clasboot:x:6000:146:Boot Scripts Only:/home/clasboot:/bin/tcsh
clasmail:x:6003:146:CLAS Automated Mail:/home/clasmail:/bin/tcsh
epics:x:5001:146:EPICS Account:/home/epics:/bin/tcsh
nagios:x:6246:9997:Nagios:/home/nagios:/bin/tcsh
+@clon_cluster::::::
+sshd::::::
+::::::/bin/false

'''Note''': user-related lines must be removed, like

+boiarino::::::

as well as

+::::::

'''Note''': assumed that following line is in already:

+@ccc::::::

'''Note''': if following line exist, it must be placed in the end, or removed:

+::::::/bin/false

Modify file ''/etc/group'' adding following:

onliners::9998:heyes,hujl,rwm,timmer,wolin,taylorw,cuevas,abbottd,abulafia,anciant,anghi,aswin,auger,avakian,banta,barrow,battagli,bjlee,bogdan,brooksw,bruhwel,boiarino,buckle,burchesk,burin,bzh,cetina,chen,cole,cords,corvi,costy,davidl,costy,davidl,dcarter,dcurry,dennisl,deppman,dhlee,doughty,drago,dytman,dugger,dugger,elton,fedro,ficenec,fklein,france,freyberg,gholden,gilfoyle,golovach,gurjyan,haddock,heddle,jenkins,jhardie,jmorris,kellyk,klusman,kmkim,kossov,lcsmith,longhi,manak,marchand,marki,mastersj,mjohnson,mosbackr,mueller,muguira,murphyl,necaise,odonnell,opper,parkkj,pasyuk,phkim,piot,riccardi,richardt,ripani,rossi,saw,sergpozd,serov,sholt,staylor,taiuti,tang,tedeschi,vineyard,vlassov,vvsap,weygand,wooyoung,burchesk,clasrun,giovanet,clasboot,clascoda,clasroot,clasmail,clascron,trigger,epics,southern,carstens,ccutter,danagu,heyes,huertas,jacobsg,kliv,lachniet,mestayer,primex,hovanes,nerses,sytnik,baltzell,carman
clon::383:clascoda,clascron,clasmail
nagios::9997:nagios

Modify file ''/etc/shadow'' using an example from another RHEL7 clon machine (clonioc2 etc). Do ''chmod 600 shadow'' before editing and ''chmod 000 shadow'' after.

Make sure file ''/etc/ssh/sshd_config'' has following line uncommented (must be pushed in by CC security scripts):

##PermitUserEnvironment yes

NOT NEEDED, DONE IN THE END OF FILE ALREADY !!! Uncomment following in file ''/etc/ssh/ssh_config'':

##Host *
##ForwardX11 yes

Add line 'export NO_AT_BRIDGE=1' to the file '/etc/environment' to suppress annoying messages like '** (emacs:38714): WARNING **: Couldn't register with accessibility bus: Did not receive a reply.'

If big (>2GB) partition to be formated, do following (for example /dev/sdb):

parted /dev/sdb
(parted) print
(parted) mklabel gpt
(parted) print
mkpart primary 0GB 25855.2GB
(parted) print
(parted) quit

mkfs.xfs /dev/sdb1

then create /data and mount it using ''/etc/fstab'':

/dev/sdb1 /data xfs defaults 1 2

'''NOTE:''' sometimes machine can loose NIS connection, then ssh to it becomes intermittent; if it happens ssh as root (may have to try several times) and run command

ypwhich

to shows NIS server. If it returns nothing check file ''/etc/resolv.conf'', it must have following (as on July 2019):

search jlab.org acc.jlab.org
nameserver 129.57.90.255
nameserver 129.57.32.101

If file is empty or does not contain right info, fix it. After that run command

ypbind

It should fix a problem. Run ''ypwhich'' to make sure.

'''Display Setting:''' if machine is multi-head, goto ''Applications->System Tools->Settings->Devices->Displays'' and arrange displays.

Proceed to the [[Linux Customization on CLON Cluster]].

== RHEL6 (64 bit) ==

Installed using CD provided by Computer Center. Requires MAC address to be registered with Computer Center (using jnet.jlab.org as 'boiarino') because it is network-based installation.

'''NOTE: all disks will be reformatted in a process, all information will be lost !'''

Dialog:

* boot: <enter>

* ...[D]esktop: [use 's' for server, 'd' for desktop] <enter>

* root password: enter root password

* admin user: boiarino

Installation will proceed. When prompted, remove installation disk and reboot machine if not done automatically. After reboot patching process will be started and it will take a while, do not interrupt it, otherwise system will not be installed correctly.

To make emacs work, install

yum install libotf

Edit the /etc/yum.conf file and add the following line to force installation of teh 32bit and 64bit libraries:

multilib_policy=all

Install following packages:

yum install openmotif-devel xinetd mysql-devel cmake libXpm-devel net-snmp-utils
yum install mesa-libGL-devel mesa-libGLU-devel mesa-libGLw-devel (for OpenGL, needed by ROOT)
yum install libXaw-devel (for xterm)
yum install expat-devel libgcj-devel (for evio/et)

yum install compat-libtermcap (for xterm)
ln -s /lib/libtermcap.so.2 /usr/lib/libtermcap.so
###ln -s /lib64/libtermcap.so.2 /usr/lib64/libtermcap.so

Install following fonts for EPICS EDMs:

yum install xorg-x11-fonts-75dpi xorg-x11-fonts-ISO8859-1-75dpi bitmap-miscfixed-fonts
yum install bitmap-console-fonts bitmap-fixed-fonts bitmap-lucida-typewriter-fonts
ln -s /usr/share/X11/fonts/100dpi /etc/X11/fontpath.d/xorg-x11-fonts-100dpi:pri=60
ln -s /usr/share/X11/fonts/75dpi /etc/X11/fontpath.d/xorg-x11-fonts-75dpi:pri=50
ln -s /usr/share/X11/fonts/misc /etc/X11/fontpath.d/xorg-x11-fonts-misc:pri=40
ln -s /usr/share/fonts/bitmap /etc/X11/fontpath.d/bitmap-fonts

'''NOTE:''' Useful ''yum'' commands:

yum whatprovides libstdc++.so.5 - show which package contains libstdc++.so.5

== RHEL5 ==

Installed using CD provided by Computer Center. Requires MAC address to be registered with Computer Center (email to helpdesk@jlab.org) because it is network-based installation.

Dialog:

* boot: <enter>

* ...[D]esktop: Server (it is ignored, will do Desktop anyway ...)

* root password: enter root password

* system user: <enter>

* manually partition disk: 100MB /boot, 2048 etc MB swap, the rest /.

'''CFENGINE''': there are procesess restoring some system config files (in particular ''/etc/ssh/sshd_config'') in according to the Computer Center - maintained templete. To shut them down: (1) comment out ''cfengine''-related stuff in root cronjobs; (2) do ''/etc/init.d/cfengine stop''; (3) do ''chkconfig cfengine off''. Ask CC (Sherman White, Paul Letta) to fix templete.

Run ''/usr/bin/system-config-authentication'' and set NIS servers list as ''clon00,clon10,nis1''.

Add following in the end of ''/etc/passwd'':
clasrun:x:2508:9998:Online DAQ:/home/clasrun:/bin/tcsh
clas12run:x:6007:146:clas12run Account:/home/clas12run:/bin/tcsh
clascron:x:6005:146:CLAS Cron Jobs:/home/clascron:/bin/tcsh
clasboot:x:6000:146:Boot Scripts Only:/home/clasboot:/bin/tcsh
clasmail:x:6003:146:CLAS Automated Mail:/home/clasmail:/bin/tcsh
epics:x:5001:146:EPICS Account:/home/epics:/bin/tcsh
nagios:x:6246:9997:Nagios:/home/nagios:/bin/tcsh
+@clon_cluster::::::
+@ccc::::::

Add following in the end of ''/etc/group'':
onliners::9998:heyes,hujl,rwm,timmer,wolin,taylorw,cuevas,abbottd,abulafia,anciant,anghi,aswin,auger,avakian,banta,barrow,battagli,bjlee,bogdan,brooksw,bruhwel,boiarino,buckle,burchesk,burin,bzh,cetina,chen,cole,cords,corvi,costy,davidl,costy,davidl,dcarter,dcurry,dennisl,deppman,dhlee,doughty,drago,dytman,dugger,dugger,elton,fedro,ficenec,fklein,france,freyberg,gholden,gilfoyle,golovach,gurjyan,haddock,heddle,jenkins,jhardie,jmorris,kellyk,klusman,kmkim,kossov,lcsmith,longhi,manak,marchand,marki,mastersj,mjohnson,mosbackr,mueller,muguira,murphyl,necaise,odonnell,opper,parkkj,pasyuk,phkim,piot,riccardi,richardt,ripani,rossi,saw,sergpozd,serov,sholt,staylor,taiuti,tang,tedeschi,vineyard,vlassov,vvsap,weygand,wooyoung,burchesk,clasrun,giovanet,clasboot,clascoda,clasroot,clasmail,clascron,trigger,epics,southern,carstens,ccutter,danagu,heyes,huertas,jacobsg,kliv,lachniet,mestayer,primex,hovanes,nerses,sytnik
clon::383:clascoda,clascron,clasmail
nagios::9997:nagios

Create ''/etc/shadow'' files with entries for users clasrun, epics and nagios (copy from another machine).

Install updates: normally all updates should be installed by now, it can be done manually by commands
yum list updates
yum update

Configure [[SSH]].

Install missing packages:
yum install openmotif-devel xinetd mysql-devel cmake

Some additional packages on request (for EPICS):

yum install mc lapack lapack-devel blas blas-devel giflib-devel

Proceed to the [[Linux Customization on CLON Cluster]].

'''PROBLEMS''':

1. /usr/lib/libg2c.so link is missing

FIXED ??? 2. /usr/lib/libXm.so link is missing

3. Created /etc/shadow file for clasrun, epics and nagios

== RHEL4 ==

Get RHEL4 CDs from Paul Letta.

Connect terminal, keyboard and mouse.

Boot from CD1. Follow instructions. When asked, choose following options:

* Choose 'Manually partition with Disk Druid', set /boot to 100MB, then / to 40GB, then swap to 8192MB or at least double memory size. The rest of disk can be set as /space.

* Network: choose manually, type clonpc2.jlab.org; click 'EDIT', deactivate 'Configure using DHCP',
type IP address and netmask (255.255.255.0), click Ok.
Type Gateway (for example 129.57.167.99) and 3 DNS servers (129.57.167.5,129.57.167.14,129.57.32.100).

* Choose 'No firewall'

* Disable 'SELinux'

* Choose 'Customize software packages to be installed', click 'Everything'.

You will be asked to install CD2, CD3 and CD4, then CD1 again.
Then you will be asked to click 'Reboot'. First remove CD, then click 'Reboot'.
You will be asked few more questions. When asked to activate service, choose
'Tell me why I need to register ..' and click 'Next'. Choose 'I can not complete registration ..'
and click 'Next'. You will see 'System user' screen, click 'Use network login..'.
Choose 'Enable NIS support' and click 'Configure NIS'. Type NIS Domain: 'CCCHP' and NIS Server: clon00.jlab.org.
Finish installation process.

* fix files ''/etc/passwd'', ''/etc/shadow'' and ''/etc/group'' adding clasrun etc (see examples on another machines).

'''NOTE''': if machine has multiple network ports, Linux may not assign them properly to specified IP names and addresses. If problem occures, open network GUI and delete all existing records. After that, click ''New'' and pick hadrware port you want to configure from the list of available ports (tricky part is to know which RJ-45 connector corresponds to which port ..). Configure and activate it, make sure it works. Repeat for other ports. Results will be stored in directory ''/etc/sysconfig/network-scripts'', file names will be ''ifcfg-eth0'', ''ifcfg-eth1'' etc. If modifying those files manually, restart network by ''/etc/init.d/network restart''. Finally, set routing, for example for ''clonmon'' command ''route -n'' shows following:
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
129.57.160.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1
129.57.68.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3
129.57.69.0 0.0.0.0 255.255.255.0 U 0 0 0 dev5937
129.57.64.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0
169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth3
0.0.0.0 129.57.68.100 0.0.0.0 UG 0 0 0 eth3
Run following commands:
/sbin/route add -net 129.57.160.0 netmask 255.255.255.0 gw 129.57.160.5 dev eth1
/sbin/route add -net 129.57.68.0 netmask 255.255.255.0 gw 129.57.68.26 dev eth3
/sbin/route add -net 129.57.69.0 netmask 255.255.255.0 gw 129.57.69.206 dev dev5937
/sbin/route add -net 129.57.64.0 netmask 255.255.255.0 gw 129.57.64.57 dev eth0
Now ''route -n'' shows following:
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
129.57.160.0 129.57.160.5 255.255.255.0 UG 0 0 0 eth1
129.57.160.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1
129.57.68.0 129.57.68.26 255.255.255.0 UG 0 0 0 eth3
129.57.68.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3
129.57.69.0 129.57.69.206 255.255.255.0 UG 0 0 0 dev5937
129.57.69.0 0.0.0.0 255.255.255.0 U 0 0 0 dev5937
129.57.64.0 129.57.64.57 255.255.255.0 UG 0 0 0 eth0
129.57.64.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0
169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth3
0.0.0.0 129.57.68.100 0.0.0.0 UG 0 0 0 eth3
In that example automount will do configured using ''clonmon-daq1'' interface, because default ''clonmon'' interface is on external subnet. To make that routing table permanent (retore it after reboot) I tried to add four files with following contents to the ''/etc/sysconfig/network-scripts'' directory:
route-eth1:
GATEWAY0=129.57.160.5
NETMASK0=255.255.255.0
ADDRESS0=129.57.160.0
route-eth3:
GATEWAY0=129.57.68.26
NETMASK0=255.255.255.0
ADDRESS0=129.57.68.0
route-dev5937:
GATEWAY0=129.57.69.206
NETMASK0=255.255.255.0
ADDRESS0=129.57.69.0
route-eth0:
GATEWAY0=129.57.64.57
NETMASK0=255.255.255.0
ADDRESS0=129.57.64.0
It did not worked. Then I added four ''/sbin/route add ..'' lines to ''/etc/rc.local'' script, and it worked.

From now on you can use remote 'ssh' connection.

* To configure your system to use the patch server, issue the following commands as root:
# mount jlabsite:/site /mnt
# /mnt/CC/linux/satellite-connect --patchall
The script will prompt you for an activation key, but if you don't know what this is, just hit ENTER and it will use a sensible default. Depending on how many patches need to be applied to your system to bring it up to the current level, this script may take a very long time to run. When it finishes, you should reboot your machine to make the new patches take effect.

To install updates later run ''up2date -uf'' as ''root''.

Configure [[SSH]].

* Proceed with [[Linux Customization on CLON Cluster]] if applicable.

To boot Linux in single user mode (no graphics), add ''single'' to the end of boot line during boot process.

== '''background info''' ==

'''Add startup script'''

Create script in ''/etc/init.d/'' directory (use existing scripts as example). Must have a line like
# chkconfig: - 91 09
which specifies start and stop order. Run commands
chkconfig --add <scriptname>
chkconfig --level 3 <scriptname> on
for every level you want that script to be executed (usualy 3 and/or 4 and/or 5). Check if it os done using command
chkconfig --list | grep <scriptname>

'''xxx'''

You can choose to download the RHEL operating system directly from the Red Hat Web site and not receive a media kit from HP containing the software. This scenario occurs when the media option AJR is deselected from the order. (The media kit option is always selected by default. )

It is necessary to register at the Red Hat Web site prior to download. Registration requires the activation code that each customer receives from HP when ordering either RHEL.

You can download RHEL for each available platform as four CD ISO images or one DVD ISO image.

Use the following procedure to download RHEL and create the installation media:

1.

Register and log in at the following Red Hat Web site:

www.redhat.com/rhn
2.

Click on channels and then select Red Hat Enterprise Linux ES (v.4 for 64–bit Intel Itanium).
3.

Select Downloads and then download the ISO images of install, compatibility and source disks

Files with ia64 in the name are for the Itanium platform.
4.

Create the CDs or a DVD from the ISO images.

IMPORTANT: Create the CDs or DVD using the contents of the ISO images. Do not create the CDs or DVD by burning the .iso files themselves to CD or DVD. For example, if you are using K3b to burn a CD, click Tools>CD>Burn CD Image, select the .iso image, then click Burn.

'''Bootup scripts''' for example for level 5 execution (multiuser with X):

cp <script-file> /etc/init.d/
chmod +x /etc/init.d/<script-file>
ln -s /etc/init.d/<scriptfile> /etc/rc.d/rc5.d/S50<scriptfile>
ln -s /etc/init.d/<scriptfile> /etc/rc.d/rc5.d/K50<scriptfile>

'''Changing hostname/IP address'''

Changing hostname on RHEL
1. Change the HOSTNAME line in /etc/sysconfig/network
2. Change the hostname (FQDN and alias) in /etc/hosts
3. Run '/bin/hostname new_hostname' for the hostname change to take effect immediately.
4. Run '/sbin/service syslog restart' for syslog to log using the new hostname.
A reboot is not required to change the system hostname.

IP address: You have to change the IP address entry in
/etc/sysconfig/network-scripts/ifcfg-eth0.