Sv translation

language	en

Warning

title	Advanced Topic

Warning - this is an advanced topic. Always backup your data first.

Preparation

Add a new disk to both machines of EXACTLY the same size and configuration in the virtual environment.

It is also possible to use a new partition on an existing disk whose size has been increased, but this is not covered here.

The commands below assume that /dev/sdc will be used to increase the size of the storage in a DRBD on top of LVM configuration.

Rescan the SCSI Bus to display the drive

Sometimes the system will not see the new disk immediately. To achieve this without a reboot, run the following command to rescan the SCSI bus.

Translations Ignore

Code Block

title	Rescan SCSI Bus

# Check if the disk is there
ls /dev/sd*
 
# Expected output (includes /dev/sdc)
/dev/sda  /dev/sda1  /dev/sda2  /dev/sdb  /dev/sdc
 
# If not, rescan SCSI and repeat above
echo "- - -" > /sys/class/scsi_host/host0/scan

Make one node Secondary

Determine which node is servicing the SMB share with pcs status, and then on the non sevicing node:

Translations Ignore

Code Block

# Determine which node is servicing the share
pcs status
 
# Standby the server on which the resources are NOT running
pcs cluster standby acd-store2
 
# Run this command on the STANDBY machine
drbdadm secondary jtelshared

Create LVM Physical Volume, Extend the Volume Group and the Logical Volume (Both Nodes)

Translations Ignore

Code Block

# Create the phsyical volume - this is based on sdc assuming it is the third drive on the system
lvm pvcreate /dev/sdc

# Extend the volume group
lvm vgextend "vg_drbd_jtelshared" /dev/sdc

# Create the logical volume
lvm

lvcreate

lvresize -l +100%FREE /dev/vg_drbd_jtelshared

-n

/lv_drbd_jtelshared

...

Extend the DRBD Resource (Primary Node Only)

Translations Ignore

Code Block
#

Prepare

Extend the DRBD

firewall

resource

firewall-cmd

drbdadm --

zone=public

--

add-port=7788-7799/tcp --permanent firewall-cmd --reload

...

assume-clean resize jtelshared

Resize the FileSystem (Primary Node Only)

Translations Ignore

Code Block
# Resize

Install

File

elrepo rpm --import https://www.elrepo.org/RPM-GPG-KEY-elrepo.org rpm -Uvh http://www.elrepo.org/elrepo-release-7.0-3.el7.elrepo.noarch.rpm

Install and enable DRBD (Both Nodes)

Code Block
# Install DRBD yum -y install drbd84-utils kmod-drbd84 lsof # Enable drbd at boot, and in this session systemctl enable drbd systemctl start drbd

Configure DRBD (Both Nodes)

NOTE: The following commands requires the hostname of both machines and the IP Address. These are obtained as follows:

Code Block
ip addr hostname

Create a DRBD config file for jtelshared on /dev/sdb

Code Block

title	/etc/drbd.d/jtelshared.res

# Configure DRBD
cat <<EOFF > /etc/drbd.d/jtelshared.res
resource jtelshared {
    protocol C;
    meta-disk internal;
    device /dev/drbd0;
    syncer {
        verify-alg sha1;
    }
    net {
        allow-two-primaries;
    }
    on acd-store1.jtel.local {
        disk   /dev/vg_drbd_jtelshared/lv_drbd_jtelshared;
        address 10.42.14.98:7789;
    }
    on acd-store2.jtel.local {
        disk   /dev/vg_drbd_jtelshared/lv_drbd_jtelshared;
        address 10.42.14.198:7789;
    }
    startup {
        become-primary-on both;
    }
}
EOFF

Note: it has been observed, that the fully qualified host name is required in the configuration file.

Create Metadata and start (Both Nodes)

Code Block
# Create metadata and start DRBD drbdadm create-md jtelshared drbdadm up jtelshared

Make one node primary (First Node)

Code Block
drbdadm primary jtelshared --force

Tune the transfer (Second Node)

Code Block
drbdadm disk-options --c-plan-ahead=0 --resync-rate=110M jtelshared

Wait for initial sync to complete (Either Node)

Code Block

cat /proc/drbd
 
-->
 
# When not yet done:
 
version: 8.4.10-1 (api:1/proto:86-101)
GIT-hash: a4d5de01fffd7e4cde48a080e2c686f9e8cebf4c build by mockbuild@, 2017-09-15 14:23:22

 1: cs:SyncTarget ro:Secondary/Primary ds:Inconsistent/UpToDate C r-----
    ns:0 nr:3955712 dw:3950592 dr:0 al:8 bm:0 lo:5 pe:0 ua:5 ap:0 ep:1 wo:f oos:264474588
        [>....................] sync'ed:  1.5% (258272/262132)M
        finish: 2:08:08 speed: 34,388 (25,652) want: 112,640 K/sec


-->

# When done:

version: 8.4.10-1 (api:1/proto:86-101)
GIT-hash: a4d5de01fffd7e4cde48a080e2c686f9e8cebf4c build by mockbuild@, 2017-09-15 14:23:22

 1: cs:Connected ro:Secondary/Primary ds:UpToDate/UpToDate C r-----
    ns:0 nr:15626582 dw:284051762 dr:0 al:8 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0

Untune the transfer and make primary (Second Node)

Code Block
drbdadm adjust jtelshared drbdadm primary jtelshared

Create filesystem (First Node)

Code Block
mkfs.xfs -L data /dev/drbd/by-res/jtelshared/0

Create fstab entry for file system (Both Nodes)

Add the following line to /etc/fstab

Code Block
/dev/drbd/by-res/jtelshared/0 /srv/jtel/shared xfs noauto,noatime,nodiratime 0 0

Mount the file system (First Node)

Code Block
mkdir /srv/jtel mkdir /srv/jtel/shared chown -R jtel:jtel /srv/jtel mount /srv/jtel/shared

Create a test file and Unmount (First Node)

Code Block
cat <<EOFF > /srv/jtel/shared/test.txt test 123 EOFF umount /srv/jtel/shared

Mount the file system and check the test file (Second Node)

Code Block

mkdir /srv/jtel
mkdir /srv/jtel/shared
chown -R jtel:jtel /srv/jtel
mount /srv/jtel/shared
cat /srv/jtel/shared/test.txt
 
# Check contents of file before proceeding
 
rm /srv/jtel/shared/test.txt
umount /srv/jtel/shared

Install Samba and lsof (Both Nodes)

Code Block

title	Install SAMBA

yum -y install samba samba-client lsof

Configure Samba (Both Nodes)

Code Block

title	Configure SAMBA

cat <<EOFF > /etc/samba/smb.conf
[global]
        workgroup = SAMBA
        security = user
        passdb backend = tdbsam
        printing = cups
        printcap name = cups
        load printers = yes
        cups options = raw
        min protocol = NT1
        ntlm auth = yes

[homes]
        comment = Home Directories
        valid users = %S, %D%w%S
        browseable = No
        read only = No
        inherit acls = Yes

[printers]
        comment = All Printers
        path = /var/tmp
        printable = Yes
        create mask = 0600
        browseable = No

[print$]
        comment = Printer Drivers
        path = /var/lib/samba/drivers
        write list = root
        create mask = 0664
        directory mask = 0775

[shared]
    comment = jtel ACD Shared Directory
    read only = no
    public = yes
    writable = yes
    locking = yes
    path = /srv/jtel/shared
    guest ok = yes
    create mask = 0644
    directory mask = 0755
    force user = jtel
    force group = jtel
    acl allow execute always = True

EOFF

Setup SeLinux, jtel User access and Firewall for Samba (Both Nodes)

Code Block

title	SeLinux, jtel User, Firewall

setsebool -P samba_enable_home_dirs=on samba_export_all_rw=on use_samba_home_dirs=on use_nfs_home_dirs=on
printf 'fireball\nfireball\n' | smbpasswd -a -s jtel
firewall-cmd --zone=public --add-port=445/tcp --add-port=139/tcp --add-port=138/udp --add-port=137/udp --permanent
firewall-cmd --reload

If necessary, add further users to samba:

Code Block

title	More SAMBA users

useradd -m Administrator
printf 'F1r3B²11\nF1r3B²11\n' | smbpasswd -a -s Administrator

Test SAMBA (Both Nodes)

This test should be performed on the node which currently has /srv/jtel/shared mounted:

Code Block

title	Test SAMBA

mount /srv/jtel/shared
service nmb start
service smb start

 
# Now check access to the SMB share via (for example) one of the windows machines.
 
service smb stop
umount /srv/jtel/shared
 
# do same again on other node

Unmount and disable SAMBA (Both Nodes)

Code Block

title	Unmount

service smb stop
umount /srv/jtel/shared
systemctl disable smb

Install PCS Services (Both Nodes)

See Redundancy - Installing PCS Cluster.

Setup virtual IP (One Node Only!)

Change the following to set the virtual IP which should be shared between the nodes.

Code Block

title	Set virtual IP

KE_VIP=10.4.8.22

Configure PCS Resources (One Node Only!)

Configure the PCS resources with the following commands:

System
xfs_growfs /dev/drbd/by-res/jtelshared/0

Make Secondary Node Primary and Unstandby in Cluster (Secondary Node Only)

Translations Ignore

Code Block
# Back to primary drbdadm primary jtelshared # Back to unstandby pcs cluster unstandby acd-store2

Check the Results (Primary Node Only)

Translations Ignore

Code Block
df -h

Sv translation

language	de

Status

colour	Red
title	This page is only available in English

Sv translation

language	fr

Warning

title	Sujet avancé

Attention - il s'agit d'un sujet avancé. Sauvegardez toujours vos données en premier.

Préparation

Ajouter un nouveau disque aux deux machines de taille et de configuration EXACTEMENT identiques dans l'environnement virtuel.

Il est également possible d'utiliser une nouvelle partition sur un disque existant dont la taille a été augmentée, mais ce point n'est pas abordé ici.

Les commandes ci-dessous supposent que /dev/sdc sera utilisé pour augmenter la taille du stockage dans un DRBD en plus de la configuration LVM.

Rescanner le bus SCSI pour afficher le lecteur

Parfois, le système ne voit pas le nouveau disque immédiatement. Pour y parvenir sans redémarrer le système, exécutez la commande suivante pour ré-analyser le bus SCSI.

Translations Ignore

Code Block

title	Réanalyser le bus SCSI

# Vérifiez si le disque est là ls /dev/sd* # Sortie attendue (y compris /dev/sdc) /dev/sda /dev/sda1 /dev/sda2 /dev/sdb /dev/sdc # Si ce n'est pas le cas, rescannez le SCSI et répétez l'écho ci-dessus "- - -" > /sys/class/scsi_host/host0/scan

Faire un nœud secondaire

Déterminez quel nœud dessert la part de la SMB avec le statut pcs, puis sur le nœud non desservi:

Translations Ignore

Code Block

# Déterminer quel nœud dessert le share pcs status # Mettre en veille le serveur sur lequel les ressources ne tournent PAS pcs cluster standby acd-store2 # Exécuter cette commande sur la machine STANDBY drbdadm secondary jtelshared

Créer le volume physique LVM, étendre le groupe de volume et le volume logique (les deux nœuds)

Translations Ignore

Code Block

# Créer le volume physique - ceci est basé sur sdc en supposant que c'est le troisième lecteur du système lvm pvcreate /dev/sdc # Etendre le groupe de volume lvm vgextend "vg_drbd_jtelshared" /dev/sdc # Créer le volume logique lvm lvresize -l +100%FREE /dev/vg_drbd_jtelshared/lv_drbd_jtelshared

Étendre la ressource DRBD (nœud primaire uniquement)

Translations Ignore

Code Block
# Étendre la ressource DRBD drbdadm -- --assume-clean resize jtelshared

Redimensionner le système de fichiers (nœud primaire uniquement)

Translations Ignore

Code Block
# Redimensionner le système de fichiers xfs_growfs

Code Block

title	Configure PCS Resources

pcs resource create ClusterDataJTELSharedMount ocf:heartbeat:Filesystem device="

/dev/drbd/by-res/jtelshared/0

" directory="/srv/jtel/shared" fstype="xfs" --group=jtel_portal_group pcs resource create ClusterIP ocf:heartbeat:IPaddr2 ip=${KE_VIP} cidr_netmask=32 op monitor interval=30s --group=jtel_portal_group pcs resource create samba systemd:smb op monitor interval=30s --group=jtel_portal_group pcs constraint order start ClusterDataJTELSharedMount then ClusterIP pcs constraint order start ClusterIP then samba

Test

Test as follows:

Code Block

title	Test pcs status

pcs status
 
--> shows the status of the newly created resources on both nodes, one node should be active. 
 
Cluster name: portal
Stack: corosync
Current DC: uk-acd-store2 (version 1.1.16-12.el7_4.8-94ff4df) - partition with quorum
Last updated: Mon Mar 19 15:40:24 2018
Last change: Mon Mar 19 15:40:16 2018 by root via cibadmin on uk-acd-store1

2 nodes configured
3 resources configured

Online: [ uk-acd-store1 uk-acd-store2 ]

Full list of resources:

 Resource Group: jtel_portal_group
     ClusterDataJTELSharedMount (ocf::heartbeat:Filesystem):    Started uk-acd-store1
     ClusterIP  (ocf::heartbeat:IPaddr2):       Started uk-acd-store1
     samba      (systemd:smb):  Started uk-acd-store1

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled

Test the file mount:

Code Block

title	Test file mount

# From the windows machines:
 
dir \\uk-acd-store\shared

Test manual failover:

Code Block

title	Test file mount

# Failover to node 2
pcs cluster standby uk-acd-store1 
 
# ... (wait)
 
pcs status
 
# Then test the availability of the files from the windows machines.
# Create a new file before failing back (to make sure DRBD working ok).
 
# Fail back to node 1
pcs cluster unstandby uk-acd-store1
pcs cluster standby uk-acd-store2
 
# ... (wait)

pcs status

# Then test the availability of the files from the windows machines.
# Check that the new file created above is available.
 
# Unstandby node 2

pcs cluster unstandby uk-acd-store2

Manually link /home/jtel/shared (Both Nodes)

Rendre le nœud secondaire primaire et le mettre en veille dans le cluster (nœud secondaire uniquement)

Translations Ignore

Code Block
# Retour au fichier principal drbdadm primary jtelshared # Retour au fichier non standard pcs cluster unstandby acd-store2

Vérifier les résultats (nœud primaire uniquement)

Translations Ignore

Code Block
df -h

Code Block

title	link /home/jtel/shared

ln -s /srv/jtel/shared /home/jtel/shared

Page tree

Page History

Versions Compared

Old Version 1

New Version Current

Key

Preparation

Rescan the SCSI Bus to display the drive

Make one node Secondary

Create LVM Physical Volume, Extend the Volume Group and the Logical Volume (Both Nodes)

Extend the DRBD Resource (Primary Node Only)

Resize the FileSystem (Primary Node Only)

Install and enable DRBD (Both Nodes)

Configure DRBD (Both Nodes)

Create Metadata and start (Both Nodes)

Make one node primary (First Node)

Tune the transfer (Second Node)

Wait for initial sync to complete (Either Node)

Untune the transfer and make primary (Second Node)

Create filesystem (First Node)

Create fstab entry for file system (Both Nodes)

Mount the file system (First Node)

Create a test file and Unmount (First Node)

Mount the file system and check the test file (Second Node)

Install Samba and lsof (Both Nodes)

Configure Samba (Both Nodes)

Setup SeLinux, jtel User access and Firewall for Samba (Both Nodes)

Test SAMBA (Both Nodes)

Unmount and disable SAMBA (Both Nodes)

Install PCS Services (Both Nodes)

Setup virtual IP (One Node Only!)

Configure PCS Resources (One Node Only!)

Make Secondary Node Primary and Unstandby in Cluster (Secondary Node Only)

Check the Results (Primary Node Only)

Préparation

Rescanner le bus SCSI pour afficher le lecteur

Faire un nœud secondaire

Créer le volume physique LVM, étendre le groupe de volume et le volume logique (les deux nœuds)

Étendre la ressource DRBD (nœud primaire uniquement)

Redimensionner le système de fichiers (nœud primaire uniquement)

Test

Manually link /home/jtel/shared (Both Nodes)

Rendre le nœud secondaire primaire et le mettre en veille dans le cluster (nœud secondaire uniquement)

Vérifier les résultats (nœud primaire uniquement)