CentOS Stream 10
Sponsored Link

Pacemaker : Set LVM Shared Storage2025/02/26
 

Configure Active/Passive HA-LVM (High Availability LVM) volume in Cluster.

This example is based on the environment like follows.
Before this setting, Configure basic settings of Cluster and Configure Fence device first. 

                        +--------------------+
                        | [  ISCSI Target  ] |
                        |    dlp.srv.world   |
                        +---------+----------+
                         10.0.0.30|
                                  |
+----------------------+          |          +----------------------+
| [  Cluster Node#1  ] |10.0.0.51 | 10.0.0.52| [  Cluster Node#2  ] |
|   node01.srv.world   +----------+----------+   node02.srv.world   |
|                      |                     |                      |
+----------------------+                     +----------------------+
[1]

Create a storage for share on ISCSI Target, refer to here.
On this example, it created ISCSI storage as IQN [iqn.2024-12.world.srv:dlp.target02] with [10G] size.

[2] On all Cluster Nodes, Change LVM System ID.
[root@node01 ~]#
vi /etc/lvm/lvm.conf
# line 1410 : uncomment and change

system_id_source = "
uname
"
[3] On a Node in Cluster, Set LVM on shared storage.
[sdb] on the example below is shared storage from ISCSI Target.
# current session

[root@node01 ~]#
iscsiadm -m session -o show

tcp: [1] 10.0.0.30:3260,1 iqn.2024-12.world.srv:dlp.target01 (non-flash)
# discover

[root@node01 ~]#
iscsiadm -m discovery -t sendtargets -p 10.0.0.30

10.0.0.30:3260,1 iqn.2024-12.world.srv:dlp.target01
10.0.0.30:3260,1 iqn.2024-12.world.srv:dlp.target02
# login

[root@node01 ~]#
iscsiadm -m node --login --target iqn.2024-12.world.srv:dlp.target02
[root@node01 ~]#
iscsiadm -m session -o show

tcp: [1] 10.0.0.30:3260,1 iqn.2024-12.world.srv:dlp.target01 (non-flash)
tcp: [2] 10.0.0.30:3260,1 iqn.2024-12.world.srv:dlp.target02 (non-flash)
# set LVM

[root@node01 ~]#
parted --script /dev/sdb "mklabel gpt"

[root@node01 ~]#
parted --script /dev/sdb "mkpart primary 0% 100%"

[root@node01 ~]#
parted --script /dev/sdb "set 1 lvm on"
# create physical volume

[root@node01 ~]#
pvcreate /dev/sdb1 

  Physical volume "/dev/sdb1" successfully created.
# create volume group

[root@node01 ~]#
vgcreate --setautoactivation n vg_ha /dev/sdb1 

  Volume group "vg_ha" successfully created with system ID node01.srv.world
# confirm the value of [System ID] equals the value of [$ uname -n]

[root@node01 ~]#
vgs -o+systemid 

  VG    #PV #LV #SN Attr   VSize   VFree  System ID
  cs      1   2   0 wz--n- <29.00g     0
  vg_ha   1   0   0 wz--n-  <9.98g <9.98g node01.srv.world
# create logical volume

[root@node01 ~]#
lvcreate -l 100%FREE -n lv_ha vg_ha 

  Logical volume "lv_ha" created.
# format with ext4

[root@node01 ~]#
mkfs.ext4 /dev/vg_ha/lv_ha
[4] On other Nodes except a Node of [3], Scan LVM volumes to find new volume.
[root@node02 ~]#
iscsiadm -m session -o show

tcp: [1] 10.0.0.30:3260,1 iqn.2024-12.world.srv:dlp.target01 (non-flash)
[root@node02 ~]#
iscsiadm -m discovery -t sendtargets -p 10.0.0.30

10.0.0.30:3260,1 iqn.2024-12.world.srv:dlp.target01
10.0.0.30:3260,1 iqn.2024-12.world.srv:dlp.target02
[root@node02 ~]#
iscsiadm -m node --login --target iqn.2024-12.world.srv:dlp.target02
[root@node02 ~]#
iscsiadm -m session -o show

tcp: [1] 10.0.0.30:3260,1 iqn.2024-12.world.srv:dlp.target01 (non-flash)
tcp: [2] 10.0.0.30:3260,1 iqn.2024-12.world.srv:dlp.target02 (non-flash)
[root@node02 ~]#
lvmdevices --adddev /dev/sdb1

[root@node02 ~]#
lvm pvscan --cache --activate ay 

  pvscan[16413] PV /dev/vda3 online, VG cs is complete.
  pvscan[16413] PV /dev/sdb1 ignore foreign VG.
  pvscan[16413] VG cs run autoactivation.
  2 logical volume(s) in volume group "cs" now active
[5] On a Node of [3], Set shared storage as a Cluster resource.
# [lvm_ha] : any name
# [vgname=***] : volume group name
# [group] : any name

[root@node01 ~]#
pcs resource create lvm_ha ocf:heartbeat:LVM-activate vgname=vg_ha vg_access_mode=system_id group ha_group --future

# confirm status
# OK if LVM resource is [Started]

[root@node01 ~]#
pcs status 

Cluster name: ha_cluster
Cluster Summary:
  * Stack: corosync (Pacemaker is running)
  * Current DC: node01.srv.world (version 3.0.0-5.el10-1353d31) - partition with quorum
  * Last updated: Wed Feb 26 09:28:12 2025 on node01.srv.world
  * Last change:  Wed Feb 26 09:27:56 2025 by root via root on node01.srv.world
  * 2 nodes configured
  * 2 resource instances configured

Node List:
  * Online: [ node01.srv.world node02.srv.world ]

Full List of Resources:
  * scsi-shooter        (stonith:fence_scsi):    Started node01.srv.world
  * Resource Group: ha_group:
    * lvm_ha    (ocf:heartbeat:LVM-activate):    Started node01.srv.world

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled
# set [lvm_ha] and [scsi-shooter] start on a same node

[root@node01 ~]#
pcs constraint colocation add lvm_ha with scsi-shooter

[root@node01 ~]#
pcs status 

Cluster name: ha_cluster
Cluster Summary:
  * Stack: corosync (Pacemaker is running)
  * Current DC: node01.srv.world (version 3.0.0-5.el10-1353d31) - partition with quorum
  * Last updated: Wed Feb 26 09:30:29 2025 on node01.srv.world
  * Last change:  Wed Feb 26 09:30:24 2025 by root via root on node01.srv.world
  * 2 nodes configured
  * 2 resource instances configured

Node List:
  * Online: [ node01.srv.world node02.srv.world ]

Full List of Resources:
  * scsi-shooter        (stonith:fence_scsi):    Started node01.srv.world
  * Resource Group: ha_group:
    * lvm_ha    (ocf:heartbeat:LVM-activate):    Started node01.srv.world

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled
Matched Content