CentOS Stream 9
Sponsored Link

OpenStack Caracal : Use Cinder Storage (LVM)2024/08/07

 

It's possible to use Virtual Storages provided by Cinder if an Instance needs more disks.

Configure Virtual storage with LVM backend on here.
It needs there are some free space on disks of Storage Node.

------------+--------------------------+--------------------------+------------
            |                          |                          |
        eth0|10.0.0.30             eth0|10.0.0.50             eth0|10.0.0.51
+-----------+-----------+  +-----------+-----------+  +-----------+-----------+
|   [ dlp.srv.world ]   |  | [ network.srv.world ] |  |  [ node01.srv.world ] |
|     (Control Node)    |  |     (Network Node)    |  |     (Compute Node)    |
|                       |  |                       |  |                       |
|  MariaDB    RabbitMQ  |  |      Open vSwitch     |  |        Libvirt        |
|  Memcached  Nginx     |  |     Neutron Server    |  |      Nova Compute     |
|  Keystone   httpd     |  |      OVN-Northd       |  |      Open vSwitch     |
|  Glance     Nova API  |  |  Nginx  iSCSI Target  |  |   OVN Metadata Agent  |
|  Cinder API           |  |     Cinder Volume     |  |     OVN-Controller    |
+-----------------------+  +-----------------------+  +-----------------------+

[1] Create a volume group for Cinder on Storage Node.
[root@network ~]#
pvcreate /dev/sdb1

Physical volume "/dev/sdb1" successfully created
[root@network ~]#
vgcreate -s 32M vg_volume01 /dev/sdb1

Volume group "vg_volume01" successfully created
[2] Configure Cinder Volume on Storage Node.
[root@network ~]#
vi /etc/cinder/cinder.conf
# add follows into [DEFAULT] section

enabled_backends = lvm

# add follows to last line
[lvm]
target_helper = lioadm
target_protocol = iscsi
target_ip_address = $my_ip
# volume group name just created
volume_group = vg_volume01
volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver
volumes_dir = $state_path/volumes

[root@network ~]#
systemctl restart openstack-cinder-volume

[3] On Storage Node, If Firewalld is running, allow service ports.
[root@network ~]#
firewall-cmd --add-service=iscsi-target

success
[root@network ~]#
firewall-cmd --runtime-to-permanent

success
[4] Configure Nova on Compute Node.
[root@node01 ~]#
vi /etc/nova/nova.conf
# add into the [keystone_authtoken] section
[keystone_authtoken]
.....
.....
service_token_roles = service
service_token_roles_required = true

# add to last line
[service_user]
send_service_user_token = true
auth_url = https://dlp.srv.world:5000
auth_type = password
project_domain_name = Default
user_domain_name = Default
project_name = service
username = nova
password = servicepassword
insecure = false

[cinder]
os_region_name = RegionOne

[root@node01 ~]#
systemctl restart openstack-nova-compute
# if SELinux enabled, change policy like follows

[root@node01 ~]#
vi iscsiadm.te
# create new

module iscsiadm 1.0;

require {
        type iscsid_t;
        class capability dac_override;
}

#============= iscsid_t ==============
allow iscsid_t self:capability dac_override;

[root@node01 ~]#
checkmodule -m -M -o iscsiadm.mod iscsiadm.te

[root@node01 ~]#
semodule_package --outfile iscsiadm.pp --module iscsiadm.mod

[root@node01 ~]#
semodule -i iscsiadm.pp

[5] Login as an openstack user and add volumes to your instances.
For example, create a virtual disk [disk01] with 10GB.
It's OK to work on any node. (example below is on Control Node)
# set environment variable

[cent@dlp ~(keystone)]$
echo "export OS_VOLUME_API_VERSION=3" >> ~/keystonerc

[cent@dlp ~(keystone)]$
source ~/keystonerc
[cent@dlp ~(keystone)]$
openstack volume create --size 10 disk01

+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| attachments         | []                                   |
| availability_zone   | nova                                 |
| bootable            | false                                |
| consistencygroup_id | None                                 |
| created_at          | 2024-08-07T01:22:28.718832           |
| description         | None                                 |
| encrypted           | False                                |
| id                  | efcd48f8-51ca-41a2-8544-e04e5aa1c64d |
| multiattach         | False                                |
| name                | disk01                               |
| properties          |                                      |
| replication_status  | None                                 |
| size                | 10                                   |
| snapshot_id         | None                                 |
| source_volid        | None                                 |
| status              | creating                             |
| type                | __DEFAULT__                          |
| updated_at          | None                                 |
| user_id             | 8a9b46168b42480f889ad4fad3ca6ee4     |
+---------------------+--------------------------------------+

[cent@dlp ~(keystone)]$
openstack volume list

+--------------------------------------+--------+-----------+------+-------------+
| ID                                   | Name   | Status    | Size | Attached to |
+--------------------------------------+--------+-----------+------+-------------+
| efcd48f8-51ca-41a2-8544-e04e5aa1c64d | disk01 | available |   10 |             |
+--------------------------------------+--------+-----------+------+-------------+
[6] Attach the virtual disk to an Instance.
For the example below, the disk is connected as [/dev/vdb]. It's possible to use it as a storage to create a file system on it.
[cent@dlp ~(keystone)]$
openstack server list

+--------------------------------------+------------+---------+------------------------------------+----------------+----------+
| ID                                   | Name       | Status  | Networks                           | Image          | Flavor   |
+--------------------------------------+------------+---------+------------------------------------+----------------+----------+
| 1d0c2140-098d-4a1a-a705-82d7755d7c84 | CentOS-St9 | SHUTOFF | private=10.0.0.250, 192.168.100.65 | CentOS-Stream9 | m1.small |
+--------------------------------------+------------+---------+------------------------------------+----------------+----------+

[cent@dlp ~(keystone)]$
openstack server add volume CentOS-St9 disk01

+-----------------------+--------------------------------------+
| Field                 | Value                                |
+-----------------------+--------------------------------------+
| ID                    | efcd48f8-51ca-41a2-8544-e04e5aa1c64d |
| Server ID             | 1d0c2140-098d-4a1a-a705-82d7755d7c84 |
| Volume ID             | efcd48f8-51ca-41a2-8544-e04e5aa1c64d |
| Device                | /dev/vdb                             |
| Tag                   | None                                 |
| Delete On Termination | False                                |
+-----------------------+--------------------------------------+

# the status of attached disk turns [in-use] like follows

[cent@dlp ~(keystone)]$
openstack volume list

+--------------------------------------+--------+--------+------+-------------------------------------+
| ID                                   | Name   | Status | Size | Attached to                         |
+--------------------------------------+--------+--------+------+-------------------------------------+
| efcd48f8-51ca-41a2-8544-e04e5aa1c64d | disk01 | in-use |   10 | Attached to CentOS-St9 on /dev/vdb  |
+--------------------------------------+--------+--------+------+-------------------------------------+

# detach the disk

[cent@dlp ~(keystone)]$
openstack server remove volume CentOS-St9 disk01

Matched Content