OpenStack Zed : How to use Manila (Local Device)2023/06/29 |
|
This is How to use OpenStack Shared File System (Manila).
This example is based on the environment like follows.
For example, Configure a local block device as a shared storage on Storage Node and use it on Instances.
Therefore, it needs there is a free block device on Storage Node.
------------+--------------------------+--------------------------+------------
| | |
eth0|10.0.0.30 eth0|10.0.0.50 eth0|10.0.0.51
+-----------+-----------+ +-----------+-----------+ +-----------+-----------+
| [ dlp.srv.world ] | | [ network.srv.world ] | | [ node01.srv.world ] |
| (Control Node) | | (Network Node) | | (Compute Node) |
| | | | | |
| MariaDB RabbitMQ | | Neutron L2/L3 Agent | | Libvirt |
| Memcached Nginx | | Neutron Metadata | | Nova Compute |
| Keystone httpd | | Open vSwitch | | Neutron L2 Agent |
| Glance Nova API | | iSCSI Target | | Open vSwitch |
| Neutron Server | | Cinder Volume | | |
| Neutron Metadata | | Manila Share | | |
| Cinder API Manila API | | | | |
+-----------------------+ +-----------------------+ +-----------------------+
|
| [1] | Configure Storage Node. |
|
root@network:~#
apt -y install lvm2 nfs-kernel-server # create a volume for Manila on free block device root@network:~# pvcreate /dev/sdc1 Physical volume "/dev/sdc1" successfully created root@network:~# vgcreate manila-volumes /dev/sdc1 Volume group "manila-volumes" successfully created
root@network:~#
vi /etc/manila/manila.conf # add follows into [DEFAULT] section
enabled_share_backends = lvm
# add to the end [lvm] share_backend_name = LVM share_driver = manila.share.drivers.lvm.LVMShareDriver driver_handles_share_servers = False lvm_share_volume_group = manila-volumes lvm_share_export_ips = $my_ip systemctl restart manila-share nfs-server root@network:~# systemctl enable manila-share nfs-server
|
| [2] | Create a default share type. It's OK to work on any node. (example below is on Control Node) |
|
root@dlp ~(keystone)# manila type-create default_share_type False +----------------------+--------------------------------------+ | Property | Value | +----------------------+--------------------------------------+ | ID | edc01ccb-d197-4d40-8964-9ab8f34ec087 | | Name | default_share_type | | Visibility | public | | is_default | YES | | required_extra_specs | driver_handles_share_servers : False | | optional_extra_specs | | | Description | None | +----------------------+--------------------------------------+root@dlp ~(keystone)# manila type-list +--------------------------------------+--------------------+------------+------------+--------------------------------------+----------------------+-------------+ | ID | Name | visibility | is_default | required_extra_specs | optional_extra_specs | Description | +--------------------------------------+--------------------+------------+------------+--------------------------------------+----------------------+-------------+ | edc01ccb-d197-4d40-8964-9ab8f34ec087 | default_share_type | public | YES | driver_handles_share_servers : False | | None | +--------------------------------------+--------------------+------------+------------+--------------------------------------+----------------------+-------------+ |
| [3] | Login as a common user to create Manila NFS Share. |
|
debian@dlp ~(keystone)$ manila create NFS 10 --name share01 --share-type default_share_type
+---------------------------------------+--------------------------------------+
| Property | Value |
+---------------------------------------+--------------------------------------+
| id | b6699c78-14b2-4f73-918c-a14b616a3d64 |
| size | 10 |
| availability_zone | None |
| created_at | 2023-06-29T07:31:26.732412 |
| status | creating |
| name | share01 |
| description | None |
| project_id | 1c2f5dc8c4f9494fbaaa4217c8e3585a |
| snapshot_id | None |
| share_network_id | None |
| share_proto | NFS |
| metadata | {} |
| share_type | edc01ccb-d197-4d40-8964-9ab8f34ec087 |
| is_public | False |
| snapshot_support | False |
| task_state | None |
| share_type_name | default_share_type |
| access_rules_status | active |
| replication_type | None |
| has_replicas | False |
| user_id | de51d5f0ee2c485885877d21f5b424e0 |
| create_share_from_snapshot_support | False |
| revert_to_snapshot_support | False |
| share_group_id | None |
| source_share_group_snapshot_member_id | None |
| mount_snapshot_support | False |
| progress | None |
| is_soft_deleted | False |
| scheduled_to_be_deleted_at | None |
+---------------------------------------+--------------------------------------+
# OK if the Status turns to [available] after a few minutes debian@dlp ~(keystone)$ manila list +--------------------------------------+---------+------+-------------+-----------+-----------+--------------------+------+-------------------+ | ID | Name | Size | Share Proto | Status | Is Public | Share Type Name | Host | Availability Zone | +--------------------------------------+---------+------+-------------+-----------+-----------+--------------------+------+-------------------+ | b6699c78-14b2-4f73-918c-a14b616a3d64 | share01 | 10 | NFS | available | False | default_share_type | | nova | +--------------------------------------+---------+------+-------------+-----------+-----------+--------------------+------+-------------------+ |
| [4] | That's OK, you can use Manila Shared filesystem on your own instances like follows. |
|
debian@dlp ~(keystone)$ openstack server list +--------------------------------------+-----------+---------+------------------------------------+----------+-----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+-----------+---------+------------------------------------+----------+-----------+ | c3a4a792-a7ac-41bd-8c93-7fd162016f22 | Debian-12 | SHUTOFF | private=10.0.0.241, 192.168.100.66 | Debian12 | m1.medium | +--------------------------------------+-----------+---------+------------------------------------+----------+-----------+ # set access permission first debian@dlp ~(keystone)$ manila access-allow share01 ip 10.0.0.0/24 --access-level rw
+--------------+--------------------------------------+
| Property | Value |
+--------------+--------------------------------------+
| id | 2d825bb3-fa3a-4c33-9130-be0c978a26f9 |
| share_id | b6699c78-14b2-4f73-918c-a14b616a3d64 |
| access_level | rw |
| access_to | 10.0.0.0/24 |
| access_type | ip |
| state | queued_to_apply |
| access_key | None |
| created_at | 2023-06-29T07:32:46.767256 |
| updated_at | None |
| metadata | {} |
+--------------+--------------------------------------+
# OK if State turns to [active] debian@dlp ~(keystone)$ manila access-list share01 +--------------------------------------+-------------+-------------+--------------+--------+------------+----------------------------+------------+ | id | access_type | access_to | access_level | state | access_key | created_at | updated_at | +--------------------------------------+-------------+-------------+--------------+--------+------------+----------------------------+------------+ | 2d825bb3-fa3a-4c33-9130-be0c978a26f9 | ip | 10.0.0.0/24 | rw | active | None | 2023-06-29T07:32:46.767256 | None | +--------------------------------------+-------------+-------------+--------------+--------+------------+----------------------------+------------+
debian@dlp ~(keystone)$
openstack server start Debian-12 # confirm access Path debian@dlp ~(keystone)$ manila show share01 | grep path | cut -d'|' -f3 path = 10.0.0.50:/var/lib/manila/mnt/share-8d7fb685-8933-4657-ac85-189496318407debian@dlp ~(keystone)$ ssh debian@10.0.0.241 Linux debian-12 6.1.0-9-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.27-1 (2023-05-08) x86_64 The programs included with the Debian GNU/Linux system are free software; the exact distribution terms for each program are described in the individual files in /usr/share/doc/*/copyright. Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent permitted by applicable law. Last login: Wed Jun 28 00:28:17 2023 from 10.0.0.30 # mount Manila shared storage debian@debian-12:~$ sudo mount -t nfs \ 10.0.0.50:/var/lib/manila/mnt/share-8d7fb685-8933-4657-ac85-189496318407 /mnt debian@debian-12:~$ df -hT Filesystem Type Size Used Avail Use% Mounted on udev devtmpfs 1.9G 0 1.9G 0% /dev tmpfs tmpfs 392M 572K 391M 1% /run /dev/mapper/debian--vg-root ext4 8.4G 1.3G 6.6G 17% / tmpfs tmpfs 2.0G 0 2.0G 0% /dev/shm tmpfs tmpfs 5.0M 0 5.0M 0% /run/lock /dev/vda1 ext2 455M 58M 373M 14% /boot tmpfs tmpfs 392M 0 392M 0% /run/user/1000 10.0.0.50:/var/lib/manila/mnt/share-8d7fb685-8933-4657-ac85-189496318407 nfs4 9.8G 0 9.3G 0% /mnt |
| Sponsored Link |