CentOS 8
Sponsored Link

OpenStack Victoria : Neutron ネットワークを構成する (Geneve)2020/11/26

 
OpenStack Network Service(Neutron)による仮想ネットワークの構成です。
例として、Geneve カプセル化によるネットワークを構成します。
事前に以下のように Control ノードNetwork ノードCompute ノードの 各サービスノードを構築済みであることが前提です。
また、当例では Network ノードと Compute ノードが 2つのネットワークインターフェースを持っているものとします。
------------+---------------------------+---------------------------+------------
            |                           |                           |
        eth0|10.0.0.30              eth0|10.0.0.50              eth0|10.0.0.51
+-----------+-----------+   +-----------+-----------+   +-----------+-----------+
|    [ Control Node ]   |   |    [ Network Node ]   |   |    [ Compute Node ]   |
|                       |   |                       |   |                       |
|  MariaDB    RabbitMQ  |   |      Open vSwitch     |   |        Libvirt        |
|  Memcached  httpd     |   |     Neutron Server    |   |     Nova Compute      |
|  Keystone   Glance    |   |       OVN-Northd      |   |      Open vSwitch     |
|  Nova API             |   |                       |   |   OVN Metadata Agent  |
|                       |   |                       |   |     OVN-Controller    |
+-----------------------+   +-----------+-----------+   +-----------+-----------+
                                    eth1|(UP with no IP)        eth1|(UP with no IP)

[1] Network ノードと Compute ノードの両方でブリッジマッピングを設定しておきます。
# ブリッジ作成 (名称は任意)

[root@network ~]#
ovs-vsctl add-br br-eth1
# 追加したブリッジのポートに [eth1] を追加

# [eth1] は環境によって異なるため自身の環境に置き換え

[root@network ~]#
ovs-vsctl add-port br-eth1 eth1
# ブリッジと [physnet1] をマッピング ([physnet1] の名称は任意)

[root@network ~]#
ovs-vsctl set open . external-ids:ovn-bridge-mappings=physnet1:br-eth1

[2] 仮想ルーターを作成します。作業場所はどこでもよいですが、当例では Control ノード上で作業します。
# 仮想ルーター作成

[root@dlp ~(keystone)]#
openstack router create router01

+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| admin_state_up          | UP                                   |
| availability_zone_hints |                                      |
| availability_zones      |                                      |
| created_at              | 2020-11-26T04:03:30Z                 |
| description             |                                      |
| external_gateway_info   | null                                 |
| flavor_id               | None                                 |
| id                      | ded07a54-221a-4b91-973d-3276b81fb5b3 |
| name                    | router01                             |
| project_id              | f631c12338934447bb3172f3378d2b9a     |
| revision_number         | 1                                    |
| routes                  |                                      |
| status                  | ACTIVE                               |
| tags                    |                                      |
| updated_at              | 2020-11-26T04:03:30Z                 |
+-------------------------+--------------------------------------+
[3] 内部用のネットワークを作成し、仮想ルーターに関連付けます。
# 内部用ネットワーク作成

[root@dlp ~(keystone)]#
openstack network create private --provider-network-type geneve

+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2020-11-26T04:03:50Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | 431d7888-dcde-40dc-9727-ecfa65a25366 |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1442                                 |
| name                      | private                              |
| port_security_enabled     | True                                 |
| project_id                | f631c12338934447bb3172f3378d2b9a     |
| provider:network_type     | geneve                               |
| provider:physical_network | None                                 |
| provider:segmentation_id  | 1                                    |
| qos_policy_id             | None                                 |
| revision_number           | 1                                    |
| router:external           | Internal                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| tags                      |                                      |
| updated_at                | 2020-11-26T04:03:50Z                 |
+---------------------------+--------------------------------------+

# 内部用ネットワークにサブネット作成

[root@dlp ~(keystone)]#
openstack subnet create private-subnet --network private \
--subnet-range 192.168.100.0/24 --gateway 192.168.100.1 \
--dns-nameserver 10.0.0.10

+----------------------+--------------------------------------+
| Field                | Value                                |
+----------------------+--------------------------------------+
| allocation_pools     | 192.168.100.2-192.168.100.254        |
| cidr                 | 192.168.100.0/24                     |
| created_at           | 2020-11-26T04:04:15Z                 |
| description          |                                      |
| dns_nameservers      | 10.0.0.10                            |
| dns_publish_fixed_ip | None                                 |
| enable_dhcp          | True                                 |
| gateway_ip           | 192.168.100.1                        |
| host_routes          |                                      |
| id                   | db0a36a6-5be6-4609-951e-27b4d3f9f5b9 |
| ip_version           | 4                                    |
| ipv6_address_mode    | None                                 |
| ipv6_ra_mode         | None                                 |
| name                 | private-subnet                       |
| network_id           | 431d7888-dcde-40dc-9727-ecfa65a25366 |
| prefix_length        | None                                 |
| project_id           | f631c12338934447bb3172f3378d2b9a     |
| revision_number      | 0                                    |
| segment_id           | None                                 |
| service_types        |                                      |
| subnetpool_id        | None                                 |
| tags                 |                                      |
| updated_at           | 2020-11-26T04:04:15Z                 |
+----------------------+--------------------------------------+

# 仮想ルーターに内部ネットワークを設定

[root@dlp ~(keystone)]#
openstack router add subnet router01 private-subnet
[4] 外部接続用のネットワークを作成し、仮想ルーターに関連付けます。
# 外部用ネットワーク作成

[root@dlp ~(keystone)]#
openstack network create \
--provider-physical-network physnet1 \
--provider-network-type flat --external public

+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2020-11-26T04:04:55Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | dae78c9d-c885-4949-a05d-8e456f9ba1b9 |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1500                                 |
| name                      | public                               |
| port_security_enabled     | True                                 |
| project_id                | f631c12338934447bb3172f3378d2b9a     |
| provider:network_type     | flat                                 |
| provider:physical_network | physnet1                             |
| provider:segmentation_id  | None                                 |
| qos_policy_id             | None                                 |
| revision_number           | 1                                    |
| router:external           | External                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| tags                      |                                      |
| updated_at                | 2020-11-26T04:04:55Z                 |
+---------------------------+--------------------------------------+

# 外部用ネットワークにサブネット作成

[root@dlp ~(keystone)]#
openstack subnet create public-subnet \
--network public --subnet-range 10.0.0.0/24 \
--allocation-pool start=10.0.0.200,end=10.0.0.254 \
--gateway 10.0.0.1 --dns-nameserver 10.0.0.10 --no-dhcp

+----------------------+--------------------------------------+
| Field                | Value                                |
+----------------------+--------------------------------------+
| allocation_pools     | 10.0.0.200-10.0.0.254                |
| cidr                 | 10.0.0.0/24                          |
| created_at           | 2020-11-26T04:05:14Z                 |
| description          |                                      |
| dns_nameservers      | 10.0.0.10                            |
| dns_publish_fixed_ip | None                                 |
| enable_dhcp          | False                                |
| gateway_ip           | 10.0.0.1                             |
| host_routes          |                                      |
| id                   | e09e5481-afaf-484e-9c7a-b24a3545d092 |
| ip_version           | 4                                    |
| ipv6_address_mode    | None                                 |
| ipv6_ra_mode         | None                                 |
| name                 | public-subnet                        |
| network_id           | dae78c9d-c885-4949-a05d-8e456f9ba1b9 |
| prefix_length        | None                                 |
| project_id           | f631c12338934447bb3172f3378d2b9a     |
| revision_number      | 0                                    |
| segment_id           | None                                 |
| service_types        |                                      |
| subnetpool_id        | None                                 |
| tags                 |                                      |
| updated_at           | 2020-11-26T04:05:14Z                 |
+----------------------+--------------------------------------+

# 仮想ルーターにゲートウェイを設定

[root@dlp ~(keystone)]#
openstack router set router01 --external-gateway public

[5] 作成したネットワークは、外部用はデフォルトで全プロジェクトがアクセス可能ですが、内部用はデフォルトでは [admin] プロジェクトのみがアクセス可能なため、内部ネットワークを利用させたいプロジェクトにアクセス権限を付与しておきます。
# ネットワーク RBAC リスト表示

[root@dlp ~(keystone)]#
openstack network rbac list

+--------------------------------------+-------------+--------------------------------------+
| ID                                   | Object Type | Object ID                            |
+--------------------------------------+-------------+--------------------------------------+
| e35e56e7-cb21-4158-8ee2-044c61863731 | network     | dae78c9d-c885-4949-a05d-8e456f9ba1b9 |
+--------------------------------------+-------------+--------------------------------------+

# RBAC の詳細

# [access_as_external] のみ全プロジェクトがアクセス可能な状態

[root@dlp ~(keystone)]#
openstack network rbac show e35e56e7-cb21-4158-8ee2-044c61863731

+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| action            | access_as_external                   |
| id                | e35e56e7-cb21-4158-8ee2-044c61863731 |
| name              | None                                 |
| object_id         | dae78c9d-c885-4949-a05d-8e456f9ba1b9 |
| object_type       | network                              |
| project_id        | f631c12338934447bb3172f3378d2b9a     |
| target_project_id | *                                    |
+-------------------+--------------------------------------+

# 作成済みネットワーク一覧

[root@dlp ~(keystone)]#
openstack network list

+--------------------------------------+---------+--------------------------------------+
| ID                                   | Name    | Subnets                              |
+--------------------------------------+---------+--------------------------------------+
| 431d7888-dcde-40dc-9727-ecfa65a25366 | private | db0a36a6-5be6-4609-951e-27b4d3f9f5b9 |
| dae78c9d-c885-4949-a05d-8e456f9ba1b9 | public  | e09e5481-afaf-484e-9c7a-b24a3545d092 |
+--------------------------------------+---------+--------------------------------------+

# 作成済みプロジェクト一覧

[root@dlp ~(keystone)]#
openstack project list

+----------------------------------+-----------+
| ID                               | Name      |
+----------------------------------+-----------+
| 36a0b2c4640c4d1e98c9e758c61e1bf8 | hiroshima |
| 78a30ddac623441396857b102e8b6a13 | service   |
| f631c12338934447bb3172f3378d2b9a | admin     |
+----------------------------------+-----------+

# [int_net] への [access_as_shared] アクセス権を [hiroshima] プロジェクトに付与

[root@dlp ~(keystone)]#
netID=$(openstack network list | grep private | awk '{ print $2 }')

[root@dlp ~(keystone)]#
prjID=$(openstack project list | grep hiroshima | awk '{ print $2 }')

[root@dlp ~(keystone)]#
openstack network rbac create --target-project $prjID --type network --action access_as_shared $netID

+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| action            | access_as_shared                     |
| id                | bb8a85f5-22a4-433b-9583-8025e068f945 |
| name              | None                                 |
| object_id         | 431d7888-dcde-40dc-9727-ecfa65a25366 |
| object_type       | network                              |
| project_id        | f631c12338934447bb3172f3378d2b9a     |
| target_project_id | 36a0b2c4640c4d1e98c9e758c61e1bf8     |
+-------------------+--------------------------------------+
[6] 内部ネットワークへのアクセス権を付与したプロジェクトに所属する任意のユーザーでログインし、 作成した内部ネットワークをインスタンスに紐付けてインスタンスを作成/起動します。
# 利用可能な [flavor] 確認

[cent@dlp ~(keystone)]$
openstack flavor list

+----+----------+------+------+-----------+-------+-----------+
| ID | Name     |  RAM | Disk | Ephemeral | VCPUs | Is Public |
+----+----------+------+------+-----------+-------+-----------+
| 0  | m1.small | 2048 |   10 |         0 |     1 | True      |
+----+----------+------+------+-----------+-------+-----------+

# 利用可能なイメージ確認

[cent@dlp ~(keystone)]$
openstack image list

+--------------------------------------+---------+--------+
| ID                                   | Name    | Status |
+--------------------------------------+---------+--------+
| 214323d8-21a4-46e7-8c85-1f119fc6cf60 | CentOS8 | active |
+--------------------------------------+---------+--------+

# 利用可能なネットワーク確認

[cent@dlp ~(keystone)]$
openstack network list

+--------------------------------------+---------+--------------------------------------+
| ID                                   | Name    | Subnets                              |
+--------------------------------------+---------+--------------------------------------+
| 431d7888-dcde-40dc-9727-ecfa65a25366 | private | db0a36a6-5be6-4609-951e-27b4d3f9f5b9 |
| dae78c9d-c885-4949-a05d-8e456f9ba1b9 | public  | e09e5481-afaf-484e-9c7a-b24a3545d092 |
+--------------------------------------+---------+--------------------------------------+

# インスタンス用のセキュリティグループを作成

[cent@dlp ~(keystone)]$
openstack security group create secgroup01

+-----------------+-----------------------------------------------------------------------------+
| Field           | Value                                                                       |
+-----------------+-----------------------------------------------------------------------------+
| created_at      | 2020-11-26T04:08:51Z                                                        |
| description     | secgroup01                                                                  |
| id              | 58f7b204-841e-4c8e-88dd-e88710bdfb8d                                        |
| name            | secgroup01                                                                  |
| project_id      | 36a0b2c4640c4d1e98c9e758c61e1bf8                                            |
| revision_number | 1                                                                           |
| rules           | created_at='2020-11-26T04:08:51Z', direction='egress', ethertype='IPv4',... |
|                 | created_at='2020-11-26T04:08:51Z', direction='egress', ethertype='IPv6',... |
| stateful        | True                                                                        |
| tags            | []                                                                          |
| updated_at      | 2020-11-26T04:08:51Z                                                        |
+-----------------+-----------------------------------------------------------------------------+

# インスタンス接続用の SSH キーペア作成

[cent@dlp ~(keystone)]$
ssh-keygen -q -N ""

Enter file in which to save the key (/home/cent/.ssh/id_rsa):
# 公開鍵登録

[cent@dlp ~(keystone)]$
openstack keypair create --public-key ~/.ssh/id_rsa.pub mykey

+-------------+-------------------------------------------------+
| Field       | Value                                           |
+-------------+-------------------------------------------------+
| fingerprint | 9d:40:55:95:ac:91:4b:49:0e:5f:bc:00:68:c2:19:c0 |
| name        | mykey                                           |
| user_id     | 37a7da78c45d41c4b36e7e2893798961                |
+-------------+-------------------------------------------------+

[cent@dlp ~(keystone)]$
netID=$(openstack network list | grep private | awk '{ print $2 }')

[cent@dlp ~(keystone)]$
openstack server create --flavor m1.small --image CentOS8 --security-group secgroup01 --nic net-id=$netID --key-name mykey CentOS-8
[cent@dlp ~(keystone)]$
openstack server list

+--------------------------------------+----------+--------+-------------------------+---------+----------+
| ID                                   | Name     | Status | Networks                | Image   | Flavor   |
+--------------------------------------+----------+--------+-------------------------+---------+----------+
| bc62189e-9ab7-46ab-9b4f-6bffb1ecf54a | CentOS-8 | ACTIVE | private=192.168.100.178 | CentOS8 | m1.small |
+--------------------------------------+----------+--------+-------------------------+---------+----------+
[7] 作成した仮想マシンインスタンスにフローティング IP を割り当てます。
[cent@dlp ~(keystone)]$
openstack floating ip create public

+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| created_at          | 2020-11-26T04:13:33Z                 |
| description         |                                      |
| dns_domain          |                                      |
| dns_name            |                                      |
| fixed_ip_address    | None                                 |
| floating_ip_address | 10.0.0.234                           |
| floating_network_id | dae78c9d-c885-4949-a05d-8e456f9ba1b9 |
| id                  | 5ac7030c-b795-4540-bb14-2a426b430fda |
| name                | 10.0.0.234                           |
| port_details        | None                                 |
| port_id             | None                                 |
| project_id          | 36a0b2c4640c4d1e98c9e758c61e1bf8     |
| qos_policy_id       | None                                 |
| revision_number     | 0                                    |
| router_id           | None                                 |
| status              | DOWN                                 |
| subnet_id           | None                                 |
| tags                | []                                   |
| updated_at          | 2020-11-26T04:13:33Z                 |
+---------------------+--------------------------------------+

[cent@dlp ~(keystone)]$
openstack server add floating ip CentOS-8 10.0.0.234
# 設定確認

[cent@dlp ~(keystone)]$
openstack floating ip show 10.0.0.234

+---------------------+--------------------------------------------------------------------------+
| Field               | Value                                                                    |
+---------------------+--------------------------------------------------------------------------+
| created_at          | 2020-11-26T04:13:33Z                                                     |
| description         |                                                                          |
| dns_domain          |                                                                          |
| dns_name            |                                                                          |
| fixed_ip_address    | 192.168.100.178                                                          |
| floating_ip_address | 10.0.0.234                                                               |
| floating_network_id | dae78c9d-c885-4949-a05d-8e456f9ba1b9                                     |
| id                  | 5ac7030c-b795-4540-bb14-2a426b430fda                                     |
| name                | 10.0.0.234                                                               |
| port_details        | admin_state_up='True', device_id='bc62189e-9ab7-46ab-9b4f-6bffb1ecf54... |
| port_id             | 2c3b8e69-21cb-432e-9138-1a1a6698abd3                                     |
| project_id          | 36a0b2c4640c4d1e98c9e758c61e1bf8                                         |
| qos_policy_id       | None                                                                     |
| revision_number     | 2                                                                        |
| router_id           | ded07a54-221a-4b91-973d-3276b81fb5b3                                     |
| status              | ACTIVE                                                                   |
| subnet_id           | None                                                                     |
| tags                | []                                                                       |
| updated_at          | 2020-11-26T04:13:54Z                                                     |
+---------------------+--------------------------------------------------------------------------+

[cent@dlp ~(keystone)]$
openstack server list

+--------------------------------------+----------+--------+-------------------------------------+---------+----------+
| ID                                   | Name     | Status | Networks                            | Image   | Flavor   |
+--------------------------------------+----------+--------+-------------------------------------+---------+----------+
| bc62189e-9ab7-46ab-9b4f-6bffb1ecf54a | CentOS-8 | ACTIVE | private=192.168.100.178, 10.0.0.234 | CentOS8 | m1.small |
+--------------------------------------+----------+--------+-------------------------------------+---------+----------+
[8] 起動した仮想マシンインスタンスに SSH 接続できるように、先に作成したセキュリティグループにポート許可の設定を追加します。
# ICMP 許可

[cent@dlp ~(keystone)]$
openstack security group rule create --protocol icmp --ingress secgroup01

+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| created_at        | 2020-11-26T04:15:14Z                 |
| description       |                                      |
| direction         | ingress                              |
| ether_type        | IPv4                                 |
| id                | d63c0044-ceb1-4cbc-9860-03d0898548fc |
| name              | None                                 |
| port_range_max    | None                                 |
| port_range_min    | None                                 |
| project_id        | 36a0b2c4640c4d1e98c9e758c61e1bf8     |
| protocol          | icmp                                 |
| remote_group_id   | None                                 |
| remote_ip_prefix  | 0.0.0.0/0                            |
| revision_number   | 0                                    |
| security_group_id | 58f7b204-841e-4c8e-88dd-e88710bdfb8d |
| tags              | []                                   |
| updated_at        | 2020-11-26T04:15:14Z                 |
+-------------------+--------------------------------------+

# SSH 許可

[cent@dlp ~(keystone)]$
openstack security group rule create --protocol tcp --dst-port 22:22 secgroup01

+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| created_at        | 2020-11-26T04:15:27Z                 |
| description       |                                      |
| direction         | ingress                              |
| ether_type        | IPv4                                 |
| id                | bff3661e-a9e3-4df0-b922-108528fd33fc |
| name              | None                                 |
| port_range_max    | 22                                   |
| port_range_min    | 22                                   |
| project_id        | 36a0b2c4640c4d1e98c9e758c61e1bf8     |
| protocol          | tcp                                  |
| remote_group_id   | None                                 |
| remote_ip_prefix  | 0.0.0.0/0                            |
| revision_number   | 0                                    |
| security_group_id | 58f7b204-841e-4c8e-88dd-e88710bdfb8d |
| tags              | []                                   |
| updated_at        | 2020-11-26T04:15:27Z                 |
+-------------------+--------------------------------------+

[cent@dlp ~(keystone)]$
openstack security group rule list

+--------------------------------------+-------------+-----------+-----------+------------+---------+
| ID                                   | IP Protocol | Ethertype | IP Range  | Port Range | Remote  |
+--------------------------------------+-------------+-----------+-----------+------------+---------+
| 2a56be89-44ed-4733-81c6-029281db0a65 | None        | IPv6      | ::/0      |            | None    |
| 7b677776-0d50-469f-81e0-ef5948c7a106 | None        | IPv4      | 0.0.0.0/0 |            | b0d3... |
| 7cd2f529-70b7-4021-86f6-e63069bc0de8 | None        | IPv4      | 0.0.0.0/0 |            | None    |
| b8d31dd0-a31f-4360-86d9-da54d2fe2cb5 | None        | IPv6      | ::/0      |            | b0d3... |
| bc1cb50a-5b81-4eb6-a255-286038ca87ed | None        | IPv6      | ::/0      |            | None    |
| bff3661e-a9e3-4df0-b922-108528fd33fc | tcp         | IPv4      | 0.0.0.0/0 | 22:22      | None    |
| d39636a4-6441-4c93-a604-34933458106c | None        | IPv4      | 0.0.0.0/0 |            | None    |
| d63c0044-ceb1-4cbc-9860-03d0898548fc | icmp        | IPv4      | 0.0.0.0/0 |            | None    |
+--------------------------------------+-------------+-----------+-----------+------------+---------+
[9] 仮想マシンインスタンスに割りあてられたフローティング IP 宛てに SSH 接続することで、インスタンスに SSH ログインできます。
[cent@dlp ~(keystone)]$
openstack server list

+--------------------------------------+----------+--------+-------------------------------------+---------+----------+
| ID                                   | Name     | Status | Networks                            | Image   | Flavor   |
+--------------------------------------+----------+--------+-------------------------------------+---------+----------+
| bc62189e-9ab7-46ab-9b4f-6bffb1ecf54a | CentOS-8 | ACTIVE | private=192.168.100.178, 10.0.0.234 | CentOS8 | m1.small |
+--------------------------------------+----------+--------+-------------------------------------+---------+----------+

[cent@dlp ~(keystone)]$
ssh centos@10.0.0.234

The authenticity of host '10.0.0.234 (10.0.0.234)' can't be established.
ECDSA key fingerprint is SHA256:y8APwTioxNs+nDxkWrfarIyEgOTxKAnbg+piewH+Em8.
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added '10.0.0.234' (ECDSA) to the list of known hosts.
[centos@centos-8 ~]$     # ログインできた
関連コンテンツ