Ubuntu 20.04
Sponsored Link

OpenStack Wallaby : Neutron ネットワークを構成する (Geneve)2021/04/20

 
OpenStack Network Service(Neutron)による仮想ネットワークの構成です。
例として、Geneve カプセル化によるネットワークを構成します。
事前に以下のように Control ノードNetwork ノードCompute ノードの 各サービスノードを構築済みであることが前提です。
また、当例では Network ノードと Compute ノードが 2つのネットワークインターフェースを持っているものとします。
また、下例で eth1 の方は IP なしでインターフェースを UP しています。
IP なしでのインターフェース UP の設定はこちらの [1] を参照ください
------------+---------------------------+---------------------------+------------
            |                           |                           |
        eth0|10.0.0.30              eth0|10.0.0.50              eth0|10.0.0.51
+-----------+-----------+   +-----------+-----------+   +-----------+-----------+
|    [ Control Node ]   |   |    [ Network Node ]   |   |    [ Compute Node ]   |
|                       |   |                       |   |                       |
|  MariaDB    RabbitMQ  |   |      Open vSwitch     |   |        Libvirt        |
|  Memcached  httpd     |   |     Neutron Server    |   |     Nova Compute      |
|  Keystone   Glance    |   |       OVN-Northd      |   |      Open vSwitch     |
|  Nova API             |   |                       |   |   OVN Metadata Agent  |
|                       |   |                       |   |     OVN-Controller    |
+-----------------------+   +-----------+-----------+   +-----------+-----------+
                                    eth1|(UP with no IP)        eth1|(UP with no IP)

[1] Network ノードと Compute ノードの両方でブリッジマッピングを設定しておきます。
# ブリッジ作成 (名称は任意)

root@network:~#
ovs-vsctl add-br br-eth1
# 追加したブリッジのポートに [eth1] を追加

# [eth1] は環境によって異なるため自身の環境に置き換え

root@network:~#
ovs-vsctl add-port br-eth1 eth1
# ブリッジと [physnet1] をマッピング ([physnet1] の名称は任意)

root@network:~#
ovs-vsctl set open . external-ids:ovn-bridge-mappings=physnet1:br-eth1

[2] 仮想ルーターを作成します。作業場所はどこでもよいですが、当例では Control ノード上で作業します。
# 仮想ルーター作成

root@dlp ~(keystone)#
openstack router create router01

+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| admin_state_up          | UP                                   |
| availability_zone_hints |                                      |
| availability_zones      |                                      |
| created_at              | 2021-04-20T00:32:41Z                 |
| description             |                                      |
| external_gateway_info   | null                                 |
| flavor_id               | None                                 |
| id                      | 768f44c2-25cd-4391-9c16-1df9e7505409 |
| name                    | router01                             |
| project_id              | da2214d30eaa4b7aaae25c8cbba0483e     |
| revision_number         | 1                                    |
| routes                  |                                      |
| status                  | ACTIVE                               |
| tags                    |                                      |
| updated_at              | 2021-04-20T00:32:41Z                 |
+-------------------------+--------------------------------------+
[3] 内部用のネットワークを作成し、仮想ルーターに関連付けます。
# 内部用ネットワーク作成

root@dlp ~(keystone)#
openstack network create private --provider-network-type geneve

+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2021-04-20T00:32:54Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | ca2c4289-f0e7-42dc-95d4-ea9507567541 |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1442                                 |
| name                      | private                              |
| port_security_enabled     | True                                 |
| project_id                | da2214d30eaa4b7aaae25c8cbba0483e     |
| provider:network_type     | geneve                               |
| provider:physical_network | None                                 |
| provider:segmentation_id  | 11145                                |
| qos_policy_id             | None                                 |
| revision_number           | 1                                    |
| router:external           | Internal                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| tags                      |                                      |
| updated_at                | 2021-04-20T00:32:54Z                 |
+---------------------------+--------------------------------------+

# 内部用ネットワークにサブネット作成

root@dlp ~(keystone)#
openstack subnet create private-subnet --network private \
--subnet-range 192.168.100.0/24 --gateway 192.168.100.1 \
--dns-nameserver 10.0.0.10

+----------------------+--------------------------------------+
| Field                | Value                                |
+----------------------+--------------------------------------+
| allocation_pools     | 192.168.100.2-192.168.100.254        |
| cidr                 | 192.168.100.0/24                     |
| created_at           | 2021-04-20T00:33:12Z                 |
| description          |                                      |
| dns_nameservers      | 10.0.0.10                            |
| dns_publish_fixed_ip | None                                 |
| enable_dhcp          | True                                 |
| gateway_ip           | 192.168.100.1                        |
| host_routes          |                                      |
| id                   | c11c200c-d463-4330-beaf-80ab87ead256 |
| ip_version           | 4                                    |
| ipv6_address_mode    | None                                 |
| ipv6_ra_mode         | None                                 |
| name                 | private-subnet                       |
| network_id           | ca2c4289-f0e7-42dc-95d4-ea9507567541 |
| prefix_length        | None                                 |
| project_id           | da2214d30eaa4b7aaae25c8cbba0483e     |
| revision_number      | 0                                    |
| segment_id           | None                                 |
| service_types        | None                                 |
| subnetpool_id        | None                                 |
| tags                 |                                      |
| updated_at           | 2021-04-20T00:33:12Z                 |
+----------------------+--------------------------------------+

# 仮想ルーターに内部ネットワークを設定

root@dlp ~(keystone)#
openstack router add subnet router01 private-subnet
[4] 外部接続用のネットワークを作成し、仮想ルーターに関連付けます。
# 外部用ネットワーク作成

root@dlp ~(keystone)#
openstack network create \
--provider-physical-network physnet1 \
--provider-network-type flat --external public

+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2021-04-20T00:33:48Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | ffa87ed8-7da9-488c-a7c8-09912ca2443a |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1500                                 |
| name                      | public                               |
| port_security_enabled     | True                                 |
| project_id                | da2214d30eaa4b7aaae25c8cbba0483e     |
| provider:network_type     | flat                                 |
| provider:physical_network | physnet1                             |
| provider:segmentation_id  | None                                 |
| qos_policy_id             | None                                 |
| revision_number           | 1                                    |
| router:external           | External                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| tags                      |                                      |
| updated_at                | 2021-04-20T00:33:48Z                 |
+---------------------------+--------------------------------------+

# 外部用ネットワークにサブネット作成

root@dlp ~(keystone)#
openstack subnet create public-subnet \
--network public --subnet-range 10.0.0.0/24 \
--allocation-pool start=10.0.0.200,end=10.0.0.254 \
--gateway 10.0.0.1 --dns-nameserver 10.0.0.10 --no-dhcp

+----------------------+--------------------------------------+
| Field                | Value                                |
+----------------------+--------------------------------------+
| allocation_pools     | 10.0.0.200-10.0.0.254                |
| cidr                 | 10.0.0.0/24                          |
| created_at           | 2021-04-20T00:34:11Z                 |
| description          |                                      |
| dns_nameservers      | 10.0.0.10                            |
| dns_publish_fixed_ip | None                                 |
| enable_dhcp          | False                                |
| gateway_ip           | 10.0.0.1                             |
| host_routes          |                                      |
| id                   | e8c73b2b-a6c7-4d97-8782-df4d841f84eb |
| ip_version           | 4                                    |
| ipv6_address_mode    | None                                 |
| ipv6_ra_mode         | None                                 |
| name                 | public-subnet                        |
| network_id           | ffa87ed8-7da9-488c-a7c8-09912ca2443a |
| prefix_length        | None                                 |
| project_id           | da2214d30eaa4b7aaae25c8cbba0483e     |
| revision_number      | 0                                    |
| segment_id           | None                                 |
| service_types        | None                                 |
| subnetpool_id        | None                                 |
| tags                 |                                      |
| updated_at           | 2021-04-20T00:34:11Z                 |
+----------------------+--------------------------------------+

# 仮想ルーターにゲートウェイを設定

root@dlp ~(keystone)#
openstack router set router01 --external-gateway public

[5] 作成したネットワークは、外部用はデフォルトで全プロジェクトがアクセス可能ですが、内部用はデフォルトでは [admin] プロジェクトのみがアクセス可能なため、内部ネットワークを利用させたいプロジェクトにアクセス権限を付与しておきます。
# ネットワーク RBAC リスト表示

root@dlp ~(keystone)#
openstack network rbac list

+--------------------------------------+-------------+--------------------------------------+
| ID                                   | Object Type | Object ID                            |
+--------------------------------------+-------------+--------------------------------------+
| 8acdd103-9ccf-450c-b7cf-1a535ec7bc1a | network     | ffa87ed8-7da9-488c-a7c8-09912ca2443a |
+--------------------------------------+-------------+--------------------------------------+

# RBAC の詳細

# [access_as_external] のみ全プロジェクトがアクセス可能な状態

root@dlp ~(keystone)#
openstack network rbac show 8acdd103-9ccf-450c-b7cf-1a535ec7bc1a

+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| action            | access_as_external                   |
| id                | 8acdd103-9ccf-450c-b7cf-1a535ec7bc1a |
| name              | None                                 |
| object_id         | ffa87ed8-7da9-488c-a7c8-09912ca2443a |
| object_type       | network                              |
| project_id        | da2214d30eaa4b7aaae25c8cbba0483e     |
| target_project_id | *                                    |
+-------------------+--------------------------------------+

# 作成済みネットワーク一覧

root@dlp ~(keystone)#
openstack network list

+--------------------------------------+---------+--------------------------------------+
| ID                                   | Name    | Subnets                              |
+--------------------------------------+---------+--------------------------------------+
| ca2c4289-f0e7-42dc-95d4-ea9507567541 | private | c11c200c-d463-4330-beaf-80ab87ead256 |
| ffa87ed8-7da9-488c-a7c8-09912ca2443a | public  | e8c73b2b-a6c7-4d97-8782-df4d841f84eb |
+--------------------------------------+---------+--------------------------------------+

# 作成済みプロジェクト一覧

root@dlp ~(keystone)#
openstack project list

+----------------------------------+-----------+
| ID                               | Name      |
+----------------------------------+-----------+
| b1f2e1bdf6fb4e03bb30ef3b90764d3b | service   |
| da2214d30eaa4b7aaae25c8cbba0483e | admin     |
| e256a7323fda468fb02e8f1975fce488 | hiroshima |
+----------------------------------+-----------+

# [private] への [access_as_shared] アクセス権を [hiroshima] プロジェクトに付与

root@dlp ~(keystone)#
netID=$(openstack network list | grep private | awk '{ print $2 }')

root@dlp ~(keystone)#
prjID=$(openstack project list | grep hiroshima | awk '{ print $2 }')

root@dlp ~(keystone)#
openstack network rbac create --target-project $prjID --type network --action access_as_shared $netID

+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| action            | access_as_shared                     |
| id                | e975f27c-18b4-473c-a8b1-f096d6a36777 |
| name              | None                                 |
| object_id         | ca2c4289-f0e7-42dc-95d4-ea9507567541 |
| object_type       | network                              |
| project_id        | da2214d30eaa4b7aaae25c8cbba0483e     |
| target_project_id | e256a7323fda468fb02e8f1975fce488     |
+-------------------+--------------------------------------+
[6] 内部ネットワークへのアクセス権を付与したプロジェクトに所属する任意のユーザーでログインし、 作成した内部ネットワークをインスタンスに紐付けてインスタンスを作成/起動します。
# 利用可能な [flavor] 確認

ubuntu@dlp ~(keystone)$
openstack flavor list

+----+----------+------+------+-----------+-------+-----------+
| ID | Name     |  RAM | Disk | Ephemeral | VCPUs | Is Public |
+----+----------+------+------+-----------+-------+-----------+
| 0  | m1.small | 2048 |   10 |         0 |     1 | True      |
+----+----------+------+------+-----------+-------+-----------+

# 利用可能なイメージ確認

ubuntu@dlp ~(keystone)$
openstack image list

+--------------------------------------+------------+--------+
| ID                                   | Name       | Status |
+--------------------------------------+------------+--------+
| 8df08a02-7c19-465e-8862-53eb2319918d | Ubuntu2004 | active |
+--------------------------------------+------------+--------+

# 利用可能なネットワーク確認

ubuntu@dlp ~(keystone)$
openstack network list

+--------------------------------------+---------+--------------------------------------+
| ID                                   | Name    | Subnets                              |
+--------------------------------------+---------+--------------------------------------+
| ca2c4289-f0e7-42dc-95d4-ea9507567541 | private | c11c200c-d463-4330-beaf-80ab87ead256 |
| ffa87ed8-7da9-488c-a7c8-09912ca2443a | public  | e8c73b2b-a6c7-4d97-8782-df4d841f84eb |
+--------------------------------------+---------+--------------------------------------+

# インスタンス用のセキュリティグループを作成

ubuntu@dlp ~(keystone)$
openstack security group create secgroup01

+-----------------+-------------------------------------------------------------------------------+
| Field           | Value                                                                         |
+-----------------+-------------------------------------------------------------------------------+
| created_at      | 2021-04-20T00:40:02Z                                                          |
| description     | secgroup01                                                                    |
| id              | e8d72cf7-666a-4590-a95c-767f44025e49                                          |
| name            | secgroup01                                                                    |
| project_id      | e256a7323fda468fb02e8f1975fce488                                              |
| revision_number | 1                                                                             |
| rules           | created_at='2021-04-20T00:40:02Z', direction='egress', ethertype='IPv6', i... |
|                 | created_at='2021-04-20T00:40:02Z', direction='egress', ethertype='IPv4', i... |
| stateful        | None                                                                          |
| tags            | []                                                                            |
| updated_at      | 2021-04-20T00:40:02Z                                                          |
+-----------------+-------------------------------------------------------------------------------+

# インスタンス接続用の SSH キーペア作成

ubuntu@dlp ~(keystone)$
ssh-keygen -q -N ""

Enter file in which to save the key (/home/ubuntu/.ssh/id_rsa):
# 公開鍵登録

ubuntu@dlp ~(keystone)$
openstack keypair create --public-key ~/.ssh/id_rsa.pub mykey

+-------------+-------------------------------------------------+
| Field       | Value                                           |
+-------------+-------------------------------------------------+
| created_at  | None                                            |
| fingerprint | 54:c2:89:10:97:dc:23:1f:cb:fd:c1:06:9d:0e:01:95 |
| id          | mykey                                           |
| is_deleted  | None                                            |
| name        | mykey                                           |
| type        | ssh                                             |
| user_id     | 3ebb8ec1b4fc467da96379caef902df7                |
+-------------+-------------------------------------------------+

ubuntu@dlp ~(keystone)$
netID=$(openstack network list | grep private | awk '{ print $2 }')

ubuntu@dlp ~(keystone)$
openstack server create --flavor m1.small --image Ubuntu2004 --security-group secgroup01 --nic net-id=$netID --key-name mykey Ubuntu-2004
ubuntu@dlp ~(keystone)$
openstack server list

+--------------------------------------+-------------+--------+------------------------+------------+----------+
| ID                                   | Name        | Status | Networks               | Image      | Flavor   |
+--------------------------------------+-------------+--------+------------------------+------------+----------+
| 1e693abf-1122-47b5-9f78-cadaad7d0bb0 | Ubuntu-2004 | ACTIVE | private=192.168.100.38 | Ubuntu2004 | m1.small |
+--------------------------------------+-------------+--------+------------------------+------------+----------+
[7] 作成した仮想マシンインスタンスにフローティング IP を割り当てます。
ubuntu@dlp ~(keystone)$
openstack floating ip create public

+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| created_at          | 2021-04-20T00:42:41Z                 |
| description         |                                      |
| dns_domain          | None                                 |
| dns_name            | None                                 |
| fixed_ip_address    | None                                 |
| floating_ip_address | 10.0.0.242                           |
| floating_network_id | ffa87ed8-7da9-488c-a7c8-09912ca2443a |
| id                  | 5ead80e9-c40e-43e4-9fd2-cf3c653d046d |
| name                | 10.0.0.242                           |
| port_details        | None                                 |
| port_id             | None                                 |
| project_id          | e256a7323fda468fb02e8f1975fce488     |
| qos_policy_id       | None                                 |
| revision_number     | 0                                    |
| router_id           | None                                 |
| status              | DOWN                                 |
| subnet_id           | None                                 |
| tags                | []                                   |
| updated_at          | 2021-04-20T00:42:41Z                 |
+---------------------+--------------------------------------+

ubuntu@dlp ~(keystone)$
openstack server add floating ip Ubuntu-2004 10.0.0.242
# 設定確認

ubuntu@dlp ~(keystone)$
openstack floating ip show 10.0.0.242

+---------------------+---------------------------------------------------------------------------+
| Field               | Value                                                                     |
+---------------------+---------------------------------------------------------------------------+
| created_at          | 2021-04-20T00:42:41Z                                                      |
| description         |                                                                           |
| dns_domain          | None                                                                      |
| dns_name            | None                                                                      |
| fixed_ip_address    | 192.168.100.38                                                            |
| floating_ip_address | 10.0.0.242                                                                |
| floating_network_id | ffa87ed8-7da9-488c-a7c8-09912ca2443a                                      |
| id                  | 5ead80e9-c40e-43e4-9fd2-cf3c653d046d                                      |
| name                | 10.0.0.242                                                                |
| port_details        | admin_state_up='True', device_id='1e693abf-1122-47b5-9f78-cadaad7d0bb0... |
| port_id             | dfe3c7a2-95e0-44cc-afae-3767644d29cc                                      |
| project_id          | e256a7323fda468fb02e8f1975fce488                                          |
| qos_policy_id       | None                                                                      |
| revision_number     | 2                                                                         |
| router_id           | 768f44c2-25cd-4391-9c16-1df9e7505409                                      |
| status              | ACTIVE                                                                    |
| subnet_id           | None                                                                      |
| tags                | []                                                                        |
| updated_at          | 2021-04-20T00:43:14Z                                                      |
+---------------------+---------------------------------------------------------------------------+

ubuntu@dlp ~(keystone)$
openstack server list

+--------------------------------------+-------------+--------+------------------------------------+------------+----------+
| ID                                   | Name        | Status | Networks                           | Image      | Flavor   |
+--------------------------------------+-------------+--------+------------------------------------+------------+----------+
| 1e693abf-1122-47b5-9f78-cadaad7d0bb0 | Ubuntu-2004 | ACTIVE | private=10.0.0.242, 192.168.100.38 | Ubuntu2004 | m1.small |
+--------------------------------------+-------------+--------+------------------------------------+------------+----------+
[8] 起動した仮想マシンインスタンスに SSH 接続できるように、先に作成したセキュリティグループにポート許可の設定を追加します。
# ICMP 許可

ubuntu@dlp ~(keystone)$
openstack security group rule create --protocol icmp --ingress secgroup01

+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| created_at              | 2021-04-20T00:44:16Z                 |
| description             |                                      |
| direction               | ingress                              |
| ether_type              | IPv4                                 |
| id                      | 25f8cb95-2cca-49dd-b95e-e33a2fe81aca |
| name                    | None                                 |
| port_range_max          | None                                 |
| port_range_min          | None                                 |
| project_id              | e256a7323fda468fb02e8f1975fce488     |
| protocol                | icmp                                 |
| remote_address_group_id | None                                 |
| remote_group_id         | None                                 |
| remote_ip_prefix        | 0.0.0.0/0                            |
| revision_number         | 0                                    |
| security_group_id       | e8d72cf7-666a-4590-a95c-767f44025e49 |
| tags                    | []                                   |
| updated_at              | 2021-04-20T00:44:16Z                 |
+-------------------------+--------------------------------------+

# SSH 許可

ubuntu@dlp ~(keystone)$
openstack security group rule create --protocol tcp --dst-port 22:22 secgroup01

+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| created_at              | 2021-04-20T00:44:29Z                 |
| description             |                                      |
| direction               | ingress                              |
| ether_type              | IPv4                                 |
| id                      | c6e7c6ff-5303-434a-be0e-f5506ef1421a |
| name                    | None                                 |
| port_range_max          | 22                                   |
| port_range_min          | 22                                   |
| project_id              | e256a7323fda468fb02e8f1975fce488     |
| protocol                | tcp                                  |
| remote_address_group_id | None                                 |
| remote_group_id         | None                                 |
| remote_ip_prefix        | 0.0.0.0/0                            |
| revision_number         | 0                                    |
| security_group_id       | e8d72cf7-666a-4590-a95c-767f44025e49 |
| tags                    | []                                   |
| updated_at              | 2021-04-20T00:44:29Z                 |
+-------------------------+--------------------------------------+

ubuntu@dlp ~(keystone)$
openstack security group rule list secgroup01

+--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+
| ID                                   | IP Protocol | Ethertype | IP Range  | Port Range | Direction | Remote Security Group | Remote Address Group |
+--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+
| 25f8cb95-2cca-49dd-b95e-e33a2fe81aca | icmp        | IPv4      | 0.0.0.0/0 |            | ingress   | None                  | None                 |
| 73703ab2-814f-4020-9d68-04b32effd79c | None        | IPv6      | ::/0      |            | egress    | None                  | None                 |
| 7a572c9f-5d0f-40dc-8c0e-da20bf4fb563 | None        | IPv4      | 0.0.0.0/0 |            | egress    | None                  | None                 |
| c6e7c6ff-5303-434a-be0e-f5506ef1421a | tcp         | IPv4      | 0.0.0.0/0 | 22:22      | ingress   | None                  | None                 |
+--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+
[9] 仮想マシンインスタンスに割りあてられたフローティング IP 宛てに SSH 接続することで、インスタンスに SSH ログインできます。
ubuntu@dlp ~(keystone)$
openstack server list

+--------------------------------------+-------------+--------+------------------------------------+------------+----------+
| ID                                   | Name        | Status | Networks                           | Image      | Flavor   |
+--------------------------------------+-------------+--------+------------------------------------+------------+----------+
| 1e693abf-1122-47b5-9f78-cadaad7d0bb0 | Ubuntu-2004 | ACTIVE | private=10.0.0.242, 192.168.100.38 | Ubuntu2004 | m1.small |
+--------------------------------------+-------------+--------+------------------------------------+------------+----------+

ubuntu@dlp ~(keystone)$
ssh ubuntu@10.0.0.242

The authenticity of host '10.0.0.242 (10.0.0.242)' can't be established.
ECDSA key fingerprint is SHA256:KRTnNxlJs8f0/eVVfRkXCCTCoWAvgISRdQwEcvybZTA.
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added '10.0.0.242' (ECDSA) to the list of known hosts.
Welcome to Ubuntu 20.04.2 LTS (GNU/Linux 5.4.0-71-generic x86_64)

.....
.....

To run a command as administrator (user "root"), use "sudo <command>".
See "man sudo_root" for details.

ubuntu@ubuntu-2004:~$     # ログインできた
関連コンテンツ