OpenStack Xena : Neutron ネットワークを構成する (VXLAN)2021/11/22 |
|
OpenStack Network Service（Neutron）による仮想ネットワークの構成です。
例として、VXLAN タイプのネットワークを構成します。
事前に以下のように Control ノード、 Network ノード、 Compute ノードの 各 Neutron サービスノードを構築済みであることが前提です。
また、当例では Network ノードが 2つのネットワークインターフェースを持っているものとします。
------------+---------------------------+---------------------------+------------
| | |
eth0|10.0.0.30 eth0|10.0.0.50 eth0|10.0.0.51
+-----------+-----------+ +-----------+-----------+ +-----------+-----------+
| [ Control Node ] | | [ Network Node ] | | [ Compute Node ] |
| | | | | |
| MariaDB RabbitMQ | | Open vSwitch | | Libvirt |
| Memcached httpd | | L2 Agent | | Nova Compute |
| Keystone Glance | | L3 Agent | | Open vSwitch |
| Nova API | | Metadata Agent | | L2 Agent |
| Neutron Server | | | | |
| Metadata Agent | | | | |
+-----------------------+ +-----------+-----------+ +-----------------------+
eth1|(UP with no IP)
|
| [1] | Control ノードで以下のように設定変更します。 |
|
[root@dlp ~(keystone)]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # 最終行付近：[tenant_network_types] に値を追記 [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan
# 最終行に追記 [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000 systemctl restart neutron-server |
| [2] | Network ノードで以下のように設定変更します。 |
|
# ブリッジ追加 [root@network ~]# ovs-vsctl add-br br-eth1
# 追加したブリッジのポートに [eth1] を追加 # [eth1] は環境によって異なるため自身の名称に置き換え [root@network ~]# ovs-vsctl add-port br-eth1 eth1
[root@network ~]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # 最終行付近 : [tenant_network_types] に値を追記 [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan
# 最終行に追記 [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000
[root@network ~]#
vi /etc/neutron/plugins/ml2/openvswitch_agent.ini # 最終行に追記
[agent]
tunnel_types = vxlan
prevent_arp_spoofing = True
[ovs]
# [local_ip] には当ノードのローカル IP アドレスを指定
local_ip = 10.0.0.50
bridge_mappings = physnet1:br-eth1
[root@network ~]#
for service in dhcp-agent l3-agent metadata-agent openvswitch-agent; do
systemctl restart neutron-$service done # Firewalld 稼働中の場合は VXLAN ポート許可 [root@network ~]# firewall-cmd --add-port=4789/udp [root@network ~]# firewall-cmd --runtime-to-permanent |
| [3] | Compute ノードで以下のように設定変更します。 |
|
[root@node01 ~]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # 最終行付近 : [tenant_network_types] に値を追記 [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan
# 最終行に追記 [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000
[root@node01 ~]#
vi /etc/neutron/plugins/ml2/openvswitch_agent.ini # 最終行に追記
[agent]
tunnel_types = vxlan
prevent_arp_spoofing = True
[ovs]
# [local_ip] には当ノードのローカル IP アドレスを指定
local_ip = 10.0.0.51
[root@node01 ~]#
systemctl restart neutron-openvswitch-agent
# Firewalld 稼働中の場合は VXLAN ポート許可 [root@node01 ~]# firewall-cmd --add-port=4789/udp [root@node01 ~]# firewall-cmd --runtime-to-permanent |
| [4] | 仮想ルーターを作成します。作業場所はどこでもよいですが、当例では Control ノード上で作業します。 |
|
# 仮想ルーター作成 [root@dlp ~(keystone)]# openstack router create router01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2021-11-22T06:47:01Z | | description | | | distributed | False | | external_gateway_info | null | | flavor_id | None | | ha | False | | id | fefd042f-1456-4663-aaec-d5df85203ea4 | | name | router01 | | project_id | b12f95625664420ca31949963b75b74f | | revision_number | 1 | | routes | | | status | ACTIVE | | tags | | | updated_at | 2021-11-22T06:47:01Z | +-------------------------+--------------------------------------+ |
| [5] | 内部用のネットワークを作成し、仮想ルーターに関連付けます。 |
|
# 内部用ネットワーク作成 [root@dlp ~(keystone)]# openstack network create private --provider-network-type vxlan +---------------------------+--------------------------------------+ | Field | Value | +---------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2021-11-22T06:47:21Z | | description | | | dns_domain | None | | id | 485dc058-ae45-42e0-8109-b67ad16c0ad9 | | ipv4_address_scope | None | | ipv6_address_scope | None | | is_default | False | | is_vlan_transparent | None | | mtu | 1450 | | name | private | | port_security_enabled | True | | project_id | b12f95625664420ca31949963b75b74f | | provider:network_type | vxlan | | provider:physical_network | None | | provider:segmentation_id | 935 | | qos_policy_id | None | | revision_number | 1 | | router:external | Internal | | segments | None | | shared | False | | status | ACTIVE | | subnets | | | tags | | | updated_at | 2021-11-22T06:47:21Z | +---------------------------+--------------------------------------+ # 内部用ネットワークにサブネット作成 [root@dlp ~(keystone)]# openstack subnet create private-subnet --network private \ --subnet-range 192.168.100.0/24 --gateway 192.168.100.1 \ --dns-nameserver 10.0.0.10 +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | allocation_pools | 192.168.100.2-192.168.100.254 | | cidr | 192.168.100.0/24 | | created_at | 2021-11-22T06:47:49Z | | description | | | dns_nameservers | 10.0.0.10 | | dns_publish_fixed_ip | None | | enable_dhcp | True | | gateway_ip | 192.168.100.1 | | host_routes | | | id | dd8fff2f-c42f-4077-aa35-a7a24aa4c87e | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | private-subnet | | network_id | 485dc058-ae45-42e0-8109-b67ad16c0ad9 | | project_id | b12f95625664420ca31949963b75b74f | | revision_number | 0 | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2021-11-22T06:47:49Z | +----------------------+--------------------------------------+ # 仮想ルーターに内部ネットワークを設定 [root@dlp ~(keystone)]# openstack router add subnet router01 private-subnet
|
| [6] | 外部接続用のネットワークを作成し、仮想ルーターに関連付けます。 |
|
# 外部用ネットワーク作成 [root@dlp ~(keystone)]# openstack network create \ --provider-physical-network physnet1 \ --provider-network-type flat --external public +---------------------------+--------------------------------------+ | Field | Value | +---------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2021-11-22T06:48:21Z | | description | | | dns_domain | None | | id | b59d2fc7-74bd-41b4-8e94-0a2a574e70ff | | ipv4_address_scope | None | | ipv6_address_scope | None | | is_default | False | | is_vlan_transparent | None | | mtu | 1500 | | name | public | | port_security_enabled | True | | project_id | b12f95625664420ca31949963b75b74f | | provider:network_type | flat | | provider:physical_network | physnet1 | | provider:segmentation_id | None | | qos_policy_id | None | | revision_number | 1 | | router:external | External | | segments | None | | shared | False | | status | ACTIVE | | subnets | | | tags | | | updated_at | 2021-11-22T06:48:21Z | +---------------------------+--------------------------------------+ # 外部用ネットワークにサブネット作成 [root@dlp ~(keystone)]# openstack subnet create public-subnet \ --network public --subnet-range 10.0.0.0/24 \ --allocation-pool start=10.0.0.200,end=10.0.0.254 \ --gateway 10.0.0.1 --dns-nameserver 10.0.0.10 --no-dhcp +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | allocation_pools | 10.0.0.200-10.0.0.254 | | cidr | 10.0.0.0/24 | | created_at | 2021-11-22T06:48:44Z | | description | | | dns_nameservers | 10.0.0.10 | | dns_publish_fixed_ip | None | | enable_dhcp | False | | gateway_ip | 10.0.0.1 | | host_routes | | | id | 34f12b40-ef7c-45c5-adeb-d7dd4606bae8 | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | public-subnet | | network_id | b59d2fc7-74bd-41b4-8e94-0a2a574e70ff | | project_id | b12f95625664420ca31949963b75b74f | | revision_number | 0 | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2021-11-22T06:48:44Z | +----------------------+--------------------------------------+ # 仮想ルーターにゲートウェイを設定 [root@dlp ~(keystone)]# openstack router set router01 --external-gateway public |
| [7] | 作成したネットワークは、外部用はデフォルトで全プロジェクトがアクセス可能ですが、内部用はデフォルトでは [admin] プロジェクトのみがアクセス可能なため、内部ネットワークを利用させたいプロジェクトにアクセス権限を付与しておきます。 |
|
# ネットワーク RBAC リスト表示 [root@dlp ~(keystone)]# openstack network rbac list +--------------------------------------+-------------+--------------------------------------+ | ID | Object Type | Object ID | +--------------------------------------+-------------+--------------------------------------+ | ec320c67-e161-4afd-ae3e-e75fe70d31dd | network | b59d2fc7-74bd-41b4-8e94-0a2a574e70ff | +--------------------------------------+-------------+--------------------------------------+ # RBAC の詳細 # [access_as_external] のみ全プロジェクトがアクセス可能な状態 [root@dlp ~(keystone)]# openstack network rbac show ec320c67-e161-4afd-ae3e-e75fe70d31dd +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | action | access_as_external | | id | ec320c67-e161-4afd-ae3e-e75fe70d31dd | | name | None | | object_id | b59d2fc7-74bd-41b4-8e94-0a2a574e70ff | | object_type | network | | project_id | b12f95625664420ca31949963b75b74f | | target_project_id | * | +-------------------+--------------------------------------+ # 作成済みネットワーク一覧 [root@dlp ~(keystone)]# openstack network list +--------------------------------------+---------+--------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+--------------------------------------+ | 485dc058-ae45-42e0-8109-b67ad16c0ad9 | private | dd8fff2f-c42f-4077-aa35-a7a24aa4c87e | | b59d2fc7-74bd-41b4-8e94-0a2a574e70ff | public | 34f12b40-ef7c-45c5-adeb-d7dd4606bae8 | +--------------------------------------+---------+--------------------------------------+ # 作成済みプロジェクト一覧 [root@dlp ~(keystone)]# openstack project list +----------------------------------+-----------+ | ID | Name | +----------------------------------+-----------+ | 2decda8bcd724687a1cf05064ab21fdf | hiroshima | | 7e53ef14eb894f379ea1929f5defc949 | service | | b12f95625664420ca31949963b75b74f | admin | +----------------------------------+-----------+ # [private] への [access_as_shared] アクセス権を [hiroshima] プロジェクトに付与 [root@dlp ~(keystone)]# netID=$(openstack network list | grep private | awk '{ print $2 }') [root@dlp ~(keystone)]# prjID=$(openstack project list | grep hiroshima | awk '{ print $2 }') [root@dlp ~(keystone)]# openstack network rbac create --target-project $prjID --type network --action access_as_shared $netID +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | action | access_as_shared | | id | 2af72449-dde8-4539-8246-900f70d0ca07 | | name | None | | object_id | 485dc058-ae45-42e0-8109-b67ad16c0ad9 | | object_type | network | | project_id | b12f95625664420ca31949963b75b74f | | target_project_id | 2decda8bcd724687a1cf05064ab21fdf | +-------------------+--------------------------------------+ |
| [8] | 内部ネットワークへのアクセス権を付与したプロジェクトに所属する任意のユーザーでログインし、 作成した内部ネットワークをインスタンスに紐付けてインスタンスを作成/起動します。 |
|
# 利用可能な [flavor] 確認 [cent@dlp ~(keystone)]$ openstack flavor list +----+----------+------+------+-----------+-------+-----------+ | ID | Name | RAM | Disk | Ephemeral | VCPUs | Is Public | +----+----------+------+------+-----------+-------+-----------+ | 0 | m1.small | 2048 | 10 | 0 | 1 | True | +----+----------+------+------+-----------+-------+-----------+ # 利用可能なイメージ確認 [cent@dlp ~(keystone)]$ openstack image list +--------------------------------------+-----------------+--------+ | ID | Name | Status | +--------------------------------------+-----------------+--------+ | cfce605e-151b-43dd-b743-2c7988d69e96 | CentOS-Stream-8 | active | +--------------------------------------+-----------------+--------+ # 利用可能なネットワーク確認 [cent@dlp ~(keystone)]$ openstack network list +--------------------------------------+---------+--------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+--------------------------------------+ | 485dc058-ae45-42e0-8109-b67ad16c0ad9 | private | dd8fff2f-c42f-4077-aa35-a7a24aa4c87e | | b59d2fc7-74bd-41b4-8e94-0a2a574e70ff | public | 34f12b40-ef7c-45c5-adeb-d7dd4606bae8 | +--------------------------------------+---------+--------------------------------------+ # インスタンス用のセキュリティグループを作成 [cent@dlp ~(keystone)]$ openstack security group create secgroup01 +-----------------+-------------------------------------------------------------------------------+ | Field | Value | +-----------------+-------------------------------------------------------------------------------+ | created_at | 2021-11-22T06:32:36Z | | description | secgroup01 | | id | 5b9c19b6-9814-4983-b661-fcb811f44331 | | name | secgroup01 | | project_id | 2decda8bcd724687a1cf05064ab21fdf | | revision_number | 1 | | rules | created_at='2021-11-22T06:32:36Z', direction='egress', ethertype='IPv4',..... | | | created_at='2021-11-22T06:32:36Z', direction='egress', ethertype='IPv6',..... | | stateful | True | | tags | [] | | updated_at | 2021-11-22T06:32:36Z | +-----------------+-------------------------------------------------------------------------------+ # インスタンス接続用の SSH キーペア作成 [cent@dlp ~(keystone)]$ ssh-keygen -q -N "" Enter file in which to save the key (/home/cent/.ssh/id_rsa): # 公開鍵登録 [cent@dlp ~(keystone)]$ openstack keypair create --public-key ~/.ssh/id_rsa.pub mykey +-------------+-------------------------------------------------+ | Field | Value | +-------------+-------------------------------------------------+ | created_at | None | | fingerprint | eb:2b:65:8d:5b:fe:27:33:7a:b3:5f:cf:58:7a:fc:f1 | | id | mykey | | is_deleted | None | | name | mykey | | type | ssh | | user_id | 6a517543654044e8b4ea9e0eea0adaa4 | +-------------+-------------------------------------------------+[cent@dlp ~(keystone)]$ netID=$(openstack network list | grep private | awk '{ print $2 }')
[cent@dlp ~(keystone)]$
[cent@dlp ~(keystone)]$ openstack server create --flavor m1.small --image CentOS-Stream-8 --security-group secgroup01 --nic net-id=$netID --key-name mykey CentOS-St-8
openstack server list +--------------------------------------+-------------+--------+-------------------------+-----------------+----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+-------------+--------+-------------------------+-----------------+----------+ | 93cf223a-ee02-42ee-b75e-da24ef60cf84 | CentOS-St-8 | ACTIVE | private=192.168.100.202 | CentOS-Stream-8 | m1.small | +--------------------------------------+-------------+--------+-------------------------+-----------------+----------+ |
| [9] | 作成した仮想マシンインスタンスにフローティング IP を割り当てます。 |
|
[cent@dlp ~(keystone)]$ openstack floating ip create public +---------------------+--------------------------------------+ | Field | Value | +---------------------+--------------------------------------+ | created_at | 2021-11-22T06:53:46Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | None | | floating_ip_address | 10.0.0.252 | | floating_network_id | b59d2fc7-74bd-41b4-8e94-0a2a574e70ff | | id | 392ac33e-d250-4cd2-bde1-c89fa20e88b6 | | name | 10.0.0.252 | | port_details | None | | port_id | None | | project_id | 2decda8bcd724687a1cf05064ab21fdf | | qos_policy_id | None | | revision_number | 0 | | router_id | None | | status | DOWN | | subnet_id | None | | tags | [] | | updated_at | 2021-11-22T06:53:46Z | +---------------------+--------------------------------------+
[cent@dlp ~(keystone)]$
openstack server add floating ip CentOS-St-8 10.0.0.252
# 設定確認 [cent@dlp ~(keystone)]$ openstack floating ip show 10.0.0.252 +---------------------+---------------------------------------------------------------------------+ | Field | Value | +---------------------+---------------------------------------------------------------------------+ | created_at | 2021-11-22T06:53:46Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | 192.168.100.202 | | floating_ip_address | 10.0.0.252 | | floating_network_id | b59d2fc7-74bd-41b4-8e94-0a2a574e70ff | | id | 392ac33e-d250-4cd2-bde1-c89fa20e88b6 | | name | 10.0.0.252 | | port_details | admin_state_up='True', device_id='93cf223a-ee02-42ee-b75e-da24ef60cf..... | | port_id | e317584e-037c-420f-b0dd-c8ba5b3d9ab2 | | project_id | 2decda8bcd724687a1cf05064ab21fdf | | qos_policy_id | None | | revision_number | 2 | | router_id | fefd042f-1456-4663-aaec-d5df85203ea4 | | status | ACTIVE | | subnet_id | None | | tags | [] | | updated_at | 2021-11-22T06:54:07Z | +---------------------+---------------------------------------------------------------------------+[cent@dlp ~(keystone)]$ openstack server list +--------------------------------------+-------------+--------+-------------------------------------+-----------------+----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+-------------+--------+-------------------------------------+-----------------+----------+ | 93cf223a-ee02-42ee-b75e-da24ef60cf84 | CentOS-St-8 | ACTIVE | private=10.0.0.252, 192.168.100.202 | CentOS-Stream-8 | m1.small | +--------------------------------------+-------------+--------+-------------------------------------+-----------------+----------+ |
| [10] | 起動した仮想マシンインスタンスに SSH 接続できるように、先に作成したセキュリティグループにポート許可の設定を追加します。 |
|
# ICMP 許可 [cent@dlp ~(keystone)]$ openstack security group rule create --protocol icmp --ingress secgroup01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | created_at | 2021-11-22T06:34:52Z | | description | | | direction | ingress | | ether_type | IPv4 | | id | 5f333a8e-7dc7-4209-8944-a406fe2f3bf0 | | name | None | | port_range_max | None | | port_range_min | None | | project_id | 2decda8bcd724687a1cf05064ab21fdf | | protocol | icmp | | remote_address_group_id | None | | remote_group_id | None | | remote_ip_prefix | 0.0.0.0/0 | | revision_number | 0 | | security_group_id | 5b9c19b6-9814-4983-b661-fcb811f44331 | | tags | [] | | updated_at | 2021-11-22T06:34:52Z | +-------------------------+--------------------------------------+ # SSH 許可 [cent@dlp ~(keystone)]$ openstack security group rule create --protocol tcp --dst-port 22:22 secgroup01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | created_at | 2021-11-22T06:35:07Z | | description | | | direction | ingress | | ether_type | IPv4 | | id | 8876f6a8-c0c1-49f0-8ad9-b0c079cf07a1 | | name | None | | port_range_max | 22 | | port_range_min | 22 | | project_id | 2decda8bcd724687a1cf05064ab21fdf | | protocol | tcp | | remote_address_group_id | None | | remote_group_id | None | | remote_ip_prefix | 0.0.0.0/0 | | revision_number | 0 | | security_group_id | 5b9c19b6-9814-4983-b661-fcb811f44331 | | tags | [] | | updated_at | 2021-11-22T06:35:07Z | +-------------------------+--------------------------------------+[cent@dlp ~(keystone)]$ openstack security group rule list secgroup01 +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ | ID | IP Protocol | Ethertype | IP Range | Port Range | Direction | Remote Security Group | Remote Address Group | +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ | 455224a2-019a-4d00-b923-98f77de99252 | None | IPv4 | 0.0.0.0/0 | | egress | None | None | | 5f333a8e-7dc7-4209-8944-a406fe2f3bf0 | icmp | IPv4 | 0.0.0.0/0 | | ingress | None | None | | 865b499e-b2c3-4f0e-b0fe-75bd154334c0 | None | IPv6 | ::/0 | | egress | None | None | | 8876f6a8-c0c1-49f0-8ad9-b0c079cf07a1 | tcp | IPv4 | 0.0.0.0/0 | 22:22 | ingress | None | None | +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ |
| [11] | 仮想マシンインスタンスに割りあてられたフローティング IP 宛てに SSH 接続することで、インスタンスに SSH ログインできます。 |
|
[cent@dlp ~(keystone)]$ openstack server list +--------------------------------------+-------------+--------+-------------------------------------+-----------------+----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+-------------+--------+-------------------------------------+-----------------+----------+ | 93cf223a-ee02-42ee-b75e-da24ef60cf84 | CentOS-St-8 | ACTIVE | private=10.0.0.252, 192.168.100.202 | CentOS-Stream-8 | m1.small | +--------------------------------------+-------------+--------+-------------------------------------+-----------------+----------+[cent@dlp ~(keystone)]$ ssh centos@10.0.0.252 The authenticity of host '10.0.0.252 (10.0.0.252)' can't be established. ECDSA key fingerprint is SHA256:X2CYADAX83p7AVodUdbD7A1ep9OCmuR6OSkKbvGZ3AI. Are you sure you want to continue connecting (yes/no/[fingerprint])? yes Warning: Permanently added '10.0.0.252' (ECDSA) to the list of known hosts. Activate the web console with: systemctl enable --now cockpit.socket [centos@centos-st-8 ~]$ # ログインできた |
| Sponsored Link |
|
|