OpenStack Zed : Neutron ネットワークを構成 (VXLAN)2023/06/28 |
|
OpenStack Network Service（Neutron）による仮想ネットワークの構成です。
例として、VXLAN タイプのネットワークを構成します。
事前に以下のように Control ノード、 Network ノード、 Compute ノードの 各 Neutron サービスノードを構築済みであることが前提です。
また、当例では Network ノードが 2 つのネットワークインターフェースを持っているものとします。
また、下例で eth1 の方は IP なしでインターフェースを UP しています。 * IP なしでのインターフェース UP の設定はこちらの [1] を参照
------------+--------------------------+--------------------------+------------
| | |
eth0|10.0.0.30 eth0|10.0.0.50 eth0|10.0.0.51
+-----------+-----------+ +-----------+-----------+ +-----------+-----------+
| [ dlp.srv.world ] | | [ network.srv.world ] | | [ node01.srv.world ] |
| (Control Node) | | (Network Node) | | (Compute Node) |
| | | | | |
| MariaDB RabbitMQ | | Neutron L2/L3 Agent | | Libvirt |
| Memcached Nginx | | Neutron Metadata | | Nova Compute |
| Keystone httpd | | Open vSwitch | | Neutron L2 Agent |
| Glance Nova API | | | | Open vSwitch |
| Neutron Server | | | | |
| Neutron Metadata | | | | |
+-----------------------+ +-----------+-----------+ +-----------------------+
eth1|(UP with no IP)
|
| [1] | Control ノードで以下のように設定変更します。 |
|
root@dlp ~(keystone)#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # [tenant_network_types] に値を追記 tenant_network_types = vxlan
# [ml2_type_flat] セクションに追記 [ml2_type_flat]
flat_networks = physnet1
# [ml2_type_vxlan] セクションに追記 [ml2_type_vxlan]
vni_ranges = 1:1000
systemctl restart neutron-api neutron-rpc-server |
| [2] | Network ノードで以下のように設定変更します。 |
|
# ブリッジ追加 root@network:~# ovs-vsctl add-br br-eth1 root@network:~# ip link set br-eth1 up root@network:~# echo -e '\nauto br-eth1\niface br-eth1 inet manual' >> /etc/network/interfaces
# 追加したブリッジのポートに [eth1] を追加 # [eth1] は環境によって異なるため自身の名称に置き換え root@network:~# ovs-vsctl add-port br-eth1 eth1
root@network:~#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # [tenant_network_types] に値を追記 tenant_network_types = vxlan
# [ml2_type_flat] セクションに追記 [ml2_type_flat]
flat_networks = physnet1
# [ml2_type_vxlan] セクションに追記 [ml2_type_vxlan]
vni_ranges = 1:1000
root@network:~#
vi /etc/neutron/plugins/ml2/openvswitch_agent.ini # [agent] セクションに追記 [agent]
tunnel_types = vxlan
prevent_arp_spoofing = True # [ovs] セクションに追記 [ovs]
local_ip = 10.0.0.50
bridge_mappings = physnet1:br-eth1
root@network:~#
vi /etc/neutron/dhcp_agent.ini # 68行目 : 追記
dnsmasq_config_file = /etc/neutron/dnsmasq-neutron.conf
root@network:~#
vi /etc/neutron/dnsmasq-neutron.conf # 新規作成
dhcp-option-force=26,1450
systemctl restart neutron-l3-agent neutron-dhcp-agent neutron-metadata-agent neutron-openvswitch-agent |
| [3] | Compute ノードで以下のように設定変更します。 |
|
root@node01:~#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # [tenant_network_types] に値を追記 tenant_network_types = vxlan
# [ml2_type_flat] セクションに追記 [ml2_type_flat]
flat_networks = physnet1
# [ml2_type_vxlan] セクションに追記 [ml2_type_vxlan]
vni_ranges = 1:1000
root@node01:~#
vi /etc/neutron/plugins/ml2/openvswitch_agent.ini # [agent] セクションに追記 [agent]
tunnel_types = vxlan
prevent_arp_spoofing = True # [ovs] セクションに追記 : 当ノードのローカル IP アドレスを追記 [ovs]
local_ip = 10.0.0.51
systemctl restart neutron-openvswitch-agent |
| [4] | 仮想ルーターを作成します。作業場所はどこでもよいですが、当例では Control ノード上で作業します。 |
|
root@dlp ~(keystone)# openstack router create router01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2023-06-28T05:17:21Z | | description | | | distributed | False | | enable_ndp_proxy | None | | external_gateway_info | null | | flavor_id | None | | ha | False | | id | 9986dcc9-1191-4f98-a7c8-0be5afd4d7f9 | | name | router01 | | project_id | 757625ae78404e38a8cfdd7c6d262860 | | revision_number | 1 | | routes | | | status | ACTIVE | | tags | | | tenant_id | 757625ae78404e38a8cfdd7c6d262860 | | updated_at | 2023-06-28T05:17:21Z | +-------------------------+--------------------------------------+ |
| [5] | 内部用のネットワークを作成し、仮想ルーターに関連付けます。 |
|
# 内部用ネットワーク作成 root@dlp ~(keystone)# openstack network create private --provider-network-type vxlan +---------------------------+--------------------------------------+ | Field | Value | +---------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2023-06-28T05:17:42Z | | description | | | dns_domain | None | | id | ae5fdb1f-efb9-412b-9053-b81106c90336 | | ipv4_address_scope | None | | ipv6_address_scope | None | | is_default | False | | is_vlan_transparent | None | | mtu | 1450 | | name | private | | port_security_enabled | True | | project_id | 757625ae78404e38a8cfdd7c6d262860 | | provider:network_type | vxlan | | provider:physical_network | None | | provider:segmentation_id | 40 | | qos_policy_id | None | | revision_number | 1 | | router:external | Internal | | segments | None | | shared | False | | status | ACTIVE | | subnets | | | tags | | | updated_at | 2023-06-28T05:17:42Z | +---------------------------+--------------------------------------+ # 内部用ネットワークにサブネット作成 root@dlp ~(keystone)# openstack subnet create private-subnet --network private \ --subnet-range 192.168.100.0/24 --gateway 192.168.100.1 \ --dns-nameserver 10.0.0.10 +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | allocation_pools | 192.168.100.2-192.168.100.254 | | cidr | 192.168.100.0/24 | | created_at | 2023-06-28T05:18:08Z | | description | | | dns_nameservers | 10.0.0.10 | | dns_publish_fixed_ip | None | | enable_dhcp | True | | gateway_ip | 192.168.100.1 | | host_routes | | | id | b3234f3f-b3e3-41d2-b3a4-ca3d4ec55d24 | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | private-subnet | | network_id | ae5fdb1f-efb9-412b-9053-b81106c90336 | | project_id | 757625ae78404e38a8cfdd7c6d262860 | | revision_number | 0 | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2023-06-28T05:18:08Z | +----------------------+--------------------------------------+ # 仮想ルーターに内部ネットワークを設定 root@dlp ~(keystone)# openstack router add subnet router01 private-subnet
|
| [6] | 外部接続用のネットワークを作成し、仮想ルーターに関連付けます。 |
|
# 外部用ネットワーク作成 root@dlp ~(keystone)# openstack network create \ --provider-physical-network physnet1 \ --provider-network-type flat --external public +---------------------------+--------------------------------------+ | Field | Value | +---------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2023-06-28T05:18:37Z | | description | | | dns_domain | None | | id | b9b8536b-0696-4a5b-af05-602587435c0a | | ipv4_address_scope | None | | ipv6_address_scope | None | | is_default | False | | is_vlan_transparent | None | | mtu | 1500 | | name | public | | port_security_enabled | True | | project_id | 757625ae78404e38a8cfdd7c6d262860 | | provider:network_type | flat | | provider:physical_network | physnet1 | | provider:segmentation_id | None | | qos_policy_id | None | | revision_number | 1 | | router:external | External | | segments | None | | shared | False | | status | ACTIVE | | subnets | | | tags | | | updated_at | 2023-06-28T05:18:37Z | +---------------------------+--------------------------------------+ # 外部用ネットワークにサブネット作成 root@dlp ~(keystone)# openstack subnet create public-subnet \ --network public --subnet-range 10.0.0.0/24 \ --allocation-pool start=10.0.0.200,end=10.0.0.254 \ --gateway 10.0.0.1 --dns-nameserver 10.0.0.10 --no-dhcp +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | allocation_pools | 10.0.0.200-10.0.0.254 | | cidr | 10.0.0.0/24 | | created_at | 2023-06-28T05:18:58Z | | description | | | dns_nameservers | 10.0.0.10 | | dns_publish_fixed_ip | None | | enable_dhcp | False | | gateway_ip | 10.0.0.1 | | host_routes | | | id | 0129c597-e411-450e-a4f9-b387c68eddb3 | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | public-subnet | | network_id | b9b8536b-0696-4a5b-af05-602587435c0a | | project_id | 757625ae78404e38a8cfdd7c6d262860 | | revision_number | 0 | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2023-06-28T05:18:58Z | +----------------------+--------------------------------------+ # 仮想ルーターにゲートウェイを設定 root@dlp ~(keystone)# openstack router set router01 --external-gateway public |
| [7] | 作成したネットワークは、外部用はデフォルトで全プロジェクトがアクセス可能ですが、内部用はデフォルトでは [admin] プロジェクトのみがアクセス可能なため、内部ネットワークを利用させたいプロジェクトにアクセス権限を付与しておきます。 |
|
# ネットワーク RBAC リスト表示 root@dlp ~(keystone)# openstack network rbac list +--------------------------------------+-------------+--------------------------------------+ | ID | Object Type | Object ID | +--------------------------------------+-------------+--------------------------------------+ | 2d404daa-c24b-48f6-a4d8-9f9c21ca5897 | network | b9b8536b-0696-4a5b-af05-602587435c0a | +--------------------------------------+-------------+--------------------------------------+ # RBAC の詳細 # [access_as_external] のみ全プロジェクトがアクセス可能な状態 root@dlp ~(keystone)# openstack network rbac show 2d404daa-c24b-48f6-a4d8-9f9c21ca5897 +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | action | access_as_external | | id | 2d404daa-c24b-48f6-a4d8-9f9c21ca5897 | | object_id | b9b8536b-0696-4a5b-af05-602587435c0a | | object_type | network | | project_id | 757625ae78404e38a8cfdd7c6d262860 | | target_project_id | * | +-------------------+--------------------------------------+ # 作成済みネットワーク一覧 root@dlp ~(keystone)# openstack network list +--------------------------------------+---------+--------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+--------------------------------------+ | ae5fdb1f-efb9-412b-9053-b81106c90336 | private | b3234f3f-b3e3-41d2-b3a4-ca3d4ec55d24 | | b9b8536b-0696-4a5b-af05-602587435c0a | public | 0129c597-e411-450e-a4f9-b387c68eddb3 | +--------------------------------------+---------+--------------------------------------+ # 作成済みプロジェクト一覧 root@dlp ~(keystone)# openstack project list +----------------------------------+-----------+ | ID | Name | +----------------------------------+-----------+ | 1c2f5dc8c4f9494fbaaa4217c8e3585a | hiroshima | | 757625ae78404e38a8cfdd7c6d262860 | admin | | d8b09d86ed7743039f92b2e542ea26c1 | service | +----------------------------------+-----------+ # [private] への [access_as_shared] アクセス権を [hiroshima] プロジェクトに付与 root@dlp ~(keystone)# netID=$(openstack network list | grep private | awk '{ print $2 }') root@dlp ~(keystone)# prjID=$(openstack project list | grep hiroshima | awk '{ print $2 }') root@dlp ~(keystone)# openstack network rbac create --target-project $prjID --type network --action access_as_shared $netID +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | action | access_as_shared | | id | f49116ef-475a-411d-a568-142462401cc4 | | object_id | ae5fdb1f-efb9-412b-9053-b81106c90336 | | object_type | network | | project_id | 757625ae78404e38a8cfdd7c6d262860 | | target_project_id | 1c2f5dc8c4f9494fbaaa4217c8e3585a | +-------------------+--------------------------------------+ |
| [8] | 内部ネットワークへのアクセス権を付与したプロジェクトに所属する任意のユーザーでログインし、 作成した内部ネットワークをインスタンスに紐付けてインスタンスを作成・起動します。 |
|
# 利用可能な [flavor] 確認 debian@dlp ~(keystone)$ openstack flavor list +----+-----------+------+------+-----------+-------+-----------+ | ID | Name | RAM | Disk | Ephemeral | VCPUs | Is Public | +----+-----------+------+------+-----------+-------+-----------+ | 1 | m1.small | 2048 | 10 | 0 | 1 | True | | 2 | m1.medium | 4096 | 10 | 0 | 2 | True | | 3 | m1.large | 8192 | 10 | 0 | 4 | True | | 4 | m2.large | 8192 | 10 | 10 | 4 | True | | 5 | m3.large | 8192 | 20 | 0 | 4 | True | +----+-----------+------+------+-----------+-------+-----------+ # 利用可能なイメージ確認 debian@dlp ~(keystone)$ openstack image list +--------------------------------------+----------+--------+ | ID | Name | Status | +--------------------------------------+----------+--------+ | 3a660af6-3f41-4c0f-b2a8-55127dfc3c60 | Debian12 | active | +--------------------------------------+----------+--------+ # 利用可能なネットワーク確認 debian@dlp ~(keystone)$ openstack network list +--------------------------------------+---------+--------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+--------------------------------------+ | ae5fdb1f-efb9-412b-9053-b81106c90336 | private | b3234f3f-b3e3-41d2-b3a4-ca3d4ec55d24 | | b9b8536b-0696-4a5b-af05-602587435c0a | public | 0129c597-e411-450e-a4f9-b387c68eddb3 | +--------------------------------------+---------+--------------------------------------+ # インスタンス用のセキュリティグループを作成 debian@dlp ~(keystone)$ openstack security group create secgroup01 +-----------------+-----------------------------------------------------------------------------+ | Field | Value | +-----------------+-----------------------------------------------------------------------------+ | created_at | 2023-06-28T04:47:25Z | | description | secgroup01 | | id | bd1040a7-caab-477e-a1bb-add49bb8f16a | | name | secgroup01 | | project_id | 1c2f5dc8c4f9494fbaaa4217c8e3585a | | revision_number | 1 | | rules | created_at='2023-06-28T04:47:25Z', direction='egress', ethertype='IPv4',... | | | created_at='2023-06-28T04:47:25Z', direction='egress', ethertype='IPv6',... | | stateful | True | | tags | [] | | updated_at | 2023-06-28T04:47:25Z | +-----------------+-----------------------------------------------------------------------------+ # インスタンス接続用の SSH キーペア作成 debian@dlp ~(keystone)$ ssh-keygen -q -N "" Enter file in which to save the key (/home/debian/.ssh/id_rsa): # 公開鍵登録 debian@dlp ~(keystone)$ openstack keypair create --public-key ~/.ssh/id_rsa.pub mykey +-------------+-------------------------------------------------+ | Field | Value | +-------------+-------------------------------------------------+ | created_at | None | | fingerprint | 7d:e7:1f:33:80:d7:85:02:43:a9:07:52:b5:cd:be:3d | | id | mykey | | is_deleted | None | | name | mykey | | type | ssh | | user_id | de51d5f0ee2c485885877d21f5b424e0 | +-------------+-------------------------------------------------+debian@dlp ~(keystone)$ netID=$(openstack network list | grep private | awk '{ print $2 }')
debian@dlp ~(keystone)$
debian@dlp ~(keystone)$ openstack server create --flavor m1.medium --image Debian12 --security-group secgroup01 --nic net-id=$netID --key-name mykey Debian-12
openstack server list +--------------------------------------+-----------+--------+------------------------+----------+-----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+-----------+--------+------------------------+----------+-----------+ | c3a4a792-a7ac-41bd-8c93-7fd162016f22 | Debian-12 | ACTIVE | private=192.168.100.66 | Debian12 | m1.medium | +--------------------------------------+-----------+--------+------------------------+----------+-----------+ |
| [9] | 作成した仮想マシンインスタンスにフローティング IP を割り当てます。 |
|
debian@dlp ~(keystone)$ openstack floating ip create public +---------------------+--------------------------------------+ | Field | Value | +---------------------+--------------------------------------+ | created_at | 2023-06-28T05:25:12Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | None | | floating_ip_address | 10.0.0.241 | | floating_network_id | b9b8536b-0696-4a5b-af05-602587435c0a | | id | 9187bb70-90ed-4c7a-9215-ee7e4aaadbb1 | | name | 10.0.0.241 | | port_details | None | | port_id | None | | project_id | 1c2f5dc8c4f9494fbaaa4217c8e3585a | | qos_policy_id | None | | revision_number | 0 | | router_id | None | | status | DOWN | | subnet_id | None | | tags | [] | | updated_at | 2023-06-28T05:25:12Z | +---------------------+--------------------------------------+
debian@dlp ~(keystone)$
openstack server add floating ip Debian-12 10.0.0.241
# 設定確認 debian@dlp ~(keystone)$ openstack floating ip show 10.0.0.241 +---------------------+---------------------------------------------------------------------------+ | Field | Value | +---------------------+---------------------------------------------------------------------------+ | created_at | 2023-06-28T05:25:12Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | 192.168.100.66 | | floating_ip_address | 10.0.0.241 | | floating_network_id | b9b8536b-0696-4a5b-af05-602587435c0a | | id | 9187bb70-90ed-4c7a-9215-ee7e4aaadbb1 | | name | 10.0.0.241 | | port_details | admin_state_up='True', device_id='c3a4a792-a7ac-41bd-8c93-7fd162016f22... | | port_id | b1189c54-2fe8-4930-88dd-fa5cd43f74ba | | project_id | 1c2f5dc8c4f9494fbaaa4217c8e3585a | | qos_policy_id | None | | revision_number | 2 | | router_id | 9986dcc9-1191-4f98-a7c8-0be5afd4d7f9 | | status | ACTIVE | | subnet_id | None | | tags | [] | | updated_at | 2023-06-28T05:25:49Z | +---------------------+---------------------------------------------------------------------------+debian@dlp ~(keystone)$ openstack server list +--------------------------------------+-----------+--------+------------------------------------+----------+-----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+-----------+--------+------------------------------------+----------+-----------+ | c3a4a792-a7ac-41bd-8c93-7fd162016f22 | Debian-12 | ACTIVE | private=10.0.0.241, 192.168.100.66 | Debian12 | m1.medium | +--------------------------------------+-----------+--------+------------------------------------+----------+-----------+ |
| [10] | 起動した仮想マシンインスタンスに SSH 接続できるように、先に作成したセキュリティグループにポート許可の設定を追加します。 |
|
# ICMP 許可 debian@dlp ~(keystone)$ openstack security group rule create --protocol icmp --ingress secgroup01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | created_at | 2023-06-28T04:50:12Z | | description | | | direction | ingress | | ether_type | IPv4 | | id | 3c94d258-49ad-4074-9674-f5ab2f857881 | | name | None | | port_range_max | None | | port_range_min | None | | project_id | 1c2f5dc8c4f9494fbaaa4217c8e3585a | | protocol | icmp | | remote_address_group_id | None | | remote_group_id | None | | remote_ip_prefix | 0.0.0.0/0 | | revision_number | 0 | | security_group_id | bd1040a7-caab-477e-a1bb-add49bb8f16a | | tags | [] | | updated_at | 2023-06-28T04:50:12Z | +-------------------------+--------------------------------------+ # SSH 許可 debian@dlp ~(keystone)$ openstack security group rule create --protocol tcp --dst-port 22:22 secgroup01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | created_at | 2023-06-28T04:50:30Z | | description | | | direction | ingress | | ether_type | IPv4 | | id | 7dcb363a-130b-4c0a-a0b3-17e1ad4ab3c5 | | name | None | | port_range_max | 22 | | port_range_min | 22 | | project_id | 1c2f5dc8c4f9494fbaaa4217c8e3585a | | protocol | tcp | | remote_address_group_id | None | | remote_group_id | None | | remote_ip_prefix | 0.0.0.0/0 | | revision_number | 0 | | security_group_id | bd1040a7-caab-477e-a1bb-add49bb8f16a | | tags | [] | | updated_at | 2023-06-28T04:50:30Z | +-------------------------+--------------------------------------+debian@dlp ~(keystone)$ openstack security group rule list secgroup01 +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ | ID | IP Protocol | Ethertype | IP Range | Port Range | Direction | Remote Security Group | Remote Address Group | +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ | 3c94d258-49ad-4074-9674-f5ab2f857881 | icmp | IPv4 | 0.0.0.0/0 | | ingress | None | None | | 3d38e938-713c-47c6-8a97-ada9d5a734c8 | None | IPv4 | 0.0.0.0/0 | | egress | None | None | | 7dcb363a-130b-4c0a-a0b3-17e1ad4ab3c5 | tcp | IPv4 | 0.0.0.0/0 | 22:22 | ingress | None | None | | c11e0dd7-6758-4cf7-b3f2-11359b1a6dea | None | IPv6 | ::/0 | | egress | None | None | +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ |
| [11] | 仮想マシンインスタンスに割りあてられたフローティング IP 宛てに SSH 接続することで、インスタンスに SSH ログインできます。 |
|
debian@dlp ~(keystone)$ openstack server list +--------------------------------------+-----------+--------+------------------------------------+----------+-----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+-----------+--------+------------------------------------+----------+-----------+ | c3a4a792-a7ac-41bd-8c93-7fd162016f22 | Debian-12 | ACTIVE | private=10.0.0.241, 192.168.100.66 | Debian12 | m1.medium | +--------------------------------------+-----------+--------+------------------------------------+----------+-----------+debian@dlp ~(keystone)$ ssh debian@10.0.0.241 The authenticity of host '10.0.0.241 (10.0.0.241)' can't be established. ED25519 key fingerprint is SHA256:KVRQYaFG6fRclEEpjyPVgmR1pMU5eq3y9bDH6I+rf8k. This key is not known by any other names. Are you sure you want to continue connecting (yes/no/[fingerprint])? yes Warning: Permanently added '10.0.0.241' (ED25519) to the list of known hosts. Linux debian-12 6.1.0-9-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.27-1 (2023-05-08) x86_64 The programs included with the Debian GNU/Linux system are free software; the exact distribution terms for each program are described in the individual files in /usr/share/doc/*/copyright. Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent permitted by applicable law. debian@debian-12:~$ # ログインできた |
| Sponsored Link |