OpenStack Bobcat : Neutron Network (VXLAN)2023/10/24 |
|
Configure virtual networking by OpenStack Network Service (Neutron).
For example, configure VXLAN type of networking on here.
Before it, Configure basic settings on Control Node, Network Node, Compute Node.
Furthermore, this example is based on the environment that Network Node has 2 network interfaces.
------------+--------------------------+--------------------------+------------
| | |
eth0|10.0.0.30 eth0|10.0.0.50 eth0|10.0.0.51
+-----------+-----------+ +-----------+-----------+ +-----------+-----------+
| [ dlp.srv.world ] | | [ network.srv.world ] | | [ node01.srv.world ] |
| (Control Node) | | (Network Node) | | (Compute Node) |
| | | | | |
| MariaDB RabbitMQ | | Neutron L2/L3 Agent | | Libvirt |
| Memcached Nginx | | Neutron Metadata | | Nova Compute |
| Keystone httpd | | Open vSwitch | | Neutron L2 Agent |
| Glance Nova API | | | | Open vSwitch |
| Neutron Server | | | | |
| Neutron Metadata | | | | |
+-----------------------+ +-----------+-----------+ +-----------------------+
eth1|(UP with no IP)
|
| [1] | Change settings on Control Node. |
|
[root@dlp ~(keystone)]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # add a value to [tenant_network_types] [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan
# add to the end [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000 systemctl restart neutron-server |
| [2] | Change settings on Network Node. |
|
# add bridge [root@network ~]# ovs-vsctl add-br br-eth1
# add [eth1] to the port of the bridge above # replace the interface name [eth1] to your own environment [root@network ~]# ovs-vsctl add-port br-eth1 eth1
[root@network ~]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # add a value to [tenant_network_types] [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan
# add to the end [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000
[root@network ~]#
vi /etc/neutron/plugins/ml2/openvswitch_agent.ini # add to the end
[agent]
tunnel_types = vxlan
prevent_arp_spoofing = True
[ovs]
# specify IP address of this host for [local_ip]
local_ip = 10.0.0.50
bridge_mappings = physnet1:br-eth1
[root@network ~]#
systemctl restart neutron-dhcp-agent neutron-l3-agent neutron-metadata-agent neutron-openvswitch-agent
# if Firewalld is running, allow VXLAN port [root@network ~]# firewall-cmd --add-port=4789/udp [root@network ~]# firewall-cmd --runtime-to-permanent |
| [3] | Change settings on Compute Node. |
|
[root@node01 ~]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # add a value to [tenant_network_types] [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan
# add to the end [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000
[root@node01 ~]#
vi /etc/neutron/plugins/ml2/openvswitch_agent.ini # add to the end
[agent]
tunnel_types = vxlan
prevent_arp_spoofing = True
[ovs]
# specify IP address of this host for [local_ip]
local_ip = 10.0.0.51
[root@node01 ~]#
systemctl restart neutron-openvswitch-agent
# if Firewalld is running, allow VXLAN port [root@node01 ~]# firewall-cmd --add-port=4789/udp [root@node01 ~]# firewall-cmd --runtime-to-permanent |
| [4] | Create a Virtual router. It's OK to work on any node. (This example is on Control Node) |
|
[root@dlp ~(keystone)]# openstack router create router01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2023-10-24T06:19:13Z | | description | | | distributed | False | | enable_ndp_proxy | None | | external_gateway_info | null | | flavor_id | None | | ha | False | | id | aaa3591a-6a4b-4505-a532-2710e7173c68 | | name | router01 | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | revision_number | 1 | | routes | | | status | ACTIVE | | tags | | | tenant_id | d9d13fdc603c42f69a0ea034b64a3cdb | | updated_at | 2023-10-24T06:19:13Z | +-------------------------+--------------------------------------+ |
| [5] | Create internal network and associate with the router above. |
|
# create internal network [root@dlp ~(keystone)]# openstack network create private --provider-network-type vxlan +---------------------------+--------------------------------------+ | Field | Value | +---------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2023-10-24T06:19:42Z | | description | | | dns_domain | None | | id | 8c925702-1181-4c2a-8e27-b1d6afb9c3de | | ipv4_address_scope | None | | ipv6_address_scope | None | | is_default | False | | is_vlan_transparent | None | | mtu | 1450 | | name | private | | port_security_enabled | True | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | provider:network_type | vxlan | | provider:physical_network | None | | provider:segmentation_id | 621 | | qos_policy_id | None | | revision_number | 1 | | router:external | Internal | | segments | None | | shared | False | | status | ACTIVE | | subnets | | | tags | | | tenant_id | d9d13fdc603c42f69a0ea034b64a3cdb | | updated_at | 2023-10-24T06:19:42Z | +---------------------------+--------------------------------------+ # create subnet in the internal network [root@dlp ~(keystone)]# openstack subnet create private-subnet --network private \ --subnet-range 192.168.100.0/24 --gateway 192.168.100.1 \ --dns-nameserver 10.0.0.10 +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | allocation_pools | 192.168.100.2-192.168.100.254 | | cidr | 192.168.100.0/24 | | created_at | 2023-10-24T06:20:10Z | | description | | | dns_nameservers | 10.0.0.10 | | dns_publish_fixed_ip | None | | enable_dhcp | True | | gateway_ip | 192.168.100.1 | | host_routes | | | id | 6d794ec8-8649-41b9-ae1d-b4d8ea24218d | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | private-subnet | | network_id | 8c925702-1181-4c2a-8e27-b1d6afb9c3de | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | revision_number | 0 | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2023-10-24T06:20:10Z | +----------------------+--------------------------------------+ # set internal network to the router above [root@dlp ~(keystone)]# openstack router add subnet router01 private-subnet
|
| [6] | Create external network and associate with the router above. |
|
# create external network [root@dlp ~(keystone)]# openstack network create \ --provider-physical-network physnet1 \ --provider-network-type flat --external public +---------------------------+--------------------------------------+ | Field | Value | +---------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2023-10-24T06:21:38Z | | description | | | dns_domain | None | | id | fbb4c1cd-5033-479f-9482-d8493f20c014 | | ipv4_address_scope | None | | ipv6_address_scope | None | | is_default | False | | is_vlan_transparent | None | | mtu | 1500 | | name | public | | port_security_enabled | True | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | provider:network_type | flat | | provider:physical_network | physnet1 | | provider:segmentation_id | None | | qos_policy_id | None | | revision_number | 1 | | router:external | External | | segments | None | | shared | False | | status | ACTIVE | | subnets | | | tags | | | tenant_id | d9d13fdc603c42f69a0ea034b64a3cdb | | updated_at | 2023-10-24T06:21:38Z | +---------------------------+--------------------------------------+ # create subnet in the external network [root@dlp ~(keystone)]# openstack subnet create public-subnet \ --network public --subnet-range 10.0.0.0/24 \ --allocation-pool start=10.0.0.200,end=10.0.0.254 \ --gateway 10.0.0.1 --dns-nameserver 10.0.0.10 --no-dhcp +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | allocation_pools | 10.0.0.200-10.0.0.254 | | cidr | 10.0.0.0/24 | | created_at | 2023-10-24T06:22:04Z | | description | | | dns_nameservers | 10.0.0.10 | | dns_publish_fixed_ip | None | | enable_dhcp | False | | gateway_ip | 10.0.0.1 | | host_routes | | | id | 88e85964-6c74-414e-bbfc-f9979c12f5b6 | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | public-subnet | | network_id | fbb4c1cd-5033-479f-9482-d8493f20c014 | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | revision_number | 0 | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2023-10-24T06:22:04Z | +----------------------+--------------------------------------+ # set gateway to the router above [root@dlp ~(keystone)]# openstack router set router01 --external-gateway public |
| [7] | By default, it's possible to access for all projects to external network, however, for internal network, only admin projects can access to it, so grant access permission of internal network to a project you'd like to let users in the project use. |
|
# show network RBAC list [root@dlp ~(keystone)]# openstack network rbac list +--------------------------------------+-------------+--------------------------------------+ | ID | Object Type | Object ID | +--------------------------------------+-------------+--------------------------------------+ | 5498954e-3272-4353-b4ba-2365b224bc60 | network | fbb4c1cd-5033-479f-9482-d8493f20c014 | +--------------------------------------+-------------+--------------------------------------+ # RBAC details # all projects can access only to [access_as_external] [root@dlp ~(keystone)]# openstack network rbac show 5498954e-3272-4353-b4ba-2365b224bc60 +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | action | access_as_external | | id | 5498954e-3272-4353-b4ba-2365b224bc60 | | object_id | fbb4c1cd-5033-479f-9482-d8493f20c014 | | object_type | network | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | target_project_id | * | +-------------------+--------------------------------------+ # show network list [root@dlp ~(keystone)]# openstack network list +--------------------------------------+---------+--------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+--------------------------------------+ | 8c925702-1181-4c2a-8e27-b1d6afb9c3de | private | 6d794ec8-8649-41b9-ae1d-b4d8ea24218d | | fbb4c1cd-5033-479f-9482-d8493f20c014 | public | 88e85964-6c74-414e-bbfc-f9979c12f5b6 | +--------------------------------------+---------+--------------------------------------+ # show project list [root@dlp ~(keystone)]# openstack project list +----------------------------------+-----------+ | ID | Name | +----------------------------------+-----------+ | 5d97881520b34e6bbf1f15e778c82fe4 | service | | d9d13fdc603c42f69a0ea034b64a3cdb | admin | | f4598dfd3b8a47149234b6892d18d5a4 | hiroshima | +----------------------------------+-----------+ # grant [access_as_shared] permission for [private] to [hiroshima] project [root@dlp ~(keystone)]# netID=$(openstack network list | grep private | awk '{ print $2 }') [root@dlp ~(keystone)]# prjID=$(openstack project list | grep hiroshima | awk '{ print $2 }') [root@dlp ~(keystone)]# openstack network rbac create --target-project $prjID --type network --action access_as_shared $netID +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | action | access_as_shared | | id | 2d8e3683-1f95-451b-b38d-f29c692c758d | | object_id | 8c925702-1181-4c2a-8e27-b1d6afb9c3de | | object_type | network | | project_id | d9d13fdc603c42f69a0ea034b64a3cdb | | target_project_id | f4598dfd3b8a47149234b6892d18d5a4 | +-------------------+--------------------------------------+ |
| [8] | Login as a user who can use Openstack system and Create and start a Virtual machine Instance with the network created above. |
|
# show available [flavor] list [cent@dlp ~(keystone)]$ openstack flavor list +----+-----------+------+------+-----------+-------+-----------+ | ID | Name | RAM | Disk | Ephemeral | VCPUs | Is Public | +----+-----------+------+------+-----------+-------+-----------+ | 1 | m1.small | 2048 | 10 | 0 | 1 | True | | 2 | m1.medium | 4096 | 10 | 0 | 2 | True | | 3 | m1.large | 8192 | 10 | 0 | 4 | True | | 4 | m2.large | 8192 | 10 | 10 | 4 | True | | 5 | m3.large | 8192 | 50 | 0 | 4 | True | +----+-----------+------+------+-----------+-------+-----------+ # show available image list [cent@dlp ~(keystone)]$ openstack image list +--------------------------------------+----------------+--------+ | ID | Name | Status | +--------------------------------------+----------------+--------+ | bcbaa323-2438-4f5e-9473-49f633bb8f9b | CentOS-Stream9 | active | +--------------------------------------+----------------+--------+ # show available network list [cent@dlp ~(keystone)]$ openstack network list +--------------------------------------+---------+--------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+--------------------------------------+ | 8c925702-1181-4c2a-8e27-b1d6afb9c3de | private | 6d794ec8-8649-41b9-ae1d-b4d8ea24218d | | fbb4c1cd-5033-479f-9482-d8493f20c014 | public | 88e85964-6c74-414e-bbfc-f9979c12f5b6 | +--------------------------------------+---------+--------------------------------------+ # create a security group for instances [cent@dlp ~(keystone)]$ openstack security group create secgroup01 +-----------------+----------------------------------------------------------------------------+ | Field | Value | +-----------------+----------------------------------------------------------------------------+ | created_at | 2023-10-24T06:01:52Z | | description | secgroup01 | | id | 2fece9fc-ab36-430c-818e-c9c19404c02c | | name | secgroup01 | | project_id | f4598dfd3b8a47149234b6892d18d5a4 | | revision_number | 1 | | rules | created_at='2023-10-24T06:01:52Z', direction='egress', ethertype='IPv6'... | | | created_at='2023-10-24T06:01:52Z', direction='egress', ethertype='IPv4'... | | shared | False | | stateful | True | | tags | [] | | updated_at | 2023-10-24T06:01:52Z | +-----------------+----------------------------------------------------------------------------+ # create an SSH keypair for connecting to instances [cent@dlp ~(keystone)]$ ssh-keygen -q -N "" Enter file in which to save the key (/home/cent/.ssh/id_rsa): # add public-key [cent@dlp ~(keystone)]$ openstack keypair create --public-key ~/.ssh/id_rsa.pub mykey +-------------+-------------------------------------------------+ | Field | Value | +-------------+-------------------------------------------------+ | created_at | None | | fingerprint | ae:d2:da:33:67:de:c7:1d:a5:bd:97:b2:31:de:be:0d | | id | mykey | | is_deleted | None | | name | mykey | | type | ssh | | user_id | d70a5f7908de4cd9aa8e189b725244a9 | +-------------+-------------------------------------------------+[cent@dlp ~(keystone)]$ netID=$(openstack network list | grep private | awk '{ print $2 }')
[cent@dlp ~(keystone)]$
[cent@dlp ~(keystone)]$ openstack server create --flavor m1.medium --image CentOS-Stream9 --security-group secgroup01 --nic net-id=$netID --key-name mykey CentOS-St9
openstack server list +--------------------------------------+------------+--------+------------------------+----------------+-----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+------------+--------+------------------------+----------------+-----------+ | 5daa5207-b055-4028-a4ca-467ac255b2aa | CentOS-St9 | ACTIVE | private=192.168.100.18 | CentOS-Stream9 | m1.medium | +--------------------------------------+------------+--------+------------------------+----------------+-----------+ |
| [9] | Assign floating IP address to the Instance above. |
|
[cent@dlp ~(keystone)]$ openstack floating ip create public +---------------------+--------------------------------------+ | Field | Value | +---------------------+--------------------------------------+ | created_at | 2023-10-24T06:35:44Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | None | | floating_ip_address | 10.0.0.241 | | floating_network_id | fbb4c1cd-5033-479f-9482-d8493f20c014 | | id | ee4e093b-efd2-4231-8477-711b4edcf0ac | | name | 10.0.0.241 | | port_details | None | | port_id | None | | project_id | f4598dfd3b8a47149234b6892d18d5a4 | | qos_policy_id | None | | revision_number | 0 | | router_id | None | | status | DOWN | | subnet_id | None | | tags | [] | | updated_at | 2023-10-24T06:35:44Z | +---------------------+--------------------------------------+
[cent@dlp ~(keystone)]$
openstack server add floating ip CentOS-St9 10.0.0.241
# confirm settings [cent@dlp ~(keystone)]$ openstack floating ip show 10.0.0.241 +---------------------+--------------------------------------------------------------------------+ | Field | Value | +---------------------+--------------------------------------------------------------------------+ | created_at | 2023-10-24T06:35:44Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | 192.168.100.18 | | floating_ip_address | 10.0.0.241 | | floating_network_id | fbb4c1cd-5033-479f-9482-d8493f20c014 | | id | ee4e093b-efd2-4231-8477-711b4edcf0ac | | name | 10.0.0.241 | | port_details | admin_state_up='True', device_id='5daa5207-b055-4028-a4ca-467ac255b2a... | | port_id | 08e55fd5-d3dd-4307-8029-896c200f7594 | | project_id | f4598dfd3b8a47149234b6892d18d5a4 | | qos_policy_id | None | | revision_number | 2 | | router_id | aaa3591a-6a4b-4505-a532-2710e7173c68 | | status | ACTIVE | | subnet_id | None | | tags | [] | | updated_at | 2023-10-24T06:36:13Z | +---------------------+--------------------------------------------------------------------------+[cent@dlp ~(keystone)]$ openstack server list +--------------------------------------+------------+--------+------------------------------------+----------------+-----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+------------+--------+------------------------------------+----------------+-----------+ | 5daa5207-b055-4028-a4ca-467ac255b2aa | CentOS-St9 | ACTIVE | private=10.0.0.241, 192.168.100.18 | CentOS-Stream9 | m1.medium | +--------------------------------------+------------+--------+------------------------------------+----------------+-----------+ |
| [10] | Configure security settings for the security group you created above to access with SSH and ICMP. |
|
# permit ICMP [cent@dlp ~(keystone)]$ openstack security group rule create --protocol icmp --ingress secgroup01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | created_at | 2023-10-24T06:05:30Z | | description | | | direction | ingress | | ether_type | IPv4 | | id | 1d7f2882-a65c-4fa9-b642-df039d313b91 | | name | None | | normalized_cidr | 0.0.0.0/0 | | port_range_max | None | | port_range_min | None | | project_id | f4598dfd3b8a47149234b6892d18d5a4 | | protocol | icmp | | remote_address_group_id | None | | remote_group_id | None | | remote_ip_prefix | 0.0.0.0/0 | | revision_number | 0 | | security_group_id | 2fece9fc-ab36-430c-818e-c9c19404c02c | | tags | [] | | updated_at | 2023-10-24T06:05:30Z | +-------------------------+--------------------------------------+ # permit SSH [cent@dlp ~(keystone)]$ openstack security group rule create --protocol tcp --dst-port 22:22 secgroup01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | created_at | 2023-10-24T06:05:48Z | | description | | | direction | ingress | | ether_type | IPv4 | | id | 0f593e44-0200-41a2-9cc7-cd084225eaaf | | name | None | | normalized_cidr | 0.0.0.0/0 | | port_range_max | 22 | | port_range_min | 22 | | project_id | f4598dfd3b8a47149234b6892d18d5a4 | | protocol | tcp | | remote_address_group_id | None | | remote_group_id | None | | remote_ip_prefix | 0.0.0.0/0 | | revision_number | 0 | | security_group_id | 2fece9fc-ab36-430c-818e-c9c19404c02c | | tags | [] | | updated_at | 2023-10-24T06:05:48Z | +-------------------------+--------------------------------------+[cent@dlp ~(keystone)]$ openstack security group rule list secgroup01 +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ | ID | IP Protocol | Ethertype | IP Range | Port Range | Direction | Remote Security Group | Remote Address Group | +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ | 0f593e44-0200-41a2-9cc7-cd084225eaaf | tcp | IPv4 | 0.0.0.0/0 | 22:22 | ingress | None | None | | 1d7f2882-a65c-4fa9-b642-df039d313b91 | icmp | IPv4 | 0.0.0.0/0 | | ingress | None | None | | 1e13fbf6-d297-4a18-a595-59bacbc6355e | None | IPv6 | ::/0 | | egress | None | None | | a48fa185-3668-4245-81e9-39a4e1fbc7ef | None | IPv4 | 0.0.0.0/0 | | egress | None | None | +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ |
| [11] | It's possible to login to the Instance to connect to the floating IP address with SSH like follows. |
|
[cent@dlp ~(keystone)]$ openstack server list +--------------------------------------+------------+--------+------------------------------------+----------------+-----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+------------+--------+------------------------------------+----------------+-----------+ | 5daa5207-b055-4028-a4ca-467ac255b2aa | CentOS-St9 | ACTIVE | private=10.0.0.241, 192.168.100.18 | CentOS-Stream9 | m1.medium | +--------------------------------------+------------+--------+------------------------------------+----------------+-----------+[cent@dlp ~(keystone)]$ ssh centos@10.0.0.241 The authenticity of host '10.0.0.241 (10.0.0.241)' can't be established. ED25519 key fingerprint is SHA256:vHeIhGLeCE3w1EsEUqYBIKr71dn8MOl5rdWc9/sUPeM. This key is not known by any other names Are you sure you want to continue connecting (yes/no/[fingerprint])? yes Warning: Permanently added '10.0.0.241' (ED25519) to the list of known hosts. [centos@centos-st9 ~]$ # logined |
| Sponsored Link |