OpenStack Dalmatian : Neutron Network (VXLAN)2024/10/10 |
|
Configure virtual networking by OpenStack Network Service (Neutron).
For example, configure VXLAN type of networking on here. Furthermore, this example is based on the environment that Network Node has 2 network interfaces.
------------+--------------------------+--------------------------+------------
| | |
eth0|10.0.0.30 eth0|10.0.0.50 eth0|10.0.0.51
+-----------+-----------+ +-----------+-----------+ +-----------+-----------+
| [ dlp.srv.world ] | | [ network.srv.world ] | | [ node01.srv.world ] |
| (Control Node) | | (Network Node) | | (Compute Node) |
| | | | | |
| MariaDB RabbitMQ | | Neutron L2/L3 Agent | | Libvirt |
| Memcached Nginx | | Neutron Metadata | | Nova Compute |
| Keystone httpd | | Open vSwitch | | Neutron L2 Agent |
| Glance Nova API | | | | Open vSwitch |
| Neutron Server | | | | |
| Neutron Metadata | | | | |
+-----------------------+ +-----------+-----------+ +-----------------------+
eth1|(UP with no IP)
|
| [1] | Change settings on Control Node. |
|
[root@dlp ~(keystone)]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # add a value to [tenant_network_types] [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan
# add to last line [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000 systemctl restart neutron-server |
| [2] | Change settings on Network Node. |
|
# add bridge [root@network ~]# ovs-vsctl add-br br-eth1
# add [eth1] to the port of the bridge above # replace the interface name [eth1] to your own environment [root@network ~]# ovs-vsctl add-port br-eth1 eth1
[root@network ~]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # add a value to [tenant_network_types] [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan mechanism_drivers = openvswitch extension_drivers = port_security,qos # add to last line [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000
[root@network ~]#
vi /etc/neutron/plugins/ml2/openvswitch_agent.ini # add to last line
[agent]
tunnel_types = vxlan
prevent_arp_spoofing = True
[ovs]
# specify IP address of this host for [local_ip]
local_ip = 10.0.0.50
bridge_mappings = physnet1:br-eth1
[root@network ~]#
systemctl restart neutron-dhcp-agent neutron-l3-agent neutron-metadata-agent neutron-openvswitch-agent
# if Firewalld is running, allow VXLAN port [root@network ~]# firewall-cmd --add-port=4789/udp [root@network ~]# firewall-cmd --runtime-to-permanent |
| [3] | Change settings on Compute Node. |
|
[root@node01 ~]#
vi /etc/neutron/plugins/ml2/ml2_conf.ini # add a value to [tenant_network_types] [ml2] type_drivers = flat,vlan,gre,vxlan tenant_network_types = vxlan mechanism_drivers = openvswitch extension_drivers = port_security,qos # add to last line [ml2_type_flat] flat_networks = physnet1 [ml2_type_vxlan] vni_ranges = 1:1000
[root@node01 ~]#
vi /etc/neutron/plugins/ml2/openvswitch_agent.ini # add to last line
[agent]
tunnel_types = vxlan
prevent_arp_spoofing = True
[ovs]
# specify IP address of this host for [local_ip]
local_ip = 10.0.0.51
[root@node01 ~]#
systemctl restart neutron-openvswitch-agent
# if Firewalld is running, allow VXLAN port [root@node01 ~]# firewall-cmd --add-port=4789/udp [root@node01 ~]# firewall-cmd --runtime-to-permanent |
| [4] | Create a Virtual router. It's OK to work on any node. (This example is on Control Node) |
|
[root@dlp ~(keystone)]# openstack router create router01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2024-10-10T01:37:17Z | | description | | | distributed | False | | enable_ndp_proxy | None | | external_gateway_info | null | | flavor_id | None | | ha | False | | id | 31a43fae-d936-4e97-ac91-6f73a0bcf198 | | name | router01 | | project_id | b19d04cd37254937a4eaebcd0f0f0a43 | | revision_number | 1 | | routes | | | status | ACTIVE | | tags | | | tenant_id | b19d04cd37254937a4eaebcd0f0f0a43 | | updated_at | 2024-10-10T01:37:17Z | +-------------------------+--------------------------------------+ |
| [5] | Create internal network and associate with the router above. |
|
# create internal network [root@dlp ~(keystone)]# openstack network create private --provider-network-type vxlan +---------------------------+--------------------------------------+ | Field | Value | +---------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2024-10-10T01:37:48Z | | description | | | dns_domain | None | | id | 4aab3bc9-a361-499b-b949-a7123c8a6458 | | ipv4_address_scope | None | | ipv6_address_scope | None | | is_default | False | | is_vlan_transparent | None | | mtu | 1450 | | name | private | | port_security_enabled | True | | project_id | b19d04cd37254937a4eaebcd0f0f0a43 | | provider:network_type | vxlan | | provider:physical_network | None | | provider:segmentation_id | 121 | | qos_policy_id | None | | revision_number | 1 | | router:external | Internal | | segments | None | | shared | False | | status | ACTIVE | | subnets | | | tags | | | updated_at | 2024-10-10T01:37:48Z | +---------------------------+--------------------------------------+ # create subnet in the internal network [root@dlp ~(keystone)]# openstack subnet create private-subnet --network private \ --subnet-range 192.168.100.0/24 --gateway 192.168.100.1 \ --dns-nameserver 10.0.0.10 +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | allocation_pools | 192.168.100.2-192.168.100.254 | | cidr | 192.168.100.0/24 | | created_at | 2024-10-10T01:38:10Z | | description | | | dns_nameservers | 10.0.0.10 | | dns_publish_fixed_ip | None | | enable_dhcp | True | | gateway_ip | 192.168.100.1 | | host_routes | | | id | af232a16-faa3-4887-8886-3deef8482524 | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | private-subnet | | network_id | 4aab3bc9-a361-499b-b949-a7123c8a6458 | | project_id | b19d04cd37254937a4eaebcd0f0f0a43 | | revision_number | 0 | | router:external | False | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2024-10-10T01:38:10Z | +----------------------+--------------------------------------+ # set internal network to the router above [root@dlp ~(keystone)]# openstack router add subnet router01 private-subnet
|
| [6] | Create external network and associate with the router above. |
|
# create external network [root@dlp ~(keystone)]# openstack network create \ --provider-physical-network physnet1 \ --provider-network-type flat --external public +---------------------------+--------------------------------------+ | Field | Value | +---------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | | | created_at | 2024-10-10T01:38:39Z | | description | | | dns_domain | None | | id | f219368e-c984-45cc-af7a-ee2caaae76bf | | ipv4_address_scope | None | | ipv6_address_scope | None | | is_default | False | | is_vlan_transparent | None | | mtu | 1500 | | name | public | | port_security_enabled | True | | project_id | b19d04cd37254937a4eaebcd0f0f0a43 | | provider:network_type | flat | | provider:physical_network | physnet1 | | provider:segmentation_id | None | | qos_policy_id | None | | revision_number | 1 | | router:external | External | | segments | None | | shared | False | | status | ACTIVE | | subnets | | | tags | | | updated_at | 2024-10-10T01:38:39Z | +---------------------------+--------------------------------------+ # create subnet in the external network [root@dlp ~(keystone)]# openstack subnet create public-subnet \ --network public --subnet-range 10.0.0.0/24 \ --allocation-pool start=10.0.0.200,end=10.0.0.254 \ --gateway 10.0.0.1 --dns-nameserver 10.0.0.10 --no-dhcp +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | allocation_pools | 10.0.0.200-10.0.0.254 | | cidr | 10.0.0.0/24 | | created_at | 2024-10-10T01:39:06Z | | description | | | dns_nameservers | 10.0.0.10 | | dns_publish_fixed_ip | None | | enable_dhcp | False | | gateway_ip | 10.0.0.1 | | host_routes | | | id | 9bcc4b55-20a9-406b-9064-ed2d031947e0 | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | public-subnet | | network_id | f219368e-c984-45cc-af7a-ee2caaae76bf | | project_id | b19d04cd37254937a4eaebcd0f0f0a43 | | revision_number | 0 | | router:external | True | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2024-10-10T01:39:06Z | +----------------------+--------------------------------------+ # set gateway to the router above [root@dlp ~(keystone)]# openstack router set router01 --external-gateway public |
| [7] | By default, it's possible to access for all projects to external network, however, for internal network, only admin projects can access to it, so grant access permission of internal network to a project you'd like to let users in the project use. |
|
# show network RBAC list [root@dlp ~(keystone)]# openstack network rbac list +--------------------------------------+-------------+--------------------------------------+ | ID | Object Type | Object ID | +--------------------------------------+-------------+--------------------------------------+ | 2f8f2789-3aaf-447b-a0f2-e8c80e06dd3e | network | f219368e-c984-45cc-af7a-ee2caaae76bf | +--------------------------------------+-------------+--------------------------------------+ # RBAC details # all projects can access only to [access_as_external] [root@dlp ~(keystone)]# openstack network rbac show 2f8f2789-3aaf-447b-a0f2-e8c80e06dd3e +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | action | access_as_external | | id | 2f8f2789-3aaf-447b-a0f2-e8c80e06dd3e | | object_id | f219368e-c984-45cc-af7a-ee2caaae76bf | | object_type | network | | project_id | b19d04cd37254937a4eaebcd0f0f0a43 | | target_project_id | * | +-------------------+--------------------------------------+ # show network list [root@dlp ~(keystone)]# openstack network list +--------------------------------------+---------+--------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+--------------------------------------+ | 4aab3bc9-a361-499b-b949-a7123c8a6458 | private | af232a16-faa3-4887-8886-3deef8482524 | | f219368e-c984-45cc-af7a-ee2caaae76bf | public | 9bcc4b55-20a9-406b-9064-ed2d031947e0 | +--------------------------------------+---------+--------------------------------------+ # show project list [root@dlp ~(keystone)]# openstack project list +----------------------------------+-----------+ | ID | Name | +----------------------------------+-----------+ | 756e2b4937c44d3991028e294f92d89a | hiroshima | | aff8e7e402dc4d9e849bbe0e34fa4538 | service | | b19d04cd37254937a4eaebcd0f0f0a43 | admin | +----------------------------------+-----------+ # grant [access_as_shared] permission for [private] to [hiroshima] project [root@dlp ~(keystone)]# netID=$(openstack network list | grep private | awk '{ print $2 }') [root@dlp ~(keystone)]# prjID=$(openstack project list | grep hiroshima | awk '{ print $2 }') [root@dlp ~(keystone)]# openstack network rbac create --target-project $prjID --type network --action access_as_shared $netID +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | action | access_as_shared | | id | 6987143b-ffda-4fe6-bc11-a3c16ba02f87 | | object_id | 4aab3bc9-a361-499b-b949-a7123c8a6458 | | object_type | network | | project_id | b19d04cd37254937a4eaebcd0f0f0a43 | | target_project_id | 756e2b4937c44d3991028e294f92d89a | +-------------------+--------------------------------------+ |
| [8] | Login as a user who can use Openstack system and Create and start a Virtual machine Instance with the network created above. |
|
# show available [flavor] list [cent@dlp ~(keystone)]$ openstack flavor list +----+-----------+-------+------+-----------+-------+-----------+ | ID | Name | RAM | Disk | Ephemeral | VCPUs | Is Public | +----+-----------+-------+------+-----------+-------+-----------+ | 1 | m1.tiny | 2048 | 10 | 0 | 1 | True | | 2 | m1.small | 4096 | 10 | 0 | 2 | True | | 3 | m1.medium | 8192 | 10 | 0 | 4 | True | | 4 | m1.large | 16384 | 10 | 0 | 8 | True | | 5 | m2.large | 16384 | 10 | 10 | 8 | True | +----+-----------+-------+------+-----------+-------+-----------+ # show available image list [cent@dlp ~(keystone)]$ openstack image list +--------------------------------------+----------------+--------+ | ID | Name | Status | +--------------------------------------+----------------+--------+ | 75e0d976-4075-4488-8f26-87d4a50aebe9 | CentOS-Stream9 | active | +--------------------------------------+----------------+--------+ # show available network list [cent@dlp ~(keystone)]$ openstack network list +--------------------------------------+---------+--------------------------------------+ | ID | Name | Subnets | +--------------------------------------+---------+--------------------------------------+ | 4aab3bc9-a361-499b-b949-a7123c8a6458 | private | af232a16-faa3-4887-8886-3deef8482524 | | f219368e-c984-45cc-af7a-ee2caaae76bf | public | 9bcc4b55-20a9-406b-9064-ed2d031947e0 | +--------------------------------------+---------+--------------------------------------+ # create a security group for instances [cent@dlp ~(keystone)]$ openstack security group create secgroup01 +-----------------+----------------------------------------------------------------------------+ | Field | Value | +-----------------+----------------------------------------------------------------------------+ | created_at | 2024-10-10T01:28:00Z | | description | secgroup01 | | id | 4da18ab8-3ffc-4ff9-9aa1-2f41a17fe1b4 | | name | secgroup01 | | project_id | 756e2b4937c44d3991028e294f92d89a | | revision_number | 1 | | rules | created_at='2024-10-10T01:28:00Z', direction='egress', ethertype='IPv6.... | | | created_at='2024-10-10T01:28:00Z', direction='egress', ethertype='IPv4.... | | shared | False | | stateful | True | | tags | [] | | updated_at | 2024-10-10T01:28:00Z | +-----------------+----------------------------------------------------------------------------+ # create an SSH keypair for connecting to instances [cent@dlp ~(keystone)]$ ssh-keygen -q -N "" Enter file in which to save the key (/home/cent/.ssh/id_rsa): # add public-key [cent@dlp ~(keystone)]$ openstack keypair create --public-key ~/.ssh/id_rsa.pub mykey +-------------+-------------------------------------------------+ | Field | Value | +-------------+-------------------------------------------------+ | created_at | None | | fingerprint | c4:23:3d:6a:b6:6a:1e:2c:19:e7:c9:ac:07:21:1e:11 | | id | mykey | | is_deleted | None | | name | mykey | | type | ssh | | user_id | 19c7530debb54eb0bfe6dc47aae3df32 | +-------------+-------------------------------------------------+[cent@dlp ~(keystone)]$ netID=$(openstack network list | grep private | awk '{ print $2 }')
[cent@dlp ~(keystone)]$
[cent@dlp ~(keystone)]$ openstack server create --flavor m1.small --image CentOS-Stream9 --security-group secgroup01 --nic net-id=$netID --key-name mykey CentOS-St9
openstack server list +--------------------------------------+------------+--------+-------------------------+----------------+----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+------------+--------+-------------------------+----------------+----------+ | a195a971-3974-485a-aa5c-2987f5bd6f8d | CentOS-St9 | ACTIVE | private=192.168.100.182 | CentOS-Stream9 | m1.small | +--------------------------------------+------------+--------+-------------------------+----------------+----------+ |
| [9] | Assign floating IP address to the Instance above. |
|
[cent@dlp ~(keystone)]$ openstack floating ip create public +---------------------+--------------------------------------+ | Field | Value | +---------------------+--------------------------------------+ | created_at | 2024-10-10T01:44:57Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | None | | floating_ip_address | 10.0.0.248 | | floating_network_id | f219368e-c984-45cc-af7a-ee2caaae76bf | | id | 2051185a-cd26-458b-a3c0-e54dc13214dc | | name | 10.0.0.248 | | port_details | None | | port_id | None | | project_id | 756e2b4937c44d3991028e294f92d89a | | qos_policy_id | None | | revision_number | 0 | | router_id | None | | status | DOWN | | subnet_id | None | | tags | [] | | updated_at | 2024-10-10T01:44:57Z | +---------------------+--------------------------------------+
[cent@dlp ~(keystone)]$
openstack server add floating ip CentOS-St9 10.0.0.248
# confirm settings [cent@dlp ~(keystone)]$ openstack floating ip show 10.0.0.248 +---------------------+----------------------------------------------------------------------------+ | Field | Value | +---------------------+----------------------------------------------------------------------------+ | created_at | 2024-10-10T01:44:57Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | 192.168.100.182 | | floating_ip_address | 10.0.0.248 | | floating_network_id | f219368e-c984-45cc-af7a-ee2caaae76bf | | id | 2051185a-cd26-458b-a3c0-e54dc13214dc | | name | 10.0.0.248 | | port_details | admin_state_up='True', device_id='a195a971-3974-485a-aa5c-2987f5bd6f8d'... | | port_id | 9c13b0c7-66b6-47e3-9d3f-82c61419c92a | | project_id | 756e2b4937c44d3991028e294f92d89a | | qos_policy_id | None | | revision_number | 2 | | router_id | 31a43fae-d936-4e97-ac91-6f73a0bcf198 | | status | ACTIVE | | subnet_id | None | | tags | [] | | updated_at | 2024-10-10T01:45:19Z | +---------------------+----------------------------------------------------------------------------+[cent@dlp ~(keystone)]$ openstack server list +--------------------------------------+------------+--------+-------------------------------------+----------------+----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+------------+--------+-------------------------------------+----------------+----------+ | a195a971-3974-485a-aa5c-2987f5bd6f8d | CentOS-St9 | ACTIVE | private=10.0.0.248, 192.168.100.182 | CentOS-Stream9 | m1.small | +--------------------------------------+------------+--------+-------------------------------------+----------------+----------+ |
| [10] | Configure security settings for the security group you created above to access with SSH and ICMP. |
|
# permit ICMP [cent@dlp ~(keystone)]$ openstack security group rule create --protocol icmp --ingress secgroup01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | belongs_to_default_sg | False | | created_at | 2024-10-10T01:30:39Z | | description | | | direction | ingress | | ether_type | IPv4 | | id | 04e77e8d-017c-4e9a-928f-e0683dc7bf18 | | name | None | | normalized_cidr | 0.0.0.0/0 | | port_range_max | None | | port_range_min | None | | project_id | 756e2b4937c44d3991028e294f92d89a | | protocol | icmp | | remote_address_group_id | None | | remote_group_id | None | | remote_ip_prefix | 0.0.0.0/0 | | revision_number | 0 | | security_group_id | 4da18ab8-3ffc-4ff9-9aa1-2f41a17fe1b4 | | tags | [] | | updated_at | 2024-10-10T01:30:39Z | +-------------------------+--------------------------------------+ # permit SSH [cent@dlp ~(keystone)]$ openstack security group rule create --protocol tcp --dst-port 22:22 secgroup01 +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | belongs_to_default_sg | False | | created_at | 2024-10-10T01:30:56Z | | description | | | direction | ingress | | ether_type | IPv4 | | id | 5ca88e6c-45af-4ef3-a5bf-6f8ceb0c4d91 | | name | None | | normalized_cidr | 0.0.0.0/0 | | port_range_max | 22 | | port_range_min | 22 | | project_id | 756e2b4937c44d3991028e294f92d89a | | protocol | tcp | | remote_address_group_id | None | | remote_group_id | None | | remote_ip_prefix | 0.0.0.0/0 | | revision_number | 0 | | security_group_id | 4da18ab8-3ffc-4ff9-9aa1-2f41a17fe1b4 | | tags | [] | | updated_at | 2024-10-10T01:30:56Z | +-------------------------+--------------------------------------+[cent@dlp ~(keystone)]$ openstack security group rule list secgroup01 +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ | ID | IP Protocol | Ethertype | IP Range | Port Range | Direction | Remote Security Group | Remote Address Group | +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ | 04e77e8d-017c-4e9a-928f-e0683dc7bf18 | icmp | IPv4 | 0.0.0.0/0 | | ingress | None | None | | 2b16aba4-7f3d-419a-a8f8-380d6b4a3e10 | None | IPv6 | ::/0 | | egress | None | None | | 5ca88e6c-45af-4ef3-a5bf-6f8ceb0c4d91 | tcp | IPv4 | 0.0.0.0/0 | 22:22 | ingress | None | None | | f50e96bf-3bb4-4a08-815a-57ec3bed582c | None | IPv4 | 0.0.0.0/0 | | egress | None | None | +--------------------------------------+-------------+-----------+-----------+------------+-----------+-----------------------+----------------------+ |
| [11] | It's possible to login to the Instance to connect to the floating IP address with SSH like follows. |
|
[cent@dlp ~(keystone)]$ openstack server list +--------------------------------------+------------+--------+-------------------------------------+----------------+----------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+------------+--------+-------------------------------------+----------------+----------+ | a195a971-3974-485a-aa5c-2987f5bd6f8d | CentOS-St9 | ACTIVE | private=10.0.0.248, 192.168.100.182 | CentOS-Stream9 | m1.small | +--------------------------------------+------------+--------+-------------------------------------+----------------+----------+[cent@dlp ~(keystone)]$ ssh centos@10.0.0.248 The authenticity of host '10.0.0.248 (10.0.0.248)' can't be established. ED25519 key fingerprint is SHA256:u6LhcmQCshrNT9WZUWbczXC2K237g3q+Ne5y2Bde1CU. This key is not known by any other names Are you sure you want to continue connecting (yes/no/[fingerprint])? yes Warning: Permanently added '10.0.0.248' (ED25519) to the list of known hosts. [centos@centos-st9 ~]$ # logined |
| Sponsored Link |