Hi guys,
I'm going to configure VXLAN on nexus N9K-C93108TC-EX but L2VNI no connectivity.
Network topology diagram:
https://prnt.sc/2346bcn
At the all I used VLAN with EVPN
two leaf switch can learn Mac addresses from each other through EVPN but L2VNI no connectivity.
The same configuration works perfectly on nx-osv So I believe that the configuration is correct, but it will not work if it is moved to the hardware switch. there have some policies on the hardware blocking vxlan UDP traffic?
I used Ethanalyzer and I can see the VXLAN UDP traffic send to Leaf2 switch, but using Ethanalyzer on another Leaf 2 switch I can't see VXLAN traffic incoming.
so Both Leaf are sending out VXLAN traffic, but neither has received any VLXAN traffic.
There is no problem with MTU between Leaf1 and Leaf2
ping 192.168.1.202 source 192.168.1.201 df-bit packet-size 8000
ping 192.168.1.202 source 192.168.1.201 df-bit packet-size 8000
PING 192.168.1.202 (192.168.1.202) from 192.168.1.201: 8000 data bytes
8008 bytes from 192.168.1.202: icmp_seq=0 ttl=253 time=1.326 ms
8008 bytes from 192.168.1.202: icmp_seq=1 ttl=253 time=1.107 ms
8008 bytes from 192.168.1.202: icmp_seq=2 ttl=253 time=1.131 ms
Configuration
==================================================================================
Leaf1:
vlan 1001
vn-segment 10001
vlan 3000
vn-segment 8000
interface Vlan1001
no shutdown
vrf member vxlan-user1
ip address 10.0.0.1/24
fabric forwarding mode anycast-gateway
interface Vlan3000
no shutdown
vrf member vxlan-user1
no ip redirects
ip forward
ipv6 address use-link-local-only
no ipv6 redirects
interface nve1
no shutdown
host-reachability protocol bgp
source-interface loopback1
member vni 8000 associate-vrf
member vni 10001
suppress-arp
ingress-replication protocol bgp
==================================================================================
Leaf2:
vlan 1001
vn-segment 10001
vlan 3000
vn-segment 800
interface Vlan1001
no shutdown
vrf member vxlan-user1
ip address 10.0.0.1/24
fabric forwarding mode anycast-gateway
interface Vlan3000
no shutdown
vrf member vxlan-user1
no ip redirects
ip forward
ipv6 address use-link-local-only
no ipv6 redirects
interface nve1
no shutdown
host-reachability protocol bgp
source-interface loopback1
member vni 8000 associate-vrf
member vni 10001
suppress-arp
ingress-replication protocol bgp
==================================================================================
Leaf1(config)# show nve vni
Codes: CP - Control Plane DP - Data Plane
UC - Unconfigured SA - Suppress ARP
SU - Suppress Unknown Unicast
Xconn - Crossconnect
MS-IR - Multisite Ingress Replication
Interface VNI Multicast-group State Mode Type [BD/VRF] Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1 8000 n/a Up CP L3 [vxlan-user1]
nve1 10001 UnicastBGP Up CP L2 [1001]
Leaf2(config)# show nve vni
Codes: CP - Control Plane DP - Data Plane
UC - Unconfigured SA - Suppress ARP
SU - Suppress Unknown Unicast
Xconn - Crossconnect
MS-IR - Multisite Ingress Replication
Interface VNI Multicast-group State Mode Type [BD/VRF] Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1 8000 n/a Up CP L3 [vxlan-user1]
nve1 10001 UnicastBGP Up CP L2 [1001]
==================================================================================
Leaf1(config)# show nve peers
Interface Peer-IP State LearnType Uptime Route
r-Mac
--------- -------------------------------------- ----- --------- -------- -----
------------
nve1 192.168.1.202 Up CP 00:02:40 0027.
e3d1.e3c1
Leaf2(config)# show nve peers
Interface Peer-IP State LearnType Uptime Route
r-Mac
--------- -------------------------------------- ----- --------- -------- -----
------------
nve1 192.168.1.201 Up CP 00:02:41 00a3.
8e6d.5981
==================================================================================
Leaf1(config)# show l2route mac-ip all
Topology Mac Address Host IP Prod Flags
Seq No Next-Hops
----------- -------------- --------------------------------------- ------ ------
---- ---------- ---------------------------------------
1001 ecf4.bbe2.5bf8 10.0.0.2 HMM L,
0 Local
1001 246e.966a.c110 10.0.0.3 HMM L,
0 Local
1001 246e.966a.a878 10.0.0.4 BGP --
0 192.168.1.202 (Label: 10001)
1001 ecf4.bbdb.29e8 10.0.0.5 BGP --
0 192.168.1.202 (Label: 10001)
==================================================================================
Leaf2(config)# show l2route mac-ip all
Topology Mac Address Host IP Prod Flags
Seq No Next-Hops
----------- -------------- --------------------------------------- ------ ------
---- ---------- ---------------------------------------
1001 ecf4.bbe2.5bf8 10.0.0.2 BGP --
0 192.168.1.201 (Label: 10001)
1001 246e.966a.c110 10.0.0.3 BGP --
0 192.168.1.201 (Label: 10001)
1001 246e.966a.a878 10.0.0.4 HMM L,
0 Local
1001 ecf4.bbdb.29e8 10.0.0.5 HMM L,
0 Local
=========================TEST=========================================================
Leaf1(config)# ping 10.0.0.2 vrf vxlan-user1
PING 10.0.0.2 (10.0.0.2): 56 data bytes
64 bytes from 10.0.0.2: icmp_seq=0 ttl=63 time=0.828 ms
64 bytes from 10.0.0.2: icmp_seq=1 ttl=63 time=0.538 ms
64 bytes from 10.0.0.2: icmp_seq=2 ttl=63 time=0.454 ms
Leaf1(config)# ping 10.0.0.4 vrf vxlan-user1
PING 10.0.0.4 (10.0.0.4): 56 data bytes
Request 0 timed out
Request 1 timed out
Request 2 timed out
Request 3 timed out
Request 4 timed out
--- 10.0.0.4 ping statistics ---
5 packets transmitted, 0 packets received, 100.00% packet loss
Leaf2(config)# ping 10.0.0.4 vrf vxlan-user1
PING 10.0.0.4 (10.0.0.4): 56 data bytes
64 bytes from 10.0.0.4: icmp_seq=0 ttl=63 time=0.758 ms
64 bytes from 10.0.0.4: icmp_seq=1 ttl=63 time=0.534 ms
64 bytes from 10.0.0.4: icmp_seq=2 ttl=63 time=0.481 ms
64 bytes from 10.0.0.4: icmp_seq=3 ttl=63 time=0.46 ms
64 bytes from 10.0.0.4: icmp_seq=4 ttl=63 time=0.474 ms
^C
--- 10.0.0.4 ping statistics ---
5 packets transmitted, 5 packets received, 0.00% packet loss
round-trip min/avg/max = 0.46/0.541/0.758 ms
Leaf2(config)# ping 10.0.0.2 vrf vxlan-user1
PING 10.0.0.2 (10.0.0.2): 56 data bytes
Request 0 timed out
Request 1 timed out
Request 2 timed out
Request 3 timed out
Request 4 timed out
Thanks
