Hello,
I'm following a few configuration guides to test out a VXLAN deployment using Nexus 9k's in a VIRL environment. I've got everything working to a point where I see the routes being exchanged between leafs over the spine infrastructure. Each leaf knows about the end host I'm trying to ping -- I can see it is a learned l2vpn evpn route via the MP-BGP protocol.
My trouble is that despite knowing how to route these packets, there is no communication between the two end hosts off of my leaf. The NVE interface counters never increase (for that matter, neither do the switchport interfaces my hosts connect to, VIRL bug?). I found a verification guide here:
http://www.cisco.com/c/en/us/support/docs/ip/border-gateway-protocol-bgp/200952-Configuration-and-Verification-VXLAN-wit.html#anc17
Basically every step along the way I'm fine with, except for the actual packet delivery and counters incrementing on the NVE interface. NVE peers look fine, routes learned are fine, I know the correct mac/ip of my end hosts, etc.
Host A: 4.1.1.10
Host B: 4.1.1.11
Leaf2# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 16, local router ID is 40.1.1.1
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-i
njected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 30.1.1.1:33768
*>e[2]:[0]:[0]:[48]:[fa16.3e61.d251]:[32]:[4.1.1.11]/272
50.1.1.1 0 100 200 i
Route Distinguisher: 40.1.1.1:33768 (L2VNI 2001001)
*>e[2]:[0]:[0]:[48]:[fa16.3e61.d251]:[32]:[4.1.1.11]/272
50.1.1.1 0 100 200 i
*>l[2]:[0]:[0]:[48]:[fa16.3e80.0b19]:[32]:[4.1.1.10]/272
51.1.1.1 100 32768 i
Route Distinguisher: 40.1.1.1:3 (L3VNI 900001)
*>e[2]:[0]:[0]:[48]:[fa16.3e61.d251]:[32]:[4.1.1.11]/272
50.1.1.1 0 100 200 i
Leaf2# sh int eth 1/2
Ethernet1/2 is up
admin state is up, Dedicated Interface
Hardware: 100/1000/10000 Ethernet, address: fa16.3eca.b463 (bia fa16.3eca.b463
)
Description: to iosv-2
MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, medium is broadcast
Port mode is trunk
full-duplex, 1000 Mb/s
Beacon is turned off
Auto-Negotiation is turned on, FEC mode is Auto
Input flow-control is off, output flow-control is off
Auto-mdix is turned off
Switchport monitor is off
EtherType is 0x8100
EEE (efficient-ethernet) : n/a
Last link flapped 00:08:49
Last clearing of "show interface" counters never
5 interface resets
30 seconds input rate 0 bits/sec, 0 packets/sec
30 seconds output rate 0 bits/sec, 0 packets/sec
Load-Interval #2: 5 minute (300 seconds)
input rate 0 bps, 0 pps; output rate 0 bps, 0 pps
RX
0 unicast packets 0 multicast packets 0 broadcast packets
0 input packets 0 bytes
0 jumbo packets 0 storm suppression packets
0 runts 0 giants 0 CRC 0 no buffer
0 input error 0 short frame 0 overrun 0 underrun 0 ignored
0 watchdog 0 bad etype drop 0 bad proto drop 0 if down drop
0 input with dribble 0 input discard
0 Rx pause
TX
0 unicast packets 0 multicast packets 0 broadcast packets
0 output packets 0 bytes
0 jumbo packets
0 output error 0 collision 0 deferred 0 late collision
0 lost carrier 0 no carrier 0 babble 0 output discard
0 Tx pause
Leaf2# show int nve1
nve1 is up
admin state is up, Hardware: NVE
MTU 9216 bytes
Encapsulation VXLAN
Auto-mdix is turned off
RX
ucast: 0 pkts, 0 bytes - mcast: 0 pkts, 0 bytes
TX
ucast: 0 pkts, 0 bytes - mcast: 0 pkts, 0 bytes
Leaf2# show l2route mac-ip all
Topology ID Mac Address Prod Host IP Next Hop
(s)
----------- -------------- ---- --------------------------------------- --------
-------
1001 fa16.3e80.0b19 HMM 4.1.1.10 N/A
1001 fa16.3e61.d251 BGP 4.1.1.11 50.1.1.1
Leaf2# sh mac address-table vlan 1001
Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link,
(T) - True, (F) - False, C - ControlPlane MAC
VLAN MAC Address Type age Secure NTFY Ports
---------+-----------------+--------+---------+------+----+------------------
C 1001 fa16.3e61.d251 dynamic 0 F F nve1(50.1.1.1)
G 1001 fa16.3eca.b461 static - F F sup-eth1(R)
Throwing packets since 2012
