Configure EVPN with Multicast replication on Nexus 7000

JordanMoran95596 · ‎02-19-2020

Hi guys

Im currently studying EVPN. I've been working on a topology but I'vent been able to make it work. The lab was to configure EVPN between 2 nexus switches. In the original lab it was used ingress-replication. However, that options does not seem to be available in Nexus 7000. So I tried to configure Multicast.

I reviewing the outputs and the nve peers are not forming and have no rechability from host to host. I attached my outputs.

Switch1

switch(config)# show ip ospf nei
OSPF Process ID 10 VRF default
Total number of neighbors: 1
Neighbor ID Pri State Up Time Address Interface
2.2.2.2 1 FULL/BDR 00:39:43 10.10.10.2 Eth2/1
switch(config)# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 1.1.1.1, local AS number 65535
BGP table version is 29, L2VPN EVPN config peers 1, capable peers 1
0 network entries and 0 paths using 0 bytes of memory
BGP attribute entries [0/0], BGP AS path entries [0/0]
BGP community entries [0/0], BGP clusterlist entries [0/0]

Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
2.2.2.2 4 65535 302 326 29 0 0 00:39:49 0
switch(config)# show nve in
interface internal
switch(config)# show nve interface
Interface: nve1, State: Up, encapsulation: VXLAN
VPC Capability: VPC-VIP-Only [not-notified]
Local Router MAC: 0c70.65b3.262f
Host Learning Mode: Control-Plane
Source-Interface: loopback0 (primary: 1.1.1.1, secondary: 0.0.0.0)

switch(config)# show nve vni
Codes: CP - Control Plane DP - Data Plane
UC - Unconfigured SA - Suppress ARP
SU - Suppress Unknown Unicast

Interface VNI Multicast-group State Mode Type [BD/VRF] Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1 5000 230.1.1.1 Up CP L2 [1000] SA
nve1 5005 230.1.1.1 Up CP L2 [1001] SA
nve1 6000 230.1.1.1 Up CP L2 [900] SA
nve1 900001 n/a Up CP L3 [Tenant-1]
nve1 900002 n/a Up CP L3 [Tenant-2]

switch(config)# show nve peers
switch(config)#

Switch2

switch(config-if)# show ip ospf neighbors
OSPF Process ID 10 VRF default
Total number of neighbors: 1
Neighbor ID Pri State Up Time Address Interface
1.1.1.1 1 FULL/DR 00:41:26 10.10.10.1 Eth2/1
switch(config-if)# show bgp l2vpn ?
*** No matching command found in current mode, matching in (exec) mode ***
evpn Display BGP information for L2VPN EVPN address family

switch(config-if)# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 2.2.2.2, local AS number 65535
BGP table version is 5, L2VPN EVPN config peers 1, capable peers 1
0 network entries and 0 paths using 0 bytes of memory
BGP attribute entries [0/0], BGP AS path entries [0/0]
BGP community entries [0/0], BGP clusterlist entries [0/0]

Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
1.1.1.1 4 65535 59 49 5 0 0 00:41:35 0
switch(config-if)# show nve interface
Interface: nve1, State: Up, encapsulation: VXLAN
VPC Capability: VPC-VIP-Only [not-notified]
Local Router MAC: 0c70.6504.212f
Host Learning Mode: Control-Plane
Source-Interface: loopback0 (primary: 2.2.2.2, secondary: 0.0.0.0)

switch(config-if)# show nve vni
control-plane data-plane interface summary
switch(config-if)# show nve vni
Codes: CP - Control Plane DP - Data Plane
UC - Unconfigured SA - Suppress ARP
SU - Suppress Unknown Unicast

Interface VNI Multicast-group State Mode Type [BD/VRF] Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1 5000 230.1.1.1 Up CP L2 [1000] SA
nve1 5005 230.1.1.1 Up CP L2 [1001] SA
nve1 6000 230.1.1.1 Up CP L2 [900] SA
nve1 900001 n/a Up CP L3 [Tenant-1]
nve1 900002 n/a Up CP L3 [Tenant-2]

switch(config-if)# show nve peers
Interface Peer-IP State LearnType Uptime Router-Mac
--------- --------------- ----- --------- -------- -----------------
nve1 1.1.1.1 Down CP 00:42:07 0c70.65b3.262f

switch(config-if)#

Hector Gustavo Serrano Gutierrez · ‎02-23-2020

Hi @JordanMoran95596,

BGP L2 EVPN seems not to be advertising routes type-2. Therefore the 'show nve peers' command is not showing the neighbor Nexus 7000 as 'UP'.

Since this is a lab, could you please post the configuration of both Nexus 7000s?
Also, please include the next commands to review the state of Multicast PIM:

show ip pim neighbor
show ip pim rp
show ip mroute

Regards.

jomoca1990 · ‎02-24-2020

Hi @Hector Gustavo Serrano Gutierrez

Please find the outputs and the config files. Thanks in advance for your help.

Switch1

switch# show nve peers
Interface Peer-IP State LearnType Uptime Router-Mac
--------- --------------- ----- --------- -------- -----------------
nve1 2.2.2.2 Down CP 00:00:34 0ce8.c7ef.5b2f

switch# show ip pim neighbor
PIM Neighbor Status for VRF "default"
Neighbor Interface Uptime Expires DR Bidir- BFD
Priority Capable State
10.10.10.2 Ethernet2/1 00:09:22 00:01:23 1 yes n/a
switch# show ip pim rp
PIM RP Status Information for VRF "default"
BSR disabled
Auto-RP disabled
BSR RP Candidate policy: None
BSR RP policy: None
Auto-RP Announce policy: None
Auto-RP Discovery policy: None

Anycast-RP 3.3.3.3 members:
1.1.1.1* 2.2.2.2

RP: 3.3.3.3*, (0),
uptime: 00:14:51 priority: 0,
RP-source: (local),
group ranges:
224.0.0.0/4
switch# show ip mroute
IP Multicast Routing Table for VRF "default"

(*, 230.1.1.1/32), uptime: 00:15:02, nve ip pim
Incoming interface: loopback1, RPF nbr: 3.3.3.3
Outgoing interface list: (count: 1)
nve1, uptime: 00:15:02, nve

(1.1.1.1/32, 230.1.1.1/32), uptime: 00:15:02, nve mrib ip pim
Incoming interface: loopback0, RPF nbr: 1.1.1.1, internal
Outgoing interface list: (count: 0)

(*, 232.0.0.0/8), uptime: 00:15:15, pim ip
Incoming interface: Null, RPF nbr: 0.0.0.0
Outgoing interface list: (count: 0)

##############################################################

switch# show ip pim neighbor
PIM Neighbor Status for VRF "default"
Neighbor Interface Uptime Expires DR Bidir- BFD
Priority Capable State
10.10.10.1 Ethernet2/1 00:10:23 00:01:20 1 yes n/a
switch# show ip pim rp
PIM RP Status Information for VRF "default"
BSR disabled
Auto-RP disabled
BSR RP Candidate policy: None
BSR RP policy: None
Auto-RP Announce policy: None
Auto-RP Discovery policy: None

Anycast-RP 3.3.3.3 members:
1.1.1.1 2.2.2.2*

RP: 3.3.3.3*, (0),
uptime: 00:11:09 priority: 0,
RP-source: (local),
group ranges:
224.0.0.0/4
switch# show ip mroute
IP Multicast Routing Table for VRF "default"

(*, 230.1.1.1/32), uptime: 00:11:28, nve ip pim
Incoming interface: loopback1, RPF nbr: 3.3.3.3
Outgoing interface list: (count: 1)
nve1, uptime: 00:11:28, nve

(2.2.2.2/32, 230.1.1.1/32), uptime: 00:11:28, nve mrib ip pim
Incoming interface: loopback0, RPF nbr: 2.2.2.2, internal
Outgoing interface list: (count: 0)

(*, 232.0.0.0/8), uptime: 00:11:30, pim ip
Incoming interface: Null, RPF nbr: 0.0.0.0
Outgoing interface list: (count: 0)

switch#

and

Hector Gustavo Serrano Gutierrez · ‎02-24-2020

Hi @jomoca1990,

Could you please add this on both Nexus?

router bgp 65535
 address-family l2vpn evpn
 address-family ipv4 unicast

Also, on which VLAN you are currently testing? Do you have entries in the CAM for it? From both Nexus:

show mac address-table vlan X

Regards.

jomoca1990 · ‎02-27-2020

Hello @Hector Gustavo Serrano Gutierrez

Thanks for the response. I entered the commands requested but did not make a difference. I'm not having any ping reachability between the host.

belowed you can see the outputs the show mac commands. It does not show the remote macs.

switch# show mac address-table vlan 900
Note: MAC table entries displayed are getting read from software.
Use the 'hardware-age' keyword to get information related to 'Age'

Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link, E -
EVPN entry
(T) - True, (F) - False , ~~~ - use 'hardware-age' keyword to retrieve
age info
VLAN/BD MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
G 900 0ce8.c7a6.b82f static - F F sup-eth1(R)

switch# show mac address-table vlan 1000
Note: MAC table entries displayed are getting read from software.
Use the 'hardware-age' keyword to get information related to 'Age'

Legend:
* - primary entry, G - Gateway MAC, (R) - Routed MAC, O - Overlay MAC
age - seconds since last seen,+ - primary entry using vPC Peer-Link, E -
EVPN entry
(T) - True, (F) - False , ~~~ - use 'hardware-age' keyword to retrieve
age info
VLAN/BD MAC Address Type age Secure NTFY Ports/SWID.SSID.LID
---------+-----------------+--------+---------+------+----+------------------
G 1000 0ce8.c7a6.b82f static - F F sup-eth1(R)

However if I run the show l2vpn evpn I do see the information of the remote mac address as well as the ips.

switch# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 26, local router ID is 1.1.1.1
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-i
njected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup

Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 1.1.1.1:33667 (L2VNI 6000)
*>l[2]:[0]:[0]:[48]:[0002.0002.0002]:[32]:[192.168.0.10]/272
1.1.1.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[0003.0003.0003]:[32]:[192.168.0.11]/272
2.2.2.2 100 0 i

Route Distinguisher: 1.1.1.1:33767 (L2VNI 5000)
*>l[2]:[0]:[0]:[48]:[0001.0001.0001]:[32]:[192.168.0.10]/272
1.1.1.1 100 32768 i

Route Distinguisher: 1.1.1.1:33768 (L2VNI 5005)
*>i[2]:[0]:[0]:[48]:[0004.0004.0004]:[32]:[192.168.10.20]/272
2.2.2.2 100 0 i

Route Distinguisher: 2.2.2.2:33667
*>i[2]:[0]:[0]:[48]:[0003.0003.0003]:[32]:[192.168.0.11]/272
2.2.2.2 100 0 i

Route Distinguisher: 2.2.2.2:33768
*>i[2]:[0]:[0]:[48]:[0004.0004.0004]:[32]:[192.168.10.20]/272
2.2.2.2 100 0 i

Route Distinguisher: 1.1.1.1:3 (L3VNI 900001)
*>i[2]:[0]:[0]:[48]:[0004.0004.0004]:[32]:[192.168.10.20]/272
2.2.2.2 100 0 i

Route Distinguisher: 1.1.1.1:4 (L3VNI 900002)
*>i[2]:[0]:[0]:[48]:[0003.0003.0003]:[32]:[192.168.0.11]/272
2.2.2.2 100 0 i

switch#