cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
2598
Views
0
Helpful
6
Replies

Cisco ACI Multipod issues

Sean Pillay
Level 1
Level 1

Guys

We are having multipod issues, in and EPG if have 2 routers on POD A as a static path they can communicate with each other, however when  I have move router B to POD B and change the static path in the EPG they cannot communicate, does any have a similar experience ? Same issue with port channeling the routers with VPC in different pods. In the same POD they can always communicate 

We also have DVS with ESX servers setup between PODS and we can V motion hosts from one pod to another pod. At least that works

6 Replies 6

Marcel Zehnder
Spotlight
Spotlight

Hi Sean

Sounds like a multicast issue in the IPN.

1.) For the EPG not working, check the Multicast-Group for the corresponding Bridge Domain:

moquery -c fvBD -f 'fv.BD.name=="<BD-NAME-HERE>"' | grep bcastP

2.) Check the mroute-table for the resulting mulitcast group on all of your IPN-devices

How did you configure your IPN? Is it a single area connected to the spines or do you use a separate area to attach the spines?

Regards

Marcel

Hi 

We have 4 IPNs, 2 in POD A and 2 in POD B. 

OSPF AREA 0.0.0.0 to the spines

Command output as requested

moquery -c fvBD -f 'fv.BD.name=="BD-Internet-Pub"' | grep bcastP
bcastP : 225.0.56.0

225.0.56.0 appears on 3 of the IPNS

IPN1-PODA

(*, 225.0.56.0/32), bidir, uptime: 03:06:20, ip pim igmp
Incoming interface: loopback1, RPF nbr: 10.36.119.1, uptime: 03:06:20
Outgoing interface list: (count: 1)
Ethernet1/49.4, uptime: 02:59:57, igmp

IPN2-PODA

(*, 225.0.56.0/32), bidir, uptime: 02:32:46, pim ip
Incoming interface: loopback1, RPF nbr: 10.36.119.1, uptime: 02:32:46
Outgoing interface list: (count: 1)
Ethernet1/2, uptime: 02:32:46, pim

IPN3-PODB

(*, 225.0.56.0/32), bidir, uptime: 02:33:59, igmp ip pim
Incoming interface: Ethernet1/2, RPF nbr: 10.36.119.41, uptime: 02:33:59
Outgoing interface list: (count: 2)
Ethernet1/2, uptime: 02:33:59, pim, (RPF)
Ethernet1/49.4, uptime: 02:33:59, igmp

IPN4-PODB

NO ENTRY

Sean

From all your IPNs could you please post "show cdp neighbor" and "show ip route <SHADOW-RP-IP>"?

Regards

Marcel

Hi 

As requested

IPN-1# sh cdp neighbors
Capability Codes: R - Router, T - Trans-Bridge, B - Source-Route-Bridge
S - Switch, H - Host, I - IGMP, r - Repeater,
V - VoIP-Phone, D - Remotely-Managed-Device,
s - Supports-STP-Dispute

Device-ID Local Intrfce Hldtme Capability Platform Port ID
ACI-OOB-SW01 mgmt0 155 R S I WS-C2960XR-48 Gig1/0/13
RDV-IPN-3(F71Z)
Eth1/1 152 R S s N9K-C93180YC- Eth1/1
RDV-IPN-4(FDT3)
Eth1/2 139 R S s N9K-C93180YC- Eth1/1
1DP-IPN-2(FD3)
Eth1/3 139 R S s N9K-C93180YC- Eth1/3

IPN-1# sh ip route vrf fabric-mpod 10.36.119.1
IP Route Table for VRF "fabric-mpod"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

10.36.119.1/32, ubest/mbest: 2/0, attached
*via 10.36.119.1, Lo1, [0/0], 3w0d, local
*via 10.36.119.1, Lo1, [0/0], 3w0d, direct

IPN-2# show cdp neighbors
Capability Codes: R - Router, T - Trans-Bridge, B - Source-Route-Bridge
S - Switch, H - Host, I - IGMP, r - Repeater,
V - VoIP-Phone, D - Remotely-Managed-Device,
s - Supports-STP-Dispute

Device-ID Local Intrfce Hldtme Capability Platform Port ID
ACI-OOB-SW01 mgmt0 137 R S I WS-C2960XR-48 Gig1/0/14
RDV-IPN-3(FD1Z)
Eth1/1 120 R S s N9K-C93180YC- Eth1/2
RDV-IPN-4(FD3)
Eth1/2 167 R S s N9K-C93180YC- Eth1/2
1DP-IPN-1(FDO2032123L)
Eth1/3 167 R S s N9K-C93180YC- Eth1/3

Total entries displayed: 4

IPN-2# sh ip route vrf fabric-mpod 10.36.119.1
IP Route Table for VRF "fabric-mpod"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

10.36.119.1/32, ubest/mbest: 2/0, attached
*via 10.36.119.1, Lo1, [0/0], 3w0d, local
*via 10.36.119.1, Lo1, [0/0], 3w0d, direct

IPN-3# show cdp neighbors
Capability Codes: R - Router, T - Trans-Bridge, B - Source-Route-Bridge
S - Switch, H - Host, I - IGMP, r - Repeater,
V - VoIP-Phone, D - Remotely-Managed-Device,
s - Supports-STP-Dispute

Device-ID Local Intrfce Hldtme Capability Platform Port ID
ACI-OOB-SW01 mgmt0 145 R S I WS-C2960XR-48 Gig1/0/22
1DP-IPN-1(FD3L)
Eth1/1 138 R S s N9K-C93180YC- Eth1/1
1DP-IPN-2(FD03)
Eth1/2 138 R S s N9K-C93180YC- Eth1/1
RDV-IPN-4(FDOT3)
Eth1/3 178 R S s N9K-C93180YC- Eth1/3

Total entries displayed: 4

sh ip route vrf fabric-mpod 10.36.119.1
IP Route Table for VRF "fabric-mpod"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

10.36.119.1/32, ubest/mbest: 2/0
*via 10.36.119.17, Eth1/1, [110/5], 3w0d, ospf-ACI, intra
*via 10.36.119.37, Eth1/2, [110/5], 3w0d, ospf-ACI, intra

IPN-4# show cdp neighbors
Capability Codes: R - Router, T - Trans-Bridge, B - Source-Route-Bridge
S - Switch, H - Host, I - IGMP, r - Repeater,
V - VoIP-Phone, D - Remotely-Managed-Device,
s - Supports-STP-Dispute

Device-ID Local Intrfce Hldtme Capability Platform Port ID
ACI-OOB-SW01 mgmt0 133 R S I WS-C2960XR-48 Gig1/0/21
1DP-IPN-1(FD3L)
Eth1/1 155 R S s N9K-C93180YC- Eth1/2
1DP-IPN-2(FD3)
Eth1/2 155 R S s N9K-C93180YC- Eth1/2
RDV-IPN-3(FDZ)
Eth1/3 147 R S s N9K-C93180YC- Eth1/3

Total entries displayed: 4

IPN-4# sh ip route vrf fabric-mpod 10.36.119.1
IP Route Table for VRF "fabric-mpod"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

10.36.119.1/32, ubest/mbest: 2/0
*via 10.36.119.21, Eth1/1, [110/5], 3w0d, ospf-ACI, intra
*via 10.36.119.41, Eth1/2, [110/5], 3w0d, ospf-ACI, intra

Looks like your phantom-RP configuration is incorrect:

IPN1 and IPN2 need different masks for the Lo1 interface.

See the following document:

https://supportforums.cisco.com/document/55696/rp-redundancy-pim-bidir-phantom-rp

Marcel

And also pay attention to the remarks in the document above:

    * It's important the RP address is NOT the loopback address but one of the other address in the subnet defined on the loopback
    * By default, OSPF advertises all loopbacks as /32 so the need of 'ip ospf network point-to-point' command to advertise the subnet mask

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community:

Save 25% on Day-2 Operations Add-On License