Multicast over Nexus 5000

[skrowocsic]

Hello,

we have a 2 server cluster and we need to establish a multicast comunication between the servers.

The servers are located in 2 diferent DataCenters on Nexus5000 with NX-OS v 5.0 and there is a fiber connection between de Nexus.

Servers are virtual Hyper-V servers with Windows 2008 R2 Standard and they have several NICs with diferent vlans.

We are trying tu run Oracle Coherence.

Servers are in the same vlans (Service, Backup, etc) but the multicast connection doesn´t work.

When the 2 servers are in the same DataCenter there is no problem, but when we have moved one server in another DataCenter the problem started.

What can I do?

Thank you very much, Jonan.

[Peter Koltl]

IGMP snooping is probably enabled by default and you need to add an IGMP querier so that the inter-switch link is added to the snooped multicast ports.

[shajakhan85]

Hi,

have you configured any VRF on your data center????

[skrowocsic]

I have foun this technote fore Catalyst, I´m trying to find something similar for Nexus because some commands don´t work.

http://www.cisco.com/en/US/products/hw/switches/ps708/products_tech_note09186a008059a9df.shtml

I think we have only the default vrf configuration:

VRF-Name                           VRF-ID State   Reason

default                                 1 Up      --

management                              2 Up      --

Do we need VRF to enable multicast?

IGMP snooping is enabled, and there isn't any querier:

IGMP Snooping information for vlan 33
  IGMP snooping enabled
  Optimised Multicast Flood (OMF) disabled
  IGMP querier none
  Switch-querier disabled
  IGMPv3 Explicit tracking enabled
  IGMPv2 Fast leave disabled
  IGMPv1/v2 Report suppression enabled
  IGMPv3 Report suppression disabled
  Link Local Groups suppression enabled
  Router port detection using PIM Hellos, IGMP Queries
  Number of router-ports: 1
  Number of groups: 0
  VLAN vPC function enabled
  Active ports:
    Po10        Po11    Po12    Po13
    Po20        Po21    Po22    Po23
    Po24        Po25

But, How can I configure a querier?

ip igmp snooping ?

  event-history                  Configure event-history buffers

  link-local-groups-suppression  Configures Global link-local groups suppression

  mrouter                        Configures static multicast router interface

  optimise-multicast-flood       Configures Optimized Multicast Flood (OMF) on all VLANs

  report-suppression             Configures Global IGMPv1/IGMPv2 Report Suppression

  v3-report-suppression          Configures Global IGMPv3 Report Suppression and Proxy Reporting

Thanks.

[Peter Koltl]

http://www.cisco.com/en/US/docs/switches/datacenter/nexus5500/sw/multicast/6x/igmp_snoop.html#wp1073089

[Peter Koltl]

Hi, is it solved?

[skrowocsic]

Not yet, I have tried to use a multicast router, but I can´t enable pim feature because w haven´t got the license.

     feature pim

     No available license - LAN_BASE_SERVICES_PKG error Feature does not have an installed license

I have asked the license but they don´t provide me yet.

I have tried also to configure IGMP snooping in the VLAN:

     NEXUS1(config)# ip igmp snooping
     Warning: IGMP Snooping should be globally enabled on peer VPC switch as well.
     NEXUS1(config)# ip igmp snooping mrouter vpc-peer-link
     Warning: IGMP Snooping mrouter vpc-peer-link should be globally enabled on peer VPC switch as well.
     NEXUS1(config)# vlan 99
     NEXUS1(config-vlan)# ip igmp snooping
     Warning: IGMP Snooping should be enabled on peer VPC switch as well.
     Warning: IGMP Snooping should be enabled on peer VPC switch as well.
     NEXUS1(config-vlan)#  ip igmp snooping explicit-tracking
     NEXUS1(config-vlan)#  ip igmp snooping fast-leave
     NEXUS1(config-vlan)#  ip igmp snooping last-member-query-interval 3
     Warning: IGMP Snooping should be enabled on peer VPC switch as well.
     NEXUS1(config-vlan)#  ip igmp snooping querier 10.0.206.240
     NEXUS1(config-vlan)#  ip igmp snooping report-suppression
     NEXUS1(config-vlan)#  ip igmp snooping mrouter interface Po11
     NEXUS1(config-vlan)#  ip igmp snooping static-group 228.8.8.8 interface Po11
     NEXUS1(config-vlan)#  ip igmp snooping link-local-groups-suppression
     NEXUS1(config-vlan)#  ip igmp snooping v3-report-suppression
     NEXUS1(config-vlan)#  no ip igmp snooping mrouter vpc-peer-link
     Warning: IGMP Snooping mrouter vpc-peer-link should be globally disabled on peer VPC switch as well.
     NEXUS1(config)# end

And I will try next week to configure vpc-peer-link in the Port-Channel between Nexus. The actual configuration is:

     interface port-channel20

       description NEXUS2 Eth1/8-9

       switchport mode trunk

       vpc 20

And I will try to configure vpc-peer-link

     interface port-channel20

       description Peer-Link NEXUS2 Eth1/8-9

       switchport mode trunk

       vpc peer-link

       spanning-tree port type network

[Peter Koltl]

Great. You should be done. PIM is not necessary if you have a working querier.

[skrowocsic]

Hello again,

I have tried to enable vpc-peer-link between Data Centers but I can´t do it.

I have read in this document that the vpc-peer-link can establish only between 2 switches and we have already do it.

http://docwiki.cisco.com/wiki/Nexus_5000_vPC_Design_Best_Practices

We have already established it in both Data Centers because there are 2 Nexus in each Data Center. So I think we must get the PIM license and enable PIM to route the multicast traffic.

[tiwang]

Hi Skrowocsic

Have/had a similar problem - we are running MS NLB in Multicast IGMP mode and have 2 x 2 set of nexus 5k as access-switches. I have defined all the ports in between the switches as mrouter's to forward the traffic in between the L2 switches:

ex - vlan 2001 where I have port-channel5 which is a uplink to a L3 switch and port-channel 16 which is my DCI (vpc on dark-fiber with 50km in between the switches)

vlan 2001

  ip igmp snooping mrouter interface port-channel5

  ip igmp snooping mrouter interface port-channel16

seems to work now - the vm's running MS NLB announce their multicast groups and join them also in between the switches

best regards /Ti

[skrowocsic]

Hello,

I suspect that the problem is located in the software.

Do you know how can I check if IGMP snooping is correctly configured?

In spite of it all, I have open an enquiry to the support company.

Thank you very much.

[tiwang]

Hi again

Sorry for the long delay - no I am not that familiar with all the fancy options here but found some simple commands which works for me - here like the displaying the groups which has been joined by the vm's and network interfaces allocated for the traffic:

SW5020-01# sh ip igmp snooping groups vl 21

Type: S - Static, D - Dynamic, R - Router port

Vlan  Group Address      Ver  Type  Port list

21  */*                -    R     Po10 Po16 Po5

21  239.255.149.19     v1   D     Eth1/14 Eth1/19 Eth1/32

21  239.255.149.24     v1   D     Eth1/12 Eth1/15 Eth1/16

                                    Eth1/26 Eth1/31

21  239.255.255.250    v2   D     Po15 Eth1/11 Eth1/28

                                    Eth1/29

SW5020-01#

those v1 groups are ms windows 2k8 serveres running nlb for rdp. This looks correctly - the two groups ending on .19 & .49 are groups created by the NLB clusters (these groups reflect the ip adresses of the NLB cluster)

bestr egards /ti