UCS Multicast issue

ksahnoune · ‎07-08-2012

Hi every one,

I'm facing a multicast problem on UCS. I have VMs (Red Hat) installed on UCS B that use multicast for cluster communication.

When starting application, I can see creation of expected multicast groups on both VM and Fabric Interconnect:

On VM:

======

# netstat -gn

IPv6/IPv4 Group Memberships

Interface RefCnt Group

--------------- ------ ---------------------

lo 1 224.0.0.1

eth0 1 224.0.50.6

eth0 1 224.0.50.5

eth0 1 224.0.50.4

eth0 1 224.0.50.3

eth0 1 224.0.50.2

eth0 3 224.0.50.1

eth0 1 224.0.0.251

On FI:

======

VSRFI-A(nxos)# show ip igmp event-history ha

2012 Jul 8 20:47:04.565626 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.6), vlan 1, updated [count 1]

2012 Jul 8 20:46:58.364531 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.5), vlan 1, updated [count 1]

2012 Jul 8 20:46:58.358492 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.4), vlan 1, updated [count 1]

2012 Jul 8 20:46:58.352538 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.3), vlan 1, updated [count 1]

2012 Jul 8 20:46:58.346523 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.2), vlan 1, updated [count 1]

2012 Jul 8 20:46:58.086531 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.1), vlan 1, updated [count 1]

But just only 3min after cluster operation, my multicast groups are removre on FI but still on VM:

VSRFI-A(nxos)# show ip igmp event-history ha

ha events for IGMP process

2012 Jul 8 20:50:20.695544 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.6), vlan 1, updated [count 0]

2012 Jul 8 20:50:20.695252 igmp [4906]: : OIF PSS entry in vlan 1 for (*, 224.0.50.6) deleted

2012 Jul 8 20:50:20.695169 igmp [4906]: : OIF PSS entry in vlan 1 for (*, 224.0.50.6) deleted

2012 Jul 8 20:50:20.695005 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.5), vlan 1, updated [count 0]

2012 Jul 8 20:50:20.694844 igmp [4906]: : OIF PSS entry in vlan 1 for (*, 224.0.50.5) deleted

2012 Jul 8 20:50:20.694760 igmp [4906]: : OIF PSS entry in vlan 1 for (*, 224.0.50.5) deleted

2012 Jul 8 20:50:20.694598 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.4), vlan 1, updated [count 0]

2012 Jul 8 20:50:20.694436 igmp [4906]: : OIF PSS entry in vlan 1 for (*, 224.0.50.4) deleted

2012 Jul 8 20:50:20.694352 igmp [4906]: : OIF PSS entry in vlan 1 for (*, 224.0.50.4) deleted

2012 Jul 8 20:50:20.694189 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.3), vlan 1, updated [count 0]

2012 Jul 8 20:50:20.694027 igmp [4906]: : OIF PSS entry in vlan 1 for (*, 224.0.50.3) deleted

2012 Jul 8 20:50:20.693944 igmp [4906]: : OIF PSS entry in vlan 1 for (*, 224.0.50.3) deleted

2012 Jul 8 20:50:20.693780 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.2), vlan 1, updated [count 0]

2012 Jul 8 20:50:20.693618 igmp [4906]: : OIF PSS entry in vlan 1 for (*, 224.0.50.2) deleted

2012 Jul 8 20:50:20.693534 igmp [4906]: : OIF PSS entry in vlan 1 for (*, 224.0.50.2) deleted

2012 Jul 8 20:50:20.693364 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.1), vlan 1, updated [count 0]

2012 Jul 8 20:50:20.693031 igmp [4906]: : OIF PSS entry in vlan 1 for (*, 224.0.50.1) deleted

2012 Jul 8 20:50:20.692943 igmp [4906]: : OIF PSS entry in vlan 1 for (*, 224.0.50.1) deleted

2012 Jul 8 20:47:04.565626 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.6), vlan 1, updated [count 1]

2012 Jul 8 20:46:58.364531 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.5), vlan 1, updated [count 1]

2012 Jul 8 20:46:58.358492 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.4), vlan 1, updated [count 1]

2012 Jul 8 20:46:58.352538 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.3), vlan 1, updated [count 1]

2012 Jul 8 20:46:58.346523 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.2), vlan 1, updated [count 1]

2012 Jul 8 20:46:58.086531 igmp [4906]: : Group v3-oifs PSS entry for (*, 224.0.50.1), vlan 1, updated [count 1]

Do you have an idea what can explain this behavour (the interval of 3min is nearly constant) ?

Thank you for help. I can't get my cluster working

mipetrin · ‎07-08-2012

Hi Khalid,

What version of UCS firmware are you using? Also, what adapters have you got installed on the blades hosting the multicast devices?

When it comes to Multicast on UCS, there are a couple of things to note:

Currently, the UCS Fabric Interconnects have IGMP snooping enabled by default, and this cannot be disabled (this will be fixed in the next major release via CSCte64886).
Therefore, you are required to have either of the following:
1. Multicast router in the VLAN; or
2. IGMP querier in the VLAN

NOTE: Currently, the UCS Fabric Interconnects have no IGMP querier functionality (this will be fixed in the major release via CSCtg82066) and as such, you are required to enable this querier functionality on a device in the upstream L2 network

Once you make the above changes, if you still have issues, please provide the following outputs:

show ip igmp snooping mrouter (if you have Multicast router)
show ip igmp snooping querier (if you have IGMP querier)
show ip igmp snooping groups
show ip igmp snooping vlan
show ip igmp snooping statistics vlan

Let me know how you go and if you have any further questions.

Thanks,

Michael

ksahnoune · ‎07-09-2012

Thank you very much Michael.

I've enabled multicast-routing on my 3750 switchs and now I can see all my multicast groups on both switchs and FI. The switch is sending IGMP query every 60 sec (default interval) witch trigger hosts to send IGMP reports. Therefore, my multicat groups are kept and cluster nodes can communicate :)

Thanks again.