Two switches only one manageable

[thomas_daley]

Hi,

  I have a question that I hope someone can answer.  I have a Windows 2003 Server that has 4 QLE8152 CNAs that are teamed (using the QLogic utility) with a single IP address.  There are two Nexus switches and the mgmt0 interface on both are plugged into an Extreme switch.  The 2 Nexus switches and the single Extreme switch are connected through a port-channel interface on each with 2 physical interfaces from the Nexus.  With this configuration I can only get to a single IP address from the 2003 server, every other server on the network sees the network can get to both IP addresses.  The 2003 server is plugged into the Nexus, the other systems are not.  When I ping from the 2003 I get a reply from one address and no reply from the other.  The MAC for the non-responsive mgmt0 interface address shows up on the ARP table on the server and the MAC adress for the server shows up on the non-responsive mgmt for the server.  When I do an show ip arp vrf management on the responsive mgmt0 the address for the server shows up as learned through the port-channel and on the non-responsive it shows up on an Ethernet interface.  I have split the team so that it is two teams, two interfaces per with a single address on each and I still have the same results.  Has anyone seen anything similar to this?

Thanks,

Thom

[vdsudame]

Hi Thom,

can you briefly describe the topology? Is the window server connected directly to the n5k base ports or is this connected via the fex? can you paste your port channel and member interface configuration? Is the server configured in lacp mode or is this static etherchannel? Also initially you started with explaining how you having single teaming, then you mention you break the teaming into two. If you have single ip address on the server, i would assume you team all interfaces in single port channel on server side (active-active), and do a vpc on the n5k ie bind interfaces across n5ks in single pc. make sure you have port channel configured as edge port.

Thanks, Vinayak.

[thomas_daley]

Hi Vinayak,

  The server now has two NIC teams with two separate IP addresses.  LACP is not set up because of the team settings, they're set for failover.  So I have one physical interface active while the other sits in standby.  The Teams are plugged directly into the 5Ks and not into a FEX.  So I have an Extreme switch upstream and it connects to the two 5Ks through static port-channel on each.  The port-channels have two interfaces.  vPC is not set up on the switches because they didn't have enough interfaces to set it up.  So are you suggesting I set up LACP on the teams and the switches?  And as far as the edge switch setting that would be on the uplink port-channels to the Extreme switch?  Here is the settings for the interfaces on the Nexus switches:

Switch 1

interface Ethernet1/6

  switchport mode trunk

  switchport trunk native vlan 65

interface Ethernet1/25

  switchport mode trunk

  switchport access vlan 65

  switchport trunk native vlan 65

Switch 2

interface Ethernet1/6

  switchport mode trunk

  switchport trunk native vlan 65

interface Ethernet1/25

  switchport mode trunk

  switchport access vlan 65

  switchport trunk native vlan 65

Thanks for the assist,

Thom