upstream switch link detection not showing

mikeleahy1234 · ‎11-03-2011

hi guys

i have HP bl 620G7 with 1000v and vsphere 4.1. . when a physical upstream switch port goes down , my cisco 1000v doesnt notice that its down and when we bring back up the upstream port the vsm port attached to the physical nic does not come up as expected

im using smart link also so i thought this would pass the traffic etc

what teaming method should i use in the port profiles for this to work or would it be a firmware issue on the HP side?

thanks a lot

Robert Burns · ‎11-03-2011

Michael,

Good to see you're using smart-link, but also ensure you're using MAC-pinning on the 1000v uplink port profile(s). When an uplink comes back online, mac-pinning will re-balance the virtual interface pinning among active uplinks.

Assuming you have multiple uplinks to each blade with multiple switch modules in your chassis, do the following:

1. Issue this command: "module vem x execute vemcmd show port". This will show you the sub-group IDs for all vmnics and the sub-group of each virtual interface.

2. Shutdown the uplink and repeat the command. You should all virtual interfaces pinned to "other" sub-group IDs than the one you just shut down.

3. Re-enable the uplink and repeat again. You should see virtual interfaces re-pinned back to this SG.

Ex.

n1000v-BL1(config)# module vem 3 execute vemcmd show port

LTL VSM Port Admin Link State PC-LTL SGID Vem Port

17 Eth3/1 UP UP FWD 305 0 vmnic0 <==== Physical Uplink 1 = Sub Group ID 0

18 Eth3/2 UP UP FWD 305 1 vmnic1 <==== Physical Uplink 2 = Sub Group ID 1

49 Veth4 UP UP FWD 0 0 vmk0

50 Veth11 UP UP FWD 0 1 vmk1

51 Veth1 UP UP FWD 0 0 vmk2

52 Veth6 UP UP FWD 0 0 vCenter 4.1.eth0 <===All virtual interfaces have SG 1 or 0

55 Veth18 UP UP FWD 0 0 WIN2K3-DC ethernet0

56 Veth25 UP UP FWD 0 1 n1000v-BL1-Secondary.eth2

57 Veth24 UP UP FWD 0 1 n1000v-BL1-Secondary.eth1

58 Veth19 UP UP FWD 0 1 n1000v-BL1-Secondary.eth0

59 Veth10 UP UP FWD 0 0 n1000v-BL1-Primary.eth2

60 Veth9 UP UP FWD 0 0 n1000v-BL1-Primary.eth1

61 Veth8 UP UP FWD 0 0 n1000v-BL1-Primary.eth0

62 Veth5 UP UP FWD 0 1 Sharepoint-CAE ethernet0

305 Po2 UP UP FWD 0

After diabling the Uplink

n1000v-BL1(config)# module vem 3 execute vemcmd show port

LTL VSM Port Admin Link State PC-LTL SGID Vem Port

17 Eth3/1 DOWN DOWN BLK 305 0 vmnic0 <==== Physical Uplink 1 shows down

18 Eth3/2 UP UP FWD 305 1 vmnic1

49 Veth4 UP UP FWD 0 1 vmk0

50 Veth11 UP UP FWD 0 1 vmk1

51 Veth1 UP UP FWD 0 1 vmk2

52 Veth6 UP UP FWD 0 1 vCenter 4.1.eth0 <===All virtual interfaces have SG of 1

55 Veth18 UP UP FWD 0 1 WIN2K3-DC ethernet0

56 Veth25 UP UP FWD 0 1 n1000v-BL1-Secondary.eth2

57 Veth24 UP UP FWD 0 1 n1000v-BL1-Secondary.eth1

58 Veth19 UP UP FWD 0 1 n1000v-BL1-Secondary.eth0

59 Veth10 UP UP FWD 0 1 n1000v-BL1-Primary.eth2

60 Veth9 UP UP FWD 0 1 n1000v-BL1-Primary.eth1

61 Veth8 UP UP FWD 0 1 n1000v-BL1-Primary.eth0

62 Veth5 UP UP FWD 0 1 Sharepoint-CAE ethernet0

305 Po2 UP UP FWD 0

Which version of 1000v are you using btw?

Regards,

Robert

mikeleahy1234 · ‎11-03-2011

robert

thanks for that but if i plug the actual physical uplink out of the physical switch then the nexus will still display it as up, not down.

Robert Burns · ‎11-03-2011

If when you disconnect all the uplinks from the VC module in the chassis and the hosts don't see a link down event

(You can confirm by "ifconfig" or "esxcfg-nics -l") then either there's an issue with the VC module or Smart-Link isn't operating as it should. In this case you'd need to follow up with HP.

If the host doesn't detect the link down, the 1000v can't respond accordingly....

Regards,

Robert