Nexus 5k Port channel issue - Physical port (Hot standby in bundle)

rawatsandeep · ‎09-20-2012

Hi guys,

I am having issues with a port channnel connected to the UCS server.Whenever I am putting physical port into portchannel it is going down, the physical port is going down with interface staus saying first - (Link not connected) and then finally (Hot standby in bundle). Portchannel remail down with status (No operational members)

What does this status message means : Ethernet1/11 is down (Hot standby in bundle)

Below is the configuration:

interface Ethernet1/11

no cdp enable

switchport mode trunk

switchport trunk allowed vlan 317,2511-2514

spanning-tree port type edge trunk

no snmp trap link-status

logging event port link-status

logging event port trunk-status

channel-group 101 mode active

interface port-channel101

switchport mode trunk

vpc 101

switchport trunk allowed vlan 317,2511-2514

spanning-tree port type edge trunk

logging event port link-status

logging event port trunk-status

ACC14# sh port-channel summ

Flags: D - Down P - Up in port-channel (members)

I - Individual H - Hot-standby (LACP only)

s - Suspended r - Module-removed

S - Switched R - Routed

U - Up (port-channel)

--------------------------------------------------------------------------------

Group Port- Type Protocol Member Ports

Channel

--------------------------------------------------------------------------------

101 Po101(SD) Eth LACP Eth1/11(H)

-------------------------------

Below is what I have obeserved :

ACC14(config)# int eth1/11

ACC14(config-if)# no channel-group 101 mode active

ACC14(config-if)# sh int eth1/11

Ethernet1/11 is up

Hardware: 1000/10000 Ethernet, address: 547f.ee24.4e92 (bia 547f.ee24.4e92)

MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

full-duplex, 10 Gb/s, media type is 10G

Beacon is turned off

Input flow-control is off, output flow-control is off

Rate mode is dedicated

Switchport monitor is off

EtherType is 0x8100

Last link flapped 00:00:02

Last clearing of "show interface" counters never

30 seconds input rate 112 bits/sec, 14 bytes/sec, 0 packets/sec

30 seconds output rate 232 bits/sec, 29 bytes/sec, 0 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 152 bps, 0 pps; output rate 248 bps, 0 pps

RX

0 unicast packets 1701 multicast packets 0 broadcast packets

1701 input packets 368680 bytes

0 jumbo packets 0 storm suppression bytes

0 giants 0 input error 0 short frame 0 overrun 0 underrun

0 watchdog 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

0 unicast packets 59044 multicast packets 5630 broadcast packets

64674 output packets 5169139 bytes

0 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble

0 Tx pause

15 interface resets

ACC14(config-if)# sh int po101

port-channel101 is down (No operational members)

vPC Status: Down, vPC number: 101 [packets forwarded via vPC peer-link]

Hardware: Port-Channel, address: 547f.ee24.4e92 (bia 547f.ee24.4e92)

MTU 1500 bytes, BW 100000 Kbit, DLY 10 usec,

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

auto-duplex, 10 Gb/s

Beacon is turned off

Input flow-control is off, output flow-control is off

Switchport monitor is off

EtherType is 0x8100

No members

Last clearing of "show interface" counters never

0 seconds input rate 0 bits/sec, 0 bytes/sec, 0 packets/sec

0 seconds output rate 0 bits/sec, 0 bytes/sec, 0 packets/sec

Load-Interval #2: 0 seconds

input rate 0 bps, 0 pps; output rate 0 bps, 0 pps

RX

0 unicast packets 0 multicast packets 0 broadcast packets

0 input packets 0 bytes

0 jumbo packets 0 storm suppression bytes

0 giants 0 input error 0 short frame 0 overrun 0 underrun

0 watchdog 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

0 unicast packets 0 multicast packets 0 broadcast packets

0 output packets 0 bytes

0 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble

0 Tx pause

0 interface resets

ACC14(config-if)# sh int eth1/11

Ethernet1/11 is down (Link not connected)

Hardware: 1000/10000 Ethernet, address: 547f.ee24.4e92 (bia 547f.ee24.4e92)

MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

auto-duplex, 10 Gb/s, media type is 10G

Beacon is turned off

Input flow-control is off, output flow-control is off

Rate mode is dedicated

Switchport monitor is off

EtherType is 0x8100

Last link flapped 00:00:10

Last clearing of "show interface" counters never

30 seconds input rate 48 bits/sec, 6 bytes/sec, 0 packets/sec

30 seconds output rate 8056 bits/sec, 1007 bytes/sec, 8 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 288 bps, 0 pps; output rate 2.30 Kbps, 2 pps

RX

0 unicast packets 1728 multicast packets 0 broadcast packets

1728 input packets 374762 bytes

0 jumbo packets 0 storm suppression bytes

0 giants 0 input error 0 short frame 0 overrun 0 underrun

0 watchdog 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

0 unicast packets 59637 multicast packets 5685 broadcast packets

65322 output packets 5222148 bytes

0 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble

0 Tx pause

15 interface resets

ACC14(config-if)# sh int po101

port-channel101 is down (No operational members)

vPC Status: Down, vPC number: 101 [packets forwarded via vPC peer-link]

Hardware: Port-Channel, address: 547f.ee24.4e92 (bia 547f.ee24.4e92)

MTU 1500 bytes, BW 100000 Kbit, DLY 10 usec,

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

auto-duplex, 10 Gb/s

Beacon is turned off

Input flow-control is off, output flow-control is off

Switchport monitor is off

EtherType is 0x8100

Members in this channel: Eth1/11

Last clearing of "show interface" counters never

30 seconds input rate 2192 bits/sec, 274 bytes/sec, 0 packets/sec

30 seconds output rate 7296 bits/sec, 912 bytes/sec, 3 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 216 bps, 0 pps; output rate 2.38 Kbps, 2 pps

RX

0 unicast packets 450 multicast packets 0 broadcast packets

450 input packets 98735 bytes

0 jumbo packets 0 storm suppression bytes

0 giants 0 input error 0 short frame 0 overrun 0 underrun

0 watchdog 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

0 unicast packets 980 multicast packets 12 broadcast packets

992 output packets 143742 bytes

0 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble

0 Tx pause

0 interface resets

ACC14(config-if)# sh lacp counters interface po101

ACC14(config-if)# int eth1/11

ACC14(config-if)# channel-group 101 mode active

ACC14(config-if)# sh lacp counters interface po101

LACPDUs Marker Marker Response LACPDUs

Port Sent Recv Sent Recv Sent Recv Pkts Err

---------------------------------------------------------------------

port-channel101

Ethernet1/11 261 599 0 0 0 0 0

ACC14(config-if)# sh lacp counters interface po101

LACPDUs Marker Marker Response LACPDUs

Port Sent Recv Sent Recv Sent Recv Pkts Err

---------------------------------------------------------------------

port-channel101

Ethernet1/11 261 600 0 0 0 0 0

ACC14(config-if)# sh lacp counters interface po101

LACPDUs Marker Marker Response LACPDUs

Port Sent Recv Sent Recv Sent Recv Pkts Err

---------------------------------------------------------------------

port-channel101

Ethernet1/11 261 603 0 0 0 0 0

ACC14(config-if)#

ACC14(config-if)# sh lacp counters interface po101

LACPDUs Marker Marker Response LACPDUs

Port Sent Recv Sent Recv Sent Recv Pkts Err

---------------------------------------------------------------------

port-channel101

Ethernet1/11 261 605 0 0 0 0 0

ACC14(config-if)#

ACC14(config-if)# sh lacp counters interface po101

LACPDUs Marker Marker Response LACPDUs

Port Sent Recv Sent Recv Sent Recv Pkts Err

---------------------------------------------------------------------

port-channel101

Ethernet1/11 262 610 0 0 0 0 0

ACC14(config-if)#

Now no more LACP packets are sent or received

ACC14(config-if)#

ACC14(config-if)# sh int po101

port-channel101 is down (No operational members)

vPC Status: Down, vPC number: 101 [packets forwarded via vPC peer-link]

Hardware: Port-Channel, address: 547f.ee24.4e92 (bia 547f.ee24.4e92)

MTU 1500 bytes, BW 100000 Kbit, DLY 10 usec,

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

auto-duplex, 10 Gb/s

Beacon is turned off

Input flow-control is off, output flow-control is off

Switchport monitor is off

EtherType is 0x8100

Members in this channel: Eth1/11

Last clearing of "show interface" counters never

30 seconds input rate 248 bits/sec, 31 bytes/sec, 0 packets/sec

30 seconds output rate 128 bits/sec, 16 bytes/sec, 0 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 96 bps, 0 pps; output rate 1.66 Kbps, 2 pps

RX

0 unicast packets 471 multicast packets 0 broadcast packets

471 input packets 101618 bytes

0 jumbo packets 0 storm suppression bytes

0 giants 0 input error 0 short frame 0 overrun 0 underrun

0 watchdog 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

0 unicast packets 988 multicast packets 12 broadcast packets

1000 output packets 144925 bytes

0 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble

0 Tx pause

0 interface resets

ACC14(config-if)# sh int eth1/11

Ethernet1/11 is down (Hot standby in bundle)

Hardware: 1000/10000 Ethernet, address: 547f.ee24.4e92 (bia 547f.ee24.4e92)

MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec,

reliability 255/255, txload 1/255, rxload 1/255

Encapsulation ARPA

Port mode is trunk

auto-duplex, 10 Gb/s, media type is 10G

Beacon is turned off

Input flow-control is off, output flow-control is off

Rate mode is dedicated

Switchport monitor is off

EtherType is 0x8100

Last link flapped 00:01:03

Last clearing of "show interface" counters never

30 seconds input rate 160 bits/sec, 20 bytes/sec, 0 packets/sec

30 seconds output rate 176 bits/sec, 22 bytes/sec, 0 packets/sec

Load-Interval #2: 5 minute (300 seconds)

input rate 56 bps, 0 pps; output rate 1.58 Kbps, 2 pps

RX

0 unicast packets 1755 multicast packets 0 broadcast packets

1755 input packets 378413 bytes

0 jumbo packets 0 storm suppression bytes

0 giants 0 input error 0 short frame 0 overrun 0 underrun

0 watchdog 0 if down drop

0 input with dribble 0 input discard

0 Rx pause

TX

0 unicast packets 59651 multicast packets 5685 broadcast packets

65336 output packets 5224084 bytes

0 jumbo packets

0 output errors 0 collision 0 deferred 0 late collision

0 lost carrier 0 no carrier 0 babble

0 Tx pause

15 interface resets

And just to let u know This po101 is a part of vPC, between 2 N5k. Other Switch's N5k port channel is up.

Thanks in advance...

HTH

Sandeep Rawat

Message was edited by: Sandeep Rawat

rawatsandeep · ‎09-22-2012

Hmmm.. Somebody pluged the cable going out of Eth1/11 to a wrong server, thus we were gettin status as Hot standby in bundle and not able to add the eth1/11 to port channel. Port-channel, port, and vpc came up after cable was placed correctly to right server.