cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
3851
Views
0
Helpful
7
Replies

Nexus vPC Auto-Recovery

daviddo99
Level 1
Level 1

I have a issue with nexus 3064 running 6.0.2.U6(4) where ports 51 and 52 wouldn't come up with error "vpc peerlink is down". I thought configuring auto-recovery would bring the member ports up after 240sec delay but the ports never come up. The other switch is down. I have the relevant configs below.

vpc domain 10
  peer-switch
  role priority 100
  peer-keepalive destination 192.168.1.6 source 192.168.1.5 vrf default
  delay restore 1
  peer-gateway
  auto-recovery
  fast-convergence
  ip arp synchronize

interface port-channel1
  lacp suspend-individual
  switchport mode trunk
  no negotiate auto
  vpc 12

interface Ethernet1/51
  switchport mode trunk
  link debounce time 0
  channel-group 1 mode active

interface Ethernet1/52
  switchport mode trunk
  link debounce time 0
  channel-group 1 mode active

1 Accepted Solution

Accepted Solutions

Hi -

Sure.  Wipe the vPC domain configuration on the surviving switch, then put it back in place.  It will come up as the primary.  (Removing the domain will remove the vpc commands from your port-channel interfaces, so those will have to be put back too.)

Sorry.  Scratch that.  Both sides stay down on initial setup, so that won't work.  Just remove the vpc domain until your other switch is replaced.  That should fix any L2 forwarding issues you may be experiencing.  (hence the recommendation for a TAC case)

PSC

View solution in original post

7 Replies 7

Paul Chapman
Level 4
Level 4

Hi -

Can you post the following:

show vpc
show vpc peer-keepalive
show vpc role
show vpc consistency-parameters global

The vPC Best Practices guide indicates that the links on the secondary will come online after 3 failed keep alives.

http://www.cisco.com/c/dam/en/us/td/docs/switches/datacenter/sw/design/vpc_design/vpc_best_practices_design_guide.pdf

PSC

01# show vpc                                                                                                         
Legend:                                                                                                                
                (*) - local vPC is down, forwarding via vPC peer-link                                                  
                                                                                                                       
vPC domain id                     : 10                                                                                 
Peer status                       : peer link is down                                                                  
vPC keep-alive status             : Suspended (Destination IP not reachable)                                           
Configuration consistency status  : failed                                                                             
Per-vlan consistency status       : success                                                                            
Configuration inconsistency reason: Consistency Check Not Performed                                                    
Type-2 consistency status         : failed                                                                             
Type-2 inconsistency reason       : QoSMgr type-1 configuration incompatible                                           
vPC role                          : none established                                                                   
Number of vPCs configured         : 1                                                                                  
Peer Gateway                      : Enabled                                                                            
Peer gateway excluded VLANs     : -                                                                                    
Dual-active excluded VLANs        : -                                                                                  
Graceful Consistency Check        : Disabled (due to peer configuration)                                               
Auto-recovery status              : Enabled (timeout = 240 seconds)                                                    
                                                                                                                       
vPC Peer-link status                                                                                                   
---------------------------------------------------------------------                                                  
id   Port   Status Active vlans                                                                                        
--   ----   ------ --------------------------------------------------                                                  
1    Po6    down   -                                                                                                   
                                                                                                                       
vPC status                                                                                                             
----------------------------------------------------------------------------                                           
id     Port        Status Consistency Reason                     Active vlans                                          
------ ----------- ------ ----------- -------------------------- -----------                                           
12     Po1         down   Not         Consistency Check Not      -                                                     
                          Applicable  Performed                                                                        
01# show vpc peer-keepalive                                                                                          
                                                                                                                       
vPC keep-alive status             : Suspended (Destination IP not reachable)                                           
--Send status                   : Success                                                                              
--Last send at                  : 2017.02.13 22:18:37 632 ms                                                           
--Sent on interface             : Vlan217                                                                              
--Receive status                : Failed                                                                               
--Last update from peer         : (14250) seconds, (961) msec                                                          
                                                                                                                       
vPC Keep-alive parameters                                                                                              
--Destination                   : 192.168.1.6                                                                         
--Keepalive interval            : 1000 msec                                                                            
--Keepalive timeout             : 5 seconds                                                                            
--Keepalive hold timeout        : 3 seconds                                                                            
--Keepalive vrf                 : default                                                                              
--Keepalive udp port            : 3200                                                                                 
--Keepalive tos                 : 192                                                                                  
01# show vpc role                                                                                                    
                                                                                                                       
vPC Role status                                                                                                        
----------------------------------------------------                                                                   
vPC role                        : none established                                                                     
Dual Active Detection Status    : 0                                                                                    
vPC system-mac                  : 00:00:00:00:00:00                                                                    
vPC system-priority             : 32667                                                                                
vPC local system-mac            : 88:f0:31:c1:f1:81                                                                    
vPC local role-priority         : 0                                                                                    
01# show vpc consistency-parameters global                                                                           
                                                                                                                       
    Legend:                                                                                                            
        Type 1 : vPC will be suspended in case of mismatch                                                             
                                                                                                                       
Name                        Type  Local Value            Peer Value                                                    
-------------               ----  ---------------------- -----------------------                                       
Vlan to Vn-segment Map      1     No Relevant Maps       -                                                             
QoS                         2     ([], [], [], [], [],   -                                                             
                                  [], [], [])                                                                          
Network QoS (MTU)           2     (1538, 0, 0, 0, 0, 0,  -                                                             
                                  0, 0)                                                                                
Network Qos (Pause)         2     (F, F, F, F, F, F, F,  -                                                             
                                  F)                                                                                   
Network Qos (WRED)          2     (F, F, F, F, F, F, F,  -                                                             
                                  F)                                                                                   
Network Qos (ECN)           2     (F, F, F, F, F, F, F,  -                                                             
                                  F)                                                                                   
Output Queuing (Bandwidth)  2     (100, 0, 0, 0, 0, 0,   -                                                             
                                  0, 0)                                                                                
Output Queuing (Absolute    2     (F, F, F, F, F, F, F,  -                                                             
Priority)                         F)                                                                                   
STP Mode                    1     Rapid-PVST             -                                                             
STP Disabled                1     None                   -                                                             
STP MST Region Name         1     ""                     -                                                             
STP MST Region Revision     1     0                      -                                                             
STP MST Region Instance to  1                            -                                                             
 VLAN Mapping                                                                                                          
STP Loopguard               1     Disabled               -                                                             
STP Bridge Assurance        1     Enabled                -                                                             
STP Port Type, Edge         1     Normal, Disabled,      -                                                             
BPDUFilter, Edge BPDUGuard        Disabled                                                                             
STP MST Simulate PVST       1     Enabled                -                                                             
VTP domain                  2                            -                                                             
VTP version                 2     1                      -                                                             
VTP mode                    2     Transparent            -                                                             
VTP password                2                            -                                                             
VTP pruning status          2     Disabled               -                                                             
Allowed VLANs               -     -                      -                                                             
Local suspended VLANs       -     -                      -                                                             
01#

Hi -

Based on you posted configuration and the show outputs, the secondary should be online.  One last question before I suggest a TAC case.  Can you post "show logg last 100"?

PSC

01# show logg last 100
2017 Feb 13 22:53:04 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/30, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:04 01 %ETHPORT-5-SPEED: Interface port-channel20, operational speed changed to 10 Gbps
2017 Feb 13 22:53:04 01 %ETHPORT-5-IF_DUPLEX: Interface port-channel20, operational duplex mode changed to Full
2017 Feb 13 22:53:04 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel20, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:04 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel20, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:04 01 %ETHPORT-5-IF_DOWN_CFG_CHANGE: Interface Ethernet1/32 is down(Config change)
2017 Feb 13 22:53:06 01 last message repeated 1 time
2017 Feb 13 22:53:06 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/33 is down (Transceiver Absent)
2017 Feb 13 22:53:07 01 %ETH_PORT_CHANNEL-5-PORT_UP: port-channel20: Ethernet1/30 is up
2017 Feb 13 22:53:07 01 %ETH_PORT_CHANNEL-5-FOP_CHANGED: port-channel20: first operational port changed from none to Ethernet1/30
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_UP: Interface Ethernet1/30 is up in mode access
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_UP: Interface port-channel20 is up in mode access
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/33 is down (Transceiver Absent)
2017 Feb 13 22:53:07 01 last message repeated 1 time
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/34 is down (Transceiver Absent)
2017 Feb 13 22:53:07 01 %ETHPORT-5-SPEED: Interface Ethernet1/32, operational speed changed to 10 Gbps
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/32, operational duplex mode changed to Full
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/32, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/32, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:07 01 %ETHPORT-5-SPEED: Interface port-channel10, operational speed changed to 10 Gbps
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_DUPLEX: Interface port-channel10, operational duplex mode changed to Full
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel10, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel10, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:08 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/34 is down (Transceiver Absent)
2017 Feb 13 22:53:10 01 last message repeated 1 time
2017 Feb 13 22:53:10 01 %ETH_PORT_CHANNEL-5-PORT_UP: port-channel10: Ethernet1/32 is up
2017 Feb 13 22:53:10 01 %ETH_PORT_CHANNEL-5-FOP_CHANGED: port-channel10: first operational port changed from none to Ethernet1/32
2017 Feb 13 22:53:10 01 %ETHPORT-5-IF_UP: Interface Ethernet1/32 is up in mode access
2017 Feb 13 22:53:10 01 %ETHPORT-5-IF_UP: Interface port-channel10 is up in mode access
2017 Feb 13 22:53:12 01 %ETHPORT-5-SPEED: Interface Ethernet1/35, operational speed changed to 100 Mbps
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/35, operational duplex mode changed to Full
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/35, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/35, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/39 is down (Transceiver Absent)
2017 Feb 13 22:53:12 01 last message repeated 1 time
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_UP: Interface Ethernet1/35 is up in mode access
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/39 is down (Transceiver Absent)
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/40 is down (Transceiver Absent)
2017 Feb 13 22:53:13 01 last message repeated 2 times
2017 Feb 13 22:53:13 01 %ETHPORT-5-SPEED: Interface Ethernet1/36, operational speed changed to 100 Mbps
2017 Feb 13 22:53:13 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/36, operational duplex mode changed to Full
2017 Feb 13 22:53:13 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/36, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:13 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/36, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:13 01 %ETHPORT-5-IF_UP: Interface Ethernet1/36 is up in mode access
2017 Feb 13 22:53:14 01 %ETHPORT-5-SPEED: Interface Ethernet1/37, operational speed changed to 100 Mbps
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/37, operational duplex mode changed to Full
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/37, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/37, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:14 01 %ETHPORT-5-SPEED: Interface Ethernet1/38, operational speed changed to 100 Mbps
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/38, operational duplex mode changed to Full
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/38, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/38, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_UP: Interface Ethernet1/37 is up in mode access
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/43 is down (Transceiver Absent)
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_UP: Interface Ethernet1/38 is up in mode access
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/44 is down (Transceiver Absent)
2017 Feb 13 22:53:15 01 last message repeated 2 times
2017 Feb 13 22:53:15 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/45 is down (Transceiver Absent)
2017 Feb 13 22:53:15 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/46 is down (Transceiver Absent)
2017 Feb 13 22:53:16 01 last message repeated 2 times
2017 Feb 13 22:53:16 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/48 is down (Transceiver Absent)
2017 Feb 13 22:53:16 01 last message repeated 1 time
2017 Feb 13 22:53:16 01 %ETHPORT-5-SPEED: Interface Ethernet1/41, operational speed changed to 100 Mbps
2017 Feb 13 22:53:16 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/41, operational duplex mode changed to Full
2017 Feb 13 22:53:16 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/41, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:16 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/41, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:16 01 %ETHPORT-5-IF_UP: Interface Ethernet1/41 is up in mode access
2017 Feb 13 22:53:20 01 %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/38 is down (Link failure)
2017 Feb 13 22:53:21 01 last message repeated 1 time
2017 Feb 13 22:53:21 01 %ETHPORT-5-IF_DOWN_CFG_CHANGE: Interface Ethernet1/51 is down(Config change)
2017 Feb 13 22:53:23 01 last message repeated 1 time
2017 Feb 13 22:53:23 01 %ETHPORT-5-SPEED: Interface Ethernet1/51, operational speed changed to 40 Gbps
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/51, operational duplex mode changed to Full
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/51, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/51, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_UP: Interface Ethernet1/51 is up in mode trunk
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/37 is down (Link failure)
2017 Feb 13 22:53:23 01 last message repeated 1 time
2017 Feb 13 22:53:23 01 %ETHPORT-5-SPEED: Interface Ethernet1/38, operational speed changed to 100 Mbps
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/38, operational duplex mode changed to Full
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/38, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/38, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_UP: Interface Ethernet1/38 is up in mode access
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_DOWN_CHANNEL_MEMBERSHIP_UPDATE_IN_PROGRESS: Interface Ethernet1/51 is down (Channel membership update in progress)
2017 Feb 13 22:53:24 01 last message repeated 1 time
2017 Feb 13 22:53:24 01 %ETHPORT-5-IF_DOWN_CFG_CHANGE: Interface Ethernet1/52 is down(Config change)
2017 Feb 13 22:53:25 01 last message repeated 1 time
2017 Feb 13 22:53:25 01 %ETHPORT-5-SPEED: Interface Ethernet1/52, operational speed changed to 40 Gbps
2017 Feb 13 22:53:25 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/52, operational duplex mode changed to Full
2017 Feb 13 22:53:25 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/52, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:25 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/52, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:25 01 %ETHPORT-5-IF_UP: Interface Ethernet1/52 is up in mode trunk
2017 Feb 13 22:53:26 01 %ETHPORT-5-IF_DOWN_CHANNEL_MEMBERSHIP_UPDATE_IN_PROGRESS: Interface Ethernet1/52 is down (Channel membership update in progress)
2017 Feb 13 22:53:26 01 last message repeated 1 time
2017 Feb 13 22:53:26 01 %ETHPORT-5-SPEED: Interface Ethernet1/37, operational speed changed to 100 Mbps
2017 Feb 13 22:53:26 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/37, operational duplex mode changed to Full
2017 Feb 13 22:53:26 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/37, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:26 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/37, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:26 01 %ETHPORT-5-IF_UP: Interface Ethernet1/37 is up in mode access
2017 Feb 13 22:53:30 01 %VSHD-5-VSHD_SYSLOG_CONFIG_I: Configured from vty by on vsh.3962
01#

Hi -

It don't see any interesting messages in the last 100, though there may be something earlier.  I'm guessing this is a production system, so I would suggest opening a TAC case to get back online.  If its not and you want to keep t/s in the forum, let me know.

PSC

I had to take the port channel out of vpc for now so the interface would come up. Any other suggestions?

Hi -

Sure.  Wipe the vPC domain configuration on the surviving switch, then put it back in place.  It will come up as the primary.  (Removing the domain will remove the vpc commands from your port-channel interfaces, so those will have to be put back too.)

Sorry.  Scratch that.  Both sides stay down on initial setup, so that won't work.  Just remove the vpc domain until your other switch is replaced.  That should fix any L2 forwarding issues you may be experiencing.  (hence the recommendation for a TAC case)

PSC

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community:

Review Cisco Networking products for a $25 gift card