02-13-2017 12:25 PM - edited 03-08-2019 09:19 AM
I have a issue with nexus 3064 running 6.0.2.U6(4) where ports 51 and 52 wouldn't come up with error "vpc peerlink is down". I thought configuring auto-recovery would bring the member ports up after 240sec delay but the ports never come up. The other switch is down. I have the relevant configs below.
vpc domain 10
peer-switch
role priority 100
peer-keepalive destination 192.168.1.6 source 192.168.1.5 vrf default
delay restore 1
peer-gateway
auto-recovery
fast-convergence
ip arp synchronize
interface port-channel1
lacp suspend-individual
switchport mode trunk
no negotiate auto
vpc 12
interface Ethernet1/51
switchport mode trunk
link debounce time 0
channel-group 1 mode active
interface Ethernet1/52
switchport mode trunk
link debounce time 0
channel-group 1 mode active
Solved! Go to Solution.
02-13-2017 04:31 PM
Hi -
Sure. Wipe the vPC domain configuration on the surviving switch, then put it back in place. It will come up as the primary. (Removing the domain will remove the vpc commands from your port-channel interfaces, so those will have to be put back too.)
Sorry. Scratch that. Both sides stay down on initial setup, so that won't work. Just remove the vpc domain until your other switch is replaced. That should fix any L2 forwarding issues you may be experiencing. (hence the recommendation for a TAC case)
PSC
02-13-2017 02:32 PM
Hi -
Can you post the following:
show vpc
show vpc peer-keepalive
show vpc role
show vpc consistency-parameters global
The vPC Best Practices guide indicates that the links on the secondary will come online after 3 failed keep alives.
http://www.cisco.com/c/dam/en/us/td/docs/switches/datacenter/sw/design/vpc_design/vpc_best_practices_design_guide.pdf
PSC
02-13-2017 03:19 PM
01# show vpc
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 10
Peer status : peer link is down
vPC keep-alive status : Suspended (Destination IP not reachable)
Configuration consistency status : failed
Per-vlan consistency status : success
Configuration inconsistency reason: Consistency Check Not Performed
Type-2 consistency status : failed
Type-2 inconsistency reason : QoSMgr type-1 configuration incompatible
vPC role : none established
Number of vPCs configured : 1
Peer Gateway : Enabled
Peer gateway excluded VLANs : -
Dual-active excluded VLANs : -
Graceful Consistency Check : Disabled (due to peer configuration)
Auto-recovery status : Enabled (timeout = 240 seconds)
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ --------------------------------------------------
1 Po6 down -
vPC status
----------------------------------------------------------------------------
id Port Status Consistency Reason Active vlans
------ ----------- ------ ----------- -------------------------- -----------
12 Po1 down Not Consistency Check Not -
Applicable Performed
01# show vpc peer-keepalive
vPC keep-alive status : Suspended (Destination IP not reachable)
--Send status : Success
--Last send at : 2017.02.13 22:18:37 632 ms
--Sent on interface : Vlan217
--Receive status : Failed
--Last update from peer : (14250) seconds, (961) msec
vPC Keep-alive parameters
--Destination : 192.168.1.6
--Keepalive interval : 1000 msec
--Keepalive timeout : 5 seconds
--Keepalive hold timeout : 3 seconds
--Keepalive vrf : default
--Keepalive udp port : 3200
--Keepalive tos : 192
01# show vpc role
vPC Role status
----------------------------------------------------
vPC role : none established
Dual Active Detection Status : 0
vPC system-mac : 00:00:00:00:00:00
vPC system-priority : 32667
vPC local system-mac : 88:f0:31:c1:f1:81
vPC local role-priority : 0
01# show vpc consistency-parameters global
Legend:
Type 1 : vPC will be suspended in case of mismatch
Name Type Local Value Peer Value
------------- ---- ---------------------- -----------------------
Vlan to Vn-segment Map 1 No Relevant Maps -
QoS 2 ([], [], [], [], [], -
[], [], [])
Network QoS (MTU) 2 (1538, 0, 0, 0, 0, 0, -
0, 0)
Network Qos (Pause) 2 (F, F, F, F, F, F, F, -
F)
Network Qos (WRED) 2 (F, F, F, F, F, F, F, -
F)
Network Qos (ECN) 2 (F, F, F, F, F, F, F, -
F)
Output Queuing (Bandwidth) 2 (100, 0, 0, 0, 0, 0, -
0, 0)
Output Queuing (Absolute 2 (F, F, F, F, F, F, F, -
Priority) F)
STP Mode 1 Rapid-PVST -
STP Disabled 1 None -
STP MST Region Name 1 "" -
STP MST Region Revision 1 0 -
STP MST Region Instance to 1 -
VLAN Mapping
STP Loopguard 1 Disabled -
STP Bridge Assurance 1 Enabled -
STP Port Type, Edge 1 Normal, Disabled, -
BPDUFilter, Edge BPDUGuard Disabled
STP MST Simulate PVST 1 Enabled -
VTP domain 2 -
VTP version 2 1 -
VTP mode 2 Transparent -
VTP password 2 -
VTP pruning status 2 Disabled -
Allowed VLANs - - -
Local suspended VLANs - - -
01#
02-13-2017 03:42 PM
Hi -
Based on you posted configuration and the show outputs, the secondary should be online. One last question before I suggest a TAC case. Can you post "show logg last 100"?
PSC
02-13-2017 04:00 PM
01# show logg last 100
2017 Feb 13 22:53:04 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/30, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:04 01 %ETHPORT-5-SPEED: Interface port-channel20, operational speed changed to 10 Gbps
2017 Feb 13 22:53:04 01 %ETHPORT-5-IF_DUPLEX: Interface port-channel20, operational duplex mode changed to Full
2017 Feb 13 22:53:04 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel20, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:04 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel20, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:04 01 %ETHPORT-5-IF_DOWN_CFG_CHANGE: Interface Ethernet1/32 is down(Config change)
2017 Feb 13 22:53:06 01 last message repeated 1 time
2017 Feb 13 22:53:06 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/33 is down (Transceiver Absent)
2017 Feb 13 22:53:07 01 %ETH_PORT_CHANNEL-5-PORT_UP: port-channel20: Ethernet1/30 is up
2017 Feb 13 22:53:07 01 %ETH_PORT_CHANNEL-5-FOP_CHANGED: port-channel20: first operational port changed from none to Ethernet1/30
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_UP: Interface Ethernet1/30 is up in mode access
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_UP: Interface port-channel20 is up in mode access
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/33 is down (Transceiver Absent)
2017 Feb 13 22:53:07 01 last message repeated 1 time
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/34 is down (Transceiver Absent)
2017 Feb 13 22:53:07 01 %ETHPORT-5-SPEED: Interface Ethernet1/32, operational speed changed to 10 Gbps
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/32, operational duplex mode changed to Full
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/32, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/32, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:07 01 %ETHPORT-5-SPEED: Interface port-channel10, operational speed changed to 10 Gbps
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_DUPLEX: Interface port-channel10, operational duplex mode changed to Full
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel10, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:07 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel10, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:08 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/34 is down (Transceiver Absent)
2017 Feb 13 22:53:10 01 last message repeated 1 time
2017 Feb 13 22:53:10 01 %ETH_PORT_CHANNEL-5-PORT_UP: port-channel10: Ethernet1/32 is up
2017 Feb 13 22:53:10 01 %ETH_PORT_CHANNEL-5-FOP_CHANGED: port-channel10: first operational port changed from none to Ethernet1/32
2017 Feb 13 22:53:10 01 %ETHPORT-5-IF_UP: Interface Ethernet1/32 is up in mode access
2017 Feb 13 22:53:10 01 %ETHPORT-5-IF_UP: Interface port-channel10 is up in mode access
2017 Feb 13 22:53:12 01 %ETHPORT-5-SPEED: Interface Ethernet1/35, operational speed changed to 100 Mbps
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/35, operational duplex mode changed to Full
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/35, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/35, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/39 is down (Transceiver Absent)
2017 Feb 13 22:53:12 01 last message repeated 1 time
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_UP: Interface Ethernet1/35 is up in mode access
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/39 is down (Transceiver Absent)
2017 Feb 13 22:53:12 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/40 is down (Transceiver Absent)
2017 Feb 13 22:53:13 01 last message repeated 2 times
2017 Feb 13 22:53:13 01 %ETHPORT-5-SPEED: Interface Ethernet1/36, operational speed changed to 100 Mbps
2017 Feb 13 22:53:13 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/36, operational duplex mode changed to Full
2017 Feb 13 22:53:13 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/36, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:13 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/36, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:13 01 %ETHPORT-5-IF_UP: Interface Ethernet1/36 is up in mode access
2017 Feb 13 22:53:14 01 %ETHPORT-5-SPEED: Interface Ethernet1/37, operational speed changed to 100 Mbps
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/37, operational duplex mode changed to Full
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/37, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/37, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:14 01 %ETHPORT-5-SPEED: Interface Ethernet1/38, operational speed changed to 100 Mbps
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/38, operational duplex mode changed to Full
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/38, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/38, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_UP: Interface Ethernet1/37 is up in mode access
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/43 is down (Transceiver Absent)
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_UP: Interface Ethernet1/38 is up in mode access
2017 Feb 13 22:53:14 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/44 is down (Transceiver Absent)
2017 Feb 13 22:53:15 01 last message repeated 2 times
2017 Feb 13 22:53:15 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/45 is down (Transceiver Absent)
2017 Feb 13 22:53:15 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/46 is down (Transceiver Absent)
2017 Feb 13 22:53:16 01 last message repeated 2 times
2017 Feb 13 22:53:16 01 %ETHPORT-5-IF_DOWN_NONE: Interface Ethernet1/48 is down (Transceiver Absent)
2017 Feb 13 22:53:16 01 last message repeated 1 time
2017 Feb 13 22:53:16 01 %ETHPORT-5-SPEED: Interface Ethernet1/41, operational speed changed to 100 Mbps
2017 Feb 13 22:53:16 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/41, operational duplex mode changed to Full
2017 Feb 13 22:53:16 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/41, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:16 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/41, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:16 01 %ETHPORT-5-IF_UP: Interface Ethernet1/41 is up in mode access
2017 Feb 13 22:53:20 01 %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/38 is down (Link failure)
2017 Feb 13 22:53:21 01 last message repeated 1 time
2017 Feb 13 22:53:21 01 %ETHPORT-5-IF_DOWN_CFG_CHANGE: Interface Ethernet1/51 is down(Config change)
2017 Feb 13 22:53:23 01 last message repeated 1 time
2017 Feb 13 22:53:23 01 %ETHPORT-5-SPEED: Interface Ethernet1/51, operational speed changed to 40 Gbps
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/51, operational duplex mode changed to Full
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/51, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/51, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_UP: Interface Ethernet1/51 is up in mode trunk
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_DOWN_LINK_FAILURE: Interface Ethernet1/37 is down (Link failure)
2017 Feb 13 22:53:23 01 last message repeated 1 time
2017 Feb 13 22:53:23 01 %ETHPORT-5-SPEED: Interface Ethernet1/38, operational speed changed to 100 Mbps
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/38, operational duplex mode changed to Full
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/38, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/38, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_UP: Interface Ethernet1/38 is up in mode access
2017 Feb 13 22:53:23 01 %ETHPORT-5-IF_DOWN_CHANNEL_MEMBERSHIP_UPDATE_IN_PROGRESS: Interface Ethernet1/51 is down (Channel membership update in progress)
2017 Feb 13 22:53:24 01 last message repeated 1 time
2017 Feb 13 22:53:24 01 %ETHPORT-5-IF_DOWN_CFG_CHANGE: Interface Ethernet1/52 is down(Config change)
2017 Feb 13 22:53:25 01 last message repeated 1 time
2017 Feb 13 22:53:25 01 %ETHPORT-5-SPEED: Interface Ethernet1/52, operational speed changed to 40 Gbps
2017 Feb 13 22:53:25 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/52, operational duplex mode changed to Full
2017 Feb 13 22:53:25 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/52, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:25 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/52, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:25 01 %ETHPORT-5-IF_UP: Interface Ethernet1/52 is up in mode trunk
2017 Feb 13 22:53:26 01 %ETHPORT-5-IF_DOWN_CHANNEL_MEMBERSHIP_UPDATE_IN_PROGRESS: Interface Ethernet1/52 is down (Channel membership update in progress)
2017 Feb 13 22:53:26 01 last message repeated 1 time
2017 Feb 13 22:53:26 01 %ETHPORT-5-SPEED: Interface Ethernet1/37, operational speed changed to 100 Mbps
2017 Feb 13 22:53:26 01 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/37, operational duplex mode changed to Full
2017 Feb 13 22:53:26 01 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/37, operational Receive Flow Control state changed to off
2017 Feb 13 22:53:26 01 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/37, operational Transmit Flow Control state changed to off
2017 Feb 13 22:53:26 01 %ETHPORT-5-IF_UP: Interface Ethernet1/37 is up in mode access
2017 Feb 13 22:53:30 01 %VSHD-5-VSHD_SYSLOG_CONFIG_I: Configured from vty by on vsh.3962
01#
02-13-2017 04:16 PM
Hi -
It don't see any interesting messages in the last 100, though there may be something earlier. I'm guessing this is a production system, so I would suggest opening a TAC case to get back online. If its not and you want to keep t/s in the forum, let me know.
PSC
02-13-2017 04:20 PM
I had to take the port channel out of vpc for now so the interface would come up. Any other suggestions?
02-13-2017 04:31 PM
Hi -
Sure. Wipe the vPC domain configuration on the surviving switch, then put it back in place. It will come up as the primary. (Removing the domain will remove the vpc commands from your port-channel interfaces, so those will have to be put back too.)
Sorry. Scratch that. Both sides stay down on initial setup, so that won't work. Just remove the vpc domain until your other switch is replaced. That should fix any L2 forwarding issues you may be experiencing. (hence the recommendation for a TAC case)
PSC
Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: