Nexus 5000 Troubleshooting Guide
Last Updated 02/07/2012
By Steven Tanti
Customer Support Engineer
Table of Contents
Disclaimer
- Common Error Messages
1. Disclaimer
The error messages and solutions in this document may vary depending on the code version you are running. While the general concepts apply to all versions, slight variations in outputs and results may occur. This document is not meant to replace the use of Cisco TAC, so please do not hesitate to give Cisco a call whenever in doubt.
2. Common Error Messages
ERROR MESSAGE:
switch#(config-if)# show interface ethernet 1/1
Ethernet1/1 is down (SFP validation failed)
switch#(config-if)# show interface status
--------------------------------------------------------------------------------
Port Name Status Vlan Duplex Speed Type
--------------------------------------------------------------------------
Eth1/1 -- sfpInvali 1 full 1000 1/10g
DESCRIPTION:
The interface shows a status of ‘SFP validation failed’. The link will not come up. The link light on the nexus 5000 is typically dark (no LED).
SOLUTIONS:
- Configure ‘speed 1000’ or ‘speed 10000
The first, and most common, scenario is that the wrong speed is configured on the interface. For example, if you are using a 1G SFP such as the GLC-T, you will see this error message if the speed on the port is still at default 10G. To fix this case, simply configure ‘speed 1000’ on the interface. This same situation also applies for 10G SFPs if you have speed 1000 configured on the port instead of 10000.
- Configure ‘switchport mode fex-fabric’
The second scenario that sees this error message is that the wrong switchport mode is not configured on the interface. The only scenario which this can be true is when you are using a FET-10G SFP between your N2K and N5K. These FET-10G transceivers requires a ‘switchport mode fex-fabric’ to be configured on the interface to be validated.
- Verify that the SFP is supported.
For a list of supported Cisco transceivers, you can use the following link:
Table 2: Cisco Nexus 5000 Series Transceiver Support Matrix
http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/data_sheet_c78-461802.html
- Make sure the SFP is seated properly.
In rare cases, we have seen this message when the SFP is not seated properly, and was solved by unplugging the SFP and reinserting it.
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR MESSAGE:
switch# show interface fex-fabric
…
101 Eth1/1 Identity-Mismatch 2 N2K-C2248TP-1GE xxxxxxxxxxxxxxx
OR
switch# show interface brief
…
Eth1/1 1 eth fabric down FEX identity mismatch 10G(D) 101
OR
switch# show interface Ethernet 1/1
Ethernet1/1 is down (FEX identity mismatch)
DESCRIPTION:
The interface for the fex-fabric port shows down due to reason FEX identity mismatch. This will cause the FEX to not come online properly.
SOLUTION:
This is usually a cabling issue, or a configuration of the wrong fex associate number on the interface. The easiest way to trace out these errors is to issue the command ‘show interface fex-fabric’
Fex Port Port State Uplink Model Serial
---------------------------------------------------------------
100 Eth1/1 Active 1 N2K-C2232PP-10GE XXXXXXXXXXX
100 Eth1/2 Active 2 N2K-C2232PP-10GE XXXXXXXXXXX
100 Eth1/3 Active 3 N2K-C2232PP-10GE XXXXXXXXXXX
100 Eth1/4 Active 4 N2K-C2232PP-10GE XXXXXXXXXXX
101 Eth1/5 Incompatible-Topology 1 N2K-C2232PP-10GE YYYYYYYYYYY
101 Eth1/6 Incompatible-Topology 2 N2K-C2232PP-10GE YYYYYYYYYYY
101 Eth1/7 Incompatible-Topology 3 N2K-C2232PP-10GE YYYYYYYYYYY
101 Eth1/8 Incompatible-Topology 4 N2K-C2232PP-10GE YYYYYYYYYYY
From the output above, this will tell you the actual FEX that is connected to that interface, and what number FEX you have this configured as. Make sure all the serial numbers match for the specific FEX number. If your FEX is dual-homed in a VPC (active/active), you will see the message above as ‘incompatible-topology’ if a specific VPC has two different FEXs. Go onto the N5K peer and do the same serial number trace, or in other words make sure the serial numbers on switch A go to the same fex # as the ones on switch B for dual-homed fabric extenders.
Also confirm that you are using a supported FEX topology, as per the link below (page 31, Figures, 21-24):
http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/C07-572829-01_Design_N5K_N2K_vPC_DG.pdf
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR MESSAGE:
switch(config-sync)# show switch-profile status
<SNIP>
Local information:
----------------
Status: Verify Failure
Error(s):
Following commands failed mutual-exclusion checks:
interface Ethernet 1/1
Spanning-tree port type network
<SNIP>
-OR-
switch(config-if)# switchport mode trunk
Error: Command is not mutually exclusive
DESCRIPTION:
When you are using config sync and are trying to configure an interface in conf t mode, you are unable to configure the interface because the command is not mutually exclusive. This may also arise when trying to sync a switch-profile using config sync, but it fails due to the same reason.
SOLUTION:
Any mutual exclusive check failure, in config t or config sync mode, means that the command already exists in the other mode. In other words, if you see the error when trying to configure in conf t mode, this means the command already exists in your switch-profile config sync mode. If you see the switch-profile commit fail due to this, it is because the command already exists in conf t mode either on the local switch, or on the peer switch. If you are not sure which switch the command exists, "show switch-profile status" will show you the status of the last commit and where it failed. Remember that when using config sync, you may only have specific configuration in one mode at a time.
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR MESSAGE:
Nexus(config-if)# channel-group 121
port channel cannot have more than 1 members
DESCRIPTION:
When trying to add more than one interface on a Fabric Extender into a port-channel, you get an error message that states you cannot have more than 1 member in the port-channel. This will only occur when using a 2148 FEX.
SOLUTION:
This is a hardware limitation of the 2148 FEX. By design, you may only have one link in the port-channel as the error message says. However, you may have this port-channel in a vPC that has another member on a second N5K and FEX. This allows you to have a total of two links in the same port-channel across the two 2148. In all other models of FEXs, we allow more than 1 member in the port-channel per fex.
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR MESSAGE:
Nexus# show monitor session 1
session 1
---------------
description : span1
type : local
state : down (Dst in wrong mode)
source intf :
rx :
tx :
both :
source VLANs :
rx : 208
source VSANs :
rx :
destination ports : Eth1/3
Legend: f = forwarding enabled, l = learning enabled
DESCRIPTION:
When trying to configure a SPAN on the Nexus 5000, the monitor session stays down because destination port is in the wrong mode.
SOLUTION:
When configuring a SPAN destination, the port must be in “switchport monitor” mode. Once this is done correctly, the monitor session should change state to “Up”. Here is a configuration example:
interface Ethernet1/8
switchport monitor
speed 1000
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
ERROR MESSAGE:
More Coming Soon!
DESCRIPTION:
SOLUTION:
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
