05-21-2013 11:15 AM - edited 03-07-2019 01:28 PM
Hi all, hope everyone is doing well !!
I've got a pair of N7010's in a vPC domain with some FEX's attach running NX-OS 6.0.2. I am experiencing port failures on my N7K-M132XP-12L module the port got shut down due to internal errors with Error Disabled status and I am not able to bring the port back up. I am getting the following errors when I try to reset it. Has anyone run into this issue ? I am hoping is not hardware related as my vPC peer-link is on this module and I only have a single N7K-M132XP-12L in each N7010. Replacing the module will be painful.
Thanks all in advance !! I appreciate any inputs / suggestions !!
Danny
2013 May 20 15:26:38 SEG-N7010-2 %ETHPORT-5-IF_DOWN_ADMIN_DOWN: Interface Ethernet1/10 is down (Administratively down)
2013 May 20 15:26:41 SEG-N7010-2 %ETHPORT-5-IF_ADMIN_UP: Interface Ethernet1/10 is admin up .
2013 May 20 15:26:41 SEG-N7010-2 %ETHPORT-5-SPEED: Interface Ethernet1/10, operational speed changed to 10 Gbps
2013 May 20 15:26:41 SEG-N7010-2 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/10, operational duplex mode changed to Full
2013 May 20 15:26:41 SEG-N7010-2 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/10, operational Receive Flow Control state changed
to off
2013 May 20 15:26:41 SEG-N7010-2 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/10, operational Transmit Flow Control state change
d to off
2013 May 20 15:26:41 SEG-N7010-2 %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 0 of Fex 115 that is connected with Ethernet1/10 changed its s
tatus from Configured to Fabric Up
2013 May 20 15:26:47 SEG-N7010-2 %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 2 of Fex 115 that is connected with Ethernet1/10 changed its s
tatus from Fabric Up to Connecting
2013 May 20 15:26:47 SEG-N7010-2 %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 2 of Fex 115 that is connected with Ethernet1/10 changed its s
tatus from Connecting to Active
2013 May 20 15:26:47 SEG-N7010-2 %ETH_PORT_CHANNEL-5-PORT_UP: port-channel115: Ethernet1/10 is up
2013 May 20 15:26:48 SEG-N7010-2 %ETHPORT-5-IF_UP: Interface Ethernet1/10 is up in mode Fex Fabric
2013 May 20 15:26:51 SEG-N7010-2 %MODULE-2-MOD_SOMEPORTS_FAILED: Module 1 (Serial number: JAF1526AHFB) reported failure on ports 1/10-
1/10 (Ethernet) due to Naxos: Fatal interrupt in device DEV_NAXOS (error 0xc7202211)
2013 May 20 15:26:51 SEG-N7010-2 %MODULE-2-MOD_SOMEPORTS_FAILED: Module 1 (Serial number: JAF1526AHFB) reported failure on ports 1/12-
1/12 (Ethernet) due to Naxos: Fatal interrupt in device DEV_NAXOS (error 0xc7202211)
2013 May 20 15:26:51 SEG-N7010-2 %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 2 of Fex 115 that is connected with Ethernet1/10 changed its s
tatus from Active to Disconnected
2013 May 20 15:26:51 SEG-N7010-2 %ETH_PORT_CHANNEL-5-PORT_DOWN: port-channel115: Ethernet1/10 is down
2013 May 20 15:26:51 SEG-N7010-2 %ETHPORT-5-IF_DOWN_ERROR_DISABLED: Interface Ethernet1/10 is down (Error disabled. Reason:Internal Er
ror)
2013 May 20 15:26:52 SEG-N7010-2 %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 2 of Fex 115 that is connected with Ethernet1/10 changed its s
tatus from Disconnected to Configured
05-21-2013 11:28 AM
Hi,
How are the FEX connected? It looks odd that on FEX115 the log shows Uplink-ID 0 and Uplink-ID 2 both connected to Eth1\10.
Regards
Sent from Cisco Technical Support iPhone App
05-21-2013 11:34 AM
Hi Steve !! Thanks for the response !!
I've got two ports on this linecard that went Error disabled (port e1/10 and e1/12). Port e1/10 is part of a port-channel connects to FEX 115 and port e1/12 is part of the port-channel connects to FEX 123.
Thanks Steve !!
Danny
05-21-2013 11:59 AM
Are the FEX dual-homed to both Nexus 7K? You're aware this is not a supported configuration on the Nexus 7K at this time.
Regards
Sent from Cisco Technical Support Android App
05-21-2013 12:04 PM
Hi Steve,
No, the FEX's are not dual-homed to the N7K. Each FEX has a port-channel with two 10GE links to a single N7K ( no dual-home).
Thanks !!
Danny
05-21-2013 12:09 PM
Sorry. Thought I'd ask to make sure. Can you post a show vpc, show fex and show port-channel 115?
Regards
Sent from Cisco Technical Support Android App
05-21-2013 02:15 PM
Hi Steve, please see the command outputs below,
I've moved the port in error disabled status to a different port and it comes up with no errors.
sh vpc
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 1
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : secondary
Number of vPCs configured : 3
Peer Gateway : Enabled
Peer gateway excluded VLANs : 301-302
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Enabled (timeout = 300 seconds)
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ --------------------------------------------------
1 Po110 up 1-8,10,12-21,32-33,55,64,68-69,72-73,80,88,90,96-9
9,102,105-106,120-122,177-178,192,220,240,250,408,
417,468,472,488,500,505
vPC status
----------------------------------------------------------------------
id Port Status Consistency Reason Active vlans
-- ---- ------ ----------- ------ ------------
1 Po1 up success success 1-8,10,12-2
1,32-33,55,
64,68-69,72
-73,80,88,9
0,96-99,102 ....
SEG-N7010-2# sh fex
FEX FEX FEX FEX
Number Description State Model Serial
------------------------------------------------------------------------
115 Row1-Rack5-N2248TP Online N2K-C2248TP-1GE JAF1525BMPL
123 Row2-Rack3-N2248TP Online N2K-C2248TP-1GE JAF1521AAQL
126 Row2-Rack6-N2248TP Online N2K-C2248TP-1GE JAF1521ABBE
05-22-2013 12:57 AM
Hi Danny,
Good to hear you at least have it working now.
The ports you were using (eth1/10 and eth1/12) are part of the same port-group on the N7K-M132XP-12L module. Were/are those ports configured with the rate-mode dedicated or rate-mode shared command?
When using ports of the same port-group for FEX connectivity the port-group obviously needs to be configured with rate-mode shared as three of the four ports are disabled when using rate-mode dedicated.
Which ports have you moved the FEX to now to get it working and how are those ports configured?
Regards
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide