Buy or Renew
Buy or Renew
COMING SOON: Umbrella and Secure Access release notes are coming to Cisco Community. The community will be in read-only August 16 – 19. Learn more.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
cancel
Start a conversation
2723
Views
0
Helpful
7
Replies

Port Error Disabled on N7K-M132XP-12L module

dtran
Level 6
Level 6

‎05-21-2013 11:15 AM - edited ‎03-07-2019 01:28 PM

Hi all, hope everyone is doing well !!

I've got a pair of N7010's in a vPC domain with some FEX's attach running NX-OS 6.0.2. I am experiencing port failures on my N7K-M132XP-12L module the port got shut down due to internal errors with Error Disabled status and I am not able to bring the port back up. I am getting the following errors when I try to reset it. Has anyone run into this issue ? I am hoping is not hardware related as my vPC peer-link is on this module and I only have a single N7K-M132XP-12L in each N7010. Replacing the module will be painful.

Thanks all in advance !! I appreciate any inputs / suggestions !!

Danny

2013 May 20 15:26:38 SEG-N7010-2 %ETHPORT-5-IF_DOWN_ADMIN_DOWN: Interface Ethernet1/10 is down (Administratively down)

2013 May 20 15:26:41 SEG-N7010-2 %ETHPORT-5-IF_ADMIN_UP: Interface Ethernet1/10 is admin up .

2013 May 20 15:26:41 SEG-N7010-2 %ETHPORT-5-SPEED: Interface Ethernet1/10, operational speed changed to 10 Gbps

2013 May 20 15:26:41 SEG-N7010-2 %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/10, operational duplex mode changed to Full

2013 May 20 15:26:41 SEG-N7010-2 %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/10, operational Receive Flow Control state changed

to off

2013 May 20 15:26:41 SEG-N7010-2 %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/10, operational Transmit Flow Control state change

d to off

2013 May 20 15:26:41 SEG-N7010-2 %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 0 of Fex 115 that is connected with Ethernet1/10 changed its s

tatus from Configured to Fabric Up

2013 May 20 15:26:47 SEG-N7010-2 %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 2 of Fex 115 that is connected with Ethernet1/10 changed its s

tatus from Fabric Up to Connecting

2013 May 20 15:26:47 SEG-N7010-2 %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 2 of Fex 115 that is connected with Ethernet1/10 changed its s

tatus from Connecting to Active

2013 May 20 15:26:47 SEG-N7010-2 %ETH_PORT_CHANNEL-5-PORT_UP: port-channel115: Ethernet1/10 is up

2013 May 20 15:26:48 SEG-N7010-2 %ETHPORT-5-IF_UP: Interface Ethernet1/10 is up in mode Fex Fabric

2013 May 20 15:26:51 SEG-N7010-2 %MODULE-2-MOD_SOMEPORTS_FAILED: Module 1 (Serial number: JAF1526AHFB) reported failure on ports 1/10-

1/10 (Ethernet) due to Naxos: Fatal interrupt in device DEV_NAXOS (error 0xc7202211)

2013 May 20 15:26:51 SEG-N7010-2 %MODULE-2-MOD_SOMEPORTS_FAILED: Module 1 (Serial number: JAF1526AHFB) reported failure on ports 1/12-

1/12 (Ethernet) due to Naxos: Fatal interrupt in device DEV_NAXOS (error 0xc7202211)

2013 May 20 15:26:51 SEG-N7010-2 %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 2 of Fex 115 that is connected with Ethernet1/10 changed its s

tatus from Active to Disconnected

2013 May 20 15:26:51 SEG-N7010-2 %ETH_PORT_CHANNEL-5-PORT_DOWN: port-channel115: Ethernet1/10 is down

2013 May 20 15:26:51 SEG-N7010-2 %ETHPORT-5-IF_DOWN_ERROR_DISABLED: Interface Ethernet1/10 is down (Error disabled. Reason:Internal Er

ror)

2013 May 20 15:26:52 SEG-N7010-2 %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 2 of Fex 115 that is connected with Ethernet1/10 changed its s

tatus from Disconnected to Configured

Labels:
0 Helpful
7 Replies 7

Steve Fuller
Level 9
Level 9

‎05-21-2013 11:28 AM

Hi,

How are the FEX connected? It looks odd that on FEX115 the log shows Uplink-ID 0 and Uplink-ID 2 both connected to Eth1\10.

Regards

Sent from Cisco Technical Support iPhone App

0 Helpful

dtran
Level 6
Level 6
In response to Steve Fuller

‎05-21-2013 11:34 AM

Hi Steve !! Thanks for the response !!

I've got two ports on this linecard that went Error disabled (port e1/10 and e1/12). Port e1/10 is part of a port-channel connects to FEX 115 and port e1/12 is part of the port-channel connects to FEX 123.

Thanks Steve !!

Danny

0 Helpful

Steve Fuller
Level 9
Level 9

‎05-21-2013 11:59 AM

Are the FEX dual-homed to both Nexus 7K? You're aware this is not a supported configuration on the Nexus 7K at this time.

Regards

Sent from Cisco Technical Support Android App

0 Helpful

dtran
Level 6
Level 6
In response to Steve Fuller

‎05-21-2013 12:04 PM

Hi Steve,

No, the FEX's are not dual-homed to the N7K. Each FEX has a port-channel with two 10GE links to a single N7K ( no dual-home).

Thanks !!

Danny

0 Helpful

Steve Fuller
Level 9
Level 9

‎05-21-2013 12:09 PM

Sorry. Thought I'd ask to make sure. Can you post a show vpc, show fex and show port-channel 115?

Regards


Sent from Cisco Technical Support Android App

0 Helpful

dtran
Level 6
Level 6
In response to Steve Fuller

‎05-21-2013 02:15 PM

Hi Steve, please see the command outputs below,

I've moved the port in error disabled status to a different port and it comes up with no errors.

sh vpc

Legend:

                (*) - local vPC is down, forwarding via vPC peer-link

vPC domain id                     : 1

Peer status                       : peer adjacency formed ok

vPC keep-alive status             : peer is alive

Configuration consistency status  : success

Per-vlan consistency status       : success

Type-2 consistency status         : success

vPC role                          : secondary

Number of vPCs configured         : 3

Peer Gateway                      : Enabled

Peer gateway excluded VLANs       : 301-302

Dual-active excluded VLANs        : -

Graceful Consistency Check        : Enabled

Auto-recovery status              : Enabled (timeout = 300 seconds)

vPC Peer-link status

---------------------------------------------------------------------

id   Port   Status Active vlans

--   ----   ------ --------------------------------------------------

1    Po110  up     1-8,10,12-21,32-33,55,64,68-69,72-73,80,88,90,96-9

                   9,102,105-106,120-122,177-178,192,220,240,250,408,

                   417,468,472,488,500,505

vPC status

----------------------------------------------------------------------

id   Port   Status Consistency Reason                     Active vlans

--   ----   ------ ----------- ------                     ------------

1    Po1    up     success     success                    1-8,10,12-2

                                                          1,32-33,55,

                                                          64,68-69,72

                                                          -73,80,88,9

                                                          0,96-99,102 ....

SEG-N7010-2# sh fex

  FEX         FEX           FEX                       FEX

Number    Description      State            Model            Serial

------------------------------------------------------------------------

115  Row1-Rack5-N2248TP                Online     N2K-C2248TP-1GE   JAF1525BMPL

123  Row2-Rack3-N2248TP                Online     N2K-C2248TP-1GE   JAF1521AAQL

126  Row2-Rack6-N2248TP                Online     N2K-C2248TP-1GE   JAF1521ABBE

0 Helpful

Steve Fuller
Level 9
Level 9
In response to dtran

‎05-22-2013 12:57 AM

Hi Danny,

Good to hear you at least have it working now.

The ports you were using (eth1/10 and eth1/12) are part of the same port-group on the N7K-M132XP-12L module. Were/are those ports configured with the rate-mode dedicated or rate-mode shared command?

When using ports of the same port-group for FEX connectivity the port-group obviously needs to be configured with rate-mode shared as three of the four ports are disabled when using rate-mode dedicated.

Which ports have you moved the FEX to now to get it working and how are those ports configured?

Regards

0 Helpful
Customers Also Viewed These Support Documents
Review Cisco Networking for a $25 gift card