11-08-2011 05:22 AM - edited 03-07-2019 03:16 AM
NX 7000 was running fine.
Mod Ports Module-Type Model Status
--- ----- -------------------------------- ------------------ ------------
1 32 10 Gbps Ethernet Module N7K-M132XP-12 ok
5 0 Supervisor module-1X N7K-SUP1 active *
10 48 10/100/1000 Mbps Ethernet Module N7K-M148GT-11 ok
When attaching a fiber on NX7000, 10 Gbps Ethernet Module port (eth 122/1/18), the module turned down.
It was necessary to :
conf t
attach module 1
to have it active again. All NX2000 connections went down. All backbone services stoped.
Not all, but many times, I attach a NX2000 I have had this problem.
Does anybody know what is going on ?
Thanks.
Rosa
Solved! Go to Solution.
11-10-2011 01:23 PM
Rosa Ladeira wrote:
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:06 BRST: %MODULE-4-MOD_WARNING: Module 1 (serial: JAF1445AGRQ) reported warning due to X-bar Interface ASIC Error in device 70 (device error 0xc4600248)
That'd be the one that was worrying me.
From the look of that, the card in slot 1 has a hardware issue which may be interrmittent.
Report it to the TAC and have it RMA'd. Cards in a Nexus 7000 are hot-swappable, so your only outage time should be the time to swap cables.
Cheers.
11-08-2011 02:16 PM
Rosa Ladeira wrote:
NX 7000 was running fine.
Mod Ports Module-Type Model Status
--- ----- -------------------------------- ------------------ ------------
1 32 10 Gbps Ethernet Module N7K-M132XP-12 ok
5 0 Supervisor module-1X N7K-SUP1 active *
10 48 10/100/1000 Mbps Ethernet Module N7K-M148GT-11 ok
When attaching a fiber on NX7000, 10 Gbps Ethernet Module port (eth 122/1/18), the module turned down.
It was necessary to :
conf t
attach module 1
to have it active again. All NX2000 connections went down. All backbone services stoped.
Not all, but many times, I attach a NX2000 I have had this problem.
Does anybody know what is going on ?
Thanks.
Rosa
Hardware or backplane issue, maybe?
How many back-side switching modules do you have in the N7K?
I'd be reporting this to Cisco - assuming you have a maintenance contract.
Cheers.
11-09-2011 03:59 AM
I am migrating backbone.
By now I have 4 NX2000 attached to 7000.
I have a 2 ports TP trunk between 6509-E and 2 10G xenpak between other 6509-E.
Thanks,
Rosa
11-09-2011 01:36 PM
Rosa Ladeira wrote:
I am migrating backbone.
By now I have 4 NX2000 attached to 7000.
I have a 2 ports TP trunk between 6509-E and 2 10G xenpak between other 6509-E.
Thanks,
Rosa
No, I didn't mean how many devices you had attached - in the back side (I.E. the non-linecard side) there are the switching fabric modules - usually a minimum of 3, although when I installed my Nexus switches the newer F2 modules weren't available, so with those you can possibly get by with 1 or 2 - if you only have a couple, it's vaguely possible you're having a switching capacity issue, but I seriously doubt it.
What does the log from the Nexus say about the module going offline? You should be view the events quite a way back - by default the Nexus logs quite a bit.
Cheers.
11-10-2011 06:02 AM
nx7000-wc0# sh module fabric
Xbar Ports Module-Type Model Status
--- ----- -------------------------------- ------------------ ------------
1 0 Fabric Module 1 N7K-C7010-FAB-1 ok
2 0 Fabric Module 1 N7K-C7010-FAB-1 ok
3 0 Fabric Module 1 N7K-C7010-FAB-1 ok
Xbar Sw Hw
--- -------------- ------
1 NA 1.1
2 NA 1.1
3 NA 1.1
Xbar MAC-Address(es) Serial-Num
--- -------------------------------------- ----------
1 NA JAF1443BRQR
2 NA JAF1443BSGN
3 NA JAF1443BMPE
* this terminal session
nx7000-wc0#
11-10-2011 06:02 AM
Nov 8 08:48:51 smale-outside : 2011 Nov 8 07:48:51 BRST: %VSHD-5-VSHD_SYSLOG_CONFIG_I: Configured from vty by netadm on 192.168.14.6@pts/11
Nov 8 08:50:54 smale-outside : 2011 Nov 8 07:50:54 BRST: %VSHD-5-VSHD_SYSLOG_CONFIG_I: Configured from vty by netadm on 192.168.14.6@pts/11
Nov 8 08:54:15 smale-outside : 2011 Nov 8 07:54:15 BRST: %ETHPORT-5-SPEED: Interface Ethernet1/18, operational speed changed to 10 Gbps
Nov 8 08:54:15 smale-outside : 2011 Nov 8 07:54:15 BRST: %ETHPORT-5-IF_DUPLEX: Interface Ethernet1/18, operational duplex mode changed to Full
Nov 8 08:54:15 smale-outside : 2011 Nov 8 07:54:15 BRST: %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface Ethernet1/18, operational Receive Flow Control state changed to off
Nov 8 08:54:15 smale-outside : 2011 Nov 8 07:54:15 BRST: %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface Ethernet1/18, operational Transmit Flow Control state changed to off
Nov 8 08:54:15 smale-outside : 2011 Nov 8 07:54:15 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 0 of Fex 122 that is connected with Ethernet1/18 changed its status from Configured to Fabric Up
Nov 8 08:54:17 smale-outside : 2011 Nov 8 07:54:17 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 122 that is connected with Ethernet1/18 changed its status from Fabric Up to Connecting
Nov 8 08:54:17 smale-outside : 2011 Nov 8 07:54:17 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 122 that is connected with Ethernet1/18 changed its status from Connecting to Active
Nov 8 08:54:17 smale-outside : 2011 Nov 8 07:54:17 BRST: %ETHPORT-5-SPEED: Interface port-channel122, operational speed changed to 10 Gbps
Nov 8 08:54:17 smale-outside : 2011 Nov 8 07:54:17 BRST: %ETHPORT-5-IF_DUPLEX: Interface port-channel122, operational duplex mode changed to Full
Nov 8 08:54:17 smale-outside : 2011 Nov 8 07:54:17 BRST: %ETHPORT-5-IF_RX_FLOW_CONTROL: Interface port-channel122, operational Receive Flow Control state changed to off
Nov 8 08:54:17 smale-outside : 2011 Nov 8 07:54:17 BRST: %ETHPORT-5-IF_TX_FLOW_CONTROL: Interface port-channel122, operational Transmit Flow Control state changed to off
Nov 8 08:54:17 smale-outside : 2011 Nov 8 07:54:17 BRST: %ETH_PORT_CHANNEL-5-PORT_UP: port-channel122: Ethernet1/18 is up
Nov 8 08:54:17 smale-outside : 2011 Nov 8 07:54:17 BRST: %ETH_PORT_CHANNEL-5-FOP_CHANGED: port-channel122: first operational port changed from none to Ethernet1/18
Nov 8 08:54:17 smale-outside : 2011 Nov 8 07:54:17 BRST: %ETHPORT-5-IF_UP: Interface port-channel122 is up in mode Fex Fabric
Nov 8 08:54:17 smale-outside : 2011 Nov 8 07:54:17 BRST: %ETHPORT-5-IF_UP: Interface Ethernet1/18 is up in mode Fex Fabric
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %MODULE-2-MOD_NOT_ALIVE: Module 1 not responding... resetting (serial: JAF1445AGRQ)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel122 is down (Initializing)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel115 is down (Initializing)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel111 is down (Initializing)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel113 is down (Initializing)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface port-channel40 is down (Initializing)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel124 is down (No operational members)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel191 is down (No operational members)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel30 is down (No operational members)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel10 is down (No operational members)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel20 is down (No operational members)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/11 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/12 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/15 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/16 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/17 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/19 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/20 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/21 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/23 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/24 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/25 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/26 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/27 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/28 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/29 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/30 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/31 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/32 is down (Interface removed)
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 122 that is connected with Ethernet1/18 changed its status from Active to Disconnected
Nov 8 08:55:00 smale-outside : 2011 Nov 8 07:55:00 BRST: %FEX-2-NOHMS_ENV_FEX_OFFLINE: FEX-122 Off-line (Serial Number JAF1443AALB)
Nov 8 08:55:20 147.65.21.250 : 2011 Nov 8 07:55:00 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 115 that is connected with Ethernet1/13 changed its status from Active to Disconnected
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:03 BRST: %ETHPORT-5-IF_DOWN_INITIALIZING: Interface Ethernet1/9 is down (Initializing)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:03 BRST: %ETHPORT-5-IF_DOWN_PORT_CHANNEL_MEMBERS_DOWN: Interface port-channel113 is down (No operational members)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:04 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 113 that is connected with Ethernet1/9 changed its status from Disconnected to Configured
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:04 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/2 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:04 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/4 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/1 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/3 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/5 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/6 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/7 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/8 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/9 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/10 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/13 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/14 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/18 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %ETHPORT-5-IF_DOWN_INTERFACE_REMOVED: Interface Ethernet1/22 is down (Interface removed)
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 113 that is connected with Ethernet1/9 changed its status from Configured to Created
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 111 that is connected with Ethernet1/10 changed its status from Configured to Created
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 115 that is connected with Ethernet1/13 changed its status from Configured to Created
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 0 of Fex 191 that is connected with Ethernet1/14 changed its status from Configured to Created
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 1 of Fex 122 that is connected with Ethernet1/18 changed its status from Configured to Created
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:05 BRST: %FEX-5-FEX_PORT_STATUS_NOTI: Uplink-ID 0 of Fex 124 that is connected with Ethernet1/22 changed its status from Configured to Created
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:06 BRST: %MODULE-4-MOD_WARNING: Module 1 (serial: JAF1445AGRQ) reported warning due to X-bar Interface ASIC Error in device 70 (device error 0xc4600248)
11-10-2011 01:23 PM
Rosa Ladeira wrote:
Nov 8 08:58:11 smale-outside : 2011 Nov 8 07:55:06 BRST: %MODULE-4-MOD_WARNING: Module 1 (serial: JAF1445AGRQ) reported warning due to X-bar Interface ASIC Error in device 70 (device error 0xc4600248)
That'd be the one that was worrying me.
From the look of that, the card in slot 1 has a hardware issue which may be interrmittent.
Report it to the TAC and have it RMA'd. Cards in a Nexus 7000 are hot-swappable, so your only outage time should be the time to swap cables.
Cheers.
11-11-2011 03:35 AM
Thanks,
Rosa
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide