Cisco 3850 All ports turns amber when SFP inserted

aacable79 · ‎05-28-2018

We have replaced old 3750 switches (2xstack) with new WS-C3850-24T (Qty:2 in stack mode). There is no VLAN setup in this network, pretty straight forward. NOC have above 2 switches in stack, and various depts are connected via fiber to these switches.

Whenever I insert any SFP into NOC switch 4x1G Uplink Module to connect any switch , ALL ports (on both switches) turns amber (orange) for few seconds, during this phase all connectivity of other ports (on both switches) disconnects , and after around 10 seconds all ports runs back to green and connectivity restores.

This never happened in old 3750 switches. What could be the possible cause?

Logs shows this only.

Text

000609: May 27 12:05:18.852: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/4, changed state to up
000610: May 27 12:05:28.392: %PLATFORM_PM-6-MODULE_REMOVED: SFP module with interface name Gi2/1/3 removed
000611: May 27 12:07:35.009: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/1/1, changed state to down
000612: May 27 12:07:36.012: %LINK-3-UPDOWN: Interface GigabitEthernet2/1/1, changed state to down
000613: May 27 12:07:45.979: %LINK-3-UPDOWN: Interface GigabitEthernet2/1/1, changed state to up
000614: May 27 12:07:46.981: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/1/1, changed state to up
000615: May 27 12:08:41.691: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/1, changed state to down
000616: May 27 12:08:42.691: %LINK-3-UPDOWN: Interface GigabitEthernet1/1/1, changed state to down
000617: May 27 12:09:03.062: %LINK-3-UPDOWN: Interface GigabitEthernet1/1/1, changed state to up
000618: May 27 12:09:04.062: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/1, changed state to up
000619: May 27 12:09:26.333: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/1, changed state to down
000620: May 27 12:09:26.959: %PLATFORM_PM-6-MODULE_REMOVED: SFP module with interface name Gi1/1/1 removed
000621: May 27 12:09:27.331: %LINK-3-UPDOWN: Interface GigabitEthernet1/1/1, changed state to down
000622: May 27 12:09:40.525: %PLATFORM_PM-6-MODULE_INSERTED: SFP module inserted with interface name Gi1/1/1
000623: May 27 12:09:49.380: %LINK-3-UPDOWN: Interface GigabitEthernet1/1/1, changed state to up
000624: May 27 12:09:50.383: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/1, changed state to up
000625: May 27 12:10:29.500: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/4, changed state to down
000626: May 27 12:10:30.499: %LINK-3-UPDOWN: Interface GigabitEthernet1/1/4, changed state to down
000627: May 27 12:10:45.311: %LINK-3-UPDOWN: Interface GigabitEthernet1/1/4, changed state to up
000628: May 27 12:10:46.313: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/4, changed state to up
000629: May 27 12:16:50.712: %NGWC_USB_CONSOLE-6-USB_INSERT: Switch 2: USB cable inserted. Console media-type USB is in effect
000630: May 27 12:17:19.722: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/0/7, changed state to down
000631: May 27 12:17:20.721: %LINK-3-UPDOWN: Interface GigabitEthernet1/0/7, changed state to down
000632: May 27 12:17:38.611: %LINK-3-UPDOWN: Interface GigabitEthernet1/0/7, changed state to up
000633: May 27 12:17:39.610: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/0/7, changed state to up
000634: May 27 12:21:33.560: %NGWC_USB_CONSOLE-6-USB_REMOVE: Switch 2: USB cable removed. Console media-type RJ45 is in effect
000635: May 27 12:21:36.785: %NGWC_USB_CONSOLE-6-USB_INSERT: Switch 1: USB cable inserted. Console media-type USB is in effect
000636: May 27 12:23:35.031: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/4, changed state to down
000637: May 27 12:23:37.030: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/4, changed state to up
000638: May 27 12:23:39.533: %PLATFORM_PM-6-MODULE_REMOVED: SFP module with interface name Gi1/1/1 removed
000639: May 27 12:23:40.522: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/1, changed state to down
000640: May 27 12:23:40.697: %PLATFORM_PM-6-MODULE_INSERTED: SFP module inserted with interface name Gi1/1/1
000641: May 27 12:23:42.521: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/1, changed state to up
000642: May 27 12:24:27.939: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/1, changed state to down
000643: May 27 12:24:28.942: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/1, changed state to down
000644: May 27 12:24:34.400: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/1, changed state to up
000645: May 27 12:24:35.400: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/1, changed state to up
000646: May 27 12:26:09.541: %PLATFORM_PM-6-MODULE_REMOVED: SFP module with interface name Gi1/1/1 removed
000647: May 27 12:26:10.480: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/1, changed state to down
000648: May 27 12:26:11.479: %LINK-3-UPDOWN: Interface GigabitEthernet1/1/1, changed state to down
000649: May 27 12:26:14.321: %PLATFORM_PM-6-MODULE_INSERTED: SFP module inserted with interface name Gi1/1/1
000650: May 27 12:26:16.331: %LINK-3-UPDOWN: Interface GigabitEthernet1/1/1, changed state to up
000651: May 27 12:26:17.329: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/1/1, changed state to up
000652: May 27 12:26:36.481: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/0/7, changed state to down
000653: May 27 12:26:37.481: %LINK-3-UPDOWN: Interface GigabitEthernet1/0/7, changed state to down
000654: May 27 12:26:40.031: %LINK-3-UPDOWN: Interface GigabitEthernet1/0/7, changed state to up
000655: May 27 12:26:41.032: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1/0/7, changed state to up

Switch Details:

Model Revision Number              : AB0
Motherboard Revision Number        : A0
Model Number                       : WS-C3850-24T

Switch Ports Model              SW Version        SW Image              Mode
------ ----- -----              ----------        ----------            ----
*    1 32    WS-C3850-24T       03.06.08E         cat3k_caa-universalk9 INSTALL
     2 32    WS-C3850-24T       03.06.08E         cat3k_caa-universalk9 INSTALL

Following is Spanning Tree Info.

xxx-NOC-3850-Cluster#show spanning-tree summary
Switch is in rapid-pvst mode
Root bridge for: none
Extended system ID           is enabled
Portfast Default             is disabled
PortFast BPDU Guard Default  is disabled
Portfast BPDU Filter Default is disabled
Loopguard Default            is disabled
EtherChannel misconfig guard is enabled
UplinkFast                   is disabled
BackboneFast                 is disabled
Configured Pathcost method used is short

Name                   Blocking Listening Learning Forwarding STP Active
---------------------- -------- --------- -------- ---------- ----------
VLAN0001                     0         0        0         28         28
---------------------- -------- --------- -------- ---------- ----------
1 vlan                       0         0        0         28         28

Following is Inventory output:

Text

XXX-NOC-3850-Cluster#sh inv

NAME: "c38xx Stack", DESCR: "c38xx Stack"
PID: WS-C3850-24T   , VID: V07 , SN: FOC2126L0T1

NAME: "Switch 1", DESCR: "WS-C3850-24T-S"
PID: WS-C3850-24T-S , VID: V07 , SN: FOC2126L0T1

NAME: "StackPort1/1", DESCR: "StackPort1/1"
PID: STACK-T1-50CM , VID: V01 , SN: MOC2102A2VN

NAME: "Switch 1 - Power Supply B", DESCR: "Switch 1 - Power Supply B"
PID: PWR-C1-350WAC , VID: V02 , SN: LIT20462TNP

NAME: "Switch 1 FRU Uplink Module 1", DESCR: "4x1G Uplink Module"
PID: C3850-NM-4-1G , VID: V01 , SN: FOC21083GDN

NAME: "GigabitEthernet1/1/1", DESCR: "1000BaseSX SFP"
PID:                 , VID:   , SN: FNS12060A5K

NAME: "GigabitEthernet1/1/4", DESCR: "1000BaseSX SFP"
PID:                 , VID:   , SN: FNS17041183

NAME: "Switch 2", DESCR: "WS-C3850-24T-S"
PID: WS-C3850-24T-S , VID: V07 , SN: FCW2113C1AK

NAME: "StackPort2/1", DESCR: "StackPort2/1"
PID: STACK-T1-50CM , VID: V01 , SN: MOC2102A2VN

NAME: "Switch 2 - Power Supply B", DESCR: "Switch 2 - Power Supply B"
PID: PWR-C1-350WAC , VID: V02 , SN: ART2205FCLN

NAME: "Switch 2 FRU Uplink Module 1", DESCR: "4x1G Uplink Module"
PID: C3850-NM-4-1G , VID: V01 , SN: FOC21065HC4

NAME: "GigabitEthernet2/1/1", DESCR: "1000BaseSX SFP"
PID:                 , VID:   , SN: FNS17041321

NAME: "GigabitEthernet2/1/4", DESCR: "1000BaseSX SFP"
PID:                 , VID:   , SN: FNS17041205

Dennis Mink · ‎05-28-2018

its impossible to say what caused it based on the information provide, could be spanning tree recalculation, although you are just inserting an SFP. does this only happen when you insert the sfp's? and once inserted the access port remain green if something is plugged in?

Please remember to rate useful posts, by clicking on the stars below.

aacable79 · ‎05-28-2018

It only happens When I insert the SFP or If I plugin the MM pigtail cable into the SFP. then all ports turns blinks orange for about 8-10 seconds, then all ports turns back to Green and all ports including the SFP starts working fine.

Disturbance occurs only when SFP/MM Cables are inserted or pulled.

What other information I can provide in order to troubleshoot what is happening inside the switch?