Cant get connection on SFP using 9300

[Rick001]

We got a few brand new Cisco 9300 switches with the Network Module 9300-NM-4G. We setup the interface info correctly for the trunk and no shut the the port. I can see the SFP info and used different SFPs, but can't get any link.

#sh int g1/1/1
GigabitEthernet1/1/1 is down, line protocol is down (notconnect)

MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full-duplex, 1000Mb/s, link type is auto, media type is 1000BaseLX SFP
input flow-control is on, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts (0 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 0 multicast, 0 pause input
0 input packets with dribble condition detected
0 packets output, 0 bytes, 0 underruns
Output 0 broadcasts (0 multicasts)
0 output errors, 0 collisions, 6 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out

#show controllers g1/1/1 utilization
Receive Bandwidth Percentage Utilization   : 0
Transmit Bandwidth Percentage Utilization  : 0

# sh int g1/1/1 transceiver detail
ITU Channel not available (Wavelength not available),
Transceiver is internally calibrated.
mA: milliamperes, dBm: decibels (milliwatts), NA or N/A: not applicable.
++ : high alarm, +  : high warning, -  : low warning, -- : low alarm.
A2D readouts (if they differ), are reported in parentheses.
The threshold values are calibrated.

                                High Alarm  High Warn  Low Warn   Low Alarm
             Temperature        Threshold   Threshold  Threshold  Threshold
Port         (Celsius)          (Celsius)   (Celsius)  (Celsius)  (Celsius)
---------    -----------------  ----------  ---------  ---------  ---------
Gi1/1/1      21.1                   80.0       75.0       -5.0      -10.0

                                High Alarm  High Warn  Low Warn   Low Alarm
             Voltage            Threshold   Threshold  Threshold  Threshold
Port         (Volts)            (Volts)     (Volts)    (Volts)    (Volts)
---------    -----------------  ----------  ---------  ---------  ---------
Gi1/1/1      3.26                   3.59       3.50       2.90       2.79

                                  High Alarm  High Warn  Low Warn   Low Alarm
                 Current          Threshold   Threshold  Threshold  Threshold
Port       Lane  (milliamperes)   (mA)        (mA)       (mA)       (mA)
---------  ----  ---------------  ----------  ---------  ---------  ---------
Gi1/1/1    N/A   15.9                 75.0       70.0        7.0        5.0

                 Optical          High Alarm  High Warn  Low Warn   Low Alarm
                 Transmit Power   Threshold   Threshold  Threshold  Threshold
Port       Lane  (dBm)            (dBm)       (dBm)      (dBm)      (dBm)
---------  ----  ---------------  ----------  ---------  ---------  ---------
Gi1/1/1    N/A   -5.2                  0.0       -0.5      -10.0      -11.0

                 Optical          High Alarm  High Warn  Low Warn   Low Alarm
                 Receive Power    Threshold   Threshold  Threshold  Threshold
Port       Lane  (dBm)            (dBm)       (dBm)      (dBm)      (dBm)
---------  ----  ---------------  ----------  ---------  ---------  ---------
Gi1/1/1    N/A   -4.7                  1.0        0.0      -28.2      -30.0

#sh idprom interface g1/1/1

General SFP Information
-----------------------------------------------
Identifier            :   SFP/SFP+
Ext.Identifier        :   SFP function is defined by two-wire interface ID only
Connector             :   LC connector
Transceiver
 10/40GE Comp code       :   Unknown
 SONET Comp code      :   Unknown
 GE Comp code         :   1000BASE-LX
 Link length          :   Unknown
 Technology           :   Unknown
 Media                :   Single Mode
 Speed                :   Unknown
Encoding              :   8B10B
BR_Nominal            :   1300 Mbps
Length(9um)-km        :   10 km
Length(9um)           :   10000 m
Length(50um)          :   GBIC does not support 50 micron multi mode OM2 fibre
Length(62.5um)        :   GBIC does not support 62.5 micron multi mode OM1 fibre
Length(Copper)        :   GBIC does not support 50 micron multi mode OM4 fibre
Vendor Name           :   OEM
Vendor Part Number    :   M-SFP-LX-C
Vendor Revision       :   xxxxxx
Vendor Serial Number  :   xxxxxxx
Wavelength            :   1310.00 nm
CC_BASE               :   0x4D
-----------------------------------------------

Extended ID Fields
-----------------------------------------------
Options               :   0x00 0x1A
BR, max               :   0x00
BR, min               :   0x00
Date code             :   230516
Diag monitoring       :   Implemented
Internally calibrated :   Yes
Exeternally calibrated:   No
Rx.Power measurement  :   Avg.Power
Address Change        :   Not Required
CC_EXT                :   0x97
-----------------------------------------------

Other Information
-----------------------------------------------
Chk for link status   : 00
Flow control Receive  : Off
Flow control Send     : Off
Administrative Speed  : 1000
Administrative Duplex : full
Operational Speed     : 1000
Operational Duplex    : auto
-----------------------------------------------

1#sh int g1/1/1 status

Port         Name               Status       Vlan       Duplex  Speed Type
Gi1/1/1      Trunk           notconnect   trunk        full   1000 1000BaseLX SFP

I tried connecting to a Trend Networks SignalTek 10G tester that I have, but don't get any link lights.

[Ramblin Tech]

I was going to suggest that you loop the tx side of the optic back to the rx side, perhaps with an attenuator if it is launching too hot, but your tester may have made that moot.

The PROM info does not look like a Cisco-branded optic module, perhaps a Hirschmann? If this is not a Cisco-branded optic, do you have any Cisco optics that you could insert into the NM? If so, do they come up? If they do not, open a TAC case. If the Cisco optics do come up, TAC is not going to help, as TAC does not troubleshoot 3rd-party optics in instances where Cisco-branded optics do work, as they see that troubleshooting burden falling on the vendor of the 3rd-party optics.

Despite what 3rd-party optic module vendors will say, modules are not 100% interchangeable, with the incompatibilities coming mostly on the MSA interface side of the optic (as opposed to the L1 PHY side, which are much more compatible between vendors) The host device gives the optic enough power to read the PROM info and then configures its interface according to that info (compensation values, when to power the laser, etc). If the host s/w and optic vendors interpreted the MSA differently, or they implemented with different versions of the MSA, you might see the optic remain in a down state. Any incompatibility like this should be shaken out during the qualification tests by the optic vendor for that specific host h/w and s/w version, but the brutal truth of the matter is that 3rd-party optic vendors do not extensively test their products against host devices before marketing them.

Cisco does not disable or put up artificial barriers to 3rd-party optics (anymore) in its products, so they are not intentionally crippling other vendors' optics (doing so might have anti-trust implications). But they also do not test their own host products against 3rd-party optics, as their view is that interop testing must be taken on by the optic vendor, even when Cisco is the 3rd-party optic vendor with their modules inserted into Arista/Juniper/HP/etc hosts (that is, Cisco assumes the troubleshooting burden for their optics).

[Flavio Miranda]

Hi @Rick001 

 Check on this link if the SFP you are using is compatible.

https://tmgmatrix.cisco.com/

And check if the fiber is not inverted.

[Leo Laohoo]

---

@Rick001 wrote:
I tried connecting to a Trend Networks SignalTek 10G tester that I have, but don't get any link lights.

---

Will not work.  The switch has 1 Gbps optics but the tester has 10 Gbps optics.  The link lights will never light up.  

Both ends must have the same optic speeds and the same wavelengths.  

The best and fastest test is, as @Ramblin Tech said, loop the GLC-LX-SMD to itself.  Plug half the strand into one side of the optic and the end of that strand into the other side of the same optic to form a loop.  If the LED lights up (green or amber) it means the optic is fine.

[damori.pierce]

I had a similar issue and it was fixed by matching speed and duplex on both sides of the connection. I had 10G settings on a 1G SFP and 1G connection. I changed them to match all the way through the connection and the SFP and connection came up. Wont hurt to try it. 

[Rick001]

I tried looping the fiber, but no light came up and saw no transmission. I've used brand new fiber cables. I even rolled the fiber.

I connected a 10GB Cisco SFP (SFP-10G-LR) and the following are the results:

#sh int g1/1/1
GigabitEthernet1/1/1 is down, line protocol is down (notconnect)
  Hardware is Gigabit Ethernet, address is xxxxx (bia xxxxx)
  Description: Trunk
  MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, loopback not set
  Keepalive not set
  Auto-duplex, Auto-speed, link type is auto, media type is unknown
  input flow-control is on, output flow-control is unsupported
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input never, output never, output hang never
  Last clearing of "show interface" counters never
  Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     0 packets input, 0 bytes, 0 no buffer
     Received 0 broadcasts (0 multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 0 multicast, 0 pause input
     0 input packets with dribble condition detected
     0 packets output, 0 bytes, 0 underruns
     Output 0 broadcasts (0 multicasts)
     0 output errors, 0 collisions, 2 interface resets
     0 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out

#sh int g1/1/1 transceiver detail
Diagnostic Monitoring is not implemented.

#sh idprom interface g1/1/1 Didn't return anything.

sh int g1/1/1 status

Port         Name               Status       Vlan       Duplex  Speed Type
Gi1/1/1      Trunk            notconnect   trunk        auto   auto unknown

[Leo Laohoo]

---

@Rick001 wrote:
I connected a 10GB Cisco SFP (SFP-10G-LR) and the following are the results

---

9300-NM-4G will only support 1 Gbps optics.  

[Rick001]

I used it to test your comment about the 10G tester.

[Leo Laohoo]

---

@Rick001 wrote:
I used it to test your comment about the 10G tester.

---

Allow me to repeat what I said in my previous response:  The 9300-NM-4G will only support 1 Gbps optics.  If someone plugs a 10 Gbps optics into 9300-NM-4G it will not work.  

[balaji.bandi]

Auto-duplex, Auto-speed, link type is auto, media type is unknown

You need to same SFP both the side both should be same speed.

you can not have 10G and 1G connection.

[Rick001]

I looped the fiber and none of the SFPs I have seem to light up or show any transmission.

[Rick001]

Right now I have 4 different SFPs on the Network module.

G1/1/1 has a Cisco GLC-LH-SMD

G1/1/2 has a Cisco SFP-10G-LR (I understand this is 10G and will not work, but just for testing purposes...)

G1/1/3 has an unbranded SFP M-SFP-LX-C which we bought a couple of 1.25GB modules.

G1/1/4 has a Finisiar FTRJ1319P1BTL 1310 nm

All except the 10GB SFP show up info using the sh idprom interface g1/1/x command

I have run the codes:

service unsupported-transceiver
no errdisable detect cause gbic-invalid

sh interfaces status err-disabled displays no errors.

[Andrew5000]

Just giving Rick some points here because the "service unsupported-transceiver" will allow for the use of most non-Cisco SFP's