CISCO ASR920 abnormal behavior

[Mohamed Abdelmaqsoud]

Hi All,

Need your support for the below case, while doing new connectivity on CISCO ASR920 I observed an abnormal behavior like

1- New fiber cable connected to one port and physically it is showing up and green but when i login to the router i found the interface status still showing down... SFP changed still no change

2- Another port was up and green but no traffic on that port so we removed the cable and SFP then we checked the interface status still showing up.. we shut and no shut the interface then the interface status changed to Down

3- We did a direct loop on the interface but the interface status still showing down

as per the above deferent scenario we want to figure out the root cause for the abnormal behavior. this is due to [ hanging issue, software upgrade or license issue...]

below is the router information 

Cisco IOS XE Software, Version 03.16.02a.S - Extended Support Release
Cisco IOS Software, ASR920 Software (PPC_LINUX_IOSD-UNIVERSALK9_NPE-M), Version 15.5(3)S2a, RELEASE SOFTWARE (fc1)

cisco ASR-920-24SZ-M (Freescale P2020) processor (revision 1.2 GHz) with 909833K/6147K bytes of memory.
Processor board ID CAT2140V08Z
24 Gigabit Ethernet interfaces
4 Ten Gigabit Ethernet interfaces

[balaji.bandi]

Can you post the below information of that port

show run interface gigx/x

show interface gigx/x

what is other side conected ?

show logging, when you insert the SFP and remove the SFP ? (what SFP is this ?) model ?

[Mohamed Abdelmaqsoud]

Hi dear,

please find below output for your requirement

SFP Model: GLC-LX-SM-RGD-DHD [ 1310nm 10km SMF DOM ]

show interfaces gigabitEthernet 0/0/15
GigabitEthernet0/0/15 is down, line protocol is down
Hardware is 24xGE-4x10GE-FIXED-S, address is 70df.2f5c.8c8f (bia 70df.2f5c.8c8f)
Description: "Assign-for-SYNIVERSE-TECHNOLOGIES"
Internet address is 2.2.2.1/30
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full Duplex, 1000Mbps, link type is auto, media type is LX
output flow-control is unsupported, input flow-control is on
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/375/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 0 multicast, 0 pause input
0 packets output, 0 bytes, 0 underruns
0 output errors, 0 collisions, 7 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out

show running-config interface gigabitEthernet 0/0/15
Building configuration...

Current configuration : 142 bytes
!
interface GigabitEthernet0/0/15
description "Assign-for-SYNIVERSE-TECHNOLOGIES"
ip address 2.2.2.1 255.255.255.252
negotiation auto
end

#show logging
Syslog logging: enabled (0 messages dropped, 4 messages rate-limited, 0 flushes, 0 overruns, xml disabled, filtering disabled)

No Active Message Discriminator.

No Inactive Message Discriminator.

Console logging: level debugging, 59415 messages logged, xml disabled,
filtering disabled
Monitor logging: level debugging, 102 messages logged, xml disabled,
filtering disabled
Buffer logging: level debugging, 59418 messages logged, xml disabled,
filtering disabled
Exception Logging: size (4096 bytes)
Count and timestamp logging messages: disabled
Persistent logging: disabled

No active filter modules.

Trap logging: level informational, 59419 message lines logged
Logging Source-Interface: VRF Name:

Log Buffer (4096 bytes):
atively down
Aug 24 13:20:06.479: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/15, changed state to down
Aug 24 13:20:36.258: %SYS-5-CONFIG_I: Configured from console by vadmin on vty0 (172.18.60.189)
Aug 24 16:31:47.413: %SYS-5-CONFIG_I: Configured from console by vadmin on vty0 (172.18.60.189)
Aug 24 16:50:52.905: %SYS-5-CONFIG_I: Configured from console by vadmin on vty0 (172.18.60.189)
Aug 24 17:00:01.162: %SYS-5-CONFIG_I: Configured from console by vadmin on vty1 (172.18.60.189)
Sep 5 16:17:23.266: %LINK-5-CHANGED: Interface GigabitEthernet0/0/15, changed state to administratively down
Sep 5 16:20:04.757: %TRANSCEIVER-6-REMOVED: F0: iomd: Transceiver module removed from GigabitEthernet0/0/15
Sep 5 16:20:13.804: %TRANSCEIVER-6-INSERTED: F0: iomd: transceiver module inserted in GigabitEthernet0/0/15
Sep 5 16:20:43.102: %TRANSCEIVER-6-REMOVED: F0: iomd: Transceiver module removed from GigabitEthernet0/0/15
Sep 5 16:22:42.435: %TRANSCEIVER-6-INSERTED: F0: iomd: transceiver module inserted in GigabitEthernet0/0/15
Sep 5 16:30:51.170: %TRANSCEIVER-6-REMOVED: F0: iomd: Transceiver module removed from GigabitEthernet0/0/15
Sep 5 16:31:06.531: %TRANSCEIVER-6-INSERTED: F0: iomd: transceiver module inserted in GigabitEthernet0/0/15
Sep 5 16:32:48.785: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/15, changed state to down
Sep 5 16:33:11.309: %SYS-5-CONFIG_I: Configured from console by vadmin on vty2 (172.18.60.189)
Sep 5 16:36:47.578: %TRANSCEIVER-6-REMOVED: F0: iomd: Transceiver module removed from GigabitEthernet0/0/15
Sep 5 16:36:52.891: %TRANSCEIVER-6-INSERTED: F0: iomd: transceiver module inserted in GigabitEthernet0/0/15
Sep 5 16:39:47.337: %TRANSCEIVER-6-REMOVED: F0: iomd: Transceiver module removed from GigabitEthernet0/0/15
Sep 5 16:39:53.269: %TRANSCEIVER-6-REMOVED: F0: iomd: Transceiver module removed from GigabitEthernet0/0/14
Sep 5 16:39:57.377: %TRANSCEIVER-6-INSERTED: F0: iomd: transceiver module inserted in GigabitEthernet0/0/15
Sep 5 16:44:10.877: %SYS-5-CONFIG_I: Configured from console by vadmin on vty0 (172.18.236.4)
Sep 5 16:52:09.112: %LINK-5-CHANGED: Interface GigabitEthernet0/0/14, changed state to administratively down
Sep 5 16:52:09.813: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/14, changed state to down
Sep 5 16:52:24.493: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/14, changed state to down
Sep 5 16:57:37.385: %TRANSCEIVER-6-INSERTED: F0: iomd: transceiver module inserted in GigabitEthernet0/0/14
Sep 5 16:57:53.974: %LINK-5-CHANGED: Interface GigabitEthernet0/0/15, changed state to administratively down
Sep 5 16:58:02.243: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/15, changed state to down
Sep 5 17:03:49.412: %TRANSCEIVER-6-REMOVED: F0: iomd: Transceiver module removed from GigabitEthernet0/0/15
Sep 5 17:03:52.166: %TRANSCEIVER-6-REMOVED: F0: iomd: Transceiver module removed from GigabitEthernet0/0/14
Sep 5 17:04:05.599: %TRANSCEIVER-6-INSERTED: F0: iomd: transceiver module inserted in GigabitEthernet0/0/14
Sep 5 17:04:09.710: %TRANSCEIVER-6-INSERTED: F0: iomd: transceiver module inserted in GigabitEthernet0/0/15
Sep 5 17:05:06.595: %LINK-5-CHANGED: Interface GigabitEthernet0/0/14, changed state to administratively down
Sep 5 17:05:12.839: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/14, changed state to down
Sep 5 17:06:49.341: %LINK-5-CHANGED: Interface GigabitEthernet0/0/14, changed state to administratively down
Sep 5 17:07:05.857: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/14, changed state to down
Sep 5 17:07:22.339: %SYS-5-CONFIG_I: Configured from console by vadmin on vty0 (172.18.236.4)
Sep 5 17:14:13.267: %TRANSCEIVER-6-INSERTED: F0: iomd: transceiver module inserted in GigabitEthernet0/0/3
Sep 5 17:14:16.299: %TRANSCEIVER-6-REMOVED: F0: iomd: Transceiver module removed from GigabitEthernet0/0/3
Sep 5 17:14:21.456: %TRANSCEIVER-6-REMOVED: F0: iomd: Transceiver module removed from GigabitEthernet0/0/10
Sep 5 17:14:29.865: %TRANSCEIVER-6-INSERTED: F0: iomd: transceiver module inserted in GigabitEthernet0/0/10

[balaji.bandi]

try both the side :

interface GigabitEthernet0/0/15
no negotiation auto

[Mohamed Abdelmaqsoud]

it doesn't work 

even if the negotiation auto is configured and did a direct loop, the router should detect it

another point i remembered it. why it showing nothing for that command "sh hw-module subslot 0/0 transceiver 15 status"

[balaji.bandi]

before you connect Long haul fiber, do you have any MM SFP to test to see if the ports are ok ?

check the modules use below the reference guide :

https://www.cisco.com/c/en/us/td/docs/routers/asr920/configuration/guide/chassis/17-1-1/b-Chassis-Guide-xe-17-1-asr920/m-im_activation-asr920.html

[Mohamed Abdelmaqsoud]

i didn't try MM SFP, last visit we only have Single mode

[marce1000]

                    - Disable auto negotiation on the interface configuration , check if that can help.

 M.

[Mohamed Abdelmaqsoud]

Thanks Marce for your kind reply. i tried it but it doesn't work 

even if the negotiation auto is configured and did a direct loop, the router should detect it. am i right?

another point i remembered it. why it showing nothing for that command "sh hw-module subslot 0/0 transceiver 15 status"

[marce1000]

 - Try latest software version available for the ASR920 , one reason for mentioning is https://www.cisco.com/c/en/us/support/docs/field-notices/639/fn63944.html , not sure if this is a 'direct hit' however but it remains good practice to try and or test latest software.

 M.

[Mohamed Abdelmaqsoud]

thanks for your help. i will check the latest software version

[virgo]

Could you post result:
show inventory

[Mohamed Abdelmaqsoud]

Hi, please find this

show inventory
NAME: "Chassis", DESCR: "Cisco ASR920 Series - 24GE Fiber and 4-10GE - Modular PSU"
PID: ASR-920-24SZ-M , VID: V01, SN: CAT2140V08Z

NAME: "subslot 0/0 transceiver 1", DESCR: "GE LX"
PID: SFP-GE-L , VID: 1.0 , SN: N080019K7564

NAME: "subslot 0/0 transceiver 2", DESCR: "GE LX"
PID: SFP-GE-L , VID: 1.0 , SN: N080018EA042

NAME: "subslot 0/0 transceiver 10", DESCR: "GE LX"
PID: SFP-GE-L , VID: 1.0 , SN: N080018EA351

NAME: "subslot 0/0 transceiver 11", DESCR: "GE LX"
PID: SFP-GE-L , VID: 1.0 , SN: N080018EA050

NAME: "subslot 0/0 transceiver 12", DESCR: "GE LX"
PID: SFP-GE-L , VID: 1.0 , SN: N080019JU366

NAME: "subslot 0/0 transceiver 13", DESCR: "GE LX"
PID: SFP-GE-L , VID: 1.0 , SN: N080018EA045

NAME: "subslot 0/0 transceiver 14", DESCR: "GE LX"
PID: SFP-GE-L , VID: 1.0 , SN: N080019K7565

NAME: "subslot 0/0 transceiver 15", DESCR: "GE LX"
PID: SFP-GE-L , VID: 1.0 , SN: N080019K7563

NAME: "subslot 0/0 transceiver 22", DESCR: "GE SX"
PID: SFP-GE-S , VID: 1.0 , SN: N729218AJ576

NAME: "subslot 0/0 transceiver 27", DESCR: "GE SX"
PID: SFP-GE-S , VID: 1.0 , SN: N729218AJ677

NAME: "Power Supply Module 0", DESCR: "ASR 920 250W AC Power Supply"
PID: ASR-920-PWR-A , VID: V02, SN: ART2143F89T

NAME: "Power Supply Module 1", DESCR: "ASR 920 250W AC Power Supply"
PID: ASR-920-PWR-A , VID: V02, SN: ART2143F89L

NAME: "Fan Tray", DESCR: "ASR 920 Fan tray"
PID: ASR-920-FAN-F , VID: V01, SN: CAT2138V024

[virgo]

You probably have done this before, but I got to ask anyway, have you tried replacing SFP with another one? You can also “loopback” by joining the rx & tx of the sfp and see if it router detects it as interface is up or not.

when you run the show hw-module subslot 0/0 transceiver 15 status, it should give you rx/tx reading. 

[Mohamed Abdelmaqsoud]

SFP changed actually with a spare part and with another used port was connected to the router

this command didn't show anything 

all your concerns done before and i mentioned it above

thanks for your help