ASR 1002-X error message %IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/1/0, link down due to local fault

[dhaneshbhaskaran]

Team iam getting this error message,Its brand new box and we are testing it in our lab.

 %IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/1/0, link down due to local fault

complete log message

Oct 22 05:52:19.170: %SONET-4-ALARM:  TenGigabitEthernet0/1/0: WLOS declared
*Oct 22 05:52:19.181: %SONET-4-ALARM:  TenGigabitEthernet0/1/0: WLOS cleared
*Oct 22 05:52:19.181: %SONET-4-ALARM:  TenGigabitEthernet0/1/0: SLOF declared
*Oct 22 05:52:19.340: %SPA_OIR-6-ONLINECARD: SPA (SPA-1X10GE-WL-V2) online in subslot 0/1
*Oct 22 05:52:19.345: %SONET-4-ALARM:  TenGigabitEthernet0/1/0: B2 declared
*Oct 22 05:52:19.345: %SONET-4-ALARM:  TenGigabitEthernet0/1/0: WLOS declared
*Oct 22 05:52:19.378: %IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/1/0, link down due to local fault
*Oct 22 05:52:20.208: %SONET-4-ALARM:  TenGigabitEthernet0/1/0: WLOS cleared
*Oct 22 05:52:20.208: %SONET-4-ALARM:  TenGigabitEthernet0/1/0: SLOF declared
*Oct 22 05:52:21.042: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/1, changed state to up
*Oct 22 05:52:21.161: %LINK-3-UPDOWN: Interface TenGigabitEthernet0/1/0, changed state to down
*Oct 22 05:52:22.092: %IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/1/0, link down due to local fault
*Oct 22 05:52:21.376: %LINK-3-UPDOWN: SIP0/1: Interface TenGigabitEthernet0/1/0, changed state to down
 

sh int te0/1/0
TenGigabitEthernet0/1/0 is down, line protocol is down
  Hardware is SPA-1X10GE-WL-V2, address is f07f.06da.4c10 (bia f07f.06da.4c10)
  MTU 1500 bytes, BW 9953280 Kbit/sec, DLY 10 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, loopback not set
  Keepalive not supported
  Full Duplex, 10000Mbps, link type is force-up, media type is 10GBase-SR/SW
  output flow-control is on, input flow-control is on
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input never, output never, output hang never
  Last clearing of "show interface" counters never
  Input queue: 0/375/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     0 packets input, 0 bytes, 0 no buffer
     Received 0 broadcasts (0 IP multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 0 multicast, 0 pause input
     0 packets output, 0 bytes, 0 underruns
     0 output errors, 0 collisions, 2 interface resets
     0 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out

the other end of the connection is sfp-10g-sr

ASR IMAGE

ASR1002-X#sh ver
Cisco IOS XE Software, Version 03.13.00.S - Extended Support Release
Cisco IOS Software, ASR1000 Software (X86_64_LINUX_IOSD-UNIVERSALK9-M), Version 15.4(3)S, RELEASE SOFTWARE (fc11)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2014 by Cisco Systems, Inc.
Compiled Mon 28-Jul-14 01:21 by mcpre

[dhaneshbhaskaran]

I sorted out the issue with the below command since they work in WAN mode by default

"hw-module subslot 0/1 enable LAN"

[max-sandoval]

Say Slot 0/0/0 resides on the WAN side

how do you make slot 0/0/1 to be on the LAN side

as your command "hw-module subslot 0/1 enable LAN" I think would force both interfaces to be on the LAN side.

[Arup Dutta]

Hi,

I have the same problem with new box packed ASR 10001-X.

received below logs----

%IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/1/0, link down due to local fault when execute no shutdown command.

Cisco IOS XE Software, Version 03.16.03.S - Extended Support Release

Cisco IOS Software, ASR1000 Software (X86_64_LINUX_IOSD-UNIVERSALK9-M), Version 15.5(3)S3, RELEASE SOFTWARE (fc1)

#show interface TenGigabitEthernet0/0/1

TenGigabitEthernet0/0/1 is down, line protocol is down

  Hardware is BUILT-IN-2T+6X1GE, address is 84b2.61cc.d001 (bia 84b2.61cc.d001)

   Internet address is x.x.x.x

  MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,

     reliability 255/255, txload 1/255, rxload 1/255

  Encapsulation ARPA, loopback not set

  Keepalive not supported

  Full Duplex, 10000Mbps, link type is force-up, media type is unknown media type

  output flow-control is on, input flow-control is on

 ARP type: ARPA, ARP Timeout 04:00:00

  Last input never, output never, output hang never

  Last clearing of "show interface" counters never

  Input queue: 0/375/0/0 (size/max/drops/flushes); Total output drops: 0

  Queueing strategy: fifo

  Output queue: 0/40 (size/max)

  5 minute input rate 0 bits/sec, 0 packets/sec

  5 minute output rate 0 bits/sec, 0 packets/sec

     0 packets input, 0 bytes, 0 no buffer

     Received 0 broadcasts (0 IP multicasts)

     0 runts, 0 giants, 0 throttles

     0 input errors, 0 CRC, 991196 frame, 0 overrun, 0 ignored

     0 watchdog, 0 multicast, 0 pause input

     0 packets output, 0 bytes, 0 underruns

     0 output errors, 0 collisions, 4 interface resets

     0 unknown protocol drops

     0 babbles, 0 late collision, 0 deferred

     0 lost carrier, 0 no carrier, 0 pause output

     0 output buffer failures, 0 output buffers swapped out

Thanks..

[mmason221]

ROMMON - 15.5(3r)S1
IMAGE - asr1001x-universalk9.03.16.03.S.155-3.S3-ext.SPA.bin

Just opened a TAC case, will try to report back after investigations.

To me this is NOT A COSMETIC BUG. The line protocol is going UP with zero items connected.

%LINK-3-UPDOWN: SIP0/0: Interface TenGigabitEthernet0/0/0, changed state to up

%IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/0/0, link down due to local fault

%LINEPROTO-5-UPDOWN: Line protocol on Interface TenGigabitEthernet0/0/0, changed state to up

%IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/0/0, link down due to local fault
%LINK-3-UPDOWN: Interface TenGigabitEthernet0/0/0, changed state to down

[mmason221]

Prior ROMMON and IMAGE was also exhibiting same behavior

15.4(2r)S

asr1001x-universal.03.16.02.S.155-3.S2-ext.SPA.bin

[rleon62104]

Hello,

i have the same issue. Opened a TAC and engineer said that since I have no transceivers the error will continue. I have my doubts, will install transceivers and connect to our core switch to see if it's true.

[mmason221]

I have more testing to do today for the TAC engineer (not overly helpful, besides the point).

I connected both 10Gb's to a 4500x for testing, after bring up the interfaces and bringing them down all messages seemed to have stabilized. The concept behind the message does seem to be missing some logic like you alluded to above.

[urbinir]

Hi,  same issue using ASR1001-X with asr1001x-universalk9.03.16.00.S.155-3.S-ext.SPA.bin

Solved after inserting/removing a 10G SFP tranceiver into the TenGiga port

All of those messages above disappeared and never happen again 

*Jan 12 06:08:08.622: %IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/0/1, link down due to local fault
*Jan 12 06:08:08.639: %LINEPROTO-5-UPDOWN: Line protocol on Interface TenGigabitEthernet0/0/1, changed state to down
*Jan 12 06:08:08.685: %IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/0/1, link down due to local fault
*Jan 12 06:08:08.760: %IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/0/1, link down due to remote fault
*Jan 12 06:08:08.906: %IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/0/1, link down due to local faul

..............................................................................................

[manojk6]

Is this still there ?

if yes i can help you to resolve this one

i was facing same issue and resolved it

[jacobbriggs]

Please enter the fix in this thread. I have a possible issue and need the most accurate information about what the local fault means because I have read articles that state that a bit get checked in a neighbor state packet that says the neighbor has a local fault and is alerting the other end of it. Not sure if that is accurate but think it is absolutely possible. We keep having ATT outages and this is the first log I see every time. Thanks.

[jacobbriggs]

Please enter the fix in this thread. I have a possible issue and need the most accurate information about what the local fault means because I have read articles that state that a bit get checked in a neighbor state packet that says the neighbor has a local fault and is alerting the other end of it. Not sure if that is accurate but think it is absolutely possible. We keep having AT&T outages and this is the first log I see every time. Thanks.

[manojk6]

HI All,

Just check the cable on neighbour device might be its faulty or not connected properly or check the TX&RX on both side

If you are getting error for Remote Neighbour just replace the cable

It will resolve the issue

I Spent my 3hr. for this thing and finally I realised its just a cable issue

Let me know if you need any other clarification on this please  

Thanks

Manoj

[Mosasa]

%IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/0/0, link down due to local fault

%IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/0/1, link down due to local fault

The fix to this is just simply installing a transceiver, lol. Don't bother trying to clear facility alarm status either. It hasn't worked for me but installing a transceiver works.