cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
42476
Views
30
Helpful
13
Replies

ISR4321 slot0/1 booting

kellaprem
Level 1
Level 1

Hi,

I have issue in ISR4321 Router showing error of subslot 0/1 booting error.

%SPA_OIR-3-EVENT_TIMEOUT:  "Subslot0/1: Timeout Waiting for SPA OIR event

Waiting for expert opinion over it.

Regards,

Prem

1 Accepted Solution

Accepted Solutions

Leo Laohoo
Hall of Fame
Hall of Fame

Remove the NIM and re-insert and see if the problem fixes itself. 

The screenshot also shows a Traceback.  Traceback means an IOS fault.

View solution in original post

13 Replies 13

Leo Laohoo
Hall of Fame
Hall of Fame

Remove the NIM and re-insert and see if the problem fixes itself. 

The screenshot also shows a Traceback.  Traceback means an IOS fault.

Yeah. Issue resolve after uppgrading IOS.

Thanks & Regards,

Prem

Thanks for taking the time to rate our posts.  :)

I seem to be running into a similar, if not the exact same issue. I've seen a few articles stating that this is likly due to a bug, but I was hoping that you could confirm what version you were running prior to IOS upgrade and what you're running now. I realize it's a long shot because it's been a while. 

 

This is what I currently have:

 Dec 11 07:39:01.610 PST: %SPA_OIR-3-EVENT_TIMEOUT: subslot 0/1: Timeout waiting for SPA OIR event
-Traceback= 1#4091b00f8e2be70e7cdba3e27d90bc63 :55AE71E33000+C0CB343 :55AE71E33000+C0A2AA0 :55AE71E33000+9A984D7 :55AE71E33000+C09FEF2 :55AE71E33000+B369C69
Dec 11 07:39:02.979 PST: %SPA_OIR-3-EVENT_TIMEOUT: subslot 0/4: Timeout waiting for SPA OIR event
-Traceback= 1#4091b00f8e2be70e7cdba3e27d90bc63 :55AE71E33000+C0CB343 :55AE71E33000+C0A2AA0 :55AE71E33000+9A984D7 :55AE71E33000+C09FEF2 :55AE71E33000+B369C69
Dec 11 07:39:06.611 PST: %SPA_OIR-3-RECOVERY_RELOAD: subslot 0/1: Attempting recovery by reloading SPA
Dec 11 07:39:06.615 PST: %SPA_OIR-6-OFFLINECARD: SPA (NIM-2FXS/4FXO) offline in subslot 0/1
Dec 11 07:39:07.980 PST: %SPA_OIR-3-RECOVERY_RELOAD: subslot 0/4: Attempting recovery by reloading SPA
Dec 11 07:39:07.983 PST: %SPA_OIR-6-OFFLINECARD: SPA (PVDM4-32) offline in subslot 0/4

 

The bug that I found is pointing specifically to NIM T1 cards, but the symptoms do appear to be very similar. Bug: https://quickview.cloudapps.cisco.com/quickview/bug/CSCus36896

 

Current boot image: isr4300-universalk9.16.04.01.SPA.bin

 

hi,

which IOS did you load.please mention in full

LauMath
Level 1
Level 1

I have the same problem in an ISR 4331 " subslot 0/2: Attempting recovery by reloading SPA"

The NIM-4FXO slot is "active" and "OK"
the NIM-4FXSP shows "rebooting"

%SPA_OIR-6-OFFLINECARD: SPA (NIM-4FXSP) offline in subslot 0/2

%SPA_OIR-3-EVENT_TIMEOUT: subslot 0/2: Timeout waiting for SPA OIR event
-Traceback= 1#00996a21ae914aca4b637c04ca379136 :7F11EF2F2000+C268B03 :7F11EF2F2000+C2401F0 :7F11EF2F2000+9B2E977 :7F11EF2F2000+C23D452 :7F11EF2F2000+B5B91C9

 

Already upgraded firmware, still no luck.

 

Any help will be very appreciated!

 

Hi, how did you solve your problem?

Hi! The issue was resolved after I installed the newest image available for the gateway. After that, everything started to work accordingly. In my case, I used isr4300-universalk9.16.09.03.SPA. I hope this information helps you!

Muthukumar P
Level 1
Level 1

HI Team,

               We are facing same problem in ISR 4321 Router and which version suggested for this issue. Could confirm on this?

Thanks

Muthukumar

Got a 4331 with the same symptoms and running  isr4300-universalk9.16.09.04.SPA.  I see the message on different cards 

 

010386: Mar 24 13:23:29.292 EST: %SPA_OIR-3-RECOVERY_RELOAD: subslot 0/1: Attempting recovery by reloading SPA
010387: Mar 24 13:23:29.293 EST: %SPA_OIR-6-OFFLINECARD: SPA (NIM-1GE-CU-SFP) offline in subslot 0/1
010388: Mar 24 13:23:35.177 EST: %SPA_OIR-3-HW_INIT_TIMEOUT: subslot 0/4
010389: Mar 24 13:23:39.250 EST: %SPA_OIR-3-HW_INIT_TIMEOUT: subslot 0/2
010390: Mar 24 13:23:40.176 EST: %SPA_OIR-3-RECOVERY_RELOAD: subslot 0/4: Attempting recovery by reloading SPA
010391: Mar 24 13:23:40.178 EST: %FARM_DSPRM-6-CARDREMOVEINFO: dspfarm card slot 4 is removed.
010392: Mar 24 13:23:40.180 EST: %SPA_OIR-6-OFFLINECARD: SPA (PVDM4-32) offline in subslot 0/4
010393: Mar 24 13:23:44.250 EST: %SPA_OIR-3-RECOVERY_RELOAD: subslot 0/2: Attempting recovery by reloading SPA
010394: Mar 24 13:23:44.253 EST: %SPA_OIR-6-OFFLINECARD: SPA (NIM-2FXO) offline in subslot 0/2

 Is this a software bug or there is any fix for this issue that could be apply on this situation is really appreciate. 

PaulReveco
Level 1
Level 1

 

 

Hi, 

I have a similar problem where the NIM restarts, I saw a link where it talks about updating the rommon, there I have my doubts about the application, anyway I'm going to try updating the IOS.

 

https://zartmann.dk/2018/02/09/isr4321-switch-module-not-working-cpld-incompatibility/

 

RP uptime is 1 week, 4 hours, 2 minutes
Uptime for this control processor is 1 week, 4 hours, 4 minutes
System returned to ROM by PowerOn
System restarted at 10:12:58 CHI Fri Feb 25 2022
System image file is "bootflash:isr4300-universalk9.16.06.04.SPA.bin"
Last reload reason: PowerOn



CUBE#show platform
Chassis type: ISR4331/K9

Slot Type State Insert time (ago)
--------- ------------------- --------------------- -----------------
0 ISR4331/K9 ok 1w0d
0/0 ISR4331-3x1GE ok 1w0d
0/1 NIM-4FXO booting 00:04:27
0/4 PVDM4-32 booting 00:04:34
1 ISR4331/K9 ok 1w0d
R0 ISR4331/K9 ok, active 1w0d
F0 ISR4331/K9 ok, active 1w0d
P0 PWR-4330-AC ok 1w0d
P2 ACS-4330-FANASSY ok 1w0d

Slot CPLD Version Firmware Version
--------- ------------------- ---------------------------------------
0 19040541 16.7(3r)
1 19040541 16.7(3r)
R0 19040541 16.7(3r)
F0 19040541 16.7(3r)


CUBEP#sh hw-module subslot 0/1 oir
Module Model Operational Status
------------- -------------------- ------------------------
subslot 0/1 NIM-4FXO booting

CUBE#sh hw-module subslot 0/4 oir
Module Model Operational Status
------------- -------------------- ------------------------
subslot 0/4 PVDM4-32 booting

 

michael dsilva
Level 1
Level 1

"The following are two scripts, one from a working unit and the other from a unit in boot. The module is stuck in the initialization loop. I researched and found that a resynchronization might need to be performed. However, to resolve the issue with the module in boot, we always end up swapping the router, and then the UCSE module works normally. I've seen some colleagues recover by upgrading the iOS or by removing and reinserting the DIMM memory. My version is IOS XE 16.9.3, router 4331, UCS-E160S-M3/K9 - UCSE SW Module. However, I am unfamiliar with this kind of attempt; at least, it has never worked for me."

Thank's

Add: We noticed that the module's boot problem occurs due to power overload on the router or spikes or drops
If anyone managed to solve it without changing the router, please let us know.

module in boot
RTB1ST000198# show hw-module subslot 1/0 attribute
Slot 1 Bay 0 Board 0 Module[UCS-E160S-M3/K9] spa_type 0xB3F Daughter Board Not Present
Base mac_addr 10b3.d62c.ff70 mac_blk_sz 10 Endpt MAC Address offset(s) : 4
Basic attributes : length 12, version [3], module-type [alien], width [Single Wide]
Power Rating [85], Control Endpoint count [1], Daughter Board Count [0]
KR Support [0x00], 16-bit GPIO [Not present], Submodule reset support [Not required]


Extended Attributes for [UCS-E160S-M3/K9 - UCSE SW Module]
GPIO Pin Information
Output Pin[Uart mux select]


I2C Information
[dev_addr 0xB dev_type quack]


Port type UCSE Range [0 1] Per-port Information : Max IID [0] Connector [none] Network clocking [disable]
Module OID: 1 3 6 1 4 1 9 12 3 1 9 80 24
Port OID: 1 3 6 1 4 1 9 12 3 1 10 109
Module port names: TE2 TE3 NONE NONE NONE

 

RTB1ST000198# show hw-module subslot 1/0 en
RTB1ST000198# show hw-module subslot 1/0 entity
WARNING: This command is not intended for production use
and should only be used under the supervision of
Cisco Systems technical support personnel.


Entity state for SPA in subslot 1/0
SPA type: (0xB3F) UCS-E160S-M3/K9
last spa type: (0xB3F) UCS-E160S-M3/K9
oper_status: (5) booting
card status: (1) partial
last trap: spa type: (0xB3F) UCS-E160S-M3/K9
last trap: oper status: (5) booting
last_spa_env_get_ok: false
last_spa_env_read_time: (92323311) 435052301 msecs ago
resync_reqd: true
resync_count: 4


SPA physical index: 3015
SPA container index: 3001


SPA has no transceiver subblock
non-zero port indices:
all port indices are zero


non-zero SPA temp sensors:
all temp sensor indices are zero

non-zero SPA volt sensors:
all volt sensor indices are zero


non-zero SPA power sensors:
all power sensor indices are zero


RTB1ST000198# show hw-module subslot 1/0 sesn
RTB1ST000198# show hw-module subslot 1/0 se
RTB1ST000198# show hw-module subslot 1/0 sensors
UCS-E160S-M3/K9[1/0] power sensor 0, reading: no reading


RTB1ST000198# show hw-module subslot 1/0 sub
RTB1ST000198# show hw-module subslot 1/0 subblock
WARNING: This command is not intended for production use
and should only be used under the supervision of
Cisco Systems technical support personnel.
UCS-E160S-M3/K9[1/0]: SPA UCSE Module Subblock
UCS-E160S-M3/K9[1/0]: spa subblock 'SPA Controller sub-block'
subslot 1/0: bay subblock 'SPA Entity subblock'
subslot 1/0: bay subblock 'mcprp spa ha sb'

Module ok

[14:42] Michael Douglas Pereira Da Silva

RTB1ST000650#show hw-module subslot 1/0 entity
WARNING: This command is not intended for production use
and should only be used under the supervision of
Cisco Systems technical support personnel.


Entity state for SPA in subslot 1/0
SPA type: (0xB3F) UCS-E160S-M3/K9
last spa type: (0xB3F) UCS-E160S-M3/K9
oper_status: (1) ok
card status: (2) full
last trap: spa type: (0xB3F) UCS-E160S-M3/K9
last trap: oper status: (1) ok
last_spa_env_get_ok: true
last_spa_env_read_time: (175633135) 15714653 msecs ago
resync_reqd: false
resync_count: 0


SPA physical index: 3015
SPA container index: 3001


SPA has no transceiver subblock
non-zero port indices:
port 0 has index 3016
port 1 has index 3017


non-zero SPA temp sensors:
all temp sensor indices are zero


non-zero SPA volt sensors:
all volt sensor indices are zero


non-zero SPA power sensors:
sensor 0 has index 3116


RTB1ST000650#show hw-module subslot 1/0 attribute
Slot 1 Bay 0 Board 0 Module[UCS-E160S-M3/K9] spa_type 0xB3F Daughter Board Not Present
Base mac_addr 084f.a9f4.03ca mac_blk_sz 10 Endpt MAC Address offset(s) : 4
Basic attributes : length 12, version [3], module-type [alien], width [Single Wide]
Power Rating [85], Control Endpoint count [1], Daughter Board Count [0]
KR Support [0x00], 16-bit GPIO [Not present], Submodule reset support [Not required]


Extended Attributes for [UCS-E160S-M3/K9 - UCSE SW Module]
GPIO Pin Information
Output Pin[Uart mux select]


I2C Information
[dev_addr 0xB dev_type quack]


Port type UCSE Range [0 1] Per-port Information : Max IID [0] Connector [none] Network clocking [disable]
Module OID: 1 3 6 1 4 1 9 12 3 1 9 80 24
Port OID: 1 3 6 1 4 1 9 12 3 1 10 109
Module port names: TE2 TE3 NONE NONE NONE

 

RTB1ST000650#show hw-module subslot 1/0 entity
WARNING: This command is not intended for production use
and should only be used under the supervision of
Cisco Systems technical support personnel.


Entity state for SPA in subslot 1/0
SPA type: (0xB3F) UCS-E160S-M3/K9
last spa type: (0xB3F) UCS-E160S-M3/K9
oper_status: (1) ok
card status: (2) full
last trap: spa type: (0xB3F) UCS-E160S-M3/K9
last trap: oper status: (1) ok
last_spa_env_get_ok: true
last_spa_env_read_time: (175633135) 16553145 msecs ago
resync_reqd: false
resync_count: 0


SPA physical index: 3015
SPA container index: 3001


SPA has no transceiver subblock
non-zero port indices:
port 0 has index 3016
port 1 has index 3017


non-zero SPA temp sensors:
all temp sensor indices are zero


non-zero SPA volt sensors:
all volt sensor indices are zero


non-zero SPA power sensors:
sensor 0 has index 3116


RTB1ST000650#show hw-module subslot 1/0 oir
Module Model Operational Status
------------- -------------------- ------------------------
subslot 1/0 UCS-E160S-M3/K9 ok


RTB1ST000650#show hw-module subslot 1/0 sensors
UCS-E160S-M3/K9[1/0] power sensor 0, reading: 39 Watts


RTB1ST000650#show hw-module subslot 1/0 subblock
WARNING: This command is not intended for production use
and should only be used under the supervision of
Cisco Systems technical support personnel.
UCS-E160S-M3/K9[1/0]: SPA UCSE Module Subblock
UCS-E160S-M3/K9[1/0]: spa subblock 'SPA Controller sub-block'
subslot 1/0: bay subblock 'SPA Entity subblock'
subslot 1/0: bay subblock 'mcprp spa ha sb'


RTB1ST000650#


003220: Dec 7 11:06:06.313 BRSPO: %SPA_OIR-3-HW_INIT_TIMEOUT: subslot 1/0
003221: Dec 7 11:06:11.313 BRSPO: %SPA_OIR-3-RECOVERY_RELOAD: subslot 1/0: Attempting recovery by reloading SPA
003222: Dec 7 11:06:11.320 BRSPO: %SPA_OIR-6-OFFLINECARD: SPA (UCS-E160S-M3/K9) offline in subslot 1/0
003223: Dec 7 11:13:16.345 BRSPO: %SPA_OIR-3-HW_INIT_TIMEOUT: subslot 1/0
003224: Dec 7 11:13:21.344 BRSPO: %SPA_OIR-3-RECOVERY_RELOAD: subslot 1/0: Attempting recovery by reloading SPA
003225: Dec 7 11:13:21.351 BRSPO: %SPA_OIR-6-OFFLINECARD: SPA (UCS-E160S-M3/K9) offline in subslot 1/0
003226: Dec 7 11:20:26.371 BRSPO: %SPA_OIR-3-HW_INIT_TIMEOUT: subslot 1/0
003227: Dec 7 11:20:31.370 BRSPO: %SPA_OIR-3-RECOVERY_RELOAD: subslot 1/0: Attempting recovery by reloading SPA
003228: Dec 7 11:20:31.377 BRSPO: %SPA_OIR-6-OFFLINECARD: SPA (UCS-E160S-M3/K9) offline in subslot 1/0

 

 

BalajiSivaraj49175
Spotlight
Spotlight

- The software version on the device is rather old ; I would advise to upgrade to :
    https://software.cisco.com/download/home/286006221/type/282046477/release/Dublin-17.12.3a

    + If considering , take care of the Release Notes , look for sections related to upgrade paths and or needed
       ROMMON versions , if applicable

   - Afterwards , check the boot process : you can also re-seat a card if the problem persists but attach a console to
     the device first to look for messages , or when connected with SSH use the command terminal monitor to get output of
     the console (too)