Solved: Re: ASR-920-12CZ-A interface offline

vedanth@tglobalin.com · ‎07-14-2018

Hello all,

%SPA_OIR-6-OFFLINECARD: SPA (12xGE-2x10GE-FIXED) offline in subslot 0/0

I am getting this above error in one of the working ASR-920-12CZ-A router..

the the one gig ports are perfectly fine also the ten gig ports...its all in "no shutdown" state...Could somebody help me understanding what exactly the error is all about ?

here is the log of the router I have highlighted the event:

Calculating SHA-1 hash...done
validate_package: SHA-1 hash:
calculated 220e0548:2d9db03b:40f90222:ea7bcab9:a0cc136e
expected 220e0548:2d9db03b:40f90222:ea7bcab9:a0cc136e
invalid RP package type 1000
Warning: filesystem is not clean
Located asr920-universalk9_npe.03.18.00.sp.156-2.sp-ext.bin
Image size 331586556 inode num 32, bks cnt 80954 blk size 8*512
#######################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################################
Boot image size = 331586556 (0x13c39bfc) bytes

Package header rev 2 structure detected
Calculating SHA-1 hash...done
validate_package: SHA-1 hash:
calculated b2dc9cd5:b580a621:e8747f71:636e0e99:a50920ef
expected b2dc9cd5:b580a621:e8747f71:636e0e99:a50920ef
Image validated
Passing control to the main image..
%IOSXEBOOT-4-FILESYS_ERRORS_CORRECTED: (rp/0): bootflash 1 contained errors which were auto-corrected.
%IOSXEBOOT-4-FILESYS_ERRORS_CORRECTED: (rp/0): bootflash 5 contained errors which were auto-corrected.
%IOSXEBOOT-4-FILESYS_ERRORS_CORRECTED: (rp/0): bootflash 6 contained errors which were auto-corrected.
%IOSXEBOOT-4-FILESYS_ERRORS_CORRECTED: (rp/0): bootflash 7 contained errors which were auto-corrected.
%IOSXEBOOT-4-FILESYS_ERRORS_CORRECTED: (rp/0): bootflash 8 contained errors which were auto-corrected.

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software, ASR920 Software (PPC_LINUX_IOSD-UNIVERSALK9_NPE-M), Version 15.6(2)SP, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2016 by Cisco Systems, Inc.
Compiled Wed 27-Jul-16 09:11 by mcpre

Cisco IOS-XE software, Copyright (c) 2005-2016 by cisco Systems, Inc.
All rights reserved. Certain components of Cisco IOS-XE software are
licensed under the GNU General Public License ("GPL") Version 2.0. The
software code licensed under GPL Version 2.0 is free software that comes
with ABSOLUTELY NO WARRANTY. You can redistribute and/or modify such
GPL code under the terms of GPL Version 2.0. For more details, see the
documentation or "License Notice" file accompanying the IOS-XE software,
or the applicable URL provided on the flyer accompanying the IOS-XE
software.

Tmpdisk creation successful, status = 0
flashfs[16]: 0 files, 1 directories
flashfs[16]: 0 orphaned files, 0 orphaned directories
flashfs[16]: Total bytes: 1935360
flashfs[16]: Bytes used: 1024
flashfs[16]: Bytes available: 1934336
This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

cisco ASR-920-12CZ-A (Freescale P2020) processor (revision 1.0 GHz) with 901400K/6147K bytes of memory.
Processor board ID CAT1903U0DM
12 Gigabit Ethernet interfaces
2 Ten Gigabit Ethernet interfaces
32768K bytes of non-volatile configuration memory.
3670016K bytes of physical memory.
1328927K bytes of SD flash at bootflash:.

Press RETURN to get started!

*Jul 9 05:32:14.192: %SMART_LIC-6-AGENT_READY: Smart Agent for Licensing is initialized
*Jul 9 05:32:16.541: %IOS_LICENSE_IMAGE_APPLICATION-6-LICENSE_LEVEL: Module name = ASR-920-12CZ-A Next reboot level = advancedmetroipaccess and License = advancedmetroipaccess
*Jul 9 05:32:36.682: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled for type vlanCannot Get the number of ports in MAC notification

*Jul 9 05:32:40.104: %LINK-3-UPDOWN: Interface Lsmpi0, changed state to up
*Jul 9 05:32:40.106: %LINK-3-UPDOWN: Interface EOBC0, changed state to up
*Jul 9 05:32:40.106: %LINEPROTO-5-UPDOWN: Line protocol on Interface LI-Null0, changed state to up
*Jul 9 05:32:40.107: %LINK-3-UPDOWN: Interface GigabitEthernet0, changed state to down
*Jul 9 05:32:40.127: %LINK-3-UPDOWN: Interface LIIN0, changed state to up
*Jul 9 05:32:40.873: %LINEPROTO-5-UPDOWN: Line protocol on Interface Lsmpi0, changed state to up
*Jul 9 05:32:40.873: %LINEPROTO-5-UPDOWN: Line protocol on Interface EOBC0, changed state to up
*Jul 9 05:32:40.874: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to down
*Jul 9 05:32:40.874: %LINEPROTO-5-UPDOWN: Line protocol on Interface LIIN0, changed state to up
*Jul 9 05:32:41.038: %IOSXE_MGMTVRF-6-CREATE_SUCCESS_INFO: Management vrf Mgmt-intf created with ID 1, ipv4 table-id 0x1, ipv6 table-id 0x1E000001
*Jul 9 05:32:44.969: %SYS-5-CONFIG_I: Configured from memory by console
*Jul 9 05:32:44.982: %IOSXE_OIR-6-REMSPA: SPA removed from subslot 0/0, interfaces disabled
*Jul 9 05:32:45.013: %SPA_OIR-6-OFFLINECARD: SPA (12xGE-2x10GE-FIXED) offline in subslot 0/0
*Jul 9 05:32:45.235: %SYS-5-RESTART: System restarted --
Cisco IOS Software, ASR920 Software (PPC_LINUX_IOSD-UNIVERSALK9_NPE-M), Version 15.6(2)SP, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2016 by Cisco Systems, Inc.
Compiled Wed 27-Jul-16 09:11 by mcpre
*Jul 9 05:32:47.691: %IOSXE_OIR-6-INSCARD: Card (fp) inserted in slot F0
*Jul 9 05:32:47.691: %IOSXE_OIR-6-ONLINECARD: Card (fp) online in slot F0
*Jul 9 05:32:47.692: %IOSXE_OIR-6-INSCARD: Card (cc) inserted in slot 0
*Jul 9 05:32:47.692: %IOSXE_OIR-6-ONLINECARD: Card (cc) online in slot 0
*Jul 9 05:32:47.779: %IOSXE_OIR-6-INSSPA: SPA inserted in subslot 0/0
Authentication passed

Router>en
Router#sh inv
*Jul 9 05:33:24.116: Bulk port license Activated

*Jul 9 05:33:24.152: %SPA_OIR-6-ONLINECARD: SPA (12xGE-2x10GE-FIXED) online in subslot 0/0
*Jul 9 05:33:25.750: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/0, changed state to down
*Jul 9 05:33:25.846: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/1, changed state to down
*Jul 9 05:33:25.895: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/2, changed state to down
*Jul 9 05:33:25.954: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/3, changed state to down
*Jul 9 05:33:26.050: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/4, changed state to down
*Jul 9 05:33:26.050: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/5, changed state to down
*Jul 9 05:33:26.050: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/6, changed state to down
*Jul 9 05:33:26.051: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/7, changed state to down
*Jul 9 05:33:26.051: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/8, changed state to down
*Jul 9 05:33:26.051: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/9, changed state to down
*Jul 9 05:33:26.052: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/10, changed state to down
*Jul 9 05:33:26.052: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/11, changed state to down
*Jul 9 05:33:26.052: %LINK-3-UPDOWN: Interface TenGigabitEthernet0/0/12, changed state to down
*Jul 9 05:33:26.053: %LINK-3-UPDOWN: Interface TenGigabitEthernet0/0/13, changed state to down[OK]
NAME: "Chassis", DESCR: "Cisco ASR920 Series - 12GE and 2-10GE - AC model"
PID: ASR-920-12CZ-A , VID: V01, SN: CAT1903U0DM

Georg Pauwen · ‎07-14-2018

Hello,

I looked around, it is possible that the FPD image is corrupted. Try and use the command 'upgrade hw-module subslot fpd bundled' to recover the image.

View solution in original post

Georg Pauwen · ‎07-14-2018

Hello,

I looked around, it is possible that the FPD image is corrupted. Try and use the command 'upgrade hw-module subslot fpd bundled' to recover the image.

vedanth@tglobalin.com · ‎07-15-2018

@Georg Pauwen thnaks for the reverting on this... sure i will try this out and come back with the results

vedanth@tglobalin.com · ‎07-16-2018

Hello @Georg Pauwen

earlier for the same below command the output for STATUS was "out of service"(failed too many times)............ now its showing OK: (highlighted on red) and all of a sudden the remaining gig ports changed it states to up and down is this normal ????

Router#sh hw-module subslot all oir
Module Model Operational Status
------------- -------------------- ------------------------
subslot 0/0 12xGE-2x10GE-FIXED ok

Router#sh hw-module subslot all fpd

==== ====================== ====== =============================================
H/W Field Programmable Current Min. Required
Slot Card Type Ver. Device: "ID-Name" Version Version
==== ====================== ====== ================== =========== ==============
0/0 12xGE-2x10GE-FIXED 1.0 N/A N/A N/A
==== ====================== ====== =============================================

Router#
*Jul 16 08:31:19.286: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/7, changed state to up
*Jul 16 08:31:19.956: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/5, changed state to up
*Jul 16 08:31:19.971: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/6, changed state to up
*Jul 16 08:31:19.986: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/7, changed state to up
*Jul 16 08:31:21.250: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/4, changed state to up
*Jul 16 08:31:21.263: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/5, changed state to up
*Jul 16 08:31:21.274: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/6, changed state to up
*Jul 16 08:31:21.950: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/4, changed state to up
*Jul 16 08:31:24.259: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/5, changed state to down
*Jul 16 08:31:24.263: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/6, changed state to down
*Jul 16 08:31:26.263: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/5, changed state to up
*Jul 16 08:31:26.274: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/6, changed state to up
*Jul 16 08:31:26.950: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/4, changed state to down
*Jul 16 08:31:28.951: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/4, changed state to up
*Jul 16 08:31:38.250: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/4, changed state to down
*Jul 16 08:31:38.950: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/4, changed state to down
*Jul 16 08:31:39.260: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/5, changed state to down
*Jul 16 08:31:39.959: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/5, changed state to down
*Jul 16 08:31:41.259: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/6, changed state to down
*Jul 16 08:31:41.266: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/7, changed state to down
*Jul 16 08:31:41.967: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/7, changed state to down
*Jul 16 08:31:43.986: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/6, changed state to down
*Jul 16 08:31:46.283: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/7, changed state to up
*Jul 16 08:31:46.950: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/5, changed state to up
*Jul 16 08:31:46.968: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/6, changed state to up
*Jul 16 08:31:46.983: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/7, changed state to up
*Jul 16 08:31:48.254: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/5, changed state to up
*Jul 16 08:31:48.267: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/6, changed state to up
*Jul 16 08:31:49.250: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/4, changed state to up
*Jul 16 08:31:49.952: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/4, changed state to up
*Jul 16 08:31:53.254: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/5, changed state to down
*Jul 16 08:31:53.264: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/6, changed state to down
*Jul 16 08:31:53.267: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/7, changed state to down
*Jul 16 08:31:53.955: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/5, changed state to down
*Jul 16 08:31:53.962: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/6, changed state to down
*Jul 16 08:31:53.967: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/7, changed state to down
*Jul 16 08:31:54.251: %LINK-3-UPDOWN: Interface GigabitEthernet0/0/4, changed state to down
*Jul 16 08:31:54.951: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0/4, changed state to down
Router#sh ver
Cisco IOS XE Software, Version 03.18.00.SP.156-2.SP-ext
Cisco IOS Software, ASR920 Software (PPC_LINUX_IOSD-UNIVERSALK9_NPE-M), Version 15.6(2)SP, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2016 by Cisco Systems, Inc.
Compiled Wed 27-Jul-16 09:11 by mcpre

Cisco IOS-XE software, Copyright (c) 2005-2016 by cisco Systems, Inc.
All rights reserved. Certain components of Cisco IOS-XE software are
licensed under the GNU General Public License ("GPL") Version 2.0. The
software code licensed under GPL Version 2.0 is free software that comes
with ABSOLUTELY NO WARRANTY. You can redistribute and/or modify such
GPL code under the terms of GPL Version 2.0. For more details, see the
documentation or "License Notice" file accompanying the IOS-XE software,
or the applicable URL provided on the flyer accompanying the IOS-XE
software.

ROM: IOS-XE ROMMON

Router uptime is 39 minutes
Uptime for this control processor is 42 minutes
System returned to ROM by reload
System image file is "bootflash:/asr920-universalk9_npe.03.18.00.sp.156-2.sp-ext.bin"
Last reload reason: PowerOn

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

License Level: advancedmetroipaccess
License Type: Permanent
Next reload license Level: advancedmetroipaccess

cisco ASR-920-12CZ-A (Freescale P2020) processor (revision 1.0 GHz) with 901400K/6147K bytes of memory.
Processor board ID CAT1903U0DM
12 Gigabit Ethernet interfaces
2 Ten Gigabit Ethernet interfaces
32768K bytes of non-volatile configuration memory.
3670016K bytes of physical memory.
1328927K bytes of SD flash at bootflash:.

Configuration register is 0x2102

Router# wr mem
Building configuration...
[OK]

shall i try upgrading the FPD image bundle as u suggested ?