Re: ASR1006 ASR1000-RP2 Unknown state after CPLD upgrade

ez9 · ‎07-03-2021

Hello,

I tried to upgrade the CPLD version on one ASR1000-RP2 card. The upgrade is finished ok and the cli prompts for a power cycle. I check with the command (show upgrade hw-programmable progress) and I proceeded to a power cycle but the RP is not powering anymore. All leds are switched off (including power led). I tried to boot the chassis using another RP and execute some commands:

#show diag slot R1 eeprom detail
Slot R1 EEPROM data is not initialized

#show inventory

NAME: "module R1", DESCR: "Cisco ASR1000 Unknown Route Processor"
PID: ASR1000-RP-UNKNOWN, VID: , SN:

#show platform

Slot Type State Insert time (ago)
--------- ------------------- --------------------- -----------------

R1 unknown 00:07:26

Do you have any suggestions for this issue?

mgrabovs · ‎07-03-2021

Hello,

Looking at this, it would be great to have some more information about the status of this RP and box itself.

Is it feasible to collect information with these commands:

show version
show platform
show inventory
show logging

Also, from which to which CPLD version did you upgrade?

Thank you.

Marin

Leo Laohoo · ‎07-03-2021

@ez9 wrote:

#show platform

Slot Type State Insert time (ago)
--------- ------------------- --------------------- -----------------

R1 unknown 00:07:26

Is this a defense or security/intelligence network? If it is, raise a TAC Case.

If it is not, do not "over edit" anything because we need to see the complete output.

ez9 · ‎07-04-2021

Hello,

Thats the full output of the commads:

I boot the chassis using one RP1 on R0 seat. The RP2 is on R1 seat.

The show log command is executed after #hw-module slot R1 reload. The RP2 after it changes from unkown to disabled state.

If you need some other command outputs, please let me know.

I have not a sh version before CPLD upgrade. This is a show platform output before the CPLD upgrade:

#sh platform
Chassis type: ASR1006

Slot Type State Insert time (ago)
--------- ------------------- --------------------- -----------------
0 ASR1000-SIP10 ok 00:05:09
R0 ASR1000-RP2 ok, active 00:05:09
F0 ASR1000-ESP20 ok, active 00:05:09
P0 ASR1006-PWR-AC ok 00:04:11
P1 ASR1006-PWR-AC ok 00:04:10

Slot CPLD Version Firmware Version
--------- ------------------- ---------------------------------------
0 N/A N/A
R0 10021901 16.9(5r)
F0 08041102 12.2(33r)XNC

After upgrade (using RP1):

#sh platform
Chassis type: ASR1006

Slot Type State Insert time (ago)
--------- ------------------- --------------------- -----------------
0 ASR1000-SIP10 ok 00:05:40
0/0 SPA-1X10GE-L-V2 ok 00:04:03
0/2 SPA-1X10GE-L-V2 ok 00:03:54
R0 ASR1000-RP1 ok, active 00:13:36
R1 unknown 00:07:26
F0 ASR1000-ESP20 ok, active 00:07:38
P0 ASR1006-PWR-AC ok 00:11:16
P1 ASR1006-PWR-AC ok 00:11:14

Slot CPLD Version Firmware Version
--------- ------------------- ---------------------------------------
0 07091401 12.2(33r)XN2
R0 07062111 12.2(33r)XNC
R1 N/A N/A
F0 08041102 12.2(33r)XNC

#show inventory
NAME: "Chassis", DESCR: "Cisco ASR1006 Chassis"
PID: ASR1006 , VID: V02, SN:

NAME: "module 0", DESCR: "Cisco ASR1000 SPA Interface Processor 10"
PID: ASR1000-SIP10 , VID: V04, SN:

NAME: "SPA subslot 0/0", DESCR: "1-port 10 Gigabit Ethernet Shared Port Adapter XFP based"
PID: SPA-1X10GE-L-V2 , VID: V04, SN:

NAME: "subslot 0/0 transceiver 0", DESCR: "10GBASE-SR/SW"
PID: XFP-10G-MM-SR , VID: 02 , SN:

NAME: "SPA subslot 0/2", DESCR: "1-port 10 Gigabit Ethernet Shared Port Adapter XFP based"
PID: SPA-1X10GE-L-V2 , VID: V03, SN:

NAME: "subslot 0/2 transceiver 0", DESCR: "10GBASE-SR/SW"
PID: XFP-10G-MM-SR , VID: 02 , SN:

NAME: "module R0", DESCR: "Cisco ASR1000 Route Processor 1"
PID: ASR1000-RP1 , VID: V06, SN:

NAME: "module R1", DESCR: "Cisco ASR1000 Unknown Route Processor"
PID: ASR1000-RP-UNKNOWN, VID: , SN:

NAME: "module F0", DESCR: "Cisco ASR1000 Embedded Services Processor, 20Gbps"
PID: ASR1000-ESP20 , VID: V04, SN:

NAME: "Power Supply Module 0", DESCR: "Cisco ASR1006 AC Power Supply"
PID: ASR1006-PWR-AC , VID: V03, SN:

NAME: "Power Supply Module 1", DESCR: "Cisco ASR1006 AC Power Supply"
PID: ASR1006-PWR-AC , VID: V03, SN:

#sh log
Syslog logging: enabled (0 messages dropped, 1 messages rate-limited, 0 flushes, 0 overruns, xml disabled, filtering disabled)

No Active Message Discriminator.

No Inactive Message Discriminator.

Console logging: level debugging, 55 messages logged, xml disabled,
filtering disabled
Monitor logging: level debugging, 0 messages logged, xml disabled,
filtering disabled
Buffer logging: level debugging, 55 messages logged, xml disabled,
filtering disabled
Exception Logging: size (4096 bytes)
Count and timestamp logging messages: disabled
Persistent logging: disabled

No active filter modules.

Trap logging: level informational, 54 message lines logged
Logging Source-Interface: VRF Name:

Log Buffer (4096 bytes):
anged state to up
*Jul 2 13:12:26.354: %LINEPROTO-5-UPDOWN: Line protocol on Interface EOBC0, changed state to up
*Jul 2 13:12:26.355: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to down
*Jul 2 13:12:26.355: %LINEPROTO-5-UPDOWN: Line protocol on Interface LIIN0, changed state to up
*Jul 2 13:12:26.680: %IOSXE_MGMTVRF-6-CREATE_SUCCESS_INFO: Management vrf Mgmt-intf created with ID 1, ipv4 table-id 0x1, ipv6 table-id 0x1E000001
*Jul 2 13:12:29.601: %SYS-6-STARTUP_CONFIG_IGNORED: System startup configuration is ignored based on the configuration register setting.
*Jul 2 13:12:29.780: %IOSXE_OIR-6-INSCARD: Card (rp) inserted in slot R1
*Jul 2 13:12:29.782: %IOSXE_OIR-6-INSCARD: Card (fp) inserted in slot F0
*Jul 2 13:12:29.782: %IOSXE_OIR-6-ONLINECARD: Card (fp) online in slot F0
*Jul 2 13:12:29.939: % Redundancy mode change to SSO

*Jul 2 13:12:29.939: %VOICE_HA-7-STATUS: NONE->SSO; SSO mode will not take effect until after a platform reload.
*Jul 2 13:12:30.337: %SYS-5-RESTART: System restarted --
Cisco IOS Software, ASR1000 Software (PPC_LINUX_IOSD-ADVIPSERVICESK9-M), Version 15.5(3)S8, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2018 by Cisco Systems, Inc.
Compiled Wed 08-Aug-18 11:17 by mcpre
*Jul 2 13:12:31.244: %CRYPTO-6-GDOI_ON_OFF: GDOI is OFF
*Jul 2 13:12:31.244: %CRYPTO-6-ISAKMP_ON_OFF: ISAKMP is OFF
*Jul 2 13:12:36.115: %SYS-6-BOOTTIME: Time taken to reboot after reload = 28689409 seconds
*Jul 2 13:14:42.442: %IOSXE_OIR-6-OFFLINECARD: Card (fp) offline in slot F0
*Jul 2 13:14:42.874: %IOSXE_OIR-6-REMCARD: Card (fp) removed from slot F0
*Jul 2 13:14:43.325: %IOSXE_OIR-6-INSCARD: Card (fp) inserted in slot F0
*Jul 2 13:14:49.035: %LINK-3-UPDOWN: Interface GigabitEthernet0, changed state to up
*Jul 2 13:14:50.036: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to up
*Jul 2 13:14:53.563: %IOSXE_OIR-6-REMCARD: Card (rp) removed from slot R1
*Jul 2 13:14:55.152: %IOSXE_OIR-6-INSCARD: Card (rp) inserted in slot R1
*Jul 2 13:14:55.158: %IOSXE_OIR-6-OFFLINECARD: Card (rp) offline in slot R1
*Jul 2 13:15:11.519: %SYS-5-CONFIG_I: Configured from console by console
*Jul 2 13:15:38.652: %IOSXE_OIR-6-ONLINECARD: Card (fp) online in slot F0
*Jul 2 13:16:39.042: %LINK-3-UPDOWN: Interface GigabitEthernet0, changed state to down
*Jul 2 13:16:40.043: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to down
*Jul 2 13:16:41.107: %IOSXE_OIR-6-INSCARD: Card (cc) inserted in slot 0
*Jul 2 13:16:49.043: %LINK-3-UPDOWN: Interface GigabitEthernet0, changed state to up
*Jul 2 13:16:50.043: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to up
*Jul 2 13:17:17.095: %NETCLK-5-NETCLK_MODE_CHANGE: Network clock source not available. The network clock has changed to freerun
*Jul 2 13:17:41.728: %IOSXE_OIR-6-ONLINECARD: Card (cc) online in slot 0
*Jul 2 13:17:42.362: %IOSXE_OIR-6-INSSPA: SPA inserted in subslot 0/0
*Jul 2 13:17:42.681: %IOSXE_OIR-6-INSSPA: SPA inserted in subslot 0/2
*Jul 2 13:18:14.897: %LINK-3-UPDOWN: SIP0/0: Interface EOBC0/1, changed state to up
*Jul 2 13:18:21.915: %SPA_OIR-6-ONLINECARD: SPA (SPA-1X10GE-L-V2) online in subslot 0/0
*Jul 2 13:18:23.587: %LINK-3-UPDOWN: SIP0/2: Interface EOBC0/1, changed state to up
*Jul 2 13:18:28.597: %SYS-5-CONFIG_I: Configured from console by console
*Jul 2 13:18:30.157: %SPA_OIR-6-ONLINECARD: SPA (SPA-1X10GE-L-V2) online in subslot 0/2
*Jul 2 13:18:53.156: %SSH-5-ENABLED: SSH 1.99 has been enabled
*Jul 2 13:20:43.566: DNS: detail: log_addr: failed address 1.1.1.1 port 53
*Jul 2 13:21:47.567: DNS: detail: log_addr: failed address 8.8.8.8 port 53
*Jul 2 13:23:00.829: %PNP-6-PNP_DISCOVERY_STOPPED: PnP Discovery stopped (Aborted by non-PnP bootstrapping)
*Jul 2 13:32:59.973: %SYS-5-CONFIG_I: Configured from console by console

Leo Laohoo · ‎07-04-2021

Was the router rebooted?

ez9 · ‎07-05-2021

Hello,

Yes I rebooted the router in order to apply the CPLD upgrade. After the upgrade it prompts for a power cycle.

marce1000 · ‎07-05-2021

- FYI : https://bst.cloudapps.cisco.com/bugsearch/bug/CSCuw88499

M.

-- ' 'Good body every evening' ' this sentence was once spotted on a logo at the entrance of a Weight Watchers Club !

ez9 · ‎07-05-2021

Hello,

I checked this bug report. My RP is not powering at all. I don't know if in this reported issue the RP is working ok but the commads shows just the state as 'unknown'. In my case the RP is not working at all (the chassis is not booting using the RP).

Leo Laohoo · ‎07-05-2021

@ez9 wrote:

NAME: "module R1", DESCR: "Cisco ASR1000 Unknown Route Processor"
PID: ASR1000-RP-UNKNOWN, VID: , SN:

Re-seat RP1. I think it has crashed.

ez9 · ‎07-06-2021

I tried to re-seat it several times with no result. All the leds on the RP are off.

marce1000 · ‎07-06-2021

- Check if this command can give more info's : show facility-alarm status

M.

-- ' 'Good body every evening' ' this sentence was once spotted on a logo at the entrance of a Weight Watchers Club !

ez9 · ‎07-07-2021

#show facility-alarm status
System Totals Critical: 2 Major: 1 Minor: 0

Source Time Severity Description [Index]
------ ------ -------- -------------------
TenGigabitEthernet0/0/0 Jul 02 2021 14:05:32 CRITICAL Physical Port Link Down [35]
TenGigabitEthernet0/2/0 Jul 02 2021 14:05:33 CRITICAL Physical Port Link Down [35]
module R1 Jul 06 2021 14:10:38 MAJOR Disabled [2]

marce1000 · ‎07-07-2021

- I second Leo's opinion, probably has a fatal not recoverable problem.

M.

-- ' 'Good body every evening' ' this sentence was once spotted on a logo at the entrance of a Weight Watchers Club !

Leo Laohoo · ‎07-06-2021

Contact Cisco TAC and organize for the RMA of the RP1.

ez9 · ‎07-07-2021

Unfortunately, no TAC support for this RP. Is there anything else that I can try?