NCS55A2 router issue after 'reload'

[TelesEC]

Hello everyone,

I have an NCS55A2 router that I mistakenly rebooted using the 'reload' command, but the router only has a single supervisor card. After issuing the command, I encountered several issues regaining console access to the device, and now I can only access it in admin mode. Could anyone help me restore the device?

sysadmin-vm:0_RP0# show vm
Location: 0/RP0
Id Status IP Address HB Sent/Recv
-------------------------------------------------------------
sysadmin running 192.0.0.1 NA/NA
default-sdr shutoff 192.0.0.4 0/0
default-sdr shutoff 192.0.0.6 0/0

Thanks in advance.

@ios-XR

[mmachari]

Hi @TelesEC,

Try with “CTRL +O” on your keyboard and see if it will exit/cycle from the sysadmin to XR vm.

Regards,

Martin

[TelesEC]

Hi Martin, thanks for your comment, I will try Ctrl+"o". Regards,

[smilstea]

Looks like the RP and LC VMs are shutoff and only sysadmin is running.
The syslogs from sysadmin might help. If you just want to try and recover try a 'hw-module loc all reload'. Note when you did reload (either from sysadmin or exec/xr) it only reloads the VM and not the hardware, hw-module is the proper way to reload.
It is also possible you just need to wait a little longer for the VMs to come up, but syslog should say what is going on.

If its stuck we can gather a few show techs like os, ctrace, install, hb-loss.

Sam

[TelesEC]

Hello Sam,

Thank you for your response. The router doesn’t have any configuration, just the management IP, and since I’m used to IOS-XE and NX-OS, I did a reload on that equipment without thinking, and it spent over half an hour rebooting with errors, eventually ending up in admin mode.

What I want is to regain normal access to the router, as it was before the 'reload.' The version is 7.9.1, so I’ll try the command 'hw-module loc all reload' to try to recover the router.

Regards, 

[TelesEC]

Hi, In the attached file, you will find the 'show logg'. Thanks a lot.

[smilstea]

If the reload of the entire router with the hw-module command doesn't bring up the default-SDR (XR VM) then we should go for RMA.
There is a chance it's an issue caused by having used the 'reload' command and going headless.

But essentially everytime sysadmin tried to bring up the XR VM we get an LXC crash file and auto-reload to try and recover the VM. There are also some CPU errors but they could be harmless.

If you really want an RCA then we would have to provision the mgmt. port on sysadmin or insert a USB and copy several show techs off the box.

Sam

[TelesEC]

The news isn't so good... During working hours, I'll run the hw-module command, hoping the issue gets resolved regards,

[TelesEC]

Hello Sam, it didn't work, so the only option left is the RMA?

[smilstea]

I would RMA. Please open a ticket with TAC and include the syslogs you provided.

Sam

[TelesEC]

Thanks Sam. I will do it. The equipment is practically new, and it was restarted to prepare for a later upgrade, so was it the "reload" command that affected the router? Is there any specific reason that could explain it? Thanks for your time & help.

[Cristian Matei]

Hi,

     I would try an upgrade first, I've seen enough similar bugs, not exactly with same logs, but very similar.

Best,

Cristian.

[TelesEC]

Hi, The router is on version 7.9.2, and I wasn't planning on performing an upgrade, so I'm not sure if there's another image (.tar) on it. Regards,

[Cristian Matei]

Hi,

    Download a newer image (maintenance / stable version) and perform the upgrade, I'd say there are good chances on fixing it this way; after the upgrade, perform a reload via "hw-module loc all reload" to validate it comes back alive. https://www.cisco.com/c/en/us/td/docs/iosxr/ncs5500/system-setup/711x/configuration/guide/b-system-setup-cg-ncs5500-711x/m-install-ios-xr-software.html

Best,

Cristian.