Cisco ISR C1117 - Boot up issues

[Stephen Carter]

Just going through normal s/w upgrade, and my C1100 isn't playing ball - getting this on boot up - 

Rom image verified correctly

System Bootstrap, Version 16.9(1r), RELEASE SOFTWARE
Copyright (c) 1994-2018 by cisco Systems, Inc.

Current image running: Boot ROM0

Last reset cause: PowerOn
C1117-4PLTEEA platform with 4194304 Kbytes of main memory

........

Located c1100-universalk9.17.12.04.SPA.bin
##########  (edited)  #########

Package header rev 3 structure detected
IsoSize = 646672384
Calculating SHA-1 hash...Validate package: SHA-1 hash:
calculated A8B62A2C:39123A26:B020DAF2:6EAE0132:A87C23B2
expected A8B62A2C:39123A26:B020DAF2:6EAE0132:A87C23B2

RSA Signed RELEASE Image Signature Verification Successful
Image validated
Rom image verified correctly

### AT this point - sit here for 3 /4 minutes - then - 

System Bootstrap, Version 16.9(1r), RELEASE SOFTWARE
Copyright (c) 1994-2018 by cisco Systems, Inc.

Current image running: Boot ROM0

Last reset cause: Unrecoverable Error
C1117-4PLTEEA platform with 4194304 Kbytes of main memory

and repeats....

Am thinking there's an issue with the new version 17.12.04 that the older C1100 doesn't like.

Anyone any ideas as to how to recover this unit back to a working state.

TIA

[marce1000]

 - What can sometimes happen is that you need to upgrade ROMMON on the device to be compatible with that image (check Release Notes).  You could try to interrupt the boot process according to https://community.cisco.com/t5/routing/how-to-interrupt-isr-4000-boot-process/m-p/2762620/highlight/true#M256890 and try to boot a compatible image through USB (if possible) ; or boot an existing compatible image from local flash manually , if possible , 

 M.

[Stephen Carter · Accepted solution]

ok, initial issue was that an ACL was being deleted on start up because of a bug, so another router was upgraded from 17.12.03 to 17.12.04.  I then naturally upgraded the 4LTE - however i'm thinking it was running 16.12 version, so the sudden jump to 17.12 screwed it up.

So using the download page - I found the oldest version 16.9 - and via the USB got that onto the box using - 

To boot from usb try 'boot usbflash0:image.name or usbflash1:image.name'. Once the router boots up then copy the ios image form the usb to the internal flash: drive and you are all set.

Then got a 'no valid BOOT image found' message.

Checked out a few pages and then upgraded to 16.12.07 or the like - and the device is now working with no issues.

Thanks again for your help.

https://community.cisco.com/t5/routing/new-c1111-4p-router-does-not-boot-anymore/td-p/4611768

https://www.cisco.com/c/en/us/support/docs/field-notices/723/fn72304.html

[Stephen Carter]

OK - further update - just so people don't panic - as there were 2 versions of s/w on the device, had to add in boot system command - 

hostname Router
!
boot-start-marker
boot system flash c1100-universalk9.16.12.08.SPA.bin
boot-end-marker

Did a reload - 

System Bootstrap, Version 16.9(1r), RELEASE SOFTWARE

C1117-4PLTEEA platform with 4194304 Kbytes of main memory

........

Located c1100-universalk9.16.12.08.SPA.bin
######## edited #######

System Bootstrap, Version 16.9(1r), RELEASE SOFTWARE
Current image running: Boot ROM0

Last reset cause: LocalSoft
C1117-4PLTEEA platform with 4194304 Kbytes of main memory

Rommon upgrade requested
Flash upgrade reset 1 in progress

It appears that it checks the new s/w version (which must come with any newer versions of ROMMON embedded)

and promptly re-boots the device again - 

System Bootstrap, Version 16.12(2r), RELEASE SOFTWARE
Copyright (c) 1994-2020 by cisco Systems, Inc.

Current image running: *Upgrade in progress* Boot ROM1

Last reset cause: BootRomUpgrade
C1117-4PLTEEA platform with 4194304 Kbytes of main memory

........

Located c1100-universalk9.16.12.08.SPA.bin
######### Edited ############

Normal cisco boot up blurb

Cisco IOS Software [Gibraltar], ISR Software (ARMV8EL_LINUX_IOSD-UNIVERSALK9-M), Version 16.12.8, RELEASE SOFTWARE (fc1)
Press RETURN to get started!

Router>
Router>en
Router#
Router#
Router#sh rom-monitor r0
==========================================================

System Bootstrap, Version 16.12(2r), RELEASE SOFTWARE
Copyright (c) 1994-2020 by cisco Systems, Inc.

Router#

[Leo Laohoo]

---

@Stephen Carter wrote:

System Bootstrap, Version 16.9(1r), RELEASE SOFTWARE​

---

The router has ROMMON version 16.9(1r) PLUS it's currently on 16.X.X. 

The intention is to conduct a direct firmware upgrade to 17.12.X.  

I do not believe this is going to work and I suspect the router will go into a boot-crash-loop.  

The reason is because, to go to 17.12.X (and later), the ROMMON version needs to be 17.5(1r).  Unfortunately, ROMMON version 17.5(1r) is not a downloadable file.  17.5(1r) is "rolled into" 17.6.X and 17.9.X but it has not been rolled into 17.12.X.  

Upgrade first to 17.6.X or 17.9.X before making a jump to 17.12.X (or later).  Failure to do so will cause the router to go into a boot-crash-loop.  

By the way, this is completely undocumented.  

[Stephen Carter]

Many Thanks for the reply, the initial task was to get the router back, as I'd upgraded from 16.x.x to 17.12.4 because of a bug to do with ACL's and got caught in the loop first mentioned.

Now knowing about the failure to upgrade ROMMON in later versions of 17.x.x. I'm now going to follow those steps and will report back on my findings.

[Stephen Carter]

So first part of the upgrade - and now understanding the process - so this is an upgrade from 16.12.08 to 17.06.08a - 

Router#
Router#reload
Proceed with reload? [confirm]

*Dec 6 09:58:07.418: %SYS-5-RELOAD: Reload requested by console. Reload ReasonXhcCheckUrbResult: STALL_ERROR! Completecode = 6
XhcControlTransfer: error - Device Error, transfer - 2
Rom image verified correctly

System Bootstrap, Version 16.12(2r), RELEASE SOFTWARE
Copyright (c) 1994-2020 by cisco Systems, Inc.

Current image running: Boot ROM1

Last reset cause: LocalSoft
C1117-4PLTEEA platform with 4194304 Kbytes of main memory

Located c1100-universalk9.17.06.08a.SPA.bin
######### edited ##########

Package header rev 3 structure detected
IsoSize = 647999488
Performing Integrity Check ...
Performing Signature Verification ...
RSA Signed RELEASE Image Signature Verification Successful
Image validated

Detected old ROMMON version 16.12(2r), upgrade required
Upgrading to newer ROMMON version required by this version of IOS-XE, do not power cycle the system. A reboot will automatically occur for the new ROMMON to take effect.
Booted : 1
Selected : 1
Reset Reason: 0
Switching to ROM 0
Upgrading ROMMON image...
Verifying ROMMON image...
Switching back to ROM 1
ROMMON upgrade was successful...
ROMMON upgrade complete.
To make the new ROMMON permanent, you must restart the RP.
ROMMON upgrade sXhcCheckUrbResult: STALL_ERROR! Completecode = 6
XhcControlTransfer: error - Device Error, transfer - 2
Rom image verified correctly

System Bootstrap, Version 16.12(2r), RELEASE SOFTWARE
Copyright (c) 1994-2020 by cisco Systems, Inc.

Current image running: Boot ROM1

Last reset cause: LocalSoft
C1117-4PLTEEA platform with 4194304 Kbytes of main memory

Rommon upgrade requested
Flash upgrade reset 1 in progress

........

XhcCheckUrbResult: STALL_ERROR! Completecode = 6
XhcControlTransfer: error - Device Error, transfer - 2
UsbBootExecCmd: Success to Exec 0x0 Cmd (Result = 1)
Rom image verified correctly

System Bootstrap, Version 17.5(1r), RELEASE SOFTWARE
Copyright (c) 1994-2021 by cisco Systems, Inc.

Current image running: *Upgrade in progress* Boot ROM0

Last reset cause: BootRomUpgrade
C1117-4PLTEEA platform with 4194304 Kbytes of main memory

........

Located c1100-universalk9.17.06.08a.SPA.bin
############# edited #############

Package header rev 3 structure detected
IsoSize = 647999488
Performing Integrity Check ...
Performing Signature Verification ...
RSA Signed RELEASE Image Signature Verification Successful
Image validated

Restricted Rights Legend

Press RETURN to get started!

Router>
Router>
Router>en
Router#
Router#sh ver

Cisco IOS XE Software, Version 17.06.08a
Cisco IOS Software [Bengaluru], ISR Software (ARMV8EL_LINUX_IOSD-UNIVERSALK9-M), Version 17.6.8a, RELEASE SOFTWARE (fc1)

Now onwards to 17.12.04 .....

[Stephen Carter]

Set the boot sys to the correct file -

Router(config)#boot sys flash c1100-universalk9.17.12.04.SPA.bin

Router#reload
Proceed with reload? [confirm]

*Dec 6 11:05:37.682: %SYS-5-RELOAD: Reload requested by console. Reload Reason: Reload Command.Rom image verified correctly

System Bootstrap, Version 17.5(1r), RELEASE SOFTWARE
Copyright (c) 1994-2021 by cisco Systems, Inc.

Current image running: Boot ROM0

Last reset cause: LocalSoft
C1117-4PLTEEA platform with 4194304 Kbytes of main memory

........

Located c1100-universalk9.17.12.04.SPA.bin
########## edited ########

Package header rev 3 structure detected
IsoSize = 646672384
Performing Integrity Check ...
Performing Signature Verification ...
RSA Signed RELEASE Image Signature Verification Successful
Image validated

Restricted Rights Legend

Cisco IOS Software [Dublin], ISR Software (ARMV8EL_LINUX_IOSD-UNIVERSALK9-M), Version 17.12.4, RELEASE SOFTWARE (fc3)

C1117-4PLTEEA (1RU) processor with 1341141K/6147K bytes of memory.

Press RETURN to get started!

Router>
Router>en
Router#
Router#sh ver
Cisco IOS XE Software, Version 17.12.04
Cisco IOS Software [Dublin], ISR Software (ARMV8EL_LINUX_IOSD-UNIVERSALK9-M), Version 17.12.4, RELEASE SOFTWARE (fc3)

ROM: 17.5(1r)

System image file is "bootflash:c1100-universalk9.17.12.04.SPA.bin"

Router#

And all done and dusted. No errors - Woo Hoo - 1 recovered router.

[Leo Laohoo]

Cisco ISR & ASR 1k Routers: IOS-XE/Firmware Upgrade (Install Mode)