Issues when upgrading dual SUP 4510R+E switch with SUP8E (SSO)

[Basavaraj Ningappa]

Hi,

We have Cisco 4510R+E switch with dual SUP8E, we have configured SSO and it was running IOS XE 03.03.00.XO from very longtime and ROMMON-15.1(1r)SG1, last week we have tried upgrading it to IOS XE-3.6.7E, as per the release notes if we want to upgrade from 03.03. to 3.X we have need to upgrade rommon to 5.1(1r)SG4 which we have upgraded and tried upgrading the IOS 3.6.7E, we have copied the ios bootflash and slavebootflash and set the boot system and after we have rebooted the secondary SUP engine, it went to rommon mode, we have tried booting it from there and after that at last we used see this below message and it will stop there, we have tried with different version on 3.6.X but still were unable to upgrade the supervisor engines.

Platform Manager: starting in standalone mode (standby)

Please let me now if any one has faced same problem during upgrade.

Thanks

Basavaraj

[Rich Uline]

Basavaraj,

Could you check if the rommon upgrade was actually applied on both supervisors? You should be able to verify that with either the 'show version' or 'show module' commands. If the system currently isn't bootable to IOS, the version should be displayed automatically once you go into rommon, or you can use the 'showmon' command.

[Reza Sharifi]

Have a look at this post:

https://supportforums.cisco.com/t5/lan-switching-and-routing/unable-to-upgrade-cat4500-to-ios-xe-03-06-01/td-p/2601343

HTH

[Basavaraj Ningappa]

Hi Reza,
Thanks for the link, we have already gone through this link, and also tried upgrading rommon to SG10 and SG11 even after that it was not able to boot, so i upgraded rommon back to SG4

[Leo Laohoo]

---

@Basavaraj Ningappa wrote:

we have copied the ios bootflash and slavebootflash and set the boot system and after we have rebooted the secondary SUP engine, it went to rommon mode

---

This is the reason why the secondary card went into ROMmon:  Because when the secondary was rebooted, it was loading a DIFFERENT IOS version compared to the primary supervisor card. 

The only way is to reboot both line cards.  

And post the complete output to the command "sh version" because we want to see if the ROMmon was correctly upgraded or not.

[Basavaraj Ningappa]

Hi Leo,

We have upgraded only secondary SUP initially, after that i was trying to boot using new IOS from rommon mode, then we have upgraded primary SUP rommon also, even then also it use to go to rommon mode and from there we tried to boot manually but still it was not working, below is the log messages from the console

================================================================================

rommon 0 >dir

usage: dir { [ bootflash: ] | [ slot0: ] | [ usb0: ] }
rommon 1 >dir bootflash:

Date Time Attribute Size Name
========== ===== ========== ========== ================
2013/12/06 04:30 -rwxrwxrwx 181583336 cat4500es8-universal.SPA.03.03.00.XO.151-1.XO.bin
2017/11/26 01:23 -rw-rw-rw- 200253532 cat4500es8-universalk9.SPA.03.06.07.E.152-2.E7.bin
2017/11/26 02:40 -rw-rw-rw- 621504 cat4500-e-ios-promupgrade-151-1r-SG4

Total space = 1660959 KB
Available = 1291332 KB

rommon 2 >boot bootflash:cat4500-e-ios-promupgrade-151-1r-SG4
Loading image !

Checking digital signature....
[bootflash:/cat4500-e-ios-promupgrade-151-1r-SG4]
Digitally Signed Release Software with key version A

************************************************************
* *
* Unified FPGA Upgrade Utility *
* Copyright (c) 2012-2014 by Cisco Systems, Inc. *
* All rights reserved. *
* *
************************************************************
Version 15.1(1r)SG4
Compiled Thu 05-Jun-14 11:18 [RLS]

WS-X45-SUP8-E system detected
Unpacking FPGA:>

Image Name : Cat4K_WSX45SUP8E_FPGA_SIG
Image size : 692 bytes

Uncompressing image...

Image Name : Cat4K_WSX45SUP8E_FPGA_BIN
Image size : 1484960 bytes

Uncompressing image...

Validating FPGA:>

Cat4K_WSX45SUP8E_FPGA_BIN: Digitally signed image Release with key version A

FPGA[R] MD5 : d6106d9343b9595a0465449bf6c77f9b

Programming FPGA:>
-----------------------
***********************
Verifying FPGA:>
.......................
FPGA[W] MD5 : d6106d9343b9595a0465449bf6c77f9b

Unpacking ROMMON:>

Image Name : Cat4K_WSX45SUP8E_PROM_SIG
Image size : 692 bytes

Uncompressing image...

Image Name : Cat4K_WSX45SUP8E_PROM_BIN
Image size : 524288 bytes

Uncompressing image...

Validating ROMMON:>

Cat4K_WSX45SUP8E_PROM_BIN: Digitally signed image Release with key version A

ROMMON[R] MD5 : b92b79fc3566c3700d3b2b87c5d0898f

Programming ROMMON:>
---------
*********

Verifying ROMMON:>
.........
ROMMON[W] MD5 : b92b79fc3566c3700d3b2b87c5d0898f

[S] Resetting System !!!!

Verifying FPGA (P) Signature ....................... PASSED
Verifying ROMMON (P) Signature ......... PASSED

************************************************************
* *
* Rom Monitor *
* Copyright (c) 2012-2014 by Cisco Systems, Inc. *
* All rights reserved. *
* *
************************************************************

Rom Monitor (P) Version 15.1(1r)SG4
Compiled Thu 05-Jun-14 11:15 [RLS]

System : WS-X45-SUP8-E Slot [5] Peer [6] Active
Chassis : WS-C4510R*E Mod [1][2][3][4][7]
Revision : CPU 2.0 BOARD 4.0 FPGA 3.1C4A.9621
Memory : 4096 MB
Date : Sun Nov 26 07:04:23 2017

***** The system will autoboot in 5 seconds *****

Type Control-C to prevent autobooting....
. . . . .

config-register = 0x2102
Autobooting using BOOT variable specified file.....

Current BOOT file is --- bootflash:cat4500es8-universalk9.SPA.03.06.07.E.152-2.E7.bin
Loading image !!!!!!!!!!!!!!!!!!!!!!

Checking digital signature....
[mem:/cat4500es8-firmware]
Digitally Signed Release Software with key version A

Rommon reg: 0x00084F80
Reset2Reg: 0x0C200000
########
Conan controller 0x36A95518..0x36D2C331 Size: 0x00CAC5EC @
####
Radtrooper controller 0x368F997C..0x36A95516 Size: 0x00661EDC @
Link: 0x00000080-0x16000000
Program Done!

Checking digital signature....
[mem:/cat4500es8-base]
Digitally Signed Release Software with key version A

###########
pci 0000:00:00.0: ignoring class b20 (doesn't match header type 01)
pci 0001:02:00.0: ignoring class b20 (doesn't match header type 01)
pci 0002:04:00.0: ignoring class b20 (doesn't match header type 01)
audit: cannot initialize inotify handle
mmc0: Got command interrupt 0x00030000 even though no command operation was in progress.
PME2: fsl_pme2_db_init: not on ctrl-plane
All packages are Digitally Signed
Starting System Services
Nov 26 07:05:26 %IOSXE-3-PLATFORM: process kernel: mmc0: Got command interrupt 0x00030000 even though no command operation was in progress.
Nov 26 07:05:26 %IOSXE-3-PLATFORM: process kernel: PME2: fsl_pme2_db_init: not on ctrl-plane

diagsk10-post version 6.1.0.0

prod: WS-X45-SUP8-E part: 73-14915-04 serial: CAT1746L45Q

Power-on-self-test for Module 5: WS-X45-SUP8-E

CPU Subsystem Tests ...
seeprom: Pass

Traffic: L3 Loopback ...
Test Results: Pass

Traffic: L2 Loopback ...
Test Results: Pass
post done(63 secs)
Exiting to ios...
Loading gsbu64atomic as gdb64atomic
Using 5 for MTS slot
Platform Manager: starting in standalone mode (standby)

==============================================================================

after upgrading the both sup's we even tried the reload the whole switch using reload command, but it didnt reload the whole switch, it only reloaded the primary SUP and secoadnry become active with the old IOS. at the moment new IOS is copied to both flashes and rommon upgraded to SG4. do you think if i do hard reboot both SUP will upgraded same time ?

Thanks

Basavaraj

[Leo Laohoo]

Great. Just great.
The two supervisors are going about like grumpy husband and wife.
Power down the switch and power it back up.

[Basavaraj Ningappa]

Hi Leo,
we will update once i do this activity, i have to request for a downtime for this activity, is there anything you wanted to suggest if reloading the whole box also doesn't work

[Leo Laohoo · Accepted solution]

Console into the primary and secondary card before reloading.
Make sure you enable console logging. We would like to see what goes on when you do a reboot. It makes troubleshooting a lot easier.

Another thing, if one of the two is booting the old IOS check the config registry value is correct.  It should be 0x2102.  Brand new supervisor cards are normally shipped with a config-registry value of 0x2101.

[Basavaraj Ningappa]

Hi All,

Reloading the whole switch fixed the problem and i was able to upgrade the core switch with new IOS 3.6.7E.

Thanks for your valuable feedback

Regards

Basavaraj