ASR1006 CPLD upgrade doesn't work

[Mark07412]

I seem to have gone down a very deep rabbit hole trying to get the IOS on this box upgraded, which has led me here. Luckily this is in a test rig preparing for a live upgrade.

CPLD upgrade seems to go through fine but after the reload the version is the same!

##
## Basic info:
##

Cisco IOS XE Software, Version 16.09.08

Router#show platform
Chassis type: ASR1006

Slot Type State Insert time (ago)
--------- ------------------- --------------------- -----------------
0 ASR1000-SIP40 ok 00:03:42
0/0 SPA-8X1FE-TX-V2 ok 00:01:57
R0 ASR1000-RP2 ok, active 00:03:42
F0 ASR1000-ESP100 ok, active 00:03:42
P0 ASR1013/06-PWR-AC ok 00:02:46

Slot CPLD Version Firmware Version
--------- ------------------- ---------------------------------------
0 00200800 16.3(2r)
R0 13092401 17.3(1r)
F0 12071700 17.3(1r)

Router#show hw-programmable all
Hw-programmable versions

Slot CPLD version FPGA version
-----------------------------------------------------------
R0 13092401 18102401
F0 12071700 N/A
0 00020008 N/A

##
## Upgrade:
##

Router#upgrade hw-programmable cpld filename bootflash:asr1000rpx86-hw-programmables.17.02.01.SPA.pkg R0
Start service Upgrade CPLD on Route-Processor 0 from current version 13092401 to 14111801 (Y)es/(N)o/(C)ontinue? [Y] y
Start service This command could take up to 10 minutes, please wait and do not power-cycle the chassis or the card. Otherwise, hardware may be unrecoverable. It is recommended that all cards are running the same version IOS-XE software prior to the upgrade. At the end of upgrade you will be asked to reload the chassis. (Y)es/(N)o/(C)ontinue? [Y] y

Upgrade cpld hw-programmable on Route-Processor 0
The cpld has been successfully upgraded on Route-Processor/0.
PLEASE POWER CYCLE THE CHASSIS NOW.

##
## After reboot (no change):
##

Router#show hw-programmable all
Hw-programmable versions

Slot CPLD version FPGA version
-----------------------------------------------------------
R0 13092401 18102401
F0 12071700 N/A
0 00020008 N/A

[Flavio Miranda]

Hi @Mark07412 

 I was checking a guide and the command there is  "upgrade hw-programmable cpld filename bootflash: <cpld.pkg> RP active"

you are using  "upgrade hw-programmable cpld filename bootflash:asr1000rpx86-hw-programmables.17.02.01.SPA.pkg R0"

https://content.cisco.com/chapter.sjs?uri=/searchable/chapter/content/en/us/td/docs/routers/asr1000/install/guide/1001-x/asr1hig-book/upgrade_romomn_cpld.html.xml

[Mark07412]

Router#upgrade hw-programmable cpld filename bootflash:asr1000rpx86-hw-programmables.17.02.01.SPA.pkg R0 ?
<cr> <cr>

That's it for this chassis / IOS

[baygray]

Hey Mark,

Flavio is correct in that you can issue the "upgrade hw-programmable cpld filename bootflash: <cpld.pkg> RP active" command. In your example above, put the ? after pkg (not R0) and you will see the option.  However, this will not solve your problem. Both commands will do the exact same thing. You've probably already figured the CPLD out by now, but if not, see my other post.

- Baylor

[Leo Laohoo]

Not all components can/will support the new ROMMON firmware version.

[Mark07412]

This post is related to CPLD not ROMMON but I did investigate ROMMON and there is a matrix explaining the supported version for each card here

All cards were 16.3(2r) when I started and after upgrades the resulting versions are visible in the outputs above

[baygray]

Hi Mark.  I have had extensive experience with CPLD upgrades, especially on ASR1Ks.  In order for the new CPLD version to show up, the chassis must be power-cycled (power cables pulled, wait 10 seconds, and plug power cables back in).  A reload will not do the trick.  A power-cycle can also be performed by doing an OIR (remove and re-insert) on the RP.  After the power-cycle, the new CPLD version will show.

[baygray]

The main point is that a power-cycle is different from a reload.  If you upgrade Rommon for example, the box will send a prompt something like "a RELOAD must be performed before the new Rommon will take effect".  However, when you upgrade the CPLD, you see the prompt reads "PLEASE POWER CYCLE THE CHASSIS NOW" (not reload the chassis now).  A reload will not cut power to the backplane or the linecards.  In order to perform a Power-Cycle, you must remove power to the card being upgraded.  If you are running dual RPs, you can issue a "hw-module slot R0 stop" and then "hw-module slot R0 start" if it is in standby.  However, if you only have one RP, your only options for power-cyle are:

1) performing an OIR on the RP (remove and replace the RP)
or
2) pulling the power cables from the box, wait 10 seconds and replace
or
3) flip the power switch to the box off, wait 10 seconds, and then back on. 

After a successful power-cycle, your CPLD will show the new version.

[shambhu.kumar]

ASR1000-SIP40 ROMmon	ASR1000-ESP40 ROMmon	ASR1000-RP2 FPGA	ASR1000-RP2 ROMmon	IOS-XE
Min: 15.5(3r)S1 Rec: 16.3(2r)	Min: 15.0(1R)S Rec: 17.3(1r)	18102401	Min: 16.9(5r) Rec: 17.3(1r)	17.6.5a

Your FPGA is 18102401  and ROMMON is 17.3(1r) you can directly upgrade new IOS-XE image. CPLD upgrade is not mandatory

Upgrading from Version 16.09.08 to 17.06.5a

Router# sh hw-programmable all
Hw-programmable versions
Slot CPLD version FPGA version
----------------------------------------------------------------------
R0 13092401 18102401
R1 13092401 18102401
F0 1003190E 10072001
F1 1003190E 10072001
0 00020008 N/A
1 00020008 N/A
Note: CPLD upgrade is not mandatory

Make space in bootflash
copy existing IOS-XE image in harddisk: from bootflash
delete existing IOS-XE because of 1GB limitation in bootflash

Copy new IOS-XE image in bootflash
Router# Router# copy usb0: asr1000rpx86-universalk9.17.06.05a.SPA.bin bootflash:

(Since you have already 17.3(1r)) No need to upgrade ROMMON

Router #sh run | i boot
boot-start-marker
boot system bootflash:asr1000rpx86-universalk9.17.06.05a.SPA.bin
boot system hardisk:asr1000rpx86-universalk9.16.09.08.SPA.bin

Router #sh bootv
S-ABH-WER-I1006-1-DC-GF#sh bootvar
BOOT variable = bootflash:asr1000rpx86-universalk9.17.06.05a.SPA.bin,12;hardisk:asr1000rpx86-
universalk9.16.09.08.SPA.bin,12;
CONFIG_FILE variable =
BOOTLDR variable does not exist
Configuration register is 0x2102

Router # hw-module slot R0 reload

Router #sh platform
Chassis type: ASR1006

Slot Type State Insert time (ago)
--------- ------------------- --------------------- -----------------
0 ASR1000-SIP40 ok 6d17h
0/0 SPA-1X10GE-L-V2 ok 6d17h
0/1 SPA-8XCHT1/E1-V2 ok 6d17h
0/2 SPA-4XOC3-POS-V2 ok 6d17h
0/3 SPA-8X1GE-V2 ok 6d17h
1 ASR1000-SIP40 ok 6d17h
1/0 SPA-1X10GE-L-V2 ok 6d17h
1/1 SPA-8XCHT1/E1-V2 ok 6d17h
1/3 SPA-4X1FE-TX-V2 ok 6d17h
R0 ASR1000-RP2 ok, standby 6d17h
R1 ASR1000-RP2 ok, active 6d17h
F0 ASR1000-ESP40 ok, active 6d17h
F1 ASR1000-ESP40 ok, standby 6d17h
P0 ASR1006-PWR-AC ok 6d17h
P1 ASR1006-PWR-AC ok 6d17h
Slot CPLD Version Firmware Version
--------- ------------------- ---------------------------------------
0 00200800 16.3(2r)
1 00200800 16.3(2r)
R0 13092401 17.3(1r)
R1 13092401 17.3(1r)
F0 1003190E 17.3(1r)
F1 1003190E 17.3(1r)

Router#show version
Cisco IOS XE Software, Version 17.06.05a
Cisco IOS Software [Bengaluru], ASR1000 Software (X86_64_LINUX_IOSD-UNIVERSALK9-M),
Version 17.6.5a, RELEASE SOFTWARE (fc2