9300 upgrade not applying

[Rick001]

I have a 3 switch stacked 9300 that I am trying to upgrade from 17.09.01 to 17.09.04.

I have copied the bin file through a USB Flash Drive using the following commands:

copy "usbflash0:cat9k_iosxe.17.09.04.SPA.bin" flash:
config t
boot system cat9k_iosxe.17.09.04.SPA.bin
exit
reload

#show boot system
---------------------------
Switch 1
---------------------------
Current Boot Variables:
BOOT variable = flash:cat9k_iosxe.17.09.04.SPA.bin;

Boot Variables on next reload:
BOOT variable does not exist
Manual Boot = no
Enable Break = no
Boot Mode = DEVICE
iPXE Timeout = 0
---------------------------
Switch 2
---------------------------
Current Boot Variables:
BOOT variable = flash:cat9k_iosxe.17.09.04.SPA.bin;

Boot Variables on next reload:
BOOT variable does not exist
Manual Boot = no
Enable Break = no
Boot Mode = DEVICE
iPXE Timeout = 0
---------------------------
Switch 3
---------------------------
Current Boot Variables:
BOOT variable = flash:cat9k_iosxe.17.09.04.SPA.bin;

Boot Variables on next reload:
BOOT variable does not exist
Manual Boot = no
Enable Break = no
Boot Mode = DEVICE
iPXE Timeout = 0

#show issu state detail
Current ISSU Status: Disabled
Previous ISSU Operation: N/A
=======================================================
System Check Status
-------------------------------------------------------
Platform ISSU Support Yes
Standby Online No
Autoboot Enabled Yes
SSO Mode Yes
Install Boot Yes
Valid Boot Media Yes
Operational Mode NONE
=======================================================
No ISSU operation is in progress

When it starts up it is still on 17.09.01.

#show install summary
[ Switch 1 2 3 ] Installed Package(s) Information:
State (St): I - Inactive, U - Activated & Uncommitted,
C - Activated & Committed, D - Deactivated & Uncommitted
--------------------------------------------------------------------------------
Type St Filename/Version
--------------------------------------------------------------------------------
IMG C 17.09.01.0.178

--------------------------------------------------------------------------------
Auto abort timer: inactive
--------------------------------------------------------------------------------

#sh log

Log Buffer (8112 bytes):
RVED_INSTALLED: Specific License Reservation Authorization code installed for udi PID:C9300-48T,SN:
*Oct 24 11:22:13.057 GMT: %SMART_LIC-6-RESERVED_INSTALLED: Specific License Reservation Authorization code installed for udi PID:C9300-48T,SN:
*Oct 24 11:22:13.190 GMT: %SMART_LIC-6-RESERVED_INSTALLED: Specific License Reservation Authorization code installed for udi PID:C9300-24T,SN:
*Oct 24 11:22:13.191 GMT: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Oct 24 11:22:13.200 GMT: %SMART_LIC-6-RESERVED_INSTALLED: Specific License Reservation Authorization code installed for udi PID:C9300-48T,SN:
*Oct 24 11:22:13.209 GMT: %SMART_LIC-6-RESERVED_INSTALLED: Specific License Reservation Authorization code installed for udi PID:C9300-48T,SN:
*Oct 24 11:22:13.881 GMT: %CRYPTO_ENGINE-5-KEY_ADDITION: A key named TEST_CISCO_IDEVID_SUDI has been generated or imported by pki-sudi
*Oct 24 11:22:13.916 GMT: %PKI-6-TRUSTPOINT_CREATE: Trustpoint: TEST_CISCO_IDEVID_SUDI0 created succesfully
*Oct 24 11:22:13.917 GMT: %CRYPTO_ENGINE-5-KEY_DELETED: A key named TEST_CISCO_IDEVID_SUDI has been removed from key storage
*Oct 24 11:22:13.932 GMT: %PKI-6-TRUSTPOINT_DELETE: Trustpoint: TEST_CISCO_IDEVID_SUDI deleted succesfully
*Oct 24 11:22:13.934 GMT: %PKI-6-TRUSTPOINT_DELETE: Trustpoint: TEST_CISCO_IDEVID_SUDI0 deleted succesfully
*Oct 24 11:22:13.934 GMT: %PKI-6-TRUSTPOINT_CREATE: Trustpoint: TEST_CISCO_IDEVID_SUDI created succesfully
*Oct 24 11:22:13.941 GMT: %CRYPTO_ENGINE-5-KEY_ADDITION: A key named TEST_CISCO_IDEVID_SUDI has been generated or imported by pki-sudi
*Oct 24 11:22:13.959 GMT: %PKI-6-TRUSTPOINT_CREATE: Trustpoint: TEST_CISCO_IDEVID_SUDI0 created succesfully
*Oct 24 11:22:13.961 GMT: %CRYPTO_ENGINE-5-KEY_DELETED: A key named TEST_CISCO_IDEVID_SUDI has been removed from key storage
*Oct 24 11:22:13.962 GMT: %PKI-6-TRUSTPOINT_DELETE: Trustpoint: TEST_CISCO_IDEVID_SUDI deleted succesfully
*Oct 24 11:22:13.963 GMT: %PKI-6-TRUSTPOINT_DELETE: Trustpoint: TEST_CISCO_IDEVID_SUDI0 deleted succesfully
*Oct 24 11:22:13.964 GMT: %PKI-6-TRUSTPOINT_CREATE: Trustpoint: CISCO_IDEVID_SUDI created succesfully
*Oct 24 11:22:13.971 GMT: %CRYPTO_ENGINE-5-KEY_ADDITION: A key named CISCO_IDEVID_SUDI has been generated or imported by pki-sudi
*Oct 24 11:22:14.009 GMT: %PKI-6-TRUSTPOINT_CREATE: Trustpoint: CISCO_IDEVID_SUDI0 created succesfully
*Oct 24 11:22:14.010 GMT: %PKI-6-TRUSTPOINT_CREATE: Trustpoint: CISCO_IDEVID_SUDI_LEGACY created succesfully
*Oct 24 11:22:14.017 GMT: %CRYPTO_ENGINE-5-KEY_ADDITION: A key named CISCO_IDEVID_SUDI_LEGACY has been generated or imported by pki-sudi
*Oct 24 11:22:14.035 GMT: %PKI-6-TRUSTPOINT_CREATE: Trustpoint: CISCO_IDEVID_SUDI_LEGACY0 created succesfully
*Oct 24 11:22:29.001 GMT: %PLATFORM_PM-6-FRULINK_INSERTED: 8x10G uplink module inserted in the switch 2 slot 1
*Oct 24 11:22:29.537 GMT: %PLATFORM_PM-6-FRULINK_INSERTED: 8x10G uplink module inserted in the switch 3 slot 1
*Oct 24 11:22:31.268 GMT: %PLATFORM_PM-6-MODULE_INSERTED: SFP module inserted with interface name Te2/1/3
*Oct 24 11:22:31.771 GMT: %PLATFORM_PM-6-MODULE_INSERTED: SFP module inserted with interface name Te3/1/3
*Oct 24 11:22:33.537 GMT: %SMART_LIC-6-RESERVED_INSTALLED: Specific License Reservation Authorization code installed for udi PID:C9300-24T,SN:
*Oct 24 11:22:33.537 GMT: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Oct 24 11:22:33.546 GMT: %SMART_LIC-6-RESERVED_INSTALLED: Specific License Reservation Authorization code installed for udi PID:C9300-48T,SN:
*Oct 24 11:22:33.558 GMT: %SMART_LIC-6-RESERVED_INSTALLED: Specific License Reservation Authorization code installed for udi PID:C9300-48T,SN:
*Oct 24 11:22:33.605 GMT: %CALL_HOME-6-CALL_HOME_ENABLED: Call-home is enabled by Smart Agent for Licensing.
*Oct 24 11:22:33.729 GMT: %SMART_LIC-6-REPORTING_REQUIRED: A Usage report acknowledgement will be required in 0 days.
*Oct 24 11:22:35.800 GMT: %LINK-3-UPDOWN: Interface TenGigabitEthernet2/1/3, changed state to up
*Oct 24 11:22:36.154 GMT: %LINK-3-UPDOWN: Interface GigabitEthernet2/0/11, changed state to up
*Oct 24 11:22:36.800 GMT: %LINEPROTO-5-UPDOWN: Line protocol on Interface TenGigabitEthernet2/1/3, changed state to up
*Oct 24 11:22:36.835 GMT: %LINEPROTO-5-UPDOWN: Line protocol on Interface Vlan3804, changed state to up
*Oct 24 11:22:37.089 GMT: %LINK-3-UPDOWN: Interface TenGigabitEthernet3/1/3, changed state to up
*Oct 24 11:22:37.154 GMT: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2/0/11, changed state to up
*Oct 24 11:22:37.284 GMT: %LINK-3-UPDOWN: Interface GigabitEthernet3/0/11, changed state to up
*Oct 24 11:22:38.023 GMT: %OSPF-5-ADJCHG: Process 1, Nbr on Vlan38 from LOADING to FULL, Loading Done
*Oct 24 11:22:38.089 GMT: %LINEPROTO-5-UPDOWN: Line protocol on Interface TenGigabitEthernet3/1/3, changed state to up
*Oct 24 11:22:38.093 GMT: %LINEPROTO-5-UPDOWN: Line protocol on Interface Vlan38, changed state to up
*Oct 24 11:22:38.289 GMT: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet3/0/11, changed state to up
*Oct 24 11:22:40.573 GMT: %OSPF-5-ADJCHG: Process 1, Nbr on Vlan38 from LOADING to FULL, Loading Done
Oct 24 11:23:09.193 GMT: %PKI-6-AUTHORITATIVE_CLOCK: The system clock has been set.
Oct 24 11:24:01.787 GMT: %IOSXE_REDUNDANCY-6-PEER: Active detected switch 2 as standby.
Oct 24 11:24:01.786 GMT: %STACKMGR-6-STANDBY_ELECTED: Switch 1 R0/0: stack_mgr: Switch 2 has been elected STANDBY.
Oct 24 11:24:11.872 GMT: %REDUNDANCY-5-PEER_MONITOR_EVENT: Active detected a standby insertion (raw-event=PEER_FOUND(4))

Oct 24 11:24:11.872 GMT: %REDUNDANCY-5-PEER_MONITOR_EVENT: Active detected a standby insertion (raw-event=PEER_REDUNDANCY_STATE_CHANGE(5))

Oct 24 11:24:29.622 GMT: %SSH-5-SSH2_SESSION: SSH2 Session request from (tty = 0) using crypto cipher 'aes128-ctr', hmac 'hmac-sha2-256' Succeeded
Oct 24 11:25:03.700 GMT: %SMART_LIC-6-RESERVED_INSTALLED: Specific License Reservation Authorization code installed for udi PID:C9300-24T,SN:
Oct 24 11:25:03.700 GMT: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
Oct 24 11:25:03.711 GMT: %SMART_LIC-6-RESERVED_INSTALLED: Specific License Reservation Authorization code installed for udi PID:C9300-48T,SN:
Oct 24 11:25:03.720 GMT: %SMART_LIC-6-RESERVED_INSTALLED: Specific License Reservation Authorization code installed for udi PID:C9300-48T,SN:
Oct 24 11:25:08.034 GMT: %HA_CONFIG_SYNC-6-BULK_CFGSYNC_SUCCEED: Bulk Sync succeeded
Oct 24 11:25:09.047 GMT: %RF-5-RF_TERMINAL_STATE: Terminal state reached for (SSO)
Oct 24 11:25:09.308 GMT: %SEC_LOGIN-5-LOGIN_SUCCESS: Login Success [user: anguser] [Source: ] [localport: 22] at 11:25:09 GMT Tue Oct 24 2023
Oct 24 11:25:09.308 GMT: %SSH-5-SSH2_USERAUTH: User '' authentication for SSH2 Session from (tty = 0) using crypto cipher 'aes128-ctr', hmac 'hmac-sha2-256' Succeeded
Oct 24 11:27:58.306 GMT: %PLATFORM-4-ELEMENT_WARNING: Switch 1 R0/0: smand: 2/RP/0: limited space - copy files out of flash: directory. flash: value 77% (8573 MB) exceeds warning level 70% (7760 MB).
Oct 24 11:27:58.304 GMT: %PLATFORM-4-ELEMENT_WARNING: Switch 2 R0/0: smand: 2/RP/0: limited space - copy files out of flash: directory. flash: value 77% (8573 MB) exceeds warning level 70% (7760 MB).
Oct 24 11:28:04.539 GMT: %PLATFORM-4-ELEMENT_WARNING: Switch 1 R0/0: smand: 3/RP/0: limited space - copy files out of flash: directory. flash: value 77% (8573 MB) exceeds warning level 70% (7760 MB).
Oct 24 11:28:04.537 GMT: %PLATFORM-4-ELEMENT_WARNING: Switch 2 R0/0: smand: 3/RP/0: limited space - copy files out of flash: directory. flash: value 77% (8573 MB) exceeds warning level 70% (7760 MB).
Oct 24 11:33:31.758 GMT: %SYS-5-CONFIG_I: Configured from console by anguser on vty0 ()
Oct 24 11:35:07.253 GMT: %SYS-5-CONFIG_I: Configured from console by anguser on vty0 ()

[Reza Sharifi]

Try following this document to upgrade:

https://www.cisco.com/c/en/us/td/docs/switches/lan/catalyst9300/software/release/17-9/release_notes/ol-17-9-9300/upgrading_the_switch_software.html#task_xpb_3tx_xkb

HTH

[Rick001]

I tried a couple times and noticed that when the switches came back up they went into diagnostic mode (switch#) and had to apply the firmware from the USB one by one in the stack with the following command:

boot usbflash0:cat9k_iosxe.17.09.04.SPA.bin

After the switch restarted, it applied the updated firmware and was seen as part of the stack.

[Reza Sharifi · Accepted solution]

Once the switch is completely booted, try to negate the old ios and add the new one:

no boot system bootflash:<old ios>

boot system bootflash:<new ios>

verify with "sh boot" that the correct IOS is there.

save and reload

HTH

[Rick001]

I had tried the no boot system on a 4 switch stack and when I reloaded it only applied on switch 1. The rest only showed switch: on the console and had to run the command boot usbflash0:cat9k_iosxe.17.09.04.SPA.bin on each switch with the USB Flash drive connected to each one.

[Reza Sharifi]

So, all 4 switches now have the new IOS installed and booted correctly?

[Rick001]

Yes, after I ran the command boot usbflash0:cat9k_iosxe.17.09.04.SPA.bin it rebooted and applied the update. I just had to do it for each switch in the stack and can't do it remotely. 

[Leo Laohoo]

Cisco 3850: IOS-XE/Firmware Upgrade

NOTE: 
The above process is compatible with the 9300/9300X, however, in Step 6 (to check if the packages.conf file is pointing to the correct target version), use the command "more flash-X:packages.conf | begin rp_boot" (where "X" is the switch member number).