Re: IOSXE Upgrade 3850 - Clean up Flash

Anup Sasikumar · ‎11-23-2017

Hey All!

Need your help please,

We are needed to do an upgrade of IOS-XE on a two switch 3850 stack. ( Switch 2 is the master)

We are going from 3.07.3E to the newer 16.3.5b

(Earlier we had done an upgrade from 3.3.4SE to the current version 3.07.3E to support GRE capabilities )

As the newer IOS is a bit heavy around 514MB, I want to make sure we have enough space in flash to copy the IOS and the later installation processes.

Can you please help me to understand which all files are safe to be removed from Flash?

From my understanding , I could safely delete all .pcap/pcapng , txt files , .pkg files of the older 3.3.4 installation.

I have included below the flash ,flash-1 contents.

Please suggest!

Switch Ports Model              SW Version        SW Image              Mode
------ ----- -----              ----------        ----------            ----
     1 32    WS-C3850-24S       03.07.03E         cat3k_caa-universalk9 INSTALL
*    2 32    WS-C3850-24S       03.07.03E         cat3k_caa-universalk9 INSTALL



Directory of flash:/

 7754  -rw-     2097152  Nov 23 2017 15:23:34 +00:00  nvram_config
 7747  -rw-    79110340  Apr 23 2015 00:42:06 +00:00  cat3k_caa-base.SPA.03.03.04SE.pkg
 7748  -rw-     6521532  Apr 23 2015 00:42:06 +00:00  cat3k_caa-drivers.SPA.03.03.04SE.pkg
 7749  -rw-    34530288  Apr 23 2015 00:42:06 +00:00  cat3k_caa-infra.SPA.03.03.04SE.pkg
 7750  -rw-    34856268  Apr 23 2015 00:42:06 +00:00  cat3k_caa-iosd-universalk9.SPA.150-1.EZ4.pkg
 7751  -rw-    25172880  Apr 23 2015 00:42:06 +00:00  cat3k_caa-platform.SPA.03.03.04SE.pkg
 7752  -rw-    77445952  Apr 23 2015 00:42:06 +00:00  cat3k_caa-wcm.SPA.10.1.140.0.pkg
 7757  -rw-        1236   Jun 2 2017 15:17:34 +00:00  packages.conf
 7746  -rw-        1216  Jul 28 2017 12:54:15 +00:00  vlan.dat
 7755  -rw-   322991728   Jun 2 2017 11:48:35 +00:00  cat3k_caa-universalk9.SPA.03.07.03.E.152-3.E3.bin
 7756  -rw-        1247  Apr 23 2015 00:42:14 +00:00  packages.conf.00-
54211  -rw-    82022500   Jun 2 2017 15:17:30 +00:00  cat3k_caa-base.SPA.03.07.03E.pkg
54212  -rw-     5653180   Jun 2 2017 15:17:30 +00:00  cat3k_caa-drivers.SPA.03.07.03E.pkg
54213  -rw-    36953096   Jun 2 2017 15:17:30 +00:00  cat3k_caa-infra.SPA.03.07.03E.pkg
54214  -rw-    46236992   Jun 2 2017 15:17:30 +00:00  cat3k_caa-iosd-universalk9.SPA.152-3.E3.pkg
54215  -rw-    28883852   Jun 2 2017 15:17:30 +00:00  cat3k_caa-platform.SPA.03.07.03E.pkg
54216  -rw-   123237184   Jun 2 2017 15:17:30 +00:00  cat3k_caa-wcm.SPA.10.3.130.0.pkg
 7753  drwx        4096   Jun 2 2017 15:35:36 +00:00  virtual-instance
 7758  drwx        4096   Jun 2 2017 15:40:45 +00:00  onep
54209  drwx        4096   Jun 2 2017 15:40:45 +00:00  dc_profile_dir
54217  drwx        4096   Jun 2 2017 15:41:33 +00:00  wnweb_store
 7759  -rw-        7900  Nov 15 2017 13:45:40 +00:00  DHCP.pcapng
 7760  -rw-     4781284  Nov 15 2017 13:27:03 +00:00  CP.pcapng
 7761  -rw-           1  Nov 15 2017 13:10:51 +00:00  output_fed_trace.txt
 7762  -rw-      328711  Nov 15 2017 13:14:36 +00:00  output_fed_trace2.txt

1621966848 bytes total (707416064 bytes free)



Directory of flash-1:/

 7779  -rw-     2097152  Nov 23 2017 15:23:36 +00:00  nvram_config
 7747  -rw-    79110340  Apr 23 2015 00:44:23 +00:00  cat3k_caa-base.SPA.03.03.04SE.pkg
 7748  -rw-     6521532  Apr 23 2015 00:44:24 +00:00  cat3k_caa-drivers.SPA.03.03.04SE.pkg
 7749  -rw-    34530288  Apr 23 2015 00:44:24 +00:00  cat3k_caa-infra.SPA.03.03.04SE.pkg
 7750  -rw-    34856268  Apr 23 2015 00:44:24 +00:00  cat3k_caa-iosd-universalk9.SPA.150-1.EZ4.pkg
 7751  -rw-    25172880  Apr 23 2015 00:44:24 +00:00  cat3k_caa-platform.SPA.03.03.04SE.pkg
 7752  -rw-    77445952  Apr 23 2015 00:44:24 +00:00  cat3k_caa-wcm.SPA.10.1.140.0.pkg
 7759  -rw-        1236   Jun 2 2017 15:17:34 +00:00  packages.conf
 7746  -rw-        1216  Nov 10 2017 13:52:36 +00:00  vlan.dat
 7756  -rw-   322991728   Jun 2 2017 11:48:35 +00:00  cat3k_caa-universalk9.SPA.03.07.03.E.152-3.E3.bin
 7757  -rw-   322991728   Jun 2 2017 11:55:40 +00:00  flash-2
 7758  -rw-        1247  Apr 23 2015 00:44:31 +00:00  packages.conf.00-
15489  drwx        4096   Jun 2 2017 15:35:28 +00:00  vman_fdb
 7760  -rw-    82022500   Jun 2 2017 15:17:29 +00:00  cat3k_caa-base.SPA.03.07.03E.pkg
 7761  -rw-     5653180   Jun 2 2017 15:17:29 +00:00  cat3k_caa-drivers.SPA.03.07.03E.pkg
 7762  -rw-    36953096   Jun 2 2017 15:17:29 +00:00  cat3k_caa-infra.SPA.03.07.03E.pkg
 7763  -rw-    46236992   Jun 2 2017 15:17:29 +00:00  cat3k_caa-iosd-universalk9.SPA.152-3.E3.pkg
 7764  -rw-    28883852   Jun 2 2017 15:17:29 +00:00  cat3k_caa-platform.SPA.03.07.03E.pkg
 7765  -rw-   123237184   Jun 2 2017 15:17:30 +00:00  cat3k_caa-wcm.SPA.10.3.130.0.pkg
 7753  drwx        4096   Jun 2 2017 15:35:28 +00:00  virtual-instance
23233  drwx        4096   Jun 2 2017 15:37:43 +00:00  dc_profile_dir
30977  drwx        4096   Jun 2 2017 15:38:19 +00:00  wnweb_store
 7766  -rw-     1008664  Sep 15 2017 10:34:21 +00:00  dhcpcontrol.pcap
 7767  -rw-        1098  Sep 15 2017 10:55:26 +00:00  dhcpgi107.pcap
 7768  -rw-      919310  Sep 15 2017 11:21:39 +00:00  dhcpgi6control.pcap
 7769  -rw-      957282  Sep 15 2017 12:11:32 +00:00  finaltest.pcap
 7770  -rw-       27821  Sep 15 2017 12:12:08 +00:00  finaldebugs.txt
 7771  -rw-      901380  Oct 17 2017 10:33:32 +00:00  Gi102-1017.pcap
 7772  -rw-      742220  Oct 17 2017 10:55:31 +00:00  Gi102-1017-2.pcap
 7773  -rw-     1523962  Oct 17 2017 11:20:34 +00:00  Gi108-1017-3.pcap
 7774  -rw-     2497764  Oct 26 2017 08:06:59 +00:00  dhcpcop.pcap
 7775  -rw-    10002163  Oct 26 2017 08:07:44 +00:00  dhcpdebugs.txt
 7776  -rw-     1160190  Oct 26 2017 08:41:32 +00:00  dhcpcop2.pcap
 7777  -rw-    10002163  Oct 26 2017 08:42:20 +00:00  dhcpdebugs3.txt
 7778  -rw-     2497764  Oct 26 2017 14:57:32 +00:00  usbflash0-1
 7755  drwx        4096  Nov 10 2017 13:51:51 +00:00  onep

1622147072 bytes total (357040128 bytes free)

Regards,
Anup

Leo Laohoo · ‎11-23-2017

@Anup Sasikumar wrote:

We are going from 3.07.3E to the newer 16.3.5b

I hope you read the Release Notes carefully.

Anup Sasikumar · ‎11-24-2017

@Leo Laohoo wrote:

@Anup Sasikumar wrote:

We are going from 3.07.3E to the newer 16.3.5b

I hope you read the Release Notes carefully.

Thanks for looking into my query , Leo! And Thanks for your suggestion. I looked into the Release Notes for the 16.X IOS-XE versions and happen to find something really important which should be taken into account during the upgrade.

-------

Note When you upgrade to Cisco IOS XE Denali 16.3.5 the SSH access is lost, because it cannot use the CISCO_IDEVID_SUDI_LEGACY RSA server key. Before upgrade, generate the server key using the crypto key generate rsa command in global configuration mode.
To verify whether the RSA server key is available on your device, run the show crypto key command.

--------

Do you have any suggestion for me regarding the files which can be safely removed?

I believe I can use "software clean" to remove .pkg files which are not in use also delete the other .pcap/pcapng , .txt files from the flash ?

Please help :)

Thanks,

Anup

Regards,
Anup

Mark Malone · ‎11-24-2017

Right so when you change version to another image like this and the ssh keys are lost use the below script first save it and then reboot make sure its saved first , when the router/switch is coming back up it will re-generate the SSH keys automatically , I used this recently as we were moving off denali back to standard ios-xe version , and when we were downgrading we were loosing the keys locking us out remotely

event manager applet EEM_SSH_Keygen

event timer cron cron-entry "@reboot"

action 0.0 info type routername

action 0.1 set status "none"

action 1.0 cli command "enable"

action 2.0 cli command "show ip ssh | include ^SSH"

action 2.1 regexp "([ED][^ ]+)" "$_cli_result" result status

action 3.0 if $status eq "Disabled"

action 3.1 cli command "configure terminal"

action 3.2 cli command "crypto key generate rsa modulus 2048 label $_info_routername"

action 3.3 cli command "end"

action 3.4 end

Mark Malone · ‎11-24-2017

also I would recommend you floow this doc there is a software clean command for iox-xe , it explains in this doc how to do it

Deleting Files

When you no longer need files on a flash memory device, you can permanently delete them.

•Use the delete command to remove any type of file.

•Use the software clean command to remove unused package files and provisioning files.

https://www.cisco.com/c/en/us/td/docs/switches/lan/catalyst3850/software/release/3-2_0_se/system_management/appendix/iosfsApp/swiosfs.html

Jos Mandjes · ‎04-15-2018

Bit late... Software clean only cleans up old files from packages not used, no txt files or others are removed, also it will show files it is going to delete and you can abort. https://www.cisco.com/c/en/us/support/docs/switches/catalyst-3850-series-switches/117552-technote-cat3850-00.html#anc10

BR,

Jos

Joseph Ritchey · ‎04-27-2018

Passed on from another user Brandon Buffin:

You need to use the "request platform software package install" command. Take a look at the Upgrading the Switch Software section of this link.

http://www.cisco.com/c/en/us/td/docs/switches/lan/catalyst3850/software/release/16-3/release_notes/ol-16-3-3850.html

nzinfrastructure · ‎08-05-2019

The actual command (as I was also confused) is

"request platform software package clean"

CAS4710 · ‎01-07-2020

I am attempting to clean up packages on a 3650, with version 16.3.8 Install mode. The command you list is correct, however the reply is that the files cannot be deleted because they are in use. I cannot copy the new IOS, 16.3.9, from a USB drive to flash: because there isn't enough room. Yet when I attempt to create room by executing the command, 'request platform software package clean', I'm told they are in use. File not deleted.

The only way I have found to upgrade the switch is by booting it with the mode button pressed in, execute flash_init to switch: prompt, then running the command "emergency-install usbflash0:<new IOS>". This will install the new version with "Install", not "Bundle" which is what I want. This is for single switch. In the 3.6.8 version days you copied the new IOS to a single switch in a stack then ran the command to upgrade. From what I've read for a Denali upgrade the command for a stack is "request platform software package expand switch all file ......". Again, how can you copy the new IOS to a switch that will not allow you to delete files to make room?

Leo Laohoo · ‎01-07-2020

Post the complete output to the command "dir".

CAS4710 · ‎01-08-2020

This is probably not going to be helpful because the upgrade from 16.3.8 to 16.3.9 worked with the emergency-install from USB since I couldn't copy the .bin file to flash due to space. But here you go.

Directory of flash:/

56562 -rw- 2097152 Jan 8 2020 12:22:45 +00:00 nvram_config
56563 -rw- 2097152 Jan 8 2020 12:22:48 +00:00 nvram_config_bkup
56564 -rw- 15938176 Jan 6 2020 20:20:18 +00:00 cat3k_caa-guestshell.16.03.09.SPA.pkg
56565 -rw- 24008561 Jan 6 2020 20:20:16 +00:00 cat3k_caa-rpbase.16.03.09.SPA.pkg
56566 -rw- 264671864 Jan 6 2020 20:20:18 +00:00 cat3k_caa-rpcore.16.03.09.SPA.pkg
56567 -rw- 9673344 Jan 6 2020 20:20:17 +00:00 cat3k_caa-srdriver.16.03.09.SPA.pkg
56568 -rw- 209599092 Jan 6 2020 20:20:17 +00:00 cat3k_caa-wcm.16.03.09.SPA.pkg
56569 -rw- 13441660 Jan 6 2020 20:20:17 +00:00 cat3k_caa-webui.16.03.09.SPA.pkg
56570 -rw- 4725 Jan 6 2020 20:20:41 +00:00 packages.conf
56571 -rw- 74 Jan 8 2020 12:16:55 +00:00 bootloader_evt_handle.log
56572 drwx 4096 Jan 6 2020 20:38:00 +00:00 core
11 drwx 4096 Jan 6 2020 20:32:25 +00:00 .prst_sync
24241 drwx 4096 Jan 6 2020 20:32:27 +00:00 .rollback_timer
32321 drwx 4096 Jan 8 2020 12:17:09 +00:00 dc_profile_dir
32323 drwx 4096 Jan 6 2020 20:32:35 +00:00 gs_script
56573 -rw- 76 Jan 8 2020 12:17:10 +00:00 boothelper.log
56574 -rw- 65568 Jan 8 2020 12:17:27 +00:00 memleak.tcl
56575 drwx 4096 Jan 6 2020 20:33:03 +00:00 .installer

1562509312 bytes total (938160128 bytes free)

I tried to rollback this install so that I could show the directory with 16.3.8 and the error of not being able to delete the files becuase they were in use, so I would have to wipe the switch and start from scratch. The rollback didn't work - which is worrisome:

Trying to rollback to Denali 16.3.8
Switch#request platform software package install switch 1 rollback
[1]: rollback package(s) on switch 1
--- Starting local lock acquisition on switch 1 ---
Finished local lock acquisition on switch 1

--- Starting preparation for software rollback ---
FAILED: No rollback file found for /flash/packages.conf
FAILED: rollback failed on switch 1
Switch#

Jeffrey Yentz · ‎01-13-2020

Thanks for this! Before the upgrade, the command was just 'software clean'.

@nzinfrastructure wrote:
The actual command (as I was also confused) is

"request platform software package clean"

steeleryan · ‎08-05-2019

Get rid of all your PCAPs and associated txt files. then run the "request platform software package clean switch all" to get rid of old IOS stuff.

CAS4710 · ‎01-08-2020

Flash contains 16.3.9 files after emergency-install from USB, however number of files and names are identical when 16.3.8 was in the directory. As you can see there are no PCAP or txt files listed.

Directory of flash:/

56562 -rw- 2097152 Jan 8 2020 12:22:45 +00:00 nvram_config
56563 -rw- 2097152 Jan 8 2020 12:22:48 +00:00 nvram_config_bkup
56564 -rw- 15938176 Jan 6 2020 20:20:18 +00:00 cat3k_caa-guestshell.16.03.09.SPA.pkg
56565 -rw- 24008561 Jan 6 2020 20:20:16 +00:00 cat3k_caa-rpbase.16.03.09.SPA.pkg
56566 -rw- 264671864 Jan 6 2020 20:20:18 +00:00 cat3k_caa-rpcore.16.03.09.SPA.pkg
56567 -rw- 9673344 Jan 6 2020 20:20:17 +00:00 cat3k_caa-srdriver.16.03.09.SPA.pkg
56568 -rw- 209599092 Jan 6 2020 20:20:17 +00:00 cat3k_caa-wcm.16.03.09.SPA.pkg
56569 -rw- 13441660 Jan 6 2020 20:20:17 +00:00 cat3k_caa-webui.16.03.09.SPA.pkg
56570 -rw- 4725 Jan 6 2020 20:20:41 +00:00 packages.conf
56571 -rw- 74 Jan 8 2020 12:16:55 +00:00 bootloader_evt_handle.log
56572 drwx 4096 Jan 6 2020 20:38:00 +00:00 core
11 drwx 4096 Jan 6 2020 20:32:25 +00:00 .prst_sync
24241 drwx 4096 Jan 6 2020 20:32:27 +00:00 .rollback_timer
32321 drwx 4096 Jan 8 2020 12:17:09 +00:00 dc_profile_dir
32323 drwx 4096 Jan 6 2020 20:32:35 +00:00 gs_script
56573 -rw- 76 Jan 8 2020 12:17:10 +00:00 boothelper.log
56574 -rw- 65568 Jan 8 2020 12:17:27 +00:00 memleak.tcl
56575 drwx 4096 Jan 6 2020 20:33:03 +00:00 .installer

1562509312 bytes total (938160128 bytes free)

Leo Laohoo · ‎01-08-2020

I really don't see any files related to 16.3.9. This to me means the flash in the switch is "clean".