CLI slowness on C9300-48UXM

Antionette · ‎08-19-2025

I am experiencing CLI slowness on C9300-48UXM (2 stack) any suggestions? I looked at the "show process cpu sorted" and did not see anything that stood out.

M02@rt37 · ‎08-19-2025

Hello @Antionette

Which ios-xe version please ?

Best regards
.ı|ı.ı|ı. If This Helps, Please Rate .ı|ı.ı|ı.

Antionette · ‎08-20-2025

We are using 17.12.04

MHM Cisco World · ‎08-19-2025

1- check cpu top process

2- check cpu history

3- check memory

MHM

Antionette · ‎08-20-2025

I checked the memory and cpu nothing stood out to me as abnormal. Also, this device is in a lab environment with no end users currently.

MHM Cisco World · ‎08-20-2025

No user and no connection at all except stack cable in back?

MHM

Leo Laohoo · ‎08-19-2025

Switches in a stack, is it?

Post the complete output to the following commands:

sh version
sh platform resource
sh platform software status conn brief

Antionette · ‎08-20-2025

Cisco IOS XE Software, Version 17.12.04
Cisco IOS Software [Dublin], Catalyst L3 Switch Software (CAT9K_IOSXE), Version 17.12.4, RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2024 by Cisco Systems, Inc.
Compiled Tue 23-Jul-24 09:40 by mcpre

Cisco IOS-XE software, Copyright (c) 2005-2024 by cisco Systems, Inc.
All rights reserved. Certain components of Cisco IOS-XE software are
licensed under the GNU General Public License ("GPL") Version 2.0. The
software code licensed under GPL Version 2.0 is free software that comes
with ABSOLUTELY NO WARRANTY. You can redistribute and/or modify such
GPL code under the terms of GPL Version 2.0. For more details, see the
documentation or "License Notice" file accompanying the IOS-XE software,
or the applicable URL provided on the flyer accompanying the IOS-XE
software.

ROM: IOS-XE ROMMON
BOOTLDR: System Bootstrap, Version 17.12.1r, RELEASE SOFTWARE (P)

6325hospk4a-s2 uptime is 1 day, 15 hours, 23 minutes
Uptime for this control processor is 1 day, 15 hours, 25 minutes
System returned to ROM by PowerOn at 16:42:33 EDT Mon Aug 18 2025
System image file is "flash:packages.conf"
Last reload reason: PowerOn

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

Technology Package License Information:

------------------------------------------------------------------------------
Technology-package Technology-package
Current Type Next reboot
------------------------------------------------------------------------------
network-advantage Smart License network-advantage
dna-advantage Subscription Smart License dna-advantage
AIR License Level: AIR DNA Advantage
Next reload AIR license Level: AIR DNA Advantage

Smart Licensing Status: Smart Licensing Using Policy

cisco C9300-48UXM (X86) processor with 1301943K/6147K bytes of memory.
Processor board ID FJB2351D036
2 Virtual Ethernet interfaces
8 Gigabit Ethernet interfaces
72 2.5 Gigabit Ethernet interfaces
40 Ten Gigabit Ethernet interfaces
4 TwentyFive Gigabit Ethernet interfaces
4 Forty Gigabit Ethernet interfaces
2048K bytes of non-volatile configuration memory.
8388608K bytes of physical memory.
1638400K bytes of Crash Files at crashinfo:.
1638400K bytes of Crash Files at crashinfo-2:.
11264000K bytes of Flash at flash:.
11264000K bytes of Flash at flash-2:.

Base Ethernet MAC Address : 3c:41:0e:ec:99:80
Motherboard Assembly Number : 73-18277-04
Motherboard Serial Number : FJZ23310FDL
Model Revision Number : A0
Motherboard Revision Number : B0
Model Number : C9300-48UXM
System Serial Number : FJB2351D036
CLEI Code Number : INM4N00ARB

Switch Ports Model SW Version SW Image Mode
------ ----- ----- ---------- ---------- ----
* 1 65 C9300-48UXM 17.12.04 CAT9K_IOSXE INSTALL
2 65 C9300-48UXM 17.12.04 CAT9K_IOSXE INSTALL

Switch 02
---------
Switch uptime : 1 day, 15 hours, 26 minutes

Base Ethernet MAC Address : 54:86:bc:f4:36:80
Motherboard Assembly Number : 73-18277-04
Motherboard Serial Number : FJZ23110JCE
Model Revision Number : A0
Motherboard Revision Number : B0
Model Number : C9300-48UXM
System Serial Number : FJC2317T00H
Last reload reason : Image Install
CLEI Code Number : INM4N00ARB

================

**State Acronym: H - Healthy, W - Warning, C - Critical
Resource Usage Max Warning Critical State
----------------------------------------------------------------------------------------------------
Control Processor 3.37% 100% 90% 95% H
DRAM 3073MB(40%) 7564MB 85% 90% H
TMPFS 235MB(3%) 7564MB 40% 50% H

======================

Load Average
Slot Status 1-Min 5-Min 15-Min
1-RP0 Healthy 0.18 0.21 0.24
2-RP0 Healthy 0.18 0.23 0.26

Memory (kB)
Slot Status Total Used (Pct) Free (Pct) Committed (Pct)
1-RP0 Healthy 7745560 3148508 (41%) 4597052 (59%) 3745948 (48%)
2-RP0 Healthy 7745560 3083252 (40%) 4662308 (60%) 3757036 (49%)

CPU Utilization
Slot CPU User System Nice Idle IRQ SIRQ IOwait
1-RP0 0 0.49 0.19 0.00 99.30 0.00 0.00 0.00
1 2.70 0.20 0.00 97.10 0.00 0.00 0.00
2 0.80 0.20 0.00 99.00 0.00 0.00 0.00
3 13.47 0.19 0.00 86.32 0.00 0.00 0.00
4 0.59 0.19 0.00 99.20 0.00 0.00 0.00
5 0.59 0.29 0.00 99.10 0.00 0.00 0.00
6 1.39 0.19 0.00 98.40 0.00 0.00 0.00
7 2.79 0.29 0.00 96.90 0.00 0.00 0.00
2-RP0 0 0.99 0.49 0.00 98.50 0.00 0.00 0.00
1 6.00 0.20 0.00 93.80 0.00 0.00 0.00
2 11.60 0.20 0.00 88.20 0.00 0.00 0.00
3 0.49 0.39 0.00 99.10 0.00 0.00 0.00
4 0.79 0.49 0.00 98.70 0.00 0.00 0.00
5 1.00 0.40 0.00 98.60 0.00 0.00 0.00
6 1.19 0.39 0.00 98.40 0.00 0.00 0.00
7 2.49 0.69 0.00 96.80 0.00 0.00 0.00

MHM Cisco World · ‎08-20-2025

Control Processor 3.37% 100% 90% 95% H
DRAM 3073MB(40%) 7564MB 85% 90% H
TMPFS 235MB(3%) 7564MB 40% 50% H

Cpu spikes for short' this can be from many reasons

What are 5 top process of cpu ?

MHM

Antionette · ‎08-20-2025

This device is not in production so there is not a lot happening.

CPU utilization for five seconds: 0%/0%; one minute: 0%; five minutes: 0%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
20 78542 1223866 64 0.07% 0.06% 0.07% 0 ARP Input
165 108906 56805 1917 0.07% 0.06% 0.05% 0 IOMD IPC process
9 73228 22314 3281 0.00% 0.05% 0.04% 0 Check heaps
219 53794 1465257 36 0.00% 0.04% 0.02% 0 UDLD
125 50240 9113800 5 0.07% 0.03% 0.02% 0 L2 LISP Punt Pro
127 50870 9113799 5 0.07% 0.02% 0.01% 0 SIS Punt Process
148 8053 21520 374 0.00% 0.00% 0.00% 0 SATrustSync
492 25077 2289331 10 0.00% 0.01% 0.00% 0 MMA DP TIMER
453 25639 2289329 11 0.07% 0.01% 0.00% 0 MMA DB TIMER
69 33400 650252 51 0.00% 0.02% 0.00% 0 Net Background

MHM Cisco World · ‎08-20-2025

ARP top of list

Do

Show ip arp <<- check if there is any incomplete arp

Also I see udld' you have any fiberoptic?

MHM

Leo Laohoo · ‎08-20-2025

@Antionette wrote:

Memory (kB)
Slot  Status  Total   Used    (Pct) Free    (Pct) Committed (Pct)
1-RP0 Healthy 7745560 3148508 (41%) 4597052 (59%) 3745948 (48%)
2-RP0 Healthy 7745560 3083252 (40%) 4662308 (60%) 3757036 (49%)

Nothing connected to it and with an uptime of 1 day? I find 41% memory utilization by the stack master to be unusually high. With just sitting idle and not passing traffic, this value should be below 35%.

Please post the "first page" of the output to the following command:

sh process memory sort location switch active r0

Stefan Mihajlov · ‎08-19-2025

@Antionette

Try these quick checks:

Run show platform software process list R0 – this sometimes reveals high CPU usage not visible in show process cpu.
Check if logging to console is enabled (show logging) – disable it with no logging console to reduce lag.
Look for high control plane traffic: show platform punt-keepalive.
If you’re using stack-wise virtual or large config files, slow CLI is known – try via Telnet instead of SSH just to test.
Also try term no monitor to reduce CLI output processing.

David Ruess · ‎08-20-2025

Hello,

How are you trying to log into devices? Are you using AAA or local credentials? If you're using AAA make sure the connection to your authentication servers are stable, especially if you authenticate/authorize every command.

-David

Antionette · ‎08-25-2025

Thank you all for your responses. The issue turned out to be a memory issue on one of the stack switch. Looking at a RMA situation.