10-02-2023 06:33 AM
Hi all,
I have high CPU usage issue on Cisco Cat4506E (SUP7-E). Could you please advise and check for me? Why does the CPU usage is high?
Cat4506E#show processes cpu detailed process iosd sorted
Core 0: CPU utilization for five seconds: 33%; one minute: 35%; five minutes: 37%
Core 1: CPU utilization for five seconds: 80%; one minute: 77%; five minutes: 75%
PID T C TID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
(%) (%) (%)
4687 L 153745 1424621 200 56.87 56.13 56.27 34816 iosd
4687 L 1 4687 648004 3514529 0 40.73 39.63 38.43 34816 iosd
4687 L 0 7001 212817 1972950 0 16.15 16.49 17.83 0 iosd.fastpath
4687 L 1 7002 1291936 8870710 0 0.00 0.04 0.07 0 CMI Thread
4687 L 0 7003 2237255 1424604 0 0.00 0.00 0.00 34816 iosd.monitor
4687 L 0 7004 58698 941076 0 0.00 0.00 0.00 34816 iosd.aux
93 I 1504778 2738964 0 53.00 55.00 56.22 0 Cat4k Mgmt LoPri
92 I 1635939 3024750 0 6.33 7.00 7.99 0 Cat4k Mgmt HiPri
214 I 1618982 1094185 0 0.99 0.66 0.66 0 Spanning Tree
Cat4506E#show platform cpu packet statistics
Executing the command on VSS member switch role = VSS Active, id = 1
RkGenericPacketMan:
Packet allocation failures: 0
Packet Buffer(SW Common) allocation failures: 0
Packet Buffer(SW ESMP) allocation failures: 0
Packet Buffer(SW EOBC) allocation failures: 0
Packet Buffer(SW SupToSup) allocation failures: 0
Packets Dropped In Processing Overall
Total 5 sec avg 1 min avg 5 min avg 1 hour avg
-------------------- --------- --------- --------- ----------
28748806 0 0 0 0
Packets Dropped In Processing by CPU event
Event Total 5 sec avg 1 min avg 5 min avg 1 hour avg
----------------- -------------------- --------- --------- --------- ----------
Sa Miss 337556 0 0 0 0
Input ACl Copy 6038238 0 0 0 0
Vs Tunnel Control 22373001 0 0 0 0
Sw Packet w/ TxInfo 11 0 0 0 0
Packets Dropped In Processing by Priority
Priority Total 5 sec avg 1 min avg 5 min avg 1 hour avg
----------------- -------------------- --------- --------- --------- ----------
Unknown 1136072 0 0 0 0
Normal 5029813 0 0 0 0
Medium 623001 0 0 0 0
High 767450 0 0 0 0
Crucial 21192470 0 0 0 0
Packets Dropped In Processing by Reason
Reason Total 5 sec avg 1 min avg 5 min avg 1 hour avg
------------------ -------------------- --------- --------- --------- ----------
STPDrop 22 0 0 0 0
Tx Mode Drop 6134797 0 0 0 0
Qos Policer Drop 11 0 0 0 0
Extra packet received on VSS-Standby 240975 0 0 0 0
Packet does not contain any local TxInfos 15960367 0 0 0 0
No Vsl port found 1 0 0 0 0
L2 control packet Tx for Vsl port 5276561 0 0 0 0
L2 Ctrl Packet received as SA miss 895097 0 0 0 0
L3 Ctrl Packet copied to Standby 240975 0 0 0 0
Total packet queues 64
Packets Received by Packet Queue
Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
---------------------- --------------- --------- --------- --------- ----------
Input ACL fwd(snooping) 580190 0 0 0 0
Vslp 290214366 2 0 0 0
Host Learning 1195302 0 0 0 0
L2 Control 370461553 2 0 0 0
Input ACL log, unreach 8703718 0 0 0 0
L3 Glean 367665388 0 0 0 0
Vs Mgmt 567470727 10 1 3 1
L3 Receive 949611372 20 9 7 7
Vs Tunnel Ctrl Pkt 1068996239 0 0 0 0
Ttl Expired 1138659 0 0 0 0
Vs Tunnel Data Pkt 216271487 0 0 0 0
Bfd 278749 0 0 0 0
Adj SameIf Fail 12396709712 32900 36738 29504 28245
L2 router to CPU, 7 94694858 0 0 0 0
L3 Fwd 251 0 0 0 0
Packets Dropped by Packet Queue
Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
---------------------- --------------- --------- --------- --------- ----------
Vs Tunnel Data Pkt 3573 0 0 0 0
Adj SameIf Fail 59102240 267 249 191 162
L2 router to CPU, 7 51 0 0 0 0
Executing the command on VSS member switch role = VSS Standby, id = 2
RkGenericPacketMan:
Packet allocation failures: 0
Packet Buffer(SW Common) allocation failures: 0
Packet Buffer(SW ESMP) allocation failures: 0
Packet Buffer(SW EOBC) allocation failures: 0
Packet Buffer(SW SupToSup) allocation failures: 0
Packets Dropped In Processing Overall
Total 5 sec avg 1 min avg 5 min avg 1 hour avg
-------------------- --------- --------- --------- ----------
5484127 0 0 0 0
Packets Dropped In Processing by CPU event
Event Total 5 sec avg 1 min avg 5 min avg 1 hour avg
----------------- -------------------- --------- --------- --------- ----------
Input ACl Copy 383719 0 0 0 0
Vs Tunnel Control 5100408 0 0 0 0
Packets Dropped In Processing by Priority
Priority Total 5 sec avg 1 min avg 5 min avg 1 hour avg
----------------- -------------------- --------- --------- --------- ----------
Unknown 383721 0 0 0 0
Medium 383721 0 0 0 0
Crucial 4716685 0 0 0 0
Packets Dropped In Processing by Reason
Reason Total 5 sec avg 1 min avg 5 min avg 1 hour avg
------------------ -------------------- --------- --------- --------- ----------
Extra packet received on VSS-Standby 383719 0 0 0 0
L2 control packet Tx for Vsl port 4716685 0 0 0 0
L2 Ctrl Packet received as SA miss 2 0 0 0 0
L3 Ctrl Packet copied to Standby 383721 0 0 0 0
Total packet queues 64
Packets Received by Packet Queue
Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
---------------------- --------------- --------- --------- --------- ----------
Vslp 259428828 1 0 0 0
Host Learning 62402 0 0 0 0
L2 Control 48 0 0 0 0
Input ACL log, unreach 769576 0 0 0 0
Vs Mgmt 208461545 4 0 1 1
Vs Tunnel Ctrl Pkt 3611871410 27 22 21 22
Ttl Expired 3 0 0 0 0
Vs Tunnel Data Pkt 540862844 3 0 2 2
Bfd 18 0 0 0 0
L2 router to CPU, 7 7984384 0 0 0 0
Packets Dropped by Packet Queue
Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
---------------------- --------------- --------- --------- --------- ----------
Host Learning 3221 0 0 0 0
Cat4506E#show platform health
Executing the command on VSS member switch role = VSS Active, id = 1
K5CpuMan Review 30.00 62.74 30 44 100 500 100 96 76 22596:27
K5ForerunnerPacketMa 2.00 27.06 4 16 100 500 38 38 31 10095:12
10-02-2023 07:06 AM
what verison of code running, how long the switch uptime ?
are you seeing this high CPU recently, any big changes in the network.
worth looking for below thread and troublshoot tips :
https://community.cisco.com/t5/switching/high-cpu-4500x-utilization/td-p/2252145
10-02-2023 07:14 AM
Hi
Version is 03.07.02.E
how long the switch uptime?
7 years, 49 weeks, 3 days, 11 hours, 53 minutes
are you seeing this high CPU recently, any big changes in the network
No.
10-02-2023 07:22 AM
first option - i would reboot standby switch and then switch over active to standby in VSS and check
if possible when you get chance upgrae to latest stable code and check
10-02-2023 07:25 AM
I will ask end user and check
10-02-2023 07:24 AM
This an XE IOS?
If so, believe it would be useful to examine CPU stats internal to IOSd (believe there's a command for that, but don't recall what it is).
10-02-2023 07:25 AM
hi
yes, it is ios xe
10-02-2023 08:04 AM
IOS XE you can use below document to see what is causing the issue :
10-02-2023 08:41 AM
show processes cpu detailed process iosd sorted
Was the command I was trying to recall (from reading an earlier @Peter Paluch posting).
10-02-2023 05:13 PM
hi
yes as i check with that command
iosd, Cat4k Mgmt LoPri and K5CpuMan Review are very high cpu usage start from 28 Sept to till now.
10-02-2023 03:32 PM
If that VSS pair has been on 3.7.2 for >7 years without a reboot/crash, then leave it alone.
10-02-2023 05:15 PM
hi yes, but it is start happen from 28 September to till now.
iosd, Cat4k Mgmt LoPri and K5CpuMan Review are very high cpu usage
10-02-2023 06:09 PM
Can the firmware of the switch be upgraded?
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide