cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
714
Views
0
Helpful
12
Replies

High CPU Utilization on Cisco Cat4506E (SUP7-E)

Hi all,

I have high CPU usage issue on Cisco Cat4506E (SUP7-E). Could you please advise and check for me? Why does the CPU usage is high?

Cat4506E#show processes cpu detailed process iosd sorted
Core 0: CPU utilization for five seconds: 33%; one minute: 35%; five minutes: 37%
Core 1: CPU utilization for five seconds: 80%; one minute: 77%; five minutes: 75%
PID T C TID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
(%) (%) (%)
4687 L 153745 1424621 200 56.87 56.13 56.27 34816 iosd
4687 L 1 4687 648004 3514529 0 40.73 39.63 38.43 34816 iosd
4687 L 0 7001 212817 1972950 0 16.15 16.49 17.83 0 iosd.fastpath
4687 L 1 7002 1291936 8870710 0 0.00 0.04 0.07 0 CMI Thread
4687 L 0 7003 2237255 1424604 0 0.00 0.00 0.00 34816 iosd.monitor
4687 L 0 7004 58698 941076 0 0.00 0.00 0.00 34816 iosd.aux
93 I 1504778 2738964 0 53.00 55.00 56.22 0 Cat4k Mgmt LoPri
92 I 1635939 3024750 0 6.33 7.00 7.99 0 Cat4k Mgmt HiPri
214 I 1618982 1094185 0 0.99 0.66 0.66 0 Spanning Tree

Cat4506E#show platform cpu packet statistics

Executing the command on VSS member switch role = VSS Active, id = 1

RkGenericPacketMan:
Packet allocation failures: 0
Packet Buffer(SW Common) allocation failures: 0
Packet Buffer(SW ESMP) allocation failures: 0
Packet Buffer(SW EOBC) allocation failures: 0
Packet Buffer(SW SupToSup) allocation failures: 0

Packets Dropped In Processing Overall

Total 5 sec avg 1 min avg 5 min avg 1 hour avg
-------------------- --------- --------- --------- ----------
28748806 0 0 0 0

Packets Dropped In Processing by CPU event

Event Total 5 sec avg 1 min avg 5 min avg 1 hour avg
----------------- -------------------- --------- --------- --------- ----------
Sa Miss 337556 0 0 0 0
Input ACl Copy 6038238 0 0 0 0
Vs Tunnel Control 22373001 0 0 0 0
Sw Packet w/ TxInfo 11 0 0 0 0

Packets Dropped In Processing by Priority

Priority Total 5 sec avg 1 min avg 5 min avg 1 hour avg
----------------- -------------------- --------- --------- --------- ----------
Unknown 1136072 0 0 0 0
Normal 5029813 0 0 0 0
Medium 623001 0 0 0 0
High 767450 0 0 0 0
Crucial 21192470 0 0 0 0

Packets Dropped In Processing by Reason

Reason Total 5 sec avg 1 min avg 5 min avg 1 hour avg
------------------ -------------------- --------- --------- --------- ----------
STPDrop 22 0 0 0 0
Tx Mode Drop 6134797 0 0 0 0
Qos Policer Drop 11 0 0 0 0
Extra packet received on VSS-Standby 240975 0 0 0 0
Packet does not contain any local TxInfos 15960367 0 0 0 0
No Vsl port found 1 0 0 0 0
L2 control packet Tx for Vsl port 5276561 0 0 0 0
L2 Ctrl Packet received as SA miss 895097 0 0 0 0
L3 Ctrl Packet copied to Standby 240975 0 0 0 0

Total packet queues 64

Packets Received by Packet Queue

Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
---------------------- --------------- --------- --------- --------- ----------
Input ACL fwd(snooping) 580190 0 0 0 0
Vslp 290214366 2 0 0 0
Host Learning 1195302 0 0 0 0
L2 Control 370461553 2 0 0 0
Input ACL log, unreach 8703718 0 0 0 0
L3 Glean 367665388 0 0 0 0
Vs Mgmt 567470727 10 1 3 1
L3 Receive 949611372 20 9 7 7
Vs Tunnel Ctrl Pkt 1068996239 0 0 0 0
Ttl Expired 1138659 0 0 0 0
Vs Tunnel Data Pkt 216271487 0 0 0 0
Bfd 278749 0 0 0 0
Adj SameIf Fail 12396709712 32900 36738 29504 28245
L2 router to CPU, 7 94694858 0 0 0 0
L3 Fwd 251 0 0 0 0

Packets Dropped by Packet Queue

Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
---------------------- --------------- --------- --------- --------- ----------
Vs Tunnel Data Pkt 3573 0 0 0 0
Adj SameIf Fail 59102240 267 249 191 162
L2 router to CPU, 7 51 0 0 0 0

 

Executing the command on VSS member switch role = VSS Standby, id = 2

 

RkGenericPacketMan:
Packet allocation failures: 0
Packet Buffer(SW Common) allocation failures: 0
Packet Buffer(SW ESMP) allocation failures: 0
Packet Buffer(SW EOBC) allocation failures: 0
Packet Buffer(SW SupToSup) allocation failures: 0

Packets Dropped In Processing Overall

Total 5 sec avg 1 min avg 5 min avg 1 hour avg
-------------------- --------- --------- --------- ----------
5484127 0 0 0 0

Packets Dropped In Processing by CPU event

Event Total 5 sec avg 1 min avg 5 min avg 1 hour avg
----------------- -------------------- --------- --------- --------- ----------
Input ACl Copy 383719 0 0 0 0
Vs Tunnel Control 5100408 0 0 0 0

Packets Dropped In Processing by Priority

Priority Total 5 sec avg 1 min avg 5 min avg 1 hour avg
----------------- -------------------- --------- --------- --------- ----------
Unknown 383721 0 0 0 0
Medium 383721 0 0 0 0
Crucial 4716685 0 0 0 0

Packets Dropped In Processing by Reason

Reason Total 5 sec avg 1 min avg 5 min avg 1 hour avg
------------------ -------------------- --------- --------- --------- ----------
Extra packet received on VSS-Standby 383719 0 0 0 0
L2 control packet Tx for Vsl port 4716685 0 0 0 0
L2 Ctrl Packet received as SA miss 2 0 0 0 0
L3 Ctrl Packet copied to Standby 383721 0 0 0 0

Total packet queues 64

Packets Received by Packet Queue

Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
---------------------- --------------- --------- --------- --------- ----------
Vslp 259428828 1 0 0 0
Host Learning 62402 0 0 0 0
L2 Control 48 0 0 0 0
Input ACL log, unreach 769576 0 0 0 0
Vs Mgmt 208461545 4 0 1 1
Vs Tunnel Ctrl Pkt 3611871410 27 22 21 22
Ttl Expired 3 0 0 0 0
Vs Tunnel Data Pkt 540862844 3 0 2 2
Bfd 18 0 0 0 0
L2 router to CPU, 7 7984384 0 0 0 0

Packets Dropped by Packet Queue

Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
---------------------- --------------- --------- --------- --------- ----------
Host Learning 3221 0 0 0 0

Cat4506E#show platform health

Executing the command on VSS member switch role = VSS Active, id = 1

K5CpuMan Review 30.00 62.74 30 44 100 500 100 96 76 22596:27
K5ForerunnerPacketMa 2.00 27.06 4 16 100 500 38 38 31 10095:12

 

12 Replies 12

balaji.bandi
Hall of Fame
Hall of Fame

what verison of code running, how long the switch uptime ?

are you seeing this high CPU recently, any big changes in the network.

worth looking for below thread and troublshoot tips :

https://community.cisco.com/t5/switching/high-cpu-4500x-utilization/td-p/2252145

https://www.cisco.com/c/en/us/support/docs/switches/catalyst-4000-series-switches/65591-cat4500-high-cpu.html#toc-hId--25176116

 

BB

***** Rate All Helpful Responses *****

How to Ask The Cisco Community for Help

Hi 

Version is 03.07.02.E 

how long the switch uptime?

7 years, 49 weeks, 3 days, 11 hours, 53 minutes

are you seeing this high CPU recently, any big changes in the network

No.

 

first option - i would reboot standby switch and then switch over active to standby in VSS and check

if possible when you get chance upgrae to latest stable code and check

 

BB

***** Rate All Helpful Responses *****

How to Ask The Cisco Community for Help

I will ask end user and check

Joseph W. Doherty
Hall of Fame
Hall of Fame

This an XE IOS?

If so, believe it would be useful to examine CPU stats internal to IOSd (believe there's a command for that, but don't recall what it is).

hi

yes, it is ios xe

IOS XE  you can use below document to see what is causing the issue :

https://www.cisco.com/c/en/us/support/docs/ios-nx-os-software/ios-xe-16/213549-troubleshoot-high-cpu-usage-in-catalyst.html

 

BB

***** Rate All Helpful Responses *****

How to Ask The Cisco Community for Help

show processes cpu detailed process iosd sorted

Was the command I was trying to recall (from reading an earlier @Peter Paluch posting).

hi 

yes as i check with that command 

iosd, Cat4k Mgmt LoPri and K5CpuMan Review are very high cpu usage start from 28 Sept to till now.

Leo Laohoo
Hall of Fame
Hall of Fame

If that VSS pair has been on 3.7.2 for >7 years without a reboot/crash, then leave it alone.

hi yes, but it is start happen from 28 September to till now. 

iosd, Cat4k Mgmt LoPri and K5CpuMan Review are very high cpu usage

Can the firmware of the switch be upgraded?

Review Cisco Networking for a $25 gift card