High CPU Utilization due to Cat4k Mgmt LoPri in Cisco 4510R

[Ranjan Singh]

Hi 

I am facing high CPU utilization now a days in Cisco 4510R model. I can see that Cat4k Mgmt LoPri is taking high Process. Some times Utilization goes 60 to 70 percent.I am trying to troubleshoot this issue. Please help me to find out the root cause. I have attached log for below output

sh proc cpu sorted

sh platform health

sh platform cpu packet stat all

sh log

Your input would be highly appreciated.

[Diana Karolina Rojas]

Hello!

You are experiencing a bug, you can fix it updating your SW software to these versions: 12.2(50)SG6, 12.2(53)SG1

Reference: https://bst.cloudapps.cisco.com/bugsearch/bug/CSCsy32312/?referring_site=bugquickviewredir

---Do not forget to rate useful answers---

Regards,

[Ranjan Singh]

Hi Diana,

I am using cat4500-entservicesk9-mz.150-2.SG8.bin in my Cisco 5410R SW. Please suggest do i still need to upgrade IOS.

Thanks in advance.

[Diana Karolina Rojas]

Do you see something in your logs when this problem is present? can you provide your "show log" output? and Can you provide the output of this comand "show platform health"?

---Do not forget to rate useful answers---

Regards,

[Ranjan Singh]

Hi Diana,

Please refer attached log

PNJSR-A02-MSDDC-SW4510R-01#sh platform health
%CPU %CPU RunTimeMax Priority Average %CPU Total
Target Actual Target Actual Fg Bg 5Sec Min Hour CPU
GalChassisVp-review 3.00 0.17 10 17 100 500 0 0 0 1324:31
S2w-JobEventSchedule 10.00 1.22 10 8 100 500 1 1 1 10433:05
Stub-JobEventSchedul 10.00 1.49 10 4 100 500 1 1 1 13596:25
Lj-poll 1.00 0.02 2 1 100 500 0 0 0 223:22
StatValueMan Update 1.00 0.08 1 0 100 500 0 0 0 1047:46
Pim-review 0.10 0.00 1 0 100 500 0 0 0 86:39
Ebm-host-review 1.00 0.00 8 6 100 500 0 0 0 182:00
Ebm-host-util-review 1.00 0.00 10 0 100 500 0 0 0 1:53
Ebm-port-review 0.10 0.00 1 0 100 500 0 0 0 6:18
Protocol-aging-revie 0.20 0.00 2 0 100 500 0 0 0 0:21
EbmHostRedundancyMan 2.00 0.00 20 0 100 500 0 0 0 0:00
Acl-Flattener 1.00 0.00 10 4 100 500 0 0 0 0:00
GalChassisVp Ondeman 2.00 0.00 2 0 100 500 0 0 0 0:00
KxAclPathMan create/ 1.00 0.00 10 5 100 500 0 0 0 0:12
KxAclPathMan update 2.00 0.00 10 2 100 500 0 0 0 0:00
KxAclPathMan reprogr 1.00 0.00 2 0 100 500 0 0 0 0:00
TagMan-RecreateMtegR 1.00 0.00 10 5 100 500 0 0 0 0:00
K2CpuMan Review 30.00 31.81 30 95 100 500 40 48 33 65752:19
K2AccelPacketMan: Tx 10.00 1.59 20 0 100 500 1 1 1 10209:30
K2AccelPacketMan: Au 0.10 0.00 0 0 100 500 0 0 0 0:00
K2AclMan-labeledFlat 1.00 0.00 10 5 100 500 0 0 0 0:00
K2AclCamMan stale en 1.00 0.00 10 5 100 500 0 0 0 0:00
K2AclCamMan consolid 1.00 0.00 10 5 100 500 0 0 0 0:00
K2AclCamMan hw stats 3.00 1.11 10 5 100 500 0 0 0 3931:06
K2AclCamMan kx stats 1.00 0.55 10 5 100 500 0 0 0 2156:09
K2AclCamMan Audit re 1.00 19.42 10 5 100 500 2 0 0 2008:35
K2AclPolicerTableMan 1.00 0.00 10 1 100 500 0 0 0 119:30
K2L2 Address Table R 2.00 0.00 12 5 100 500 0 0 0 3755:51
K2L2 New Static Addr 2.00 0.00 10 3 100 500 0 0 0 0:00
K2L2 New Multicast A 2.00 0.00 10 5 100 500 0 0 0 0:03
K2L2 Dynamic Address 2.00 0.00 10 5 100 500 0 0 0 0:02
K2L2 PPE Vlan Table 2.00 0.35 10 5 100 500 0 0 0 3592:37
K2L2 Vlan Table Revi 2.00 0.00 12 8 100 500 0 0 0 0:17
K2PortMan Review 3.00 2.31 15 11 100 500 3 3 2 24563:20
Gigaport0 Review 0.40 0.05 4 1 100 500 0 0 0 634:22
Gigaport1 Review 0.40 0.06 4 5 100 500 0 0 0 650:33
Gigaport2 Review 0.40 0.06 4 2 100 500 0 0 0 648:32
Gigaport3 Review 0.40 0.44 4 23 100 500 0 0 0 1871:35
Gigaport4 Review 0.40 0.43 4 1 100 500 0 0 0 3174:06
Gigaport5 Review 0.40 0.06 4 4 100 500 0 0 0 656:46
Gigaport6 Review 0.40 0.05 4 1 100 500 0 0 0 630:02
Gigaport7 Review 0.40 0.06 4 5 100 500 0 0 0 649:48
Gigaport8 Review 0.40 0.06 4 9 100 500 0 0 0 650:17
Gigaport9 Review 0.40 0.01 4 2 100 500 0 0 0 96:55
Gigaport10 Review 0.40 0.06 4 4 100 500 0 0 0 648:19
Gigaport11 Review 0.40 0.01 4 2 100 500 0 0 0 95:46
Gigaport12 Review 0.40 0.00 4 2 100 500 0 0 0 105:48
Gigaport13 Review 0.40 0.01 4 2 100 500 0 0 0 104:41
Gigaport14 Review 0.40 0.00 4 2 100 500 0 0 0 97:12
Gigaport15 Review 0.40 0.01 4 2 100 500 0 0 0 96:23
Gigaport16 Review 0.40 0.06 4 5 100 500 0 0 0 652:01
Gigaport17 Review 0.40 0.06 4 8 100 500 0 0 0 646:47
Gigaport18 Review 0.40 0.43 4 9 100 500 0 0 0 2612:24
Gigaport19 Review 0.40 0.05 4 8 100 500 0 0 0 650:47
Gigaport20 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport21 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport22 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport23 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport24 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport25 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport26 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport27 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport28 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport29 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport30 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport31 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport32 Review 0.40 0.43 4 6 100 500 0 0 0 673:41
Gigaport33 Review 0.40 0.06 4 4 100 500 0 0 0 647:04
Gigaport34 Review 0.40 0.06 4 5 100 500 0 0 0 648:39
Gigaport35 Review 0.40 0.05 4 4 100 500 0 0 0 650:52
Gigaport36 Review 0.40 0.05 4 4 100 500 0 0 0 649:00
Gigaport37 Review 0.40 0.39 4 10 100 500 0 0 0 1714:38
Gigaport38 Review 0.40 0.43 4 9 100 500 0 0 0 1876:43
Gigaport39 Review 0.40 0.06 4 9 100 500 0 0 0 1522:12
Gigaport40 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport41 Review 0.40 0.06 4 4 100 500 0 0 0 647:01
Gigaport42 Review 0.40 0.00 4 0 100 500 0 0 0 0:00
Gigaport43 Review 0.40 0.06 4 5 100 500 0 0 0 3006:20
Gigaport44 Review 0.40 0.47 4 1 100 500 0 0 0 3173:12
Gigaport45 Review 0.40 0.43 4 9 100 500 0 0 0 1964:47
Gigaport46 Review 0.40 0.42 4 1 100 500 0 0 0 3172:17
Gigaport47 Review 0.40 0.05 4 11 100 500 0 0 0 647:54
K2Fib cam usage revi 2.00 0.00 15 0 100 500 0 0 0 0:00
K2Fib IrmFib Review 2.00 0.00 15 7 100 500 0 0 0 0:01
K2Fib AdjRepop Revie 2.00 0.00 15 0 100 500 0 0 0 0:15
K2Fib Vrf Unpunt Rev 2.00 0.00 15 0 100 500 0 0 0 76:10
K2Fib Consistency Ch 1.00 0.51 5 2 100 500 0 0 0 4941:29
K2FibAdjMan Stats Re 2.00 0.04 10 7 100 500 0 0 0 2056:23
K2FibAdjMan Host Mov 2.00 0.00 10 7 100 500 0 0 0 107:11
K2FibAdjMan Adj Chan 2.00 0.00 10 0 100 500 0 0 0 0:00
K2FibMulticast Signa 2.00 0.00 10 1 100 500 0 0 0 244:22
K2FibMulticast Entry 2.00 0.00 10 5 100 500 0 0 0 0:01
K2FibMulticast Irm M 2.00 0.00 10 0 100 500 0 0 0 0:00
K2FibFastDropMan Rev 2.00 0.00 7 0 100 500 0 0 0 0:00
K2FibPbr route map r 2.00 0.12 20 5 100 500 0 0 0 2879:40
K2FibPbr flat acl pr 2.00 0.03 20 1 100 500 0 0 0 503:52
K2FibPbr consolidati 2.00 0.00 10 0 100 500 0 0 0 103:41
K2FibPerVlanPuntMan 2.00 0.00 15 3 100 500 0 0 0 0:00
K2FibWccpMan Service 2.00 0.00 20 0 100 500 0 0 0 0:00
K2FibWccpMan Cache E 2.00 0.00 20 0 100 500 0 0 0 0:00
K2FibWccpMan Redirec 2.00 0.00 20 0 100 500 0 0 0 0:00
K2FibWccpMan AdjRepo 2.00 0.00 20 0 100 500 0 0 0 0:00
K2FibFC Aging review 2.00 0.00 10 0 100 500 0 0 0 67:16
K2FibFC DelFlow revi 2.00 0.00 10 0 100 500 0 0 0 0:00
K2FibFC Adj review 2.00 0.00 10 0 100 500 0 0 0 66:49
K2FibFC overload/rel 2.00 0.00 10 0 100 500 0 0 0 22:24
K2MetStatsMan Review 2.00 0.02 5 2 100 500 0 0 0 2679:06
K2FibMulticast MET S 2.00 0.00 10 0 100 500 0 0 0 0:00
K2QosDblMan Rate DBL 2.00 0.10 7 0 100 500 0 0 0 930:05
K2 VlanStatsMan Revi 2.00 0.37 15 1 100 500 0 0 0 2706:53
K2 Packet Memory Dia 2.00 0.00 15 8 100 500 0 0 0 7158:18
K2 L2 Aging Table Re 2.00 0.20 20 2 100 500 0 0 0 1121:39
K2PacketBufMonitor-P 3.00 2.83 10 1 100 500 2 2 2 20311:30
RkiosPortMan Port Re 2.00 0.30 12 9 100 500 0 0 0 2430:51
Rkios Module State R 4.00 0.04 40 9 100 500 0 0 0 270:34
Rkios Online Diag Re 4.00 0.03 40 0 100 500 0 0 0 262:51
MatMan Review 0.50 0.00 4 0 100 500 0 0 0 0:00
RkiosIpPbr IrmPort R 2.00 0.15 10 2 100 500 0 0 0 413:17
RkiosIpWccp IrmWccpW 2.00 0.01 10 0 100 500 0 0 0 45:10
RkiosAclMan Review 3.00 0.04 30 3 100 500 0 0 0 502:28
EthHoleLinecardMan(1 1.11 0.02 10 0 100 500 0 0 0 249:13
EthHoleLinecardMan(2 1.11 0.02 10 0 100 500 0 0 0 249:36
EthHoleLinecardMan(3 1.11 0.22 10 7 100 500 0 0 0 2449:43
EthHoleLinecardMan(4 1.11 0.32 10 6 100 500 0 0 0 2450:12
EthHoleLinecardMan(5 1.11 0.21 10 7 100 500 0 0 0 2456:15
EthHoleLinecardMan(6 1.11 0.21 10 6 100 500 0 0 0 2450:01
-------------
%CPU Totals 206.86 71.25

Allocation ceiling Current allocation
------------------ ------------------
kbytes % in use kbytes % in use

Linecard 1's Store 258.00 15% 39.06 100%
Linecard 2's Store 258.00 15% 38.91 100%
Linecard 3's Store 258.00 15% 41.17 100%
Linecard 4's Store 258.00 15% 41.16 100%
Linecard 5's Store 258.00 15% 41.17 100%
Linecard 6's Store 258.00 15% 41.16 100%
Linecard 7's Store 258.00 61% 159.16 100%
Linecard 8's Store 258.00 0% 0.00 0%
Linecard 9's Store 258.00 0% 0.00 0%
Linecard 10's Store 258.00 0% 0.00 0%
TSM objects ------------------ ------------------
PacketInfoItem 781.25 0% 0.31 0%
VbufNodes2400 80.50 0% 0.00 0%
VbufNodes1600 55.50 0% 3.46 0%
VbufNodes400 288.00 1% 5.06 77%
VbufNodes64 60.00 0% 3.28 0%
VbufNodes4200 68.37 0% 0.00 0%
PacketBufRaw 25219.50 100% 25219.50 100%
PacketBufRawJumbo 184.29 100% 184.29 100%
RkiosSysPacketBuf 250.00 0% 0.75 0%
Packet 1925.39 2% 51.85 96%
MatEntrys 9600.00 0% 4.68 100%
MatEntryTableIterato 1.00 0% 0.03 0%
PimPhyports 1093.75 36% 393.75 100%
PimPorts 921.87 42% 390.87 100%
PimModules 262.00 2% 7.16 100%
PimSlots 18.00 3% 0.70 100%
PimChassis 40.12 6% 2.50 100%
PimQuack 1.64 0% 0.00 0%
EbmVlans 5408.00 0% 33.00 100%
EbmVlanGroupEntrys 3968.00 0% 2.54 80%
EbmPorts 392.00 41% 161.92 100%
EbmPortHostEntrys 448.00 0% 0.00 0%
EbmIeNodes 540.00 0% 5.27 100%
EbmPortVlanAclFeatur 3072.00 0% 0.00 0%
EbmPortVlanMap Alloc 64.00 0% 0.00 0%
EbmSortedHostTableIt 1.75 0% 0.05 0%
EbmSortedGroupTableI 1.75 0% 0.05 0%
EbmHostRedundancyMan 1082.81 0% 0.98 100%
IrmVrfs 318.00 0% 2.48 100%
IrmFibLoadBalances 1280.00 0% 0.03 0%
IrmFibAdjs 1920.00 0% 17.10 75%
IrmPortEtherAddrEntr 500.00 0% 0.00 0%
IrmFibEntries 12288.00 0% 34.78 69%
IrmMfibEntryMemMan 6656.00 0% 0.30 100%
IrmWccpMemMan 34.25 0% 0.00 0%
IrmWccpServiceGroupL 0.06 0% 0.00 0%
AclOp 2176.00 0% 0.06 0%
AclOpAceSet 3264.00 0% 0.14 0%
AclClassifier 1280.00 0% 1.60 95%
AclFeature 2574.79 0% 2.07 85%
Acl 1536.00 0% 1.96 95%
Ace24 10880.00 0% 8.43 64%
Ace48 17408.00 0% 0.37 100%
AclFlowLabelListNode 7616.00 0% 0.00 0%
AceActionDescStorage 1088.00 0% 0.00 0%
AclListNode 512.00 0% 0.32 95%
AceListNode 25600.00 0% 1.09 30%
AclClassifierActionL 2560.00 0% 1.44 94%
AclLayerFeatureListN 512.00 0% 0.07 0%
AclClassifierListNod 512.00 0% 0.00 0%
TableMapMan NameToTa 27.00 0% 0.00 0%
TableMapAllocator 128.00 0% 0.00 0%
FlatAcl 512.00 0% 0.14 22%
FlatAce24 11264.00 0% 11.68 31%
FlatAce48 17408.00 0% 0.00 0%
FlatAceActionListNod 307200.00 0% 6.42 31%
FlatAclOpSetStorage 3072.00 0% 0.00 0%
FlatAclCacheNode 4224.00 0% 0.38 0%
FlatAclListNode 256.00 0% 0.04 33%
QosFeatureClassifier 343.51 0% 0.00 0%
QosFeatureClassifier 687.03 0% 0.00 0%
QosClassifierActionL 9618.43 0% 0.00 0%
QosNestedClassifierA 15114.68 0% 0.00 0%
QosPortVlanAclFeatur 1224.00 0% 0.00 0%
QoS Policers 37000.00 0% 0.00 0%
Qos FlowFnf 7.81 0% 0.00 0%
KxAclPath 1024.00 0% 0.06 0%
KxAclPathListNode 1280.00 0% 0.00 0%
KxAclConstPathListNo 1280.00 0% 0.00 0%
IndexCache 800.78 0% 0.00 0%
ConfigToHwAfMap 203.27 0% 0.00 0%
HwToCfgAceMap 816.00 0% 0.00 0%
CommandTables 48.00 22% 10.59 100%
K2FibWccpServiceGrou 162.59 0% 0.00 0%
K2FibPbrFlatRouteMap 494.04 0% 0.00 0%
K2FibPbrExpandedFlat 2304.00 0% 0.00 0%
K2FibPbrFlatRouteMap 320.00 0% 0.00 0%
K2FibVrfs 152.00 0% 1.18 100%
K2 Netflow FPT Entri 11.97 0% 0.00 0%
K2TxPacket 384.00 0% 0.09 0%
K2TxPacketInfo 256.00 0% 0.14 0%
KxAclLabeledFlatAcl 3584.00 0% 0.32 0%
KxAclLabeledFlatAclE 3072.00 0% 0.14 0%
EbmVlanHostEntrys 2048.00 0% 85.06 21%
GalGbicEntrys 16.73 0% 0.00 0%
Rkios QoS PolicyMaps 357.57 0% 0.00 0%
AclClassifierIdToCla 48.00 0% 0.00 0%
Rkios QoS ClassMaps 1024.00 0% 0.03 100%
AclToIosFilterMapLis 384.00 0% 0.00 0%
Rkios QoS Policers 3500.00 0% 0.00 0%
RkiosAclMan NamedGal 43.75 0% 0.03 0%
EpmPolicyListNode 120.00 0% 0.00 0%
EpmAceListNode 192.00 0% 0.00 0%
RkiosAclSecurityEpmP 4080.00 0% 0.00 0%
Rkios Acl VlanMaps 128.00 0% 0.00 0%
Rkios Acl VlanMapEnt 937.50 0% 0.00 0%
RkiosTableMap Galios 3.00 0% 0.00 0%
IrmMfibIntrfs 3072.00 0% 0.00 0%
Event Nodes 160.00 0% 2.31 27%
Event Nodes 160.00 1% 34.34 7%
IrmFlows 384.00 0% 0.00 0%
K2AclMappingTableEnt 105.89 0% 0.01 0%
K2AclMappingTableEnt 70.59 0% 0.00 0%
K2AclTagPairSignatur 1792.00 0% 0.16 0%
RkisoIpPbrRouteMaps 97.65 0% 0.00 0%
------------------ ------------------
TSM totals 599348.48 4% 26697.60 99%

NJSR-A02-MSDDC-SW4510R-01# sh log
Syslog logging: enabled (0 messages dropped, 110 messages rate-limited, 0 flushes, 0 overruns, xml disabled, filtering disabled)

No Active Message Discriminator.

No Inactive Message Discriminator.

Console logging: level informational, 22609 messages logged, xml disabled,
filtering disabled
Monitor logging: level informational, 0 messages logged, xml disabled,
filtering disabled
Buffer logging: level informational, 22718 messages logged, xml disabled,
filtering disabled
Exception Logging: size (8192 bytes)
Count and timestamp logging messages: disabled
Persistent logging: disabled

No active filter modules.

Trap logging: level informational, 22722 message lines logged
Logging to 172.31.16.181 (udp port 514, audit disabled,
authentication disabled, encryption disabled, link up),
22722 message lines logged,
0 message lines rate-limited,
0 message lines dropped-by-MD,
xml disabled, sequence number disabled
filtering disabled

Log Buffer (4096 bytes):
Down
Jun 29 14:48:47.523 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Down->Up
Jun 29 15:26:40.794 IST: %TRACKING-5-STATE: 1 ip sla 1 reachability Up->Down
Jun 29 15:31:31.084 IST: %TRACKING-5-STATE: 1 ip sla 1 reachability Down->Up
Jun 29 15:53:11.378 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Up->Down
Jun 29 15:53:16.378 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Down->Up
Jun 29 17:03:44.401 IST: %OSPF-5-ADJCHG: Process 20, Nbr 172.27.209.6 on Vlan20 from LOADING to FULL, Loading Done
Jun 29 17:07:21.221 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Up->Down
Jun 29 17:07:26.237 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Down->Up
Jun 30 02:32:41.873 IST: %TRACKING-5-STATE: 1 ip sla 1 reachability Up->Down
Jun 30 04:08:33.718 IST: %C4K_L2MAN-6-INVALIDSOURCEADDRESSPACKET: (Suppressed 717 times)Packet received with invalid source MAC address (00:00:00:00:00:00) on port Gi5/2 in vlan 1
Jun 30 06:53:51.810 IST: %C4K_REDUNDANCY-5-CALENDAR_RATELIMIT: The calendar has been successfully synchronized to the standby supervisor24 times since last calendar syslog
Jun 30 08:10:52.842 IST: %TRACKING-5-STATE: 1 ip sla 1 reachability Down->Up
Jun 30 10:08:33.887 IST: %C4K_L2MAN-6-INVALIDSOURCEADDRESSPACKET: (Suppressed 528765 times)Packet received with invalid source MAC address (00:00:00:00:00:00) on port Gi4/4 in vlan 1
Jun 30 10:47:18.257 IST: %SYS-5-CONFIG_I: Configured from console by ranjank.tcs on vty0 (172.20.54.14)
Jun 30 10:47:49.548 IST: %SYS-5-CONFIG_I: Configured from console by ranjank.tcs on vty0 (172.20.54.14)
Jun 30 10:48:20.828 IST: %SYS-5-CONFIG_I: Configured from console by ranjank.tcs on vty0 (172.20.54.14)
Jun 30 12:27:22.219 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Up->Down
Jun 30 12:27:27.243 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Down->Up
Jun 30 13:02:30.810 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet5/3, changed state to down
Jun 30 13:02:31.810 IST: %LINK-3-UPDOWN: Interface GigabitEthernet5/3, changed state to down
Jun 30 13:03:09.061 IST: %OSPF-5-ADJCHG: Process 20, Nbr 172.27.209.6 on Vlan20 from FULL to DOWN, Neighbor Down: Dead timer expired
Jun 30 13:03:09.077 IST: %OSPF-5-ADJCHG: Process 20, Nbr 172.27.209.8 on Vlan20 from LOADING to FULL, Loading Done
Jun 30 13:03:35.768 IST: %LINK-3-UPDOWN: Interface GigabitEthernet5/3, changed state to up
Jun 30 13:03:36.768 IST: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet5/3, changed state to up
Jun 30 15:13:12.026 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Up->Down
Jun 30 15:13:17.026 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Down->Up
Jun 30 15:25:22.731 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Up->Down
Jun 30 15:25:27.731 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Down->Up
Jun 30 15:33:53.269 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Up->Down
Jun 30 15:33:58.273 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Down->Up
Jun 30 15:34:53.323 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Up->Down
Jun 30 15:34:58.331 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Down->Up
Jun 30 16:54:38.039 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Up->Down
Jun 30 16:54:43.038 IST: %TRACKING-5-STATE: 2 ip sla 2 reachability Down->Up
Jun 30 19:43:49.467 IST: %TRACKING-5-STATE: 1 ip sla 1 reachability Up->Down
Jun 30 19:56:05.358 IST: %TRACKING-5-STATE: 1 ip sla 1 reachability Down->Up
Jul 1 06:53:52.267 IST: %C4K_REDUNDANCY-5-CALENDAR_RATELIMIT: The calendar has been successfully synchronized to the standby supervisor24 times since last calendar syslog
Jul 2 06:53:52.724 IST: %C4K_REDUNDANCY-5-CALENDAR_RATELIMIT: The calendar has been successfully synchronized to the standby supervisor24 times since last calendar syslog
Jul 3 02:34:27.915 IST: %C4K_L2MAN-6-INVALIDSOURCEADDRESSPACKET: (Suppressed 254750 times)Packet received with invalid source MAC address (00:00:00:00:00:00) on port Gi5/2 in vlan 1
Jul 3 06:53:53.168 IST: %C4K_REDUNDANCY-5-CALENDAR_RATELIMIT: The calendar has been successfully synchronized to the standby supervisor24 times since last calendar syslog
PNJSR-A02-MSDDC-SW4510R-01#

[Diana Karolina Rojas]

Hello!

The output of the K2CpuMan Review process is high, I need you can provide me the output of the "show platform cpu packet statistics", but send me this when you have gotten enough statistics, for about an hour or more. I will try to help you, you also can read this document from Cisco. http://www.cisco.com/c/en/us/support/docs/switches/catalyst-4000-series-switches/65591-cat4500-high-cpu.html

---Do not forget to rate useful answers---

Regards,

[Ranjan Singh]

Hi Diana,

Please check the attached Text for show platform cpu packet statistics. Please help .

[Ranjan Singh]

Hi Daina,

Please find output...please help to reduce high CPU utilization

PNJSR-A02-MSDDC-SW4510R-01#sh proc cpu sorted
CPU utilization for five seconds: 87%/2%; one minute: 76%; five minutes: 77%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
59 36450979241395712081 2611 65.16% 53.21% 54.08% 0 Cat4k Mgmt LoPri
58 26851549934270567923 0 13.27% 13.33% 13.50% 0 Cat4k Mgmt HiPri
14 7526620691562023671 481 2.71% 2.96% 3.40% 0 ARP Input
121 2403071921237554374 194 1.11% 1.09% 1.07% 0 ADJ resolve proc
3 212 131 1618 0.55% 0.25% 0.06% 1 SSH Process
241 100725782482774845 0 0.31% 0.29% 0.29% 0 IP SLAs Event Pr
82 91852213424555727 0 0.23% 0.25% 0.24% 0 Ethernet Msec Ti
125 66626092 307105490 216 0.23% 0.20% 0.21% 0 Spanning Tree
118 59500976 465453350 127 0.23% 0.11% 0.08% 0 IP Input
39 185179525 55739181 3322 0.15% 0.15% 0.15% 0 IDB Work
168 2820886 90049891 31 0.07% 0.06% 0.07% 0 CEF: IPv4 proces
66 1841161 14001463 131 0.07% 0.02% 0.00% 0 Compute load avg
254 1129568 57607103 19 0.07% 0.00% 0.00% 0 OSPF-20 Router
56 15466677 128839214 120 0.07% 0.04% 0.02% 0 DHCPD Receive
112 3903408 71270545 54 0.07% 0.03% 0.02% 0 cpf_process_tpQ
42 193432 56338110 3 0.07% 0.00% 0.00% 0 Per-Second Jobs
99 3408005 557358797 6 0.07% 0.12% 0.13% 0 UDLD
17 0 2 0 0.00% 0.00% 0.00% 0 AAA high-capacit
16 0 13 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT
18 0 1 0 0.00% 0.00% 0.00% 0 Policy Manager
19 40 186 215 0.00% 0.00% 0.00% 0 Entity MIB API
22 82735 55681995 1 0.00% 0.00% 0.00% 0 IPC Mcast Pendin
15 0 1 0 0.00% 0.00% 0.00% 0 CEF MIB API
24 8 10 800 0.00% 0.00% 0.00% 0 IPC Session Serv
11 0 1 0 0.00% 0.00% 0.00% 0 Crash writer
20 0 1 0 0.00% 0.00% 0.00% 0 IFS Agent Manage
21 45154 11136517 4 0.00% 0.00% 0.00% 0 IPC Event Notifi
28 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat TX Cont
29 81436 55681998 1 0.00% 0.00% 0.00% 0 IPC Deferred Por
23 10339 928051 11 0.00% 0.00% 0.00% 0 IPC Dynamic Cach
31 132 42 3142 0.00% 0.00% 0.00% 0 PrstVbl
32 4 6 666 0.00% 0.00% 0.00% 0 client_entity_se

PNJSR-A02-MSDDC-SW4510R-01#show platform cpu packet statistics
Packets Dropped In Hardware By CPU Subport (txQueueNotAvail)

CPU Subport TxQueue 0 TxQueue 1 TxQueue 2 TxQueue 3
------------ --------------- --------------- --------------- ---------------
0 0 0 0 2450811285
2 0 1632 0 0
6 0 0 0 1710

RkiosSysPacketMan:
Packet allocation failures: 0
Packet Buffer(Software Common) allocation failures: 0
Packet Buffer(Software ESMP) allocation failures: 0
Packet Buffer(Software EOBC) allocation failures: 0
Packet Buffer(Software SupToSup) allocation failures: 0
IOS Packet Buffer Wrapper allocation failures: 0

Packets Dropped In Processing Overall

Total 5 sec avg 1 min avg 5 min avg 1 hour avg
-------------------- --------- --------- --------- ----------
34247302 0 0 0 0

Packets Dropped In Processing by CPU event

Event Total 5 sec avg 1 min avg 5 min avg 1 hour avg
----------------- -------------------- --------- --------- --------- ----------
Input Acl 12889965 0 0 0 0
SA Miss 742 0 0 0 0
L2 Forward 21356594 0 0 0 0

Packets Dropped In Processing by Priority

Priority Total 5 sec avg 1 min avg 5 min avg 1 hour avg
----------------- -------------------- --------- --------- --------- ----------
Normal 21665706 0 0 0 0
Medium 743 0 0 0 0
High 12580854 0 0 0 0

Packets Dropped In Processing by Reason

Reason Total 5 sec avg 1 min avg 5 min avg 1 hour avg
------------------ -------------------- --------- --------- --------- ----------
SrcAddrTableFilt 166 0 0 0 0
STPDrop 85548 0 0 0 0
L2DstDrop 4 0 0 0 0
NoDstPorts 12889917 0 0 0 0
NoFloodPorts 21271667 0 0 0 0

Total packet queues 16

Packets Received by Packet Queue

Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
---------------------- --------------- --------- --------- --------- ----------
Esmp 2268795111 47 41 35 28
L2/L3Control 418193312 8 4 5 3
Host Learning 35355757 13 6 5 0
L3 Fwd Low 10271479677 1076 1097 1037 1804
L2 Fwd Low 2595582255 126 131 124 165
L3 Rx Low 60509121 1 0 1 0

Packets Dropped by Packet Queue

Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
---------------------- --------------- --------- --------- --------- ----------
Host Learning 224347 0 0 0 0
L3 Fwd Low 95748 0 0 0 0
L2 Fwd Low 644553 0 0 0 0

PNJSR-A02-MSDDC-SW4510R-01#

[wzahoor123]

Hi there, did you get any solution for it? we are experiencing same issue on 4503 having same IOS...