High CPU

Robo123 — Thu, 09 Jun 2022 07:10:09 GMT

I have a Cisco 3750 Switch running with version 15.2(4)E10 where i am experiencing High cpu Due to interupt.

CPU utilization for five seconds: 98%/17%; one minute: 98%; five minutes: 95%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
233 61574775 29293093 2102 53.11% 54.63% 52.95% 0 IP Input
181 35165004 368150864 95 10.55% 11.10% 10.43% 0 Hulc LED Process
4 336865375 14592994 23084 4.47% 1.70% 1.90% 0 Check heaps
88 213996009 57161549 3743 2.23% 1.78% 1.76% 0 RedEarth Tx Mana
129 14498779 294850241 49 1.43% 0.96% 0.91% 0 hpm main process

#sh ip traffic
IP statistics:
Rcvd: 177751942 total, 5282022 local destination
0 format errors, 0 checksum errors, 431778 bad hop count
15 unknown protocol, 7455 not a gateway
0 security failures, 0 bad options, 0 with options
Opts: 0 end, 0 nop, 0 basic security, 0 loose source route
0 timestamp, 0 extended security, 0 record route
0 stream ID, 0 strict source route, 0 alert, 0 cipso, 0 ump
0 other
Frags: 0 reassembled, 1 timeouts, 0 couldn't reassemble
20862 fragmented, 0 couldn't fragment
0 invalid hole
Bcast: 559139 received, 2078 sent
Mcast: 0 received, 0 sent
Sent: 5653688 generated, 252460632 forwarded
Drop: 468924 encapsulation failed, 0 unresolved, 65 no adjacency
0 no route, 0 unicast RPF, 0 forced drop
0 options denied, 0 source IP address zero

ICMP statistics:
Rcvd: 0 format errors, 0 checksum errors, 0 redirects, 312 unreachable
51817 echo, 10 echo reply, 6 mask requests, 0 mask replies, 0 quench
0 parameter, 418 timestamp, 0 info request, 2 other
0 irdp solicitations, 0 irdp advertisements
Sent: 0 redirects, 0 unreachable, 30 echo, 51817 echo reply
0 mask requests, 0 mask replies, 0 quench, 418 timestamp
0 info reply, 145992 time exceeded, 0 parameter problem
0 irdp solicitations, 0 irdp advertisements

EIGRP-IPv4 statistics:
Rcvd: 0 total
Sent: 0 total

TCP statistics:
Rcvd: 1147858 total, 0 checksum errors, 2443 no port
Sent: 1527392 total

PIMv2 statistics: Sent/Received
Total: 0/0, 0 checksum errors, 0 format errors
Registers: 0/0 (0 non-rp, 0 non-sm-group), Register Stops: 0/0, Hellos: 0/0
Join/Prunes: 0/0, Asserts: 0/0, grafts: 0/0
Bootstraps: 0/0, Candidate_RP_Advertisements: 0/0
Queue drops: 0
State-Refresh: 0/0

IGMP statistics: Sent/Received
Total: 0/0, Format errors: 0/0, Checksum errors: 0/0
Host Queries: 0/0, Host Reports: 0/0, Host Leaves: 0/0
DVMRP: 0/0, PIM: 0/0
Queue drops: 0

UDP statistics:
Rcvd: 4081583 total, 0 checksum errors, 549558 no port 0 finput
Sent: 3917611 total, 0 forwarded broadcasts

OSPF statistics:
Last clearing of OSPF traffic counters never
Rcvd: 0 total, 0 checksum errors
0 hello, 0 database desc, 0 link state req
0 link state updates, 0 link state acks
Sent: 0 total
0 hello, 0 database desc, 0 link state req
0 link state updates, 0 link state acks

ARP statistics:
Rcvd: 14327274 requests, 1705 replies, 0 reverse, 0 other
Sent: 267428 requests, 11741652 replies (0 proxy), 0 reverse
Drop due to input queue full: 0

I can observe the bad hop count is getting increment can some one help me to trouble shoot it further.

Re: High CPU

Leo Laohoo — Thu, 09 Jun 2022 07:16:54 GMT

@Robo123 wrote:

233 61574775 29293093 2102 53.11% 54.63% 52.95% 0 IP Input
181 35165004 368150864 95 10.55% 11.10% 10.43% 0 Hulc LED Process

IP Input + Hulc/RED Earth = Port flapping

Re: High CPU

Robo123 — Thu, 09 Jun 2022 07:27:42 GMT

@Leo Laohoo

There is no Port flap issue observed in the device.

Re: High CPU

balaji.bandi — Thu, 09 Jun 2022 09:14:37 GMT

Drop: 468924 encapsulation failed, 0 unresolved, 65 no adjacency

how is your config looks like ? - is this short term or long term

look at show process cpu history

Troubleshoot tips :

https://www.cisco.com/c/en/us/support/docs/switches/catalyst-3750-series-switches/68461-high-cpu-utilization-cat3750.html

Re: High CPU

MHM Cisco World — Thu, 09 Jun 2022 15:54:51 GMT

High cpu

There are two thing i get from info you share,

First arp is huge

Disbale arp proxy

Second there are fragment

Check mtu in all interface the cpu fragment some packet

can I see
Switch#show platform tcam utilization

topic Re: High CPU in Wireless

High CPU

Re: High CPU

Re: High CPU

Re: High CPU

Re: High CPU