cisco switch WS-C3750X-48T cpu utilization issue

Madhuraj singh kushwah · ‎01-26-2014

Hi All,

I have a swich WS-C3750X-48T and i am facing the issue of high cpu utilization .

Please suggest the reason why the switch is behaving like this and what is the solution of that.

please find the log....

UG-GW-CORE#sh proc cpu | e 0.00

CPU utilization for five seconds: 34%/1%; one minute: 36%; five minutes: 36%

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

10 833688 1686490 494 0.31% 0.71% 0.63% 0 ARP Input

69 144766 30391 4763 0.15% 0.13% 0.11% 0 Compute load avg

74 4470389 735065 6081 2.86% 2.75% 2.77% 0 RedEarth Tx Mana

80 1068811 60462 17677 0.79% 0.70% 0.65% 0 Adjust Regions

116 2567337 295705 8682 1.58% 1.55% 1.56% 0 hpm counter proc

156 24497604 2908539 8422 15.57% 14.80% 14.65% 0 Hulc LED Process

167 546741 30415 17976 0.31% 0.31% 0.31% 0 HQM Stack Proces

198 604538 1052522 574 0.31% 0.58% 0.55% 0 IP Input

217 8967911 1674951 5354 6.04% 5.16% 5.23% 0 Spanning Tree

glen.grant · ‎01-27-2014

That's not exceptionally high , typically thw hulc led process tends to be a code issue so you might want to look at a different version or use the bug tool to see if your version has that issue.

Madhuraj singh kushwah · ‎01-27-2014

Thanks for the reply ...

Actually I replace the old switch with this one .

The olod switch was having only 20 % of cpu utilization .

but from when I replaced the old switch with the same model 3750 the cpu utilization become 45% with the same configuration of network.

some other logs is ...

UG-GW-CORE#sh ip route summary

IP routing table name is Default-IP-Routing-Table(0)

IP routing table maximum-paths is 32

Route Source Networks Subnets Overhead Memory (bytes)

connected 0 25 1600 3800

static 7 33 2560 6080

eigrp 111 2 70 9216 10944

internal 6 7032

Total 15 128 13376 27856

UG-GW-CORE#sh ip traffic

IP statistics:

Rcvd: 1278413 total, 1231221 local destination

0 format errors, 0 checksum errors, 37722 bad hop count

0 unknown protocol, 6495 not a gateway

0 security failures, 0 bad options, 271 with options

Opts: 0 end, 0 nop, 0 basic security, 0 loose source route

0 timestamp, 0 extended security, 0 record route

0 stream ID, 0 strict source route, 271 alert, 0 cipso, 0 ump

0 other

Frags: 0 reassembled, 0 timeouts, 0 couldn't reassemble

0 fragmented, 0 couldn't fragment

Bcast: 517037 received, 3132 sent

Mcast: 70972 received, 875079 sent

Sent: 1617393 generated, 504595072 forwarded

Drop: 861551 encapsulation failed, 0 unresolved, 0 no adjacency

4 no route, 0 unicast RPF, 0 forced drop

0 options denied, 0 source IP address zero

ICMP statistics:

Rcvd: 0 format errors, 0 checksum errors, 0 redirects, 18 unreachable

164547 echo, 45 echo reply, 0 mask requests, 0 mask replies, 0 quench

0 parameter, 0 timestamp, 0 info request, 0 other

0 irdp solicitations, 0 irdp advertisements

Sent: 0 redirects, 1026 unreachable, 50 echo, 164547 echo reply

0 mask requests, 0 mask replies, 0 quench, 0 timestamp

0 info reply, 6 time exceeded, 0 parameter problem

0 irdp solicitations, 0 irdp advertisements

TCP statistics:

Rcvd: 425143 total, 0 checksum errors, 1 no port

Sent: 517028 total

EIGRP-IPv4 statistics:

Rcvd: 71055 total

Sent: 0 total

PIMv2 statistics: Sent/Received

Total: 0/0, 0 checksum errors, 0 format errors

Registers: 0/0 (0 non-rp, 0 non-sm-group), Register Stops: 0/0, Hellos: 0/0

Join/Prunes: 0/0, Asserts: 0/0, grafts: 0/0

Bootstraps: 0/0, Candidate_RP_Advertisements: 0/0

State-Refresh: 0/0

IGMP statistics: Sent/Received

Total: 0/0, Format errors: 0/0, Checksum errors: 0/0

Host Queries: 0/0, Host Reports: 0/0, Host Leaves: 0/0

DVMRP: 0/0, PIM: 0/0

UDP statistics:

Rcvd: 570437 total, 0 checksum errors, 52919 no port

Sent: 59593 total, 1565718 forwarded broadcasts

OSPF statistics:

Rcvd: 0 total, 0 checksum errors

0 hello, 0 database desc, 0 link state req

0 link state updates, 0 link state acks

Sent: 0 total

0 hello, 0 database desc, 0 link state req

0 link state updates, 0 link state acks

ARP statistics:

Rcvd: 2056109 requests, 29511 replies, 245 reverse, 0 other

Sent: 404933 requests, 726725 replies (35087 proxy), 0 reverse

Drop due to input queue full: 0

CAM Utilization for ASIC# 0 Max Used

Masks/Values Masks/values

Unicast mac addresses: 6364/6364 815/815

IPv4 IGMP groups + multicast routes: 1120/1120 1/1

IPv4 unicast directly-connected routes: 6144/6144 742/742

IPv4 unicast indirectly-connected routes: 2048/2048 253/253

IPv4 policy based routing aces: 442/442 12/12

IPv4 qos aces: 512/512 21/21

IPv4 security aces: 954/954 35/35

Note: Allocation of TCAM entries per feature uses

a complex algorithm. The above information is meant

to provide an abstract view of the current TCAM utilization

UG-GW-CORE#sh controllers cpu-interface

ASIC Rxbiterr Rxunder Fwdctfix Txbuflos Rxbufloc Rxbufdrain

-------------------------------------------------------------------------

ASIC0 0 0 0 0 0 0

ASIC1 0 0 0 0 0 0

ASIC2 0 0 0 0 0 0

HOL Fix Counts

--------------

No Fixes: 0 Added: 0 In Use: 0 Both: 0

CPU Heartbeat Statistics

Tx Success Tx Fail 1st Thr 2nd Thr Unthr RetryCtMax

---------- ---------- ---------- ---------- ---------- ----------

3209252 0 0 0 0 1

Rx Delay

0 1 2 3 4

---------- ---------- ---------- ---------- ----------

3209252 0 0 0 0

AddlDelay AdvanceCnt

---------- ----------

0 0

Rx Retries by RetryCount

0 1 2 3 4 5 6

---------- ---------- ---------- ---------- ---------- ---------- ----------

3209252 0 0 0 0 0 0

7 8 9

---------- ---------- ----------

0 0 0

AddlRetry

----------

0

cpu-queue-frames retrieved dropped invalid hol-block stray

----------------- ---------- ---------- ---------- ---------- ----------

rpc 3382904 0 0 0 0

stp 2330649 0 0 0 0

ipc 189710 0 0 0 0

routing protocol 5229189 0 0 0 0

L2 protocol 387206 0 0 0 0

remote console 0 0 0 0 0

sw forwarding 423435 0 0 0 0

host 1080957 0 0 0 0

broadcast 1384772 0 0 0 0

cbt-to-spt 0 0 0 0 0

igmp snooping 669364 0 0 0 0

icmp 6 0 0 0 0

logging 0 0 0 0 0

rpf-fail 0 0 0 0 0

dstats 0 0 0 0 0

cpu heartbeat 3209323 0 0 0 0

cpu-queue static inuse static added

----------------- ------------ ------------

rpc 0 0

stp 0 0

ipc 0 0

routing protocol 0 0

L2 protocol 0 0

remote console 0 0

sw forwarding 0 0

host 0 0

broadcast 0 0

cbt-to-spt 0 0

igmp snooping 0 0

icmp 0 0

logging 0 0

rpf-fail 0 0

dstats 0 0

cpu heartbeat 0 0

Supervisor ASIC receive-queue parameters

----------------------------------------

queue 0 maxrecevsize 7E0 pakhead 4CD732C paktail 4D22518

queue 1 maxrecevsize 7E0 pakhead 47A0E2C paktail 47C5A80

queue 2 maxrecevsize 7E0 pakhead 4DCC0E0 paktail 4DCB9A8

queue 3 maxrecevsize 7E0 pakhead 5416754 paktail 54129F8

queue 4 maxrecevsize 7E0 pakhead 4F0EB60 paktail 4F0E428

queue 5 maxrecevsize 7E0 pakhead 53C08DC paktail 53CEC40

queue 6 maxrecevsize 7E0 pakhead 53E39F4 paktail 53E3658

queue 7 maxrecevsize 7E0 pakhead 53183F4 paktail 5307C78

queue 8 maxrecevsize 7E0 pakhead 5331D14 paktail 53315DC

queue 9 maxrecevsize 7E0 pakhead 518450C paktail 518450C

queue A maxrecevsize 7E0 pakhead 5166EC4 paktail 516678C

queue B maxrecevsize 7E0 pakhead 541CDA8 paktail 541CA0C

queue C maxrecevsize 7E0 pakhead 5190D98 paktail 51A647C

queue D maxrecevsize 7E0 pakhead 5180A08 paktail 518402C

queue E maxrecevsize 0 pakhead 0 paktail 0

queue F maxrecevsize 7E0 pakhead 5151CEC paktail 5151950

UG-GW-CORE#sh platform tcam utilization