11-20-2013 08:31 PM
Dear support,
Our network core switch CPU usage is very high. Please find the below log and help me what we can do for normal network operation.
SW-0001#sh processes cpu
CPU utilization for five seconds: 60%/3%; one minute: 49%; five minutes: 49%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
1 27044 42032926 0 0.00% 0.00% 0.00% 0 Chunk Manager
2 7104 5244158 1 0.00% 0.00% 0.00% 0 Load Meter
3 0 1 0 0.00% 0.00% 0.00% 0 CEF RP IPC Backg
4 0 1 0 0.00% 0.00% 0.00% 0 Deferred Events
5 0 1 0 0.00% 0.00% 0.00% 0 Retransmission o
6 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Receive
7 25853676 3543750 7295 0.00% 0.07% 0.06% 0 Check heaps
8 156 2803 55 0.00% 0.00% 0.00% 0 Pool Manager
9 0 2 0 0.00% 0.00% 0.00% 0 Timers
10 92 4 23000 0.00% 0.00% 0.00% 0 PrstVbl
11 0 2 0 0.00% 0.00% 0.00% 0 Serial Backgroun
12 0 1 0 0.00% 0.00% 0.00% 0 Crash writer
13 0 1 0 0.00% 0.00% 0.00% 0 ifIndex Receive
14 31810908 296650398 107 0.31% 0.24% 0.24% 0 ARP Input
15 0 1 0 0.00% 0.00% 0.00% 0 CEF MIB API
16 0 1 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT
17 0 2 0 0.00% 0.00% 0.00% 0 AAA high-capacit
18 0 1 0 0.00% 0.00% 0.00% 0 Policy Manager
19 32 73 438 0.00% 0.00% 0.00% 0 Entity MIB API
20 20 1797 11 0.00% 0.00% 0.00% 0 EEM ED Syslog
21 0 1 0 0.00% 0.00% 0.00% 0 IFS Agent Manage
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
22 72 437027 0 0.00% 0.00% 0.00% 0 IPC Dynamic Cach
23 0 1 0 0.00% 0.00% 0.00% 0 IPC Zone Manager
24 10344 26213075 0 0.00% 0.00% 0.00% 0 IPC Periodic Tim
25 0 1 0 0.00% 0.00% 0.00% 0 IPC Managed Time
26 9340 26213077 0 0.00% 0.00% 0.00% 0 IPC Deferred Por
27 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat Manager
28 0 1 0 0.00% 0.00% 0.00% 0 IPC Session Serv
29 0 1 0 0.00% 0.00% 0.00% 0 client_entity_se
30 0 1 0 0.00% 0.00% 0.00% 0 SERIAL A'detect
31 0 1 0 0.00% 0.00% 0.00% 0 ARP Snoop
32 11136 26213077 0 0.00% 0.00% 0.00% 0 Dynamic ARP Insp
33 0 2 0 0.00% 0.00% 0.00% 0 SMART
34 9968 26213030 0 0.00% 0.00% 0.00% 0 GraphIt
35 0 1 0 0.00% 0.00% 0.00% 0 PCMCIA Hotswap
36 0 1 0 0.00% 0.00% 0.00% 0 Critical Bkgnd
37 29464 6906938 4 0.00% 0.00% 0.00% 0 Net Background
38 2184444 26221400 83 0.00% 0.05% 0.07% 0 IDB Work
39 20 3267 6 0.00% 0.00% 0.00% 0 Logger
40 15072 26213068 0 0.00% 0.00% 0.00% 0 TTY Background
41 43400 26586390 1 0.00% 0.00% 0.00% 0 Per-Second Jobs
42 8701932 639519 13607 0.00% 0.03% 0.00% 0 Per-minute Jobs
43 8 41 195 0.00% 0.00% 0.00% 0 IF-MGR control p
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
44 48 11912 4 0.00% 0.00% 0.00% 0 IF-MGR event pro
45 0 1 0 0.00% 0.00% 0.00% 0 ISSU PROCESS IPC
46 0 1 0 0.00% 0.00% 0.00% 0 PrstVbl IPC Msg
47 0 2 0 0.00% 0.00% 0.00% 0 cpf_msg_holdq_pr
48 0 1 0 0.00% 0.00% 0.00% 0 cpf_msg_rcvq_pro
49 0 2 0 0.00% 0.00% 0.00% 0 IP Host Track HA
50 0 2 0 0.00% 0.00% 0.00% 0 ARP HA
51 0 1 0 0.00% 0.00% 0.00% 0 IP Admission HA
52 0 1 0 0.00% 0.00% 0.00% 0 Network-rf Notif
53 15725746563539183566 444 3.35% 3.44% 3.45% 0 Cat4k Mgmt HiPri
54 5550566842834540074 195 34.07% 36.86% 37.73% 0 Cat4k Mgmt LoPri
55 6768 7967392 0 0.00% 0.00% 0.00% 0 Galios Reschedul
56 4 5 800 0.00% 0.00% 0.00% 0 GaliosObflLogger
57 0 30 0 0.00% 0.00% 0.00% 0 IOS ACL Helper
58 480 53 9056 0.00% 0.00% 0.00% 0 GaliosQuack_help
59 0 2 0 0.00% 0.00% 0.00% 0 rf task
60 0 1 0 0.00% 0.00% 0.00% 0 RF High Priority
61 126764 15914548 7 0.00% 0.00% 0.00% 0 Net Input
62 536356 7646802 70 0.07% 0.01% 0.00% 0 Compute load avg
63 0 1 0 0.00% 0.00% 0.00% 0 GalRedMsgProc
64 0 1 0 0.00% 0.00% 0.00% 0 RFS server proce
65 0 1 0 0.00% 0.00% 0.00% 0 RTTYS Process
SW-0001#sh processes cpu history
5555555555555555555544444555555555544444444445555566666444
2222200000555550000033333000001111166666555550000000000666
100
90
80
70
60 ***** *****
50 ******************** *********************************
40 **********************************************************
30 **********************************************************
20 **********************************************************
10 **********************************************************
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per second (last 60 seconds)
6555655566555555656777777775555555555444555444444544434444
0662467800624611267513963356622305442928124955376345494523
100
90
80 * ** *
70 *********
60 *** ******* * ***####***#** *
50 ###########*#################**####*** ******* *** * *
40 #####################################################*##**
30 ##########################################################
20 ##########################################################
10 ##########################################################
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%
7457657667558767668668767557644744644757897889999779787799665599776999
5846298038990157040155691001654543976605356654867877810978722439737688
100 * *** * ** * ***
90 * * ****** * ** ** ***
80 * * * * * * * ** * * *************** *** *** ***
70 * * * * **** * ***** ** * * * *****#************** ********
60 * ********************** ** * * * ****##*************** ********
50 ***############**#######****** * ******########***************#######
40 #**######################*************###########**********###########
30 ######################################################################
20 ######################################################################
10 ######################################################################
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%
SW-0001#sh memory summary
Head Total(b) Used(b) Free(b) Lowest(b) Largest(b)
Processor 13EE25FC 470931968 240115248 230816720 228275536 224663200
Thanks in advance.
Solved! Go to Solution.
11-24-2013 10:07 PM
Did you perform the steps I described? What was the result?
Daniel Dib
CCIE #37149
11-21-2013 01:16 AM
Refer to this URL for troubleshooting:
http://www.cisco.com/en/US/products/hw/switches/ps663/products_tech_note09186a00804cef15.shtml
Use the show platform health command.
It could be possible that you have software switched packets (punted).
Daniel Dib
CCIE #37149
11-21-2013 01:32 AM
And what is the IOS version you are running?
11-23-2013 08:55 PM
Cisco IOS Software, Catalyst 4500 L3 Switch Software (cat4500e-ENTSERVICESK9-M), Version 12.2(53)SG, RELEASE SOFTWARE (fc3).
11-24-2013 08:15 PM
Hi Leo Laohoo,
Is there any IOS bug related issues? please help..
11-24-2013 08:24 PM
Sorry, but I'm not familiar with this line of IOS version.
11-24-2013 10:07 PM
Did you perform the steps I described? What was the result?
Daniel Dib
CCIE #37149
11-25-2013 01:56 AM
Hi Daniel Dib,
We applied no ip redirects command under the uplink interfaces and its working like a magic. now the switch CPU utilization is less than 30%. Many thanks Daniel Dib.
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide