High CPU Load

[huaingomez]

Hi

I'm having this problem, my router Cisco 2801 is having, each time more frequently, these episodes of very high CPU Load.

I don't have the knowledge to pinpoint tha cause of this situation, can anybody help me based in the information bellow what steps should i follow to solve this situation?

Thanks in advance

99999999999999999999999999999999999999999999966666
999999999999999999999999999999999999999999999666666666688888
100 *********************************************
90 *********************************************
80 *********************************************
70 **************************************************
60 **************************************************
50 **************************************************
40 **************************************************
30 **************************************************
20 **************************************************
10 ************************************************************
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per second (last 60 seconds)

949399911677421128999799799999294989687955399911323682112334
973889895252921642899895499599496559408993999071064453996672
100 * *** *** ** ***** * * * * **
90 * * *** *** ** ***** * *** * *** *
80 * * *** * ******* ***** * *** *** *#* *
70 * * *** ** ************* * *** *** *#* *
60 * * *#* *** ************* * ******#* *#* **
50 *** *#* **** **********### #**#****#** *#* **
40 #***### **** *##**##*##### #*###***#****#* ** ***
30 #***### **** ############# #*###*####**##* ***## **##
20 #*#*###***##** **#############*###############* **###****###
10 ############################################################
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%

1 1 1
999999999998599499999990999999453584857435999990909995563343333454999999
999999999992399799999990999991017825982421999990909994877729899815999999
100 *********** ** ************* *********** ******
90 *********** ** ************** * *********** ******
80 ************ ** ************** * * *********** ******
70 ************ ** *******#****** * * * *********** * ******
60 ***#******** ** *******#****** ** *** *********** ** ******
50 *#*#*#*****************#*#**#* * ****** *************** *********
40 *###*#*****************#*#**#*******#*** ****##*****#****************#**
30 ######**************#*#######*******#*******####*#*##***************##*#
20 ######**************#########******##*******####*####**************#####
10 ######*************##########*****###*****###########*************######
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7..
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%

sh proc cpu sort 5sec | ex 0.00% 0.00% 0.00%

CPU utilization for five seconds: 99%/95%; one minute: 68%; five minutes: 53%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process

2 754764 107852 6998 2.01% 1.21% 0.85% 0 Load Meter

104 26164348 5197908 5033 0.88% 1.06% 0.80% 0 IP Input

40 3860264 530088 7282 0.48% 0.28% 0.25% 0 Per-Second Jobs

167 1104820 17827874 61 0.08% 0.10% 0.13% 0 HQF Shaper Backg
168 641868 5067447 126 0.08% 0.04% 0.05% 0 RBSCP Background
315 1413340 15692385 90 0.08% 0.09% 0.11% 0 PPP Events

332 346444 530408 653 0.08% 0.02% 0.00% 0 NAT MIB Helper

137 7176 2311 3105 0.08% 0.01% 0.00% 0 TCP Timer

188 5936 117 50735 0.08% 0.04% 0.02% 194 Virtual Exec

98 96244 90238 1066 0.08% 0.00% 0.00% 0 CDP Protocol

101 549328 379557 1447 0.08% 0.01% 0.00% 0 ADJ resolve proc
338 581504 2077510 279 0.08% 0.03% 0.02% 0 MLD

311 2228496 15713671 141 0.08% 0.16% 0.19% 0 PPP manager

18 962028 339959 2829 0.00% 0.03% 0.02% 0 ARP Input

49 1135840 9465 120004 0.00% 0.03% 0.04% 0 Per-minute Jobs

153 299948 762127 393 0.00% 0.03% 0.05% 0 CEF: IPv4 proce
s
5 1361412 87428 15571 0.00% 0.15% 0.17% 0 Check heaps

177 1023944 1025001 998 0.00% 0.08% 0.07% 0 FW DP Inspect pr
238 338452 2579393 131 0.00% 0.02% 0.00% 0 Atheros LED Ctro
312 626564 1017239 615 0.00% 0.04% 0.05% 0 IP NAT Ager

314 599628 98430 6091 0.00% 0.02% 0.00% 0 DHCPD Receive

319 886472 5148115 172 0.00% 0.04% 0.05% 0 FR Broadcast Out

[saif musa]

Hi,

Dose it happened just when downloading or always ? which services dose you router works for ( examole natting, Qos, cme ... etc ). ?

anyway you got to stop all debugs on the router first by entering the command undebug all . then chick if there is any diffrances 

Regards

[huaingomez]

I don't think there is any debug running.

If a use the command show debug, it returns 2 blank lines, nothing else.

Any other idea?

[johnd2310 · Accepted solution]

Hi,

Have you checked that there is no excessive logging enabled on the router?

Thanks

John

[huaingomez]

Besides show debug, there is another way to deter if there excessive logging?

[huaingomez]

Besides the notification of high cpu notification it doesn't appear to me there is excessive logging.

What do you think?

RT2801-IGLVEN-BARB#sh logging history
Syslog History Table:1 maximum table entries,
saving level warnings or higher
 43 messages ignored, 0 dropped, 0 recursion drops
 1923 table entries flushed
 SNMP notifications enabled, 1922 notifications sent
   entry number 1924 : IVR-3-LOW_CPU_RESOURCE
    IVR: System experiencing high cpu utilization (96/100).
     Call (callID=62978) is rejected.

    timestamp: 105990073

[Joseph W. Doherty]

What's the aggregate traffic volume, passing through the router, when you see the high CPU?

[huaingomez]

This is weird, i have a squid proxy behind the router, i had implemented bandwidth control through Delay Pools, well, it occurred to me that it could be the problem, to be honest i was just blindly guessing, so i removed the Delay Pools instructions from my proxy's configuration, and magically everything went back to normal in the router and it is that way ever since.

I post this here because it may be usefull for some one somewhere.