cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
1355
Views
0
Helpful
4
Replies

High CPU usage

Latchum Naidu
VIP Alumni
VIP Alumni

Hi All,

I have a cisco 1841 router at a location.

10 Mb internet link is terminated on this
Both EIGRP (on dmvpn tunnel on internet) and BGP (on MPLS) protocols are running.

Since 10 days I was observing the CPU is touching 50% and nothing process is showing taking more.

Please find the below cpu history:

Router#sh proc cpu hi

Router   11:08:42 AM Friday Nov 12 2010 UTC


    112222222222222221111122222444443333333333444444444422222333
    116666655555111114444400000000005555522222666665555599999999
100
90
80
70
60
50                                           **********
40                            **********     **********     ***
30   **********               *********************************
20   ***************     **************************************
10 ************************************************************
   0....5....1....1....2....2....3....3....4....4....5....5....6
             0    5    0    5    0    5    0    5    0    5    0
               CPU% per second (last 60 seconds)


    444434434353434556566455434343335345644435553465555344433334
    774052666718846002601180890837904852397798327842852842277747
100
90
80
70
60                  **** *             *    *    * **
50 **    * * * * ***#*#* ***       * ****** *** ******        *
40 ********#***# *######*#******** ***###*#*##****####******* *
30 ####*########*############**#***########################*###
20 ############################################################
10 ############################################################
   0....5....1....1....2....2....3....3....4....4....5....5....6
             0    5    0    5    0    5    0    5    0    5    0
               CPU% per minute (last 60 minutes)
              * = maximum CPU%   # = average CPU%


    666663121114233123577667787763332114423344678887887763221224223224676877
    437087377375209882325772524472836775709560020617403384159545683480312152
100
90                                              *
80                     *   **                  ******                   **
70   * *              **********              **********              * ***
60 *****              **********             **##***#***             ******
50 *****      *      *******#***      **   * **#######**      *      ******
40 **##**     *  *   *##**#####* *    ** *****########**      *     ****##*
30 ####** *   * ** ***#########*****  ** *****#########** * * **** ***#####
20 #####* ** *********##########**********##############**************#####
10 #####************############*********###############*************######
   0....5....1....1....2....2....3....3....4....4....5....5....6....6....7..
             0    5    0    5    0    5    0    5    0    5    0    5    0
                   CPU% per hour (last 72 hours)
                  * = maximum CPU%   # = average CPU%

Router#sh proc cpu
CPU utilization for five seconds: 14%/12%; one minute: 26%; five minutes: 28%
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
   1       14964     33292        449  0.00%  0.00%  0.00%   0 Chunk Manager
   2      169648    464490        365  0.00%  0.01%  0.00%   0 Load Meter
   3         584       217       2691  0.08%  0.01%  0.04% 194 SSH Process
   4     2633400    282791       9312  0.00%  0.09%  0.06%   0 Check heaps
   5      193528     81273       2381  0.00%  0.00%  0.00%   0 Pool Manager
   6           0         2          0  0.00%  0.00%  0.00%   0 Timers
   7           0         1          0  0.00%  0.00%  0.00%   0 OIR Handler
   8        1072     77415         13  0.00%  0.00%  0.00%   0 Environmental mo
   9           0         1          0  0.00%  0.00%  0.00%   0 Crash writer
  10     1148392   2234088        514  0.00%  0.04%  0.02%   0 ARP Input
  11           0         2          0  0.00%  0.00%  0.00%   0 ATM Idle Timer
  12           0         2          0  0.00%  0.00%  0.00%   0 AAA high-capacit
  13           0         1          0  0.00%  0.00%  0.00%   0 AAA_SERVER_DEADT
  14           0         1          0  0.00%  0.00%  0.00%   0 Policy Manager
  15           0         2          0  0.00%  0.00%  0.00%   0 DDR Timers
  16           0         2          0  0.00%  0.00%  0.00%   0 Entity MIB API
  17        2172     11613        187  0.00%  0.00%  0.00%   0 EEM ED Syslog
  18       46536    691802         67  0.00%  0.00%  0.00%   0 HC Counter Timer
  19           4         2       2000  0.00%  0.00%  0.00%   0 Serial Backgroun
  20           0         1          0  0.00%  0.00%  0.00%   0 RO Notify Timers
  21           0         2          0  0.00%  0.00%  0.00%   0 SMART
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
  22       39720   2322444         17  0.08%  0.00%  0.00%   0 GraphIt
  23           0         2          0  0.00%  0.00%  0.00%   0 Dialer event
  24           0         1          0  0.00%  0.00%  0.00%   0 SERIAL A'detect
  25           0         2          0  0.00%  0.00%  0.00%   0 XML Proxy Client
  26         996      7047        141  0.00%  0.00%  0.00%   0 Tunnel Security
  27           0         1          0  0.00%  0.00%  0.00%   0 Inode Table Dest
  28           0         1          0  0.00%  0.00%  0.00%   0 Critical Bkgnd
  29       99728   1322849         75  0.00%  0.00%  0.00%   0 Net Background
  30           0         2          0  0.00%  0.00%  0.00%   0 IDB Work
  31        1508     22221         67  0.00%  0.00%  0.00%   0 Logger
  32       65388   2321466         28  0.00%  0.00%  0.00%   0 TTY Background
  33      815672   2323450        351  0.08%  0.07%  0.08%   0 Per-Second Jobs
  34           0         1          0  0.00%  0.00%  0.00%   0 AggMgr Process
  35           0         1          0  0.00%  0.00%  0.00%   0 Token Daemon
  36           0         2          0  0.00%  0.00%  0.00%   0 ESWPPM
  37           0         2          0  0.00%  0.00%  0.00%   0 Eswilp Storm Con
  38         256         4      64000  0.00%  0.00%  0.00%   0 USB Startup
  39           0         1          0  0.00%  0.00%  0.00%   0 dev_device_inser
  40           0         1          0  0.00%  0.00%  0.00%   0 dev_device_remov
  41           0         2          0  0.00%  0.00%  0.00%   0 SM Monitor
  42           0         1          0  0.00%  0.00%  0.00%   0 IGMP Snooping Pr
  43           0         1          0  0.00%  0.00%  0.00%   0 IGMP Snooping Re
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
  44           0         1          0  0.00%  0.00%  0.00%   0 Platform Compact
  45         976     77415         12  0.00%  0.00%  0.00%   0 Call Management
  46       36436   2321475         15  0.00%  0.00%  0.00%   0 PI MATM Aging Pr
  47           0         2          0  0.00%  0.00%  0.00%   0 DTP Protocol
  48           0         2          0  0.00%  0.00%  0.00%   0 dot1x
  49           0         2          0  0.00%  0.00%  0.00%   0 AAA Dictionary R
  50          60       166        361  0.00%  0.00%  0.00%   0 AAA Server
  51           0         1          0  0.00%  0.00%  0.00%   0 AAA ACCT Proc
  52           0         1          0  0.00%  0.00%  0.00%   0 ACCT Periodic Pr
  53       18912    252570         74  0.00%  0.00%  0.00%   0 CDP Protocol
  54    24237604  17369054       1395  0.32%  0.17%  0.19%   0 IP Input
  55           4         1       4000  0.00%  0.00%  0.00%   0 ICMP event handl
  56           0         4          0  0.00%  0.00%  0.00%   0 TurboACL
  57           0         2          0  0.00%  0.00%  0.00%   0 TurboACL chunk
  58         344      3860         89  0.00%  0.00%  0.00%   0 MOP Protocols
  59           0         3          0  0.00%  0.00%  0.00%   0 PPP Hooks
  60       14072     20367        690  0.00%  0.00%  0.00%   0 Crypto SS Proces
  61           0         1          0  0.00%  0.00%  0.00%   0 SSS Manager
  62        4576    309653         14  0.00%  0.00%  0.00%   0 SSS Test Client
  63           0         1          0  0.00%  0.00%  0.00%   0 SSS Feature Mana
  64      194644   9071641         21  0.00%  0.01%  0.00%   0 SSS Feature Time
  65           0         1          0  0.00%  0.00%  0.00%   0 VPDN call manage
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
  66           0         1          0  0.00%  0.00%  0.00%   0 L2X Socket proce
  67           0         1          0  0.00%  0.00%  0.00%   0 L2X SSS manager
  68           0         2          0  0.00%  0.00%  0.00%   0 L2TP mgmt daemon
  69           0         1          0  0.00%  0.00%  0.00%   0 X.25 Encaps Mana
  70           0         2          0  0.00%  0.00%  0.00%   0 EAPoUDP Process
  71           0         2          0  0.00%  0.00%  0.00%   0 IP Host Track Pr
  72           0         1          0  0.00%  0.00%  0.00%   0 IPv6 RIB Redistr
  73           0         2          0  0.00%  0.00%  0.00%   0 KRB5 AAA
  74       20124     75739        265  0.08%  0.00%  0.00%   0 IP Background
  75        4488     45843         97  0.00%  0.00%  0.00%   0 IP RIB Update
  76           0         2          0  0.00%  0.00%  0.00%   0 PPP IP Route
  77           0         2          0  0.00%  0.00%  0.00%   0 PPP IPCP
  78      461160   3337662        138  0.00%  0.05%  0.07%   0 CEF process
  79       56780   2462681         23  0.00%  0.00%  0.00%   0 Socket Timers
  80           0         2          0  0.00%  0.00%  0.00%   0 L2MM
  81           0         1          0  0.00%  0.00%  0.00%   0 MRD
  82           0         1          0  0.00%  0.00%  0.00%   0 IGMPSN
  83           0         1          0  0.00%  0.00%  0.00%   0 IP Traceroute
  84           0         2          0  0.00%  0.00%  0.00%   0 RLM groups Proce
  85           0         3          0  0.00%  0.00%  0.00%   0 SNMP Timers
  86           4         2       2000  0.00%  0.00%  0.00%   0 SCTP Main Proces
  87           0         1          0  0.00%  0.00%  0.00%   0 IUA Main Process
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
  88       89776   2321524         38  0.00%  0.00%  0.00%   0 RUDPV1 Main Proc
  89           0         1          0  0.00%  0.00%  0.00%   0 bsm_timers
  90       35268   2321480         15  0.00%  0.00%  0.00%   0 bsm_xmt_proc
  91           0         1          0  0.00%  0.00%  0.00%   0 CES Client SVC R
  92        6632     84758         78  0.00%  0.00%  0.00%   0 TCP Timer
  93           0         1          0  0.00%  0.00%  0.00%   0 Transport Port A
  94         176       250        704  0.00%  0.00%  0.00%   0 TCP Protocols
  95           0         1          0  0.00%  0.00%  0.00%   0 COPS
  96      508300   4926356        103  0.08%  0.04%  0.06%   0 DHCPD Receive
  97           0         2          0  0.00%  0.00%  0.00%   0 Dialer Forwarder
  98       17820     38699        460  0.00%  0.00%  0.00%   0 IP Cache Ager
  99       20084     38742        518  0.00%  0.00%  0.00%   0 Adj Manager
100           0         2          0  0.00%  0.00%  0.00%   0 ATM OAM Input
101           0         2          0  0.00%  0.00%  0.00%   0 ATM OAM TIMER
102         332      7743         42  0.00%  0.00%  0.00%   0 HTTP CORE
103           0         1          0  0.00%  0.00%  0.00%   0 RARP Input
104           0         1          0  0.00%  0.00%  0.00%   0 PAD InCall
105           0         2          0  0.00%  0.00%  0.00%   0 X.25 Background
106           0         2          0  0.00%  0.00%  0.00%   0 PPP Bind
107           0         2          0  0.00%  0.00%  0.00%   0 PPP SSS
108      828308  23138964         35  0.08%  0.07%  0.08%   0 RBSCP Background
109           0         1          0  0.00%  0.00%  0.00%   0 Inspect Timer
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
110         820     19354         42  0.00%  0.00%  0.00%   0 DHCPD Timer
111         148      7742         19  0.00%  0.00%  0.00%   0 Authentication P
112           0         1          0  0.00%  0.00%  0.00%   0 Auth-proxy AAA B
113           0         1          0  0.00%  0.00%  0.00%   0 IPS Timer
114           0         2          0  0.00%  0.00%  0.00%   0 SDEE Management
115           0         1          0  0.00%  0.00%  0.00%   0 IPv6 Inspect Tim
116           0         2          0  0.00%  0.00%  0.00%   0 URL filter proc
117           4         3       1333  0.00%  0.00%  0.00%   0 Crypto HW Proc
118           0         2          0  0.00%  0.00%  0.00%   0 ENABLE AAA
119           0         1          0  0.00%  0.00%  0.00%   0 EM Background Pr
120           0         1          0  0.00%  0.00%  0.00%   0 Key chain liveke
121           0         2          0  0.00%  0.00%  0.00%   0 LINE AAA
122           0         2          0  0.00%  0.00%  0.00%   0 LOCAL AAA
123           0         2          0  0.00%  0.00%  0.00%   0 TPLUS
124           0         2          0  0.00%  0.00%  0.00%   0 VSP_MGR
125           0         1          0  0.00%  0.00%  0.00%   0 encrypt proc
126           0         3          0  0.00%  0.00%  0.00%   0 Crypto WUI
127         196       800        245  0.00%  0.00%  0.00%   0 Crypto Support
128           0         1          0  0.00%  0.00%  0.00%   0 RPMS_PROC_MAIN
129         164      5343         30  0.00%  0.00%  0.00%   0 crypto engine pr
130          36         4       9000  0.00%  0.00%  0.00%   0 Crypto CA
131           0         1          0  0.00%  0.00%  0.00%   0 Crypto PKI-CRL
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
132           0         1          0  0.00%  0.00%  0.00%   0 Crypto SSL
133       18560     13835       1341  0.00%  0.00%  0.00%   0 Crypto ACL
134           0         2          0  0.00%  0.00%  0.00%   0 CRYPTO QoS proce
135           0         1          0  0.00%  0.00%  0.00%   0 Crypto INT
136     1936208   1009027       1918  0.08%  0.15%  0.07%   0 Crypto IKMP
137        9072    138331         65  0.00%  0.00%  0.00%   0 IPSEC key engine
138           0         1          0  0.00%  0.00%  0.00%   0 IPSEC manual key
139           0         1          0  0.00%  0.00%  0.00%   0 Crypto PAS Proc
140         588     19294         30  0.00%  0.00%  0.00%   0 Crypto Delete Ma
141           0         2          0  0.00%  0.00%  0.00%   0 Key Proc
142       34108   2322454         14  0.00%  0.00%  0.00%   0 Crypto Device Up
143           0         1          0  0.00%  0.00%  0.00%   0 Crypto Hardware
144           0         2          0  0.00%  0.00%  0.00%   0 Multi-ISA Event
145           0         1          0  0.00%  0.00%  0.00%   0 Multi-ISA Cleanu
146           0         1          0  0.00%  0.00%  0.00%   0 PM Callback
147           0         1          0  0.00%  0.00%  0.00%   0 DATA Transfer Pr
148           0         1          0  0.00%  0.00%  0.00%   0 DATA Collector
149          48       152        315  0.00%  0.00%  0.00%   0 AAA SEND STOP EV
150           0         3          0  0.00%  0.00%  0.00%   0 EEM ED CLI
151           0         2          0  0.00%  0.00%  0.00%   0 EEM ED Counter
152           0         2          0  0.00%  0.00%  0.00%   0 EEM ED Interface
153           0         3          0  0.00%  0.00%  0.00%   0 EEM ED IOSWD
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
154           0         2          0  0.00%  0.00%  0.00%   0 EEM ED Memory-th
155           0         2          0  0.00%  0.00%  0.00%   0 EEM ED None
156           0         2          0  0.00%  0.00%  0.00%   0 EM ED OIR
157           0         2          0  0.00%  0.00%  0.00%   0 EEM ED SNMP
158        1484     38854         38  0.00%  0.00%  0.00%   0 EEM ED Timer
159       34156    831096         41  0.08%  0.00%  0.00%   0 EEM Server
160        3288    232236         14  0.00%  0.00%  0.00%   0 RMON Recycle Pro
161           0         2          0  0.00%  0.00%  0.00%   0 RMON Deferred Se
162           0         1          0  0.00%  0.00%  0.00%   0 Syslog Traps
163          16         2       8000  0.00%  0.00%  0.00%   0 VLAN Manager
164         448     38713         11  0.00%  0.00%  0.00%   0 DHCPD Database
165           0         2          0  0.00%  0.00%  0.00%   0 EEM Policy Direc
166        8300     11123        746  0.00%  0.00%  0.00%   0 Syslog
167           0         1          0  0.00%  0.00%  0.00%   0 VPDN Scal
168      913936      4169     219221  0.00%  0.00%  0.00%   0 crypto sw pk pro
169       66020    724066         91  0.00%  0.00%  0.00%   0 Net Input
170       54420    464568        117  0.00%  0.00%  0.00%   0 Compute load avg
171      785004     39314      19967  0.00%  0.02%  0.00%   0 Per-minute Jobs
172        2484     80569         30  0.00%  0.00%  0.00%   0 CEF Scanner
173           0         1          0  0.00%  0.00%  0.00%   0 tHUB
175         204      1291        158  0.00%  0.00%  0.00%   0 SSH Event handle
176       22224    270461         82  0.00%  0.00%  0.00%   0 NHRP
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
177           0         2          0  0.00%  0.00%  0.00%   0 IP Flow Backgrou
178      670064   5553443        120  0.00%  0.02%  0.01%   0 IP NAT Ager
179           0         1          0  0.00%  0.00%  0.00%   0 IP NAT WLAN
180      104408   1042969        100  0.00%  0.00%  0.00%   0 IP VFR proc
181       17972    290202         61  0.00%  0.00%  0.00%   0 CRYPTO IKMP IPC
182           0         3          0  0.00%  0.00%  0.00%   0 TCP Listener
183     1754844   4438934        395  0.08%  0.04%  0.05%   0 IP SNMP
184      567592   2659768        213  0.00%  0.01%  0.00%   0 PDU DISPATCHER
185     4609360   2740114       1682  0.00%  0.17%  0.18%   0 SNMP ENGINE
186           0         1          0  0.00%  0.00%  0.00%   0 SNMP ConfCopyPro
187           0         1          0  0.00%  0.00%  0.00%   0 SNMP Traps
188      403748   2475827        163  0.00%  0.00%  0.00%   0 NAT MIB Helper
189     1290632  71902755         17  0.16%  0.18%  0.16%   0 RADIUS
190      102916   2358830         43  0.00%  0.00%  0.00%   0 NTP
191         208      5800         35  0.00%  0.00%  0.00%   0 IP-EIGRP Router
192      210264   1101757        190  0.00%  0.00%  0.00%   0 IP-EIGRP: PDM
193       87236   4732876         18  0.00%  0.00%  0.00%   0 BGP Router
194      471060   2539174        185  0.08%  0.04%  0.06%   0 IP-EIGRP: HELLO
195       12636     77478        163  0.08%  0.00%  0.00%   0 BGP I/O
196      613988    154989       3961  0.00%  0.01%  0.00%   0 BGP Scanner

Can someone help me how to resolve this issue.

Regards,

Naidu.

4 Replies 4

Peter Paluch
Cisco Employee
Cisco Employee

Hello Naidu,

Can you please also post the output of the command show processes cpu sorted 5min ?

If you are using IPsec-protected DMVPN then it is possible that the encryption is causing the CPU load spikes. Do you have any hardware module installed in the 1841 to offload the crypto operations?

Best regards,

Peter

Hi Peter,

Are you saying about any AIM module is installed?

If not what hardware module can I install  to offload the crypto operations?

If i understand you correctly, by installing a hardware module we can move or something the crypto operations on to this so that the router cpu will not get more. Is that correct?

Please find the below cpu output for 5 minutes.

Router#sh proc cpu sorted 5min
CPU utilization for five seconds: 17%/16%; one minute: 28%; five minutes: 29%
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
  54    24243192  17376951       1395  0.24%  0.22%  0.21%   0 IP Input
189     1291948  71940308         17  0.16%  0.18%  0.16%   0 RADIUS
185     4612480   2741416       1682  0.08%  0.15%  0.16%   0 SNMP ENGINE
   3         576       196       2938  0.65%  0.42%  0.12% 194 SSH Process
  33      816468   2324668        351  0.08%  0.07%  0.08%   0 Per-Second Jobs
108      829060  23151083         35  0.08%  0.07%  0.08%   0 RBSCP Background
  78      461576   3339551        138  0.00%  0.05%  0.06%   0 CEF process
   4     2635152    282943       9313  0.00%  0.08%  0.06%   0 Check heaps
  96      508672   4928946        103  0.08%  0.04%  0.06%   0 DHCPD Receive
194      471452   2540482        185  0.00%  0.04%  0.05%   0 IP-EIGRP: HELLO
183     1755968   4440972        395  0.00%  0.04%  0.05%   0 IP SNMP
136     1936876   1009481       1918  0.08%  0.02%  0.02%   0 Crypto IKMP
  10     1149304   2235544        514  0.00%  0.03%  0.02%   0 ARP Input
178      670264   5555835        120  0.00%  0.01%  0.01%   0 IP NAT Ager
  88       89824   2322740         38  0.08%  0.00%  0.00%   0 RUDPV1 Main Proc
  99       20096     38763        518  0.08%  0.00%  0.00%   0 Adj Manager
  64      194900   9076397         21  0.08%  0.02%  0.00%   0 SSS Feature Time
193       87288   4735350         18  0.08%  0.00%  0.00%   0 BGP Router
  22       39748   2323664         17  0.08%  0.00%  0.00%   0 GraphIt
  19           4         2       2000  0.00%  0.00%  0.00%   0 Serial Backgroun
  20           0         1          0  0.00%  0.00%  0.00%   0 RO Notify Timers
  18       46560    692168         67  0.00%  0.00%  0.00%   0 HC Counter Timer
  23           0         2          0  0.00%  0.00%  0.00%   0 Dialer event
  17        2172     11615        186  0.00%  0.00%  0.00%   0 EEM ED Syslog
  21           0         2          0  0.00%  0.00%  0.00%   0 SMART
  16           0         2          0  0.00%  0.00%  0.00%   0 Entity MIB API
  27           0         1          0  0.00%  0.00%  0.00%   0 Inode Table Dest
  28           0         1          0  0.00%  0.00%  0.00%   0 Critical Bkgnd
  29       99792   1323697         75  0.00%  0.00%  0.00%   0 Net Background
  30           0         2          0  0.00%  0.00%  0.00%   0 IDB Work
  31        1508     22225         67  0.00%  0.00%  0.00%   0 Logger
  15           0         2          0  0.00%  0.00%  0.00%   0 DDR Timers
  14           0         1          0  0.00%  0.00%  0.00%   0 Policy Manager
  24           0         1          0  0.00%  0.00%  0.00%   0 SERIAL A'detect
  25           0         2          0  0.00%  0.00%  0.00%   0 XML Proxy Client
  26        1000      7050        141  0.00%  0.00%  0.00%   0 Tunnel Security
  37           0         2          0  0.00%  0.00%  0.00%   0 Eswilp Storm Con
  38         256         4      64000  0.00%  0.00%  0.00%   0 USB Startup
  32       65480   2322684         28  0.00%  0.00%  0.00%   0 TTY Background
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
  40           0         1          0  0.00%  0.00%  0.00%   0 dev_device_remov
  41           0         2          0  0.00%  0.00%  0.00%   0 SM Monitor
  42           0         1          0  0.00%  0.00%  0.00%   0 IGMP Snooping Pr
  43           0         1          0  0.00%  0.00%  0.00%   0 IGMP Snooping Re
  44           0         1          0  0.00%  0.00%  0.00%   0 Platform Compact
  45         976     77456         12  0.00%  0.00%  0.00%   0 Call Management
  46       36468   2322692         15  0.00%  0.00%  0.00%   0 PI MATM Aging Pr
  47           0         2          0  0.00%  0.00%  0.00%   0 DTP Protocol
  48           0         2          0  0.00%  0.00%  0.00%   0 dot1x
  49           0         2          0  0.00%  0.00%  0.00%   0 AAA Dictionary R
  50          60       168        357  0.00%  0.00%  0.00%   0 AAA Server
   9           0         1          0  0.00%  0.00%  0.00%   0 Crash writer
  34           0         1          0  0.00%  0.00%  0.00%   0 AggMgr Process
  53       18916    252712         74  0.00%  0.00%  0.00%   0 CDP Protocol
  13           0         1          0  0.00%  0.00%  0.00%   0 AAA_SERVER_DEADT
  35           0         1          0  0.00%  0.00%  0.00%   0 Token Daemon
  36           0         2          0  0.00%  0.00%  0.00%   0 ESWPPM
  57           0         2          0  0.00%  0.00%  0.00%   0 TurboACL chunk
  58         344      3862         89  0.00%  0.00%  0.00%   0 MOP Protocols
  39           0         1          0  0.00%  0.00%  0.00%   0 dev_device_inser
  60       14092     20377        691  0.00%  0.00%  0.00%   0 Crypto SS Proces
  61           0         1          0  0.00%  0.00%  0.00%   0 SSS Manager
  62        4576    309815         14  0.00%  0.00%  0.00%   0 SSS Test Client
  63           0         1          0  0.00%  0.00%  0.00%   0 SSS Feature Mana
  51           0         1          0  0.00%  0.00%  0.00%   0 AAA ACCT Proc
  65           0         1          0  0.00%  0.00%  0.00%   0 VPDN call manage
  66           0         1          0  0.00%  0.00%  0.00%   0 L2X Socket proce
  67           0         1          0  0.00%  0.00%  0.00%   0 L2X SSS manager
   7           0         1          0  0.00%  0.00%  0.00%   0 OIR Handler
  69           0         1          0  0.00%  0.00%  0.00%   0 X.25 Encaps Mana
  70           0         2          0  0.00%  0.00%  0.00%   0 EAPoUDP Process
  71           0         2          0  0.00%  0.00%  0.00%   0 IP Host Track Pr
  72           0         1          0  0.00%  0.00%  0.00%   0 IPv6 RIB Redistr
  73           0         2          0  0.00%  0.00%  0.00%   0 KRB5 AAA
  74       20136     75779        265  0.00%  0.00%  0.00%   0 IP Background
  75        4492     45863         97  0.00%  0.00%  0.00%   0 IP RIB Update
  76           0         2          0  0.00%  0.00%  0.00%   0 PPP IP Route
  77           0         2          0  0.00%  0.00%  0.00%   0 PPP IPCP
   6           0         2          0  0.00%  0.00%  0.00%   0 Timers
  79       56888   2463977         23  0.00%  0.00%  0.00%   0 Socket Timers
  80           0         2          0  0.00%  0.00%  0.00%   0 L2MM
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
  81           0         1          0  0.00%  0.00%  0.00%   0 MRD
  82           0         1          0  0.00%  0.00%  0.00%   0 IGMPSN
  83           0         1          0  0.00%  0.00%  0.00%   0 IP Traceroute
  84           0         2          0  0.00%  0.00%  0.00%   0 RLM groups Proce
  85           0         3          0  0.00%  0.00%  0.00%   0 SNMP Timers
  86           4         2       2000  0.00%  0.00%  0.00%   0 SCTP Main Proces
  87           0         1          0  0.00%  0.00%  0.00%   0 IUA Main Process
  52           0         1          0  0.00%  0.00%  0.00%   0 ACCT Periodic Pr
  12           0         2          0  0.00%  0.00%  0.00%   0 AAA high-capacit
  90       35288   2322697         15  0.00%  0.00%  0.00%   0 bsm_xmt_proc
  55           4         1       4000  0.00%  0.00%  0.00%   0 ICMP event handl
  11           0         2          0  0.00%  0.00%  0.00%   0 ATM Idle Timer
  93           0         1          0  0.00%  0.00%  0.00%   0 Transport Port A
   5      193528     81277       2381  0.00%  0.00%  0.00%   0 Pool Manager
  95           0         1          0  0.00%  0.00%  0.00%   0 COPS
   2      169880    464734        365  0.00%  0.01%  0.00%   0 Load Meter
  56           0         4          0  0.00%  0.00%  0.00%   0 TurboACL
   8        1072     77456         13  0.00%  0.00%  0.00%   0 Environmental mo
  59           0         3          0  0.00%  0.00%  0.00%   0 PPP Hooks
100           0         2          0  0.00%  0.00%  0.00%   0 ATM OAM Input
101           0         2          0  0.00%  0.00%  0.00%   0 ATM OAM TIMER
102         332      7747         42  0.00%  0.00%  0.00%   0 HTTP CORE
103           0         1          0  0.00%  0.00%  0.00%   0 RARP Input
104           0         1          0  0.00%  0.00%  0.00%   0 PAD InCall
105           0         2          0  0.00%  0.00%  0.00%   0 X.25 Background
106           0         2          0  0.00%  0.00%  0.00%   0 PPP Bind
107           0         2          0  0.00%  0.00%  0.00%   0 PPP SSS
  68           0         2          0  0.00%  0.00%  0.00%   0 L2TP mgmt daemon
109           0         1          0  0.00%  0.00%  0.00%   0 Inspect Timer
110         820     19364         42  0.00%  0.00%  0.00%   0 DHCPD Timer
111         148      7746         19  0.00%  0.00%  0.00%   0 Authentication P
112           0         1          0  0.00%  0.00%  0.00%   0 Auth-proxy AAA B
113           0         1          0  0.00%  0.00%  0.00%   0 IPS Timer
114           0         2          0  0.00%  0.00%  0.00%   0 SDEE Management
115           0         1          0  0.00%  0.00%  0.00%   0 IPv6 Inspect Tim
116           0         2          0  0.00%  0.00%  0.00%   0 URL filter proc
117           4         3       1333  0.00%  0.00%  0.00%   0 Crypto HW Proc
118           0         2          0  0.00%  0.00%  0.00%   0 ENABLE AAA
119           0         1          0  0.00%  0.00%  0.00%   0 EM Background Pr
120           0         1          0  0.00%  0.00%  0.00%   0 Key chain liveke
121           0         2          0  0.00%  0.00%  0.00%   0 LINE AAA
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
122           0         2          0  0.00%  0.00%  0.00%   0 LOCAL AAA
123           0         2          0  0.00%  0.00%  0.00%   0 TPLUS
124           0         2          0  0.00%  0.00%  0.00%   0 VSP_MGR
125           0         1          0  0.00%  0.00%  0.00%   0 encrypt proc
126           0         3          0  0.00%  0.00%  0.00%   0 Crypto WUI
127         196       800        245  0.00%  0.00%  0.00%   0 Crypto Support
128           0         1          0  0.00%  0.00%  0.00%   0 RPMS_PROC_MAIN
129         164      5343         30  0.00%  0.00%  0.00%   0 crypto engine pr
130          36         4       9000  0.00%  0.00%  0.00%   0 Crypto CA
131           0         1          0  0.00%  0.00%  0.00%   0 Crypto PKI-CRL
132           0         1          0  0.00%  0.00%  0.00%   0 Crypto SSL
133       18588     13842       1342  0.00%  0.00%  0.00%   0 Crypto ACL
134           0         2          0  0.00%  0.00%  0.00%   0 CRYPTO QoS proce
135           0         1          0  0.00%  0.00%  0.00%   0 Crypto INT
  89           0         1          0  0.00%  0.00%  0.00%   0 bsm_timers
137        9072    138398         65  0.00%  0.00%  0.00%   0 IPSEC key engine
138           0         1          0  0.00%  0.00%  0.00%   0 IPSEC manual key
139           0         1          0  0.00%  0.00%  0.00%   0 Crypto PAS Proc
140         588     19298         30  0.00%  0.00%  0.00%   0 Crypto Delete Ma
141           0         2          0  0.00%  0.00%  0.00%   0 Key Proc
142       34128   2323670         14  0.00%  0.00%  0.00%   0 Crypto Device Up
143           0         1          0  0.00%  0.00%  0.00%   0 Crypto Hardware
144           0         2          0  0.00%  0.00%  0.00%   0 Multi-ISA Event
145           0         1          0  0.00%  0.00%  0.00%   0 Multi-ISA Cleanu
146           0         1          0  0.00%  0.00%  0.00%   0 PM Callback
147           0         1          0  0.00%  0.00%  0.00%   0 DATA Transfer Pr
148           0         1          0  0.00%  0.00%  0.00%   0 DATA Collector
149          48       154        311  0.00%  0.00%  0.00%   0 AAA SEND STOP EV
150           0         3          0  0.00%  0.00%  0.00%   0 EEM ED CLI
151           0         2          0  0.00%  0.00%  0.00%   0 EEM ED Counter
152           0         2          0  0.00%  0.00%  0.00%   0 EEM ED Interface
153           0         3          0  0.00%  0.00%  0.00%   0 EEM ED IOSWD
154           0         2          0  0.00%  0.00%  0.00%   0 EEM ED Memory-th
155           0         2          0  0.00%  0.00%  0.00%   0 EEM ED None
156           0         2          0  0.00%  0.00%  0.00%   0 EM ED OIR
157           0         2          0  0.00%  0.00%  0.00%   0 EEM ED SNMP
158        1488     38875         38  0.00%  0.00%  0.00%   0 EEM ED Timer
159       34176    831582         41  0.00%  0.00%  0.00%   0 EEM Server
160        3288    232358         14  0.00%  0.00%  0.00%   0 RMON Recycle Pro
161           0         2          0  0.00%  0.00%  0.00%   0 RMON Deferred Se
162           0         1          0  0.00%  0.00%  0.00%   0 Syslog Traps
PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
163          16         2       8000  0.00%  0.00%  0.00%   0 VLAN Manager
164         448     38733         11  0.00%  0.00%  0.00%   0 DHCPD Database
165           0         2          0  0.00%  0.00%  0.00%   0 EEM Policy Direc
166        8300     11125        746  0.00%  0.00%  0.00%   0 Syslog
167           0         1          0  0.00%  0.00%  0.00%   0 VPDN Scal
168      914796      4173     219217  0.00%  0.00%  0.00%   0 crypto sw pk pro
169       66056    724440         91  0.00%  0.00%  0.00%   0 Net Input
170       54448    464812        117  0.00%  0.00%  0.00%   0 Compute load avg
171      785732     39334      19975  0.00%  0.01%  0.00%   0 Per-minute Jobs
172        2484     80611         30  0.00%  0.00%  0.00%   0 CEF Scanner
173           0         1          0  0.00%  0.00%  0.00%   0 tHUB
175         204      1293        157  0.00%  0.00%  0.00%   0 SSH Event handle
176       22252    270599         82  0.00%  0.00%  0.00%   0 NHRP
177           0         2          0  0.00%  0.00%  0.00%   0 IP Flow Backgrou
  91           0         1          0  0.00%  0.00%  0.00%   0 CES Client SVC R
179           0         1          0  0.00%  0.00%  0.00%   0 IP NAT WLAN
180      104416   1043002        100  0.00%  0.00%  0.00%   0 IP VFR proc
181       17980    290335         61  0.00%  0.00%  0.00%   0 CRYPTO IKMP IPC
182           0         3          0  0.00%  0.00%  0.00%   0 TCP Listener
  92        6640     84836         78  0.00%  0.00%  0.00%   0 TCP Timer
184      567988   2661021        213  0.00%  0.01%  0.00%   0 PDU DISPATCHER
  94         184       252        730  0.00%  0.00%  0.00%   0 TCP Protocols
186           0         1          0  0.00%  0.00%  0.00%   0 SNMP ConfCopyPro
187           0         1          0  0.00%  0.00%  0.00%   0 SNMP Traps
188      404124   2478125        163  0.00%  0.00%  0.00%   0 NAT MIB Helper
   1       14964     33292        449  0.00%  0.00%  0.00%   0 Chunk Manager
190      103004   2360065         43  0.00%  0.00%  0.00%   0 NTP
191         208      5800         35  0.00%  0.00%  0.00%   0 IP-EIGRP Router
192      210344   1102280        190  0.00%  0.00%  0.00%   0 IP-EIGRP: PDM
  97           0         2          0  0.00%  0.00%  0.00%   0 Dialer Forwarder
  98       17824     38719        460  0.00%  0.00%  0.00%   0 IP Cache Ager
195       12656     77518        163  0.00%  0.00%  0.00%   0 BGP I/O
196      614384    155070       3961  0.00%  0.01%  0.00%   0 BGP Scanner

Regards,

Naidu.

Hi Naidu,

Yes, I was talking about an AIM crypto module. See this document for further information:

http://www.cisco.com/en/US/prod/collateral/routers/ps5853/data_sheet_vpn_aim_for_18128003800routers_ps5853_Products_Data_Sheet.html

Also, you can review the installed hardware in your router using the show diag and show inventory commands.

In any case, do not yet rush into ordering the AIM. So far, I am not convinced that the high load is caused by crypto operations. Your current load was 17%, out of which 16% was in interrupt mode (i.e. fast switching, CEF switching) which is expectable for a normally working router. As we are obviously not in the time of a huge CPU spike, it is hard to tell what is causing it. I personally suggest strongly observing the load in regular intervals, and when the CPU load exceeds 50% then the listing of processes should be captured, preferably sorted by all three  keys (1s, 1m, 5m).

Best regards,

Peter

Hi Peter,

Sure, I will keep observe the CPU load on regular intervals and will update back to you.

Regards,

Naidu.