C1941 high utilization

[AndrewHow]

Hi all,

I found out this model CISCO1941/K9 of version c1900-universalk9-mz.SPA.154-3.M6a.bin have high CPU utilization. It's look common for software bug. Any other version could resolve this?

BSRPMB01#sh proc cpu his

BSRPMB01 03:10:55 PM Wednesday May 24 2017 gmt

999999999999999999999999999999999999999999999999999999999999
777777777777777777777777777777777777777777777777777777777777
100 ************************************************************
90 ************************************************************
80 ************************************************************
70 ************************************************************
60 ************************************************************
50 ************************************************************
40 ************************************************************
30 ************************************************************
20 ************************************************************
10 ************************************************************
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per second (last 60 seconds)

999999999999999999999999999999999999999999999999999999999999
777887778777778877777777777888888888888888887777777888888888
100 ############################################################
90 ############################################################
80 ############################################################
70 ############################################################
60 ############################################################
50 ############################################################
40 ############################################################
30 ############################################################
20 ############################################################
10 ############################################################
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%

9999999899999999999 11 11 11199
8888888888888888888635912503388
100 ###*#*# ##########* *#
90 ##################* *#
80 ##################* *#
70 ################### *#
60 ################### *#
50 ################### ##
40 ################### ##
30 ################### ##
20 ################### * ##
10 ###################**********##
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7..
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%

[Leo Laohoo]

If this router is connected to a WAN link, what is the WAN speed?

[Julio E. Moisa]

Hi Andrew,

Could you please provide the output of  show proc cpu sorted in order to determinate the process who is taking more CPU resources? Also I would like to see the logs. 

Thank you in advance. 

[AndrewHow]

Hi Julio,

below the output:

BSRPMB01#sh proc cpu sorted
CPU utilization for five seconds: 97%/89%; one minute: 97%; five minutes: 97%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
89 25560144 54588408 468 6.15% 6.18% 6.23% 0 Net Input
58 4012624 13375516 299 0.63% 0.63% 0.63% 0 Net Background
119 1868996 20618887 90 0.39% 0.37% 0.36% 0 PSE2 UART period
62 2996 1016 2948 0.39% 0.92% 0.32% 132 SSH Process
190 983968 18277126 53 0.31% 0.27% 0.26% 0 Ethernet Msec Ti
168 294624 446931 659 0.23% 0.12% 0.09% 0 IP Input
123 493956 1784670 276 0.07% 0.07% 0.07% 0 VRRS Main thread
209 178992 251893 710 0.07% 0.01% 0.00% 0 ADJ background
164 497376 3830539 129 0.07% 0.07% 0.07% 0 IPAM Manager
92 91280 198433 460 0.07% 0.02% 0.00% 0 Per-Second Jobs
124 16208 126559 128 0.07% 0.00% 0.00% 0 mDNS
11 0 1 0 0.00% 0.00% 0.00% 0 Image License br
10 0 1 0 0.00% 0.00% 0.00% 0 License Client N
12 259764 1911 135930 0.00% 0.12% 0.16% 0 Licensing Auto U
9 24 226 106 0.00% 0.00% 0.00% 0 WATCH_AFS
16 124 1911 64 0.00% 0.00% 0.00% 0 IPC Dynamic Cach
13 0 1 0 0.00% 0.00% 0.00% 0 RMI RM Notify Wa
14 115908 114543 1011 0.00% 0.05% 0.05% 0 Environmental mo
15 888 22912 38 0.00% 0.00% 0.00% 0 IPC Event Notifi
20 12412 112029 110 0.00% 0.00% 0.00% 0 IPC Deferred Por
21 0 1 0 0.00% 0.00% 0.00% 0 IPC Process leve
17 0 1 0 0.00% 0.00% 0.00% 0 IPC Session Serv
23 608 6562 92 0.00% 0.00% 0.00% 0 IPC Check Queue
24 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat RX Cont
25 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat TX Cont
18 0 1 0 0.00% 0.00% 0.00% 0 IPC Zone Manager
27 4672 22958 203 0.00% 0.00% 0.00% 0 IPC Loadometer
28 4 1 4000 0.00% 0.00% 0.00% 0 IPC Session Deta
19 14248 112029 127 0.00% 0.00% 0.00% 0 IPC Periodic Tim
30 0 1 0 0.00% 0.00% 0.00% 0 Exception contro
22 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat Manager
32 0 1 0 0.00% 0.00% 0.00% 0 IFS Agent Manage
33 173856 325474 534 0.00% 0.01% 0.00% 0 ARP Input
34 25168 132807 189 0.00% 0.00% 0.00% 0 ARP Background
35 0 2 0 0.00% 0.00% 0.00% 0 ATM Idle Timer
8 0 2 0 0.00% 0.00% 0.00% 0 Timers
37 4 1 4000 0.00% 0.00% 0.00% 0 CEF MIB API
38 0 1 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT
39 0 1 0 0.00% 0.00% 0.00% 0 Policy Manager
40 0 2 0 0.00% 0.00% 0.00% 0 DDR Timers
41 0 4 0 0.00% 0.00% 0.00% 0 Entity MIB API
42 2828 39 72512 0.00% 0.00% 0.00% 0 PrstVbl
43 0 2 0 0.00% 0.00% 0.00% 0 Serial Backgroun
26 1156 11484 100 0.00% 0.00% 0.00% 0 IPC Keep Alive M
29 0 1 0 0.00% 0.00% 0.00% 0 Crash writer
46 0 2 0 0.00% 0.00% 0.00% 0 SMART
47 0 1 0 0.00% 0.00% 0.00% 0 RF SCTPthread
48 0 1 0 0.00% 0.00% 0.00% 0 CHKPT RG SCTPthr
49 12696 189056 67 0.00% 0.00% 0.00% 0 ARP Snoop
31 544 5117 106 0.00% 0.00% 0.00% 0 CRYPTO IKMP IPC
51 0 2 0 0.00% 0.00% 0.00% 0 Dialer event
52 0 1 0 0.00% 0.00% 0.00% 0 SERIAL A'detect
53 0 2 0 0.00% 0.00% 0.00% 0 XML Proxy Client
54 1384 127 10897 0.00% 0.00% 0.00% 0 crypto sw pk pro
36 0 1 0 0.00% 0.00% 0.00% 0 ATM ASYNC PROC
56 0 1 0 0.00% 0.00% 0.00% 0 ISM-VPN Cleanup
57 0 1 0 0.00% 0.00% 0.00% 0 Critical Bkgnd
7 0 1 0 0.00% 0.00% 0.00% 0 DiscardQ Backgro
59 0 2 0 0.00% 0.00% 0.00% 0 IDB Work
60 2896 7576 382 0.00% 0.00% 0.00% 0 Logger
61 17052 114539 148 0.00% 0.00% 0.00% 0 TTY Background
6 468 1985 235 0.00% 0.00% 0.00% 0 Pool Manager
63 0 2 0 0.00% 0.00% 0.00% 0 CTS CORE
64 0 3 0 0.00% 0.00% 0.00% 0 SXP CORE
44 0 1 0 0.00% 0.00% 0.00% 0 License IPC stat
66 0 11 0 0.00% 0.00% 0.00% 0 IF-MGR control p
67 8 34 235 0.00% 0.00% 0.00% 0 IF-MGR event pro
68 0 1 0 0.00% 0.00% 0.00% 0 Inode Table Dest
69 0 2 0 0.00% 0.00% 0.00% 0 cpf_msg_holdq_pr
70 0 1 0 0.00% 0.00% 0.00% 0 cpf_msg_rcvq_pro
71 0 1 0 0.00% 0.00% 0.00% 0 cpf_process_tpQ
72 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien
73 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien
74 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien
75 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien
76 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien
77 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien
78 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien
79 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien
45 0 1 0 0.00% 0.00% 0.00% 0 License IPC serv
81 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien
50 13540 114804 117 0.00% 0.00% 0.00% 0 GraphIt
83 0 1 0 0.00% 0.00% 0.00% 0 Crypto PKI-HA
84 0 1 0 0.00% 0.00% 0.00% 0 IKE HA Mgr
85 0 1 0 0.00% 0.00% 0.00% 0 IPSEC HA Mgr
86 152 1007 150 0.00% 0.00% 0.00% 0 TDM Management
87 0 12 0 0.00% 0.00% 0.00% 0 RF Master Main T
88 0 7 0 0.00% 0.00% 0.00% 0 RF Master Status
5 164120 21483 7639 0.00% 0.12% 0.11% 0 Check heaps
90 27776 52625 527 0.00% 0.00% 0.00% 0 Compute load avg
91 22924 4800 4775 0.00% 0.00% 0.00% 0 Per-minute Jobs
55 49900 222953 223 0.00% 0.00% 0.00% 0 ISM-VPN main
4 0 1 0 0.00% 0.00% 0.00% 0 RO Notify Timers
94 0 1 0 0.00% 0.00% 0.00% 0 Token Daemon
95 0 1 0 0.00% 0.00% 0.00% 0 Transport Port A
96 15536 22912 678 0.00% 0.00% 0.00% 0 HC Counter Timer
97 0 2 0 0.00% 0.00% 0.00% 0 SM Monitor
98 0 2 0 0.00% 0.00% 0.00% 0 SM Installer
3 0 1 0 0.00% 0.00% 0.00% 0 LICENSE AGENT
100 0 1 0 0.00% 0.00% 0.00% 0 dev_device_remov
101 0 2 0 0.00% 0.00% 0.00% 0 ESWPPM
65 8 12 666 0.00% 0.00% 0.00% 0 RF Slave Main Th
103 164 19 8631 0.00% 0.00% 0.00% 0 DXMRVL
104 0 1 0 0.00% 0.00% 0.00% 0 esw_mrvl mat que
105 79024 115589 683 0.00% 0.00% 0.00% 0 ehwic_eswge Proc
106 1464 114666 12 0.00% 0.00% 0.00% 0 Console redirect
107 0 1 0 0.00% 0.00% 0.00% 0 RF_INTERDEV_DELA
108 0 1 0 0.00% 0.00% 0.00% 0 RF_INTERDEV_SCTP
109 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Identity
110 24 36 666 0.00% 0.00% 0.00% 0 EEM ED ND
111 0 2 0 0.00% 0.00% 0.00% 0 UCSE Monitor
113 0 1 0 0.00% 0.00% 0.00% 0 IGMP Snooping Pr
114 56 986 56 0.00% 0.00% 0.00% 0 IGMP Snooping Re
115 224 3820 58 0.00% 0.00% 0.00% 0 Call Management
116 4 2 2000 0.00% 0.00% 0.00% 0 USB Startup
117 0 1 0 0.00% 0.00% 0.00% 0 CF_INTERDEV_SCTP
118 70844 229341 308 0.00% 0.00% 0.00% 0 BPSM stat Proces
2 14640 22962 637 0.00% 0.01% 0.00% 0 Load Meter
120 240 12426 19 0.00% 0.00% 0.00% 0 ISM-VPN init
121 33860 114550 295 0.00% 0.00% 0.00% 0 FHRP Main thread
122 0 1 0 0.00% 0.00% 0.00% 0 VRRP Main thread
1 0 26 0 0.00% 0.00% 0.00% 0 Chunk Manager
80 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien
126 0 3 0 0.00% 0.00% 0.00% 0 802.1x layer3
127 0 2 0 0.00% 0.00% 0.00% 0 IP NAT HA BGND P
128 0 11 0 0.00% 0.00% 0.00% 0 Auth Manager
129 0 1 0 0.00% 0.00% 0.00% 0 AUTH POLICY Fram
130 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Mgr Proces
131 0 1 0 0.00% 0.00% 0.00% 0 802.1x Webauth F
132 0 1 0 0.00% 0.00% 0.00% 0 EAP Framework
133 0 2 0 0.00% 0.00% 0.00% 0 CMD HANDLER
134 0 2 0 0.00% 0.00% 0.00% 0 DTP Protocol
135 0 1 0 0.00% 0.00% 0.00% 0 SFF8472
136 9336 114543 81 0.00% 0.00% 0.00% 0 PI MATM Aging Pr
137 0 2 0 0.00% 0.00% 0.00% 0 call_home_les_oi
138 0 1 0 0.00% 0.00% 0.00% 0 SMI Director DB
139 0 1 0 0.00% 0.00% 0.00% 0 SMI CDP Update H
140 0 1 0 0.00% 0.00% 0.00% 0 SMI Backup Proce
141 0 2 0 0.00% 0.00% 0.00% 0 RG Faults Timer
142 0 2 0 0.00% 0.00% 0.00% 0 RG Protocol Time
143 0 2 0 0.00% 0.00% 0.00% 0 RG Transport Tim
144 0 1 0 0.00% 0.00% 0.00% 0 RG VP
145 0 2 0 0.00% 0.00% 0.00% 0 RG AR
146 208 957 217 0.00% 0.00% 0.00% 0 DHCP Snooping
147 0 2 0 0.00% 0.00% 0.00% 0 IP Host Track Pr
148 4 6 666 0.00% 0.00% 0.00% 0 AAA Server
149 0 1 0 0.00% 0.00% 0.00% 0 AAA ACCT Proc
150 0 1 0 0.00% 0.00% 0.00% 0 ACCT Periodic Pr
153 372 1926 193 0.00% 0.00% 0.00% 0 Call Home Timer
154 0 2 0 0.00% 0.00% 0.00% 0 AAA Dictionary R
155 0 2 0 0.00% 0.00% 0.00% 0 Ethernet LMI
156 0 2 0 0.00% 0.00% 0.00% 0 Ethernet OAM Pro
157 0 2 0 0.00% 0.00% 0.00% 0 CEF switching ba
158 0 1 0 0.00% 0.00% 0.00% 0 ADJ NSF process
159 0 1 0 0.00% 0.00% 0.00% 0 TRACK Main threa
160 0 1 0 0.00% 0.00% 0.00% 0 TRACK Client thr
161 0 2 0 0.00% 0.00% 0.00% 0 ATM OAM Input
162 0 2 0 0.00% 0.00% 0.00% 0 ATM OAM TIMER
163 0 2 0 0.00% 0.00% 0.00% 0 IPAM/ODAP Events
82 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien
165 0 2 0 0.00% 0.00% 0.00% 0 IPAM Events
166 176 171 1029 0.00% 0.00% 0.00% 0 IP ARP Adjacency
167 0 1 0 0.00% 0.00% 0.00% 0 IP ARP Retry Age
93 4 2 2000 0.00% 0.00% 0.00% 0 AggMgr Process
169 0 1 0 0.00% 0.00% 0.00% 0 ICMP event handl
170 0 3 0 0.00% 0.00% 0.00% 0 PIM register asy
171 24580 223717 109 0.00% 0.00% 0.00% 0 NAT64 Bgnd Proce
172 216 198 1090 0.00% 0.00% 0.00% 0 MOP Protocols
173 0 2 0 0.00% 0.00% 0.00% 0 PPP SIP
174 0 2 0 0.00% 0.00% 0.00% 0 PPP Bind
175 0 2 0 0.00% 0.00% 0.00% 0 PPP IP Route
176 0 1 0 0.00% 0.00% 0.00% 0 HQF TARGET DYNAM
178 0 2 0 0.00% 0.00% 0.00% 0 RIB LM VALIDATE
179 0 1 0 0.00% 0.00% 0.00% 0 SSS Manager
180 0 1 0 0.00% 0.00% 0.00% 0 SSS Policy Manag
181 0 1 0 0.00% 0.00% 0.00% 0 SSS Feature Mana
182 60400 448477 134 0.00% 0.00% 0.00% 0 SSS Feature Time
183 58752 200924 292 0.00% 0.01% 0.00% 0 Spanning Tree
184 0 2 0 0.00% 0.00% 0.00% 0 SSM connection m
185 0 1 0 0.00% 0.00% 0.00% 0 WAAS Process
186 0 1 0 0.00% 0.00% 0.00% 0 X.25 Encaps Mana
187 0 1 0 0.00% 0.00% 0.00% 0 IPv6 ping proces
188 0 2 0 0.00% 0.00% 0.00% 0 Ethernet CFM
189 43588 761380 57 0.00% 0.00% 0.00% 0 Ethernet Timer C
99 0 1 0 0.00% 0.00% 0.00% 0 dev_device_inser
191 0 2 0 0.00% 0.00% 0.00% 0 Ethernet CFM PAL
192 0 1 0 0.00% 0.00% 0.00% 0 Auth-proxy AAA B
193 4520 41499 108 0.00% 0.00% 0.00% 0 Auth-proxy HTTP
194 0 1 0 0.00% 0.00% 0.00% 0 IP Admin SM Proc
195 0 2 0 0.00% 0.00% 0.00% 0 EAPoUDP Process
196 0 2 0 0.00% 0.00% 0.00% 0 KRB5 AAA
197 68 1911 35 0.00% 0.00% 0.00% 0 FRR Background P
198 5288 11644 454 0.00% 0.00% 0.00% 0 CEF background p
199 0 1 0 0.00% 0.00% 0.00% 0 fib_fib_bfd_sb e
200 4 18 222 0.00% 0.00% 0.00% 0 Flow Exporter Ti
201 0 2 0 0.00% 0.00% 0.00% 0 Flow Exporter Pa
202 0 1 0 0.00% 0.00% 0.00% 0 Tunnel FIB
102 0 2 0 0.00% 0.00% 0.00% 0 Eswilp Storm Con
204 0 2 0 0.00% 0.00% 0.00% 0 HQF Input Shaper
205 0 2 0 0.00% 0.00% 0.00% 0 IPMUXv4
206 0 2 0 0.00% 0.00% 0.00% 0 IPMUXv6
207 0 1 0 0.00% 0.00% 0.00% 0 IPC UDP Input
208 26024 68051 382 0.00% 0.00% 0.00% 0 CEF: IPv4 proces
203 0 2 0 0.00% 0.00% 0.00% 0 HQF Output Shape
210 4 4 1000 0.00% 0.00% 0.00% 0 Collection proce
211 0 1 0 0.00% 0.00% 0.00% 0 Socket Timers
212 0 1 0 0.00% 0.00% 0.00% 0 Critical Auth
213 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Supplicant
214 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Supplicant
215 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Supplicant
216 12 20 600 0.00% 0.00% 0.00% 0 L2MM
217 0 1 0 0.00% 0.00% 0.00% 0 MRD
218 468 1209 387 0.00% 0.00% 0.00% 0 IGMPSN
219 0 2 0 0.00% 0.00% 0.00% 0 L2X Switching Ev
220 0 1 0 0.00% 0.00% 0.00% 0 MAB Framework
221 0 2 0 0.00% 0.00% 0.00% 0 RG Media Timer
222 0 1 0 0.00% 0.00% 0.00% 0 RG If-Mgr Timer
223 0 2 0 0.00% 0.00% 0.00% 0 Routing Topology
224 48 68 705 0.00% 0.00% 0.00% 0 IP RIB Update
225 104 2034 51 0.00% 0.00% 0.00% 0 IP Background
226 16 61 262 0.00% 0.00% 0.00% 0 IP Connected Rou
227 0 1 0 0.00% 0.00% 0.00% 0 IP Traceroute
228 0 3 0 0.00% 0.00% 0.00% 0 Service Routing
229 4 23 173 0.00% 0.00% 0.00% 0 SR CapMan Proces
230 0 3 0 0.00% 0.00% 0.00% 0 SNMP Timers
231 0 2 0 0.00% 0.00% 0.00% 0 SCTP Main Proces
232 4 9 444 0.00% 0.00% 0.00% 0 TCP Timer
233 8 5 1600 0.00% 0.00% 0.00% 0 TCP Protocols
234 64 426 150 0.00% 0.00% 0.00% 0 HTTP CORE
235 0 1 0 0.00% 0.00% 0.00% 0 AAA System Acct
236 0 2 0 0.00% 0.00% 0.00% 0 PPP Compress Inp
237 0 2 0 0.00% 0.00% 0.00% 0 PPP Compress Res
238 0 1 0 0.00% 0.00% 0.00% 0 COPS
239 0 2 0 0.00% 0.00% 0.00% 0 Dialer Forwarder
240 21048 40126 524 0.00% 0.00% 0.00% 0 ADJ resolve proc
242 0 2 0 0.00% 0.00% 0.00% 0 Tunnel
243 0 3 0 0.00% 0.00% 0.00% 0 MFIB Master back
244 0 18 0 0.00% 0.00% 0.00% 0 MVPN Mgr Process
245 0 2 0 0.00% 0.00% 0.00% 0 Multicast Offloa
246 0 1 0 0.00% 0.00% 0.00% 0 RARP Input
247 0 3 0 0.00% 0.00% 0.00% 0 static
248 0 2 0 0.00% 0.00% 0.00% 0 App Route Proces
249 0 1 0 0.00% 0.00% 0.00% 0 IPv6 RIB Cleanup
250 0 1 0 0.00% 0.00% 0.00% 0 IPv6 RIB Event H
251 0 1 0 0.00% 0.00% 0.00% 0 IP IRDP
252 0 1 0 0.00% 0.00% 0.00% 0 LAPB Process
253 0 1 0 0.00% 0.00% 0.00% 0 PAD InCall
254 0 2 0 0.00% 0.00% 0.00% 0 X.25 Background
255 10344 14983 690 0.00% 0.00% 0.00% 0 QoS stats proces
256 16036 129920 123 0.00% 0.00% 0.00% 0 RUDPV1 Main Proc
257 0 1 0 0.00% 0.00% 0.00% 0 VPDN call manage
258 4 34 117 0.00% 0.00% 0.00% 0 SSH Event handle
259 0 1 0 0.00% 0.00% 0.00% 0 IPv6 Static Hand
260 0 1 0 0.00% 0.00% 0.00% 0 Ethernet Datapla
261 0 1 0 0.00% 0.00% 0.00% 0 Ethernet PM Proc
262 0 2 0 0.00% 0.00% 0.00% 0 Ethernet PM Soft
263 2472 26571 93 0.00% 0.00% 0.00% 0 Ethernet PM Moni
264 0 2 0 0.00% 0.00% 0.00% 0 PPP NBF
265 0 2 0 0.00% 0.00% 0.00% 0 SDEE Management
266 24712 223718 110 0.00% 0.00% 0.00% 0 Inspect process
268 1532 8432 181 0.00% 0.00% 0.00% 0 FW DP Inspect pr
269 23888 223717 106 0.00% 0.00% 0.00% 0 CCE DP URLF cach
270 0 2 0 0.00% 0.00% 0.00% 0 URL filter proc
271 0 1 0 0.00% 0.00% 0.00% 0 IPS Process
272 4 2 2000 0.00% 0.00% 0.00% 0 IPS Auto Update
273 0 1 0 0.00% 0.00% 0.00% 0 Select Timers
274 32 2 16000 0.00% 0.00% 0.00% 0 HTTP Process
275 0 2 0 0.00% 0.00% 0.00% 0 CIFS API Process
276 0 2 0 0.00% 0.00% 0.00% 0 CIFS Proxy Proce
277 0 5 0 0.00% 0.00% 0.00% 0 Crypto HW Proc
278 0 1 0 0.00% 0.00% 0.00% 0 IPv6 Inspect Tim
279 0 1 0 0.00% 0.00% 0.00% 0 IPSECv6 PS Proc
281 0 2 0 0.00% 0.00% 0.00% 0 AAA Cached Serve
282 0 2 0 0.00% 0.00% 0.00% 0 ENABLE AAA
283 0 1 0 0.00% 0.00% 0.00% 0 EM Background Pr
284 0 1 0 0.00% 0.00% 0.00% 0 IDMGR CORE
285 0 1 0 0.00% 0.00% 0.00% 0 Opaque Database
286 0 1 0 0.00% 0.00% 0.00% 0 Key chain liveke
287 0 2 0 0.00% 0.00% 0.00% 0 LINE AAA
288 108 70 1542 0.00% 0.00% 0.00% 0 LOCAL AAA
289 0 2 0 0.00% 0.00% 0.00% 0 TPLUS
290 3968 98 40489 0.00% 0.00% 0.00% 0 NIST rng proc
291 0 3 0 0.00% 0.00% 0.00% 0 LDAP process
292 0 3 0 0.00% 0.00% 0.00% 0 Crypto WUI
293 0 1 0 0.00% 0.00% 0.00% 0 EAP Process
294 0 1 0 0.00% 0.00% 0.00% 0 FW_TEST_TRP
295 28912 225217 128 0.00% 0.00% 0.00% 0 Timer Library
296 192 249 771 0.00% 0.00% 0.00% 0 Crypto Support
297 0 1 0 0.00% 0.00% 0.00% 0 EPM MAIN PROCESS
298 0 2 0 0.00% 0.00% 0.00% 0 CSDB Timer proce
299 736 1312 560 0.00% 0.00% 0.00% 0 crypto engine pr
300 0 1 0 0.00% 0.00% 0.00% 0 RSA background p
301 92 131 702 0.00% 0.00% 0.00% 0 Crypto CA
302 0 3 0 0.00% 0.00% 0.00% 0 Crypto PKI-CRL
303 0 1 0 0.00% 0.00% 0.00% 0 Crypto PKI-Rev-P
304 0 1 0 0.00% 0.00% 0.00% 0 PKI OCSP
305 0 1 0 0.00% 0.00% 0.00% 0 PKI Revocation
306 0 1 0 0.00% 0.00% 0.00% 0 encrypt proc
307 35436 114549 309 0.00% 0.00% 0.00% 0 Crypto IKEv2
308 0 1 0 0.00% 0.00% 0.00% 0 IKEv2 AAA handle
309 0 3 0 0.00% 0.00% 0.00% 0 CRYPTO MAP FREE
310 0 1 0 0.00% 0.00% 0.00% 0 Crypto INT
311 7484 5252 1424 0.00% 0.00% 0.00% 0 Crypto IKE Dispa
312 40996 36525 1122 0.00% 0.00% 0.00% 0 Crypto IKMP
313 0 1 0 0.00% 0.00% 0.00% 0 IPSEC manual key
314 980 6110 160 0.00% 0.00% 0.00% 0 IPSEC key engine
315 0 3 0 0.00% 0.00% 0.00% 0 CRYPTO QoS proce
316 0 1 0 0.00% 0.00% 0.00% 0 Crypto ACL
317 0 1 0 0.00% 0.00% 0.00% 0 Crypto PAS Proc
318 968 1596 606 0.00% 0.00% 0.00% 0 IPSec background
319 0 2 0 0.00% 0.00% 0.00% 0 GKM GM Process
320 0 1 0 0.00% 0.00% 0.00% 0 GKM KS PROCESS
321 10616 114813 92 0.00% 0.00% 0.00% 0 Crypto Device Up
322 0 3 0 0.00% 0.00% 0.00% 0 Multi-ISA Event
323 0 2 0 0.00% 0.00% 0.00% 0 Multi-ISA Cleanu
324 0 1 0 0.00% 0.00% 0.00% 0 crypto raw delet
325 0 1 0 0.00% 0.00% 0.00% 0 Licensing MIB pr
326 0 2 0 0.00% 0.00% 0.00% 0 Control-plane ho
327 4856 31390 154 0.00% 0.00% 0.00% 0 PM Callback
328 1208 10348 116 0.00% 0.00% 0.00% 0 dhcp snooping sw
330 4 3 1333 0.00% 0.00% 0.00% 0 AAA SEND STOP EV
331 0 1 0 0.00% 0.00% 0.00% 0 Test AAA Client
332 0 1 0 0.00% 0.00% 0.00% 0 dcm_cli_engine
333 0 3 0 0.00% 0.00% 0.00% 0 dcm_cli_provider
334 4 5 800 0.00% 0.00% 0.00% 0 DCM Core Thread
335 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Routing
336 992 3952 251 0.00% 0.00% 0.00% 0 EEM ED Syslog
337 4 4 1000 0.00% 0.00% 0.00% 0 EEM ED Generic
338 4 4 1000 0.00% 0.00% 0.00% 0 EEM ED NHRP
339 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Track
340 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Resource
341 840 11457 73 0.00% 0.00% 0.00% 0 RMON Recycle Pro
342 0 2 0 0.00% 0.00% 0.00% 0 RMON Deferred Se
343 0 1 0 0.00% 0.00% 0.00% 0 Syslog Traps
344 0 1 0 0.00% 0.00% 0.00% 0 WAN Optimization
345 0 1 0 0.00% 0.00% 0.00% 0 IKEv2 Cluster Lo
346 0 1 0 0.00% 0.00% 0.00% 0 IKEv2 FlexVPN Pr
347 2496 3588 695 0.00% 0.00% 0.00% 0 Crypto cTCP proc
349 76 2 38000 0.00% 0.00% 0.00% 0 VLAN Manager
350 48972 171869 284 0.00% 0.00% 0.00% 0 OSPF-1 Router
351 0 4 0 0.00% 0.00% 0.00% 0 RBM CORE
352 0 3 0 0.00% 0.00% 0.00% 0 CTS credentials
353 8 103 77 0.00% 0.00% 0.00% 0 EEM Server
354 36 44 818 0.00% 0.00% 0.00% 0 Call Home proces
355 0 1 0 0.00% 0.00% 0.00% 0 Call Home DS
356 0 1 0 0.00% 0.00% 0.00% 0 Call Home DSfile
357 0 6 0 0.00% 0.00% 0.00% 0 DCM snmp dp Thre
358 0 3 0 0.00% 0.00% 0.00% 0 snmp dcm ma shim
359 2504 13159 190 0.00% 0.00% 0.00% 0 Bulkstat-Client
360 0 3 0 0.00% 0.00% 0.00% 0 dcm_expression_p
361 0 3 0 0.00% 0.00% 0.00% 0 EEM Policy Direc
362 1536 11764 130 0.00% 0.00% 0.00% 0 NHRP
363 4 4 1000 0.00% 0.00% 0.00% 0 EEM ED CLI
364 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Counter
365 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Interface
366 0 4 0 0.00% 0.00% 0.00% 0 EEM ED IOSWD
367 0 4 0 0.00% 0.00% 0.00% 0 EEM ED None
368 0 4 0 0.00% 0.00% 0.00% 0 EEM ED OIR
369 0 9 0 0.00% 0.00% 0.00% 0 EEM ED RF
370 0 4 0 0.00% 0.00% 0.00% 0 EEM ED SNMP
371 0 4 0 0.00% 0.00% 0.00% 0 EEM ED SNMP Obje
372 0 4 0 0.00% 0.00% 0.00% 0 EEM ED SNMP Noti
373 972 1919 506 0.00% 0.00% 0.00% 0 EEM ED Timer
374 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Test
375 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Config
376 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Env
377 0 4 0 0.00% 0.00% 0.00% 0 EEM ED DS
378 4 4 1000 0.00% 0.00% 0.00% 0 EEM ED CRASH
379 11064 8053 1373 0.00% 0.00% 0.00% 0 Multicast Replic
380 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Nf
381 3724 6054 615 0.00% 0.00% 0.00% 0 Syslog
382 0 10 0 0.00% 0.00% 0.00% 0 Tunnel Security
383 0 4 0 0.00% 0.00% 0.00% 0 EEM ED RPC
384 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Ipsla
385 0 1 0 0.00% 0.00% 0.00% 0 IP SLAs Ethernet
386 0 1 0 0.00% 0.00% 0.00% 0 tHUB
387 6968 8576 812 0.00% 0.00% 0.00% 0 mdns Timer Proce
388 0 2 0 0.00% 0.00% 0.00% 0 MRIB Process
389 0 3 0 0.00% 0.00% 0.00% 0 Key Proc
390 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
391 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
392 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
393 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
394 228 1911 119 0.00% 0.00% 0.00% 0 DFS flush period
395 4 7 571 0.00% 0.00% 0.00% 0 EEM Helper Threa
396 4 4 1000 0.00% 0.00% 0.00% 0 Crypto SS Proces
398 103528 138734 746 0.00% 0.01% 0.00% 0 IP SNMP
399 37796 65425 577 0.00% 0.00% 0.00% 0 PDU DISPATCHER
400 88532 78736 1124 0.00% 0.01% 0.00% 0 SNMP ENGINE
401 0 2 0 0.00% 0.00% 0.00% 0 IP SNMPV6
402 0 1 0 0.00% 0.00% 0.00% 0 SNMP ConfCopyPro
403 0 2 0 0.00% 0.00% 0.00% 0 SNMP Traps
404 38380 145915 263 0.00% 0.00% 0.00% 0 NTP
405 63528 159254 398 0.00% 0.00% 0.00% 0 OSPF-1 Hello

[Julio E. Moisa]

Hi Andrew,

If you are still seeing high CPU and no process is showing high consume of resources, it is pointing to a Bug, you could upgrade the IOS or open a ticket with the Cisco TAC.

None process is consuming a lot of resources to have high CPU. The Sum of all the displayed % will not reach more than 10%.

Also you should not be experiencing any traffic problem or lost packets. 

89 25560144 54588408 468 6.15% 6.18% 6.23% 0 Net Input
58 4012624 13375516 299 0.63% 0.63% 0.63% 0 Net Background
119 1868996 20618887 90 0.39% 0.37% 0.36% 0 PSE2 UART period
62 2996 1016 2948 0.39% 0.92% 0.32% 132 SSH Process
190 983968 18277126 53 0.31% 0.27% 0.26% 0 Ethernet Msec Ti
168 294624 446931 659 0.23% 0.12% 0.09% 0 IP Input
123 493956 1784670 276 0.07% 0.07% 0.07% 0 VRRS Main thread
209 178992 251893 710 0.07% 0.01% 0.00% 0 ADJ background
164 497376 3830539 129 0.07% 0.07% 0.07% 0 IPAM Manager

[AndrewHow]

Thanks Julio,

I'll contact cisco TAC for support.

[Julio E. Moisa]

Hi Andrew,

It was a pleasure, have a great day!

:-)

[Leo Laohoo]

I agree with Julio. 

It's a memory leak with the IOS.

[Joseph W. Doherty]

Could you also note the aggregate traffic volume too?

[AndrewHow]

Hi Joseph,

here the output for the connection to WAN

GigabitEthernet0/0 is up, line protocol is up
Hardware is CN Gigabit Ethernet, address is 30f7.0da5.5160 (bia 30f7.0da5.5160)
Description: Connect to UPE1
Internet address is 10.203.15.3/24
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full Duplex, 1Gbps, media type is RJ45
output flow-control is XON, input flow-control is XON
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: Class-based queueing
Output queue: 0/1000/0 (size/max total/drops)
5 minute input rate 326000 bits/sec, 43 packets/sec
5 minute output rate 96000 bits/sec, 30 packets/sec
4862580 packets input, 4207872362 bytes, 0 no buffer
Received 49724 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 3798 multicast, 0 pause input
3763535 packets output, 1450865526 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
3798 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
ISM0/0 is up, line protocol is up
Hardware is PSE2, address is 30f7.0da5.5184 (bia 30f7.0da5.5184)
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full Duplex, 1Gbps, media type is internal
output flow-control is XON, input flow-control is XON
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 0 multicast, 0 pause input
1 packets output, 294 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 142 pause output
0 output buffer failures, 0 output buffers swapped out
ISM0/1 is up, line protocol is up
Hardware is PSE2, address is 30f7.0da5.5185 (bia 30f7.0da5.5185)
Internet address is 127.0.0.1/8
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full Duplex, 1Gbps, media type is internal
output flow-control is XON, input flow-control is XON
ARP type: ARPA, ARP Timeout 04:00:00
Last input 1d07h, output 00:00:02, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 1/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 1000 bits/sec, 1 packets/sec
2 packets input, 174 bytes, 0 no buffer
Received 2 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 0 multicast, 0 pause input
47578 packets output, 7109166 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
GigabitEthernet0/1 is up, line protocol is up
Hardware is CN Gigabit Ethernet, address is 30f7.0da5.5161 (bia 30f7.0da5.5161)
Description: Connect to UPE1
Internet address is 10.203.16.3/24
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full Duplex, 1Gbps, media type is RJ45
output flow-control is XON, input flow-control is XON
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:03, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: Class-based queueing
Output queue: 0/1000/0 (size/max total/drops)
5 minute input rate 1000 bits/sec, 1 packets/sec
5 minute output rate 1000 bits/sec, 1 packets/sec
28132 packets input, 6573044 bytes, 0 no buffer
Received 3809 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 3798 multicast, 0 pause input
36024 packets output, 5818000 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
3798 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
GigabitEthernet0/0/0 is up, line protocol is up
Hardware is EHWIC-4 Gigabit Ethernet, address is 6073.5c42.2868 (bia 6073.5c42.2868)
Description: To LAN
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 8/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 1000Mb/s
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:23, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 32393000 bits/sec, 44880 packets/sec
5 minute output rate 241000 bits/sec, 37 packets/sec
2467125834 packets input, 3910021946 bytes, 0 no buffer
Received 395958 broadcasts (2462828662 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 0 multicast, 0 pause input
0 input packets with dribble condition detected
4880017 packets output, 3730607167 bytes, 0 underruns
0 output errors, 0 collisions, 1 interface resets
3823 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out

[Joseph W. Doherty]

Your CPU stats show most of your processing in interrupt, and your g0/0/0 interface shows a 5 minute input average of 32 Mbps.  Your router just might be struggling with the packet forwarding load.

I've sometimes noticed that some modular Ethernet interfaces, like EHWICs, may cause higher CPU load then built-in Ethernet interfaces.  If one EHWIC Ethernet port is particularly busy, you might try "swapping" it with a less utilized built-in port.