10-10-2015 09:27 AM - edited 03-08-2019 02:09 AM
Hi All,
have a high cpu utilisation problem in 4507 switch. the sorted cpu indicates the process DHCPD Receive consuming around 33%, which i believe is more than normal. i tried creating an acl for dhcp requests bbotpc and bootps to log but did not find any logs or counter on the acl.
CPU utilization for five seconds: 94%/5%; one minute: 92%; five minutes: 93%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
1 4 17 235 0.00% 0.00% 0.00% 0 Chunk Manager
2 152 37489 4 0.00% 0.00% 0.00% 0 Load Meter
3 4 1563 2 0.00% 0.00% 0.00% 0 DHCPD Timer
4 0 1 0 0.00% 0.00% 0.00% 0 Deferred Events
5 0 1 0 0.00% 0.00% 0.00% 0 Retransmission o
6 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Receive
7 393157 34366 11440 0.00% 0.21% 0.18% 0 Check heaps
8 0 11 0 0.00% 0.00% 0.00% 0 Pool Manager
9 0 2 0 0.00% 0.00% 0.00% 0 Timers
10 0 2 0 0.00% 0.00% 0.00% 0 Serial Backgroun
11 0 1 0 0.00% 0.00% 0.00% 0 Crash writer
12 44 16 2750 0.00% 0.00% 0.00% 0 RF Slave Main Th
13 0 1 0 0.00% 0.00% 0.00% 0 ifIndex Receive
14 204335 595687 343 0.07% 0.11% 0.13% 0 ARP Input
15 0 1 0 0.00% 0.00% 0.00% 0 CEF MIB API
16 0 1 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT
17 0 2 0 0.00% 0.00% 0.00% 0 AAA high-capacit
18 0 1 0 0.00% 0.00% 0.00% 0 Policy Manager
19 40 91 439 0.00% 0.00% 0.00% 0 Entity MIB API
20 0 1 0 0.00% 0.00% 0.00% 0 IFS Agent Manage
21 194 37458 5 0.00% 0.00% 0.00% 0 IPC Event Notifi
22 1003 187269 5 0.00% 0.00% 0.00% 0 IPC Mcast Pendin
23 36 3123 11 0.00% 0.00% 0.00% 0 IPC Dynamic Cach
24 0 1 0 0.00% 0.00% 0.00% 0 IPC Session Serv
25 0 1 0 0.00% 0.00% 0.00% 0 IPC Zone Manager
26 1066 187269 5 0.00% 0.00% 0.00% 0 IPC Periodic Tim
27 0 1 0 0.00% 0.00% 0.00% 0 IPC Managed Time
28 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat TX Cont
29 952 187269 5 0.00% 0.00% 0.00% 0 IPC Deferred Por
30 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat Manager
31 148 3 49333 0.00% 0.00% 0.00% 0 PrstVbl
32 0 1 0 0.00% 0.00% 0.00% 0 client_entity_se
33 0 1 0 0.00% 0.00% 0.00% 0 SERIAL A'detect
34 0 1 0 0.00% 0.00% 0.00% 0 ARP Snoop
35 1424 187269 7 0.00% 0.00% 0.00% 0 Dynamic ARP Insp
36 939 187245 5 0.00% 0.00% 0.00% 0 GraphIt
37 0 1 0 0.00% 0.00% 0.00% 0 Critical Bkgnd
38 1807 26485 68 0.00% 0.00% 0.00% 0 Net Background
39 535550 187479 2856 0.23% 0.23% 0.23% 0 IDB Work
40 255 2917 87 0.00% 0.00% 0.00% 0 Logger
41 1376 187241 7 0.00% 0.00% 0.00% 0 TTY Background
42 2204 203538 10 0.00% 0.00% 0.00% 0 Per-Second Jobs
43 188214 7908 23800 0.00% 0.08% 0.06% 0 Per-minute Jobs
44 20 68 294 0.00% 0.00% 0.00% 0 IF-MGR control p
45 16 215 74 0.00% 0.00% 0.00% 0 IF-MGR event pro
46 0 1 0 0.00% 0.00% 0.00% 0 ISSU PROCESS IPC
47 0 1 0 0.00% 0.00% 0.00% 0 PrstVbl IPC Msg
48 0 2 0 0.00% 0.00% 0.00% 0 cpf_msg_holdq_pr
49 0 1 0 0.00% 0.00% 0.00% 0 cpf_msg_rcvq_pro
50 0 2 0 0.00% 0.00% 0.00% 0 AutoQoS HA
51 0 2 0 0.00% 0.00% 0.00% 0 IP Host Track HA
52 0 3 0 0.00% 0.00% 0.00% 0 ARP HA
53 0 1 0 0.00% 0.00% 0.00% 0 IP Admission HA
54 0 1 0 0.00% 0.00% 0.00% 0 DHCPC HA
55 0 1 0 0.00% 0.00% 0.00% 0 DHCPD HA
56 72600960 107141504 677 33.91% 41.46% 42.82% 0 DHCPD Receive
57 0 1 0 0.00% 0.00% 0.00% 0 Network-rf Notif
58 21511538 82481221 260 20.71% 18.53% 18.07% 0 Cat4k Mgmt HiPri
59 28467856 36146483 787 19.83% 14.44% 13.91% 0 Cat4k Mgmt LoPri
60 2657 160827 16 0.00% 0.00% 0.00% 0 Galios Reschedul
61 0 2 0 0.00% 0.00% 0.00% 0 IOS ACL Helper
62 0 1 0 0.00% 0.00% 0.00% 0 GalRedMsgProc
63 0 16 0 0.00% 0.00% 0.00% 0 RF Master Main T
64 0 11 0 0.00% 0.00% 0.00% 0 RF Master Status
65 1423 35264 40 0.00% 0.00% 0.00% 0 Net Input
66 7776 56492 137 0.00% 0.00% 0.00% 0 Compute load avg
67 0 1 0 0.00% 0.00% 0.00% 0 RFS server proce
68 0 1 0 0.00% 0.00% 0.00% 0 RTTYS Process
69 0 1 0 0.00% 0.00% 0.00% 0 IPC Apps Task
70 567 187351 3 0.00% 0.00% 0.00% 0 RedStateMonitor
71 0 130 0 0.00% 0.00% 0.00% 0 BACK CHECK
72 0 1 0 0.00% 0.00% 0.00% 0 AggMgr Process
73 8 2179 3 0.00% 0.00% 0.00% 0 Transport Port A
74 1841 41090 44 0.00% 0.00% 0.00% 0 HC Counter Timer
75 0 1 0 0.00% 0.00% 0.00% 0 SFF8472
76 2331 30994 75 0.00% 0.00% 0.00% 0 EEM ED ND
77 0 2 0 0.00% 0.00% 0.00% 0 EEM ED Identity
78 0 3 0 0.00% 0.00% 0.00% 0 EEM ED MAT
79 0 2 0 0.00% 0.00% 0.00% 0 Ethernet CFM
80 2568 1253756 2 0.07% 0.01% 0.00% 0 Ethernet Timer C
81 75089 29494868 2 0.31% 0.31% 0.31% 0 Ethernet Msec Ti
82 0 2 0 0.00% 0.00% 0.00% 0 Ethernet OAM Pro
83 0 1 0 0.00% 0.00% 0.00% 0 PPPOE IA
84 0 2 0 0.00% 0.00% 0.00% 0 REP Topology cha
85 8 157 50 0.00% 0.00% 0.00% 0 Auth Manager
86 0 2 0 0.00% 0.00% 0.00% 0 CMD HANDLER
87 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Mgr Proces
88 0 1 0 0.00% 0.00% 0.00% 0 AUTH POLICY Fram
89 0 1 0 0.00% 0.00% 0.00% 0 802.1x Webauth F
90 40 204 196 0.00% 0.00% 0.00% 0 802.1x switch
91 6416 47533 134 0.07% 0.00% 0.00% 0 DTP Protocol
92 0 1 0 0.00% 0.00% 0.00% 0 EAP Framework
93 0 1 0 0.00% 0.00% 0.00% 0 EAP Test
94 0 1 0 0.00% 0.00% 0.00% 0 PPCP RP Stats Ba
95 4 3125 1 0.00% 0.00% 0.00% 0 Port-Security
96 0 2 0 0.00% 0.00% 0.00% 0 EFP Errd
97 0 68 0 0.00% 0.00% 0.00% 0 Qos If Bw Change
98 18559 1874630 9 0.07% 0.10% 0.09% 0 UDLD
99 0 2 0 0.00% 0.00% 0.00% 0 IP Host Track Pr
100 0 1 0 0.00% 0.00% 0.00% 0 Switch Backup In
101 60 3122 19 0.00% 0.00% 0.00% 0 MMN bkgrd proces
102 164 18728 8 0.00% 0.00% 0.00% 0 Ethchnl
103 28 161 173 0.00% 0.00% 0.00% 0 AAA Server
104 0 1 0 0.00% 0.00% 0.00% 0 AAA ACCT Proc
105 0 1 0 0.00% 0.00% 0.00% 0 ACCT Periodic Pr
106 0 1 0 0.00% 0.00% 0.00% 0 AAA System Acct
107 0 1 0 0.00% 0.00% 0.00% 0 Auth-proxy AAA B
108 4 625 6 0.00% 0.00% 0.00% 0 IP Admin SM Proc
109 319392 222199 1437 0.39% 0.19% 0.19% 0 CDP Protocol
110 14376 7655 1877 0.00% 0.02% 0.17% 0 Exec
111 0 1 0 0.00% 0.00% 0.00% 0 cpf_process_tpQ
112 0 2 0 0.00% 0.00% 0.00% 0 AAA Dictionary R
113 4 1564 2 0.00% 0.00% 0.00% 0 DHCP Snooping
114 0 1 0 0.00% 0.00% 0.00% 0 DHCP Snooping db
115 0 2 0 0.00% 0.00% 0.00% 0 EAPoUDP Process
116 0 3 0 0.00% 0.00% 0.00% 0 CEF switching ba
117 14009416 70169313 199 7.75% 9.24% 9.32% 0 IP Input
118 0 1 0 0.00% 0.00% 0.00% 0 ICMP event handl
119 1613 365546 4 0.00% 0.00% 0.00% 0 IP ARP Track
120 7063 32917 214 0.07% 0.00% 0.00% 0 ADJ resolve proc
121 0 2 0 0.00% 0.00% 0.00% 0 ADJ NSF process
122 0 1 0 0.00% 0.00% 0.00% 0 IPv6 ping proces
123 4 34 117 0.00% 0.00% 0.00% 0 Collection proce
124 976912 1473345 663 1.03% 1.27% 1.38% 0 Spanning Tree
125 4 36 111 0.00% 0.00% 0.00% 0 SXP CORE
126 287 6559 43 0.00% 0.00% 0.00% 0 CEF background p
127 0 1 0 0.00% 0.00% 0.00% 0 IP IRDP
128 0 1 0 0.00% 0.00% 0.00% 0 AAA HA INT
129 0 3 0 0.00% 0.00% 0.00% 0 XDR mcast
130 0 1 0 0.00% 0.00% 0.00% 0 IPC LC Message H
131 0 1 0 0.00% 0.00% 0.00% 0 XDR RP Ping Back
132 4 1750 2 0.00% 0.00% 0.00% 0 XDR RP backgroun
133 0 1 0 0.00% 0.00% 0.00% 0 XDR RP Test Back
134 300 9992 30 0.00% 0.00% 0.00% 0 TCP Timer
135 192 1983 96 0.00% 0.00% 0.00% 0 TCP Protocols
136 277152 10772808 25 0.00% 0.03% 0.05% 0 Socket Timers
137 0 697 0 0.00% 0.00% 0.00% 0 HTTP CORE
138 0 2346 0 0.00% 0.00% 0.00% 0 Cluster L2
139 176 18727 9 0.00% 0.00% 0.00% 0 Cluster RARP
140 0 1 0 0.00% 0.00% 0.00% 0 COPS
141 0 2 0 0.00% 0.00% 0.00% 0 ECFM HA IPC flow
142 0 1 0 0.00% 0.00% 0.00% 0 Probe Input
143 0 1 0 0.00% 0.00% 0.00% 0 RARP Input
144 0 2 0 0.00% 0.00% 0.00% 0 REP LSL Proc
145 0 2 0 0.00% 0.00% 0.00% 0 REP BPA/EPA Proc
146 0 1 0 0.00% 0.00% 0.00% 0 Critical Auth
147 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Supplicant
148 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Supplicant
149 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Supplicant
150 0 1 0 0.00% 0.00% 0.00% 0 MAB Framework
151 104 306 339 0.00% 0.00% 0.00% 0 IGMPSN L2MCM
152 0 1 0 0.00% 0.00% 0.00% 0 IGMPSN MRD
153 8 177 45 0.00% 0.00% 0.00% 0 IGMPSN
154 0 1 0 0.00% 0.00% 0.00% 0 IGMPQR
155 0 1 0 0.00% 0.00% 0.00% 0 IGMPSN-HA
156 69 225 306 0.00% 0.00% 0.00% 0 MLDSN L2MCM
157 0 1 0 0.00% 0.00% 0.00% 0 MRD
158 0 1 0 0.00% 0.00% 0.00% 0 MLD_SNOOP
159 0 2 0 0.00% 0.00% 0.00% 0 RETRY_REPOPULATE
160 0 2 0 0.00% 0.00% 0.00% 0 L2TRACE SERVER
161 0 1 0 0.00% 0.00% 0.00% 0 DHCP Snooping HA
162 4 2 2000 0.00% 0.00% 0.00% 0 ATIP_UDP_TSK
163 6116 4412 1386 0.00% 0.00% 0.00% 0 IP Background
164 484 3154 153 0.00% 0.00% 0.00% 0 IP RIB Update
165 0 2 0 0.00% 0.00% 0.00% 0 HSRP HA
166 754 18727 40 0.00% 0.00% 0.00% 0 QoS stats proces
167 136424 433036 315 0.07% 0.10% 0.09% 0 CEF: IPv4 proces
168 0 2 0 0.00% 0.00% 0.00% 0 ADJ background
169 0 1 0 0.00% 0.00% 0.00% 0 CFMPAL Process
170 0 1 0 0.00% 0.00% 0.00% 0 EPM MAIN PROCESS
171 0 1 0 0.00% 0.00% 0.00% 0 EM Background Pr
172 20 135 148 0.00% 0.00% 0.00% 0 LOCAL AAA
173 0 2 0 0.00% 0.00% 0.00% 0 ENABLE AAA
174 0 2 0 0.00% 0.00% 0.00% 0 LINE AAA
175 0 3 0 0.00% 0.00% 0.00% 0 LDAP process
176 16900 194432 86 0.00% 0.02% 0.00% 0 OSPF-4 Hello
177 272 643 423 0.00% 0.00% 0.00% 0 TPLUS
178 0 2 0 0.00% 0.00% 0.00% 0 REP Switch Helpe
179 4 12 333 0.00% 0.00% 0.00% 0 crypto engine pr
180 0 1 0 0.00% 0.00% 0.00% 0 encrypt proc
181 0 4 0 0.00% 0.00% 0.00% 0 Crypto CA
182 0 1 0 0.00% 0.00% 0.00% 0 Crypto PKI-CRL
183 0 2 0 0.00% 0.00% 0.00% 0 DHCP Security He
184 0 2 0 0.00% 0.00% 0.00% 0 DiagCard1/-1
185 0 2 0 0.00% 0.00% 0.00% 0 DiagCard3/-1
186 0 2 0 0.00% 0.00% 0.00% 0 DiagCard4/-1
187 0 2 0 0.00% 0.00% 0.00% 0 DiagCard5/-1
188 4 3 1333 0.00% 0.00% 0.00% 0 Online Diag EEM
189 6532 691182 9 0.00% 0.00% 0.00% 0 PM Callback
190 46337 491493 94 0.00% 0.04% 0.05% 0 VLAN Manager
191 56 16883 3 0.00% 0.00% 0.00% 0 dhcp snooping sw
192 0 18 0 0.00% 0.00% 0.00% 0 VTP Trap Process
193 0 1 0 0.00% 0.00% 0.00% 0 CEF RP IPC Backg
194 0 1 0 0.00% 0.00% 0.00% 0 DATA Transfer Pr
195 0 1 0 0.00% 0.00% 0.00% 0 DATA Collector
197 0 1 0 0.00% 0.00% 0.00% 0 Test AAA Client
198 12 82 146 0.00% 0.00% 0.00% 0 AAA SEND STOP EV
199 104 1482 70 0.00% 0.00% 0.00% 0 EEM ED Syslog
200 0 2 0 0.00% 0.00% 0.00% 0 EEM ED Routing
201 5055 1842 2744 0.00% 0.00% 0.00% 0 Syslog Traps
202 0 2 0 0.00% 0.00% 0.00% 0 CTS HA
203 0 1 0 0.00% 0.00% 0.00% 0 Online Diag CNS
204 0 1 0 0.00% 0.00% 0.00% 0 Online Diag CNS
205 8 40 200 0.00% 0.00% 0.00% 0 SPAN switch
206 0 1 0 0.00% 0.00% 0.00% 0 IP SLAs Ethernet
207 0 1 0 0.00% 0.00% 0.00% 0 IP SLAs AutoEthe
208 24 85 282 0.00% 0.00% 0.00% 0 EEM Server
209 0 2 0 0.00% 0.00% 0.00% 0 EEM Policy Direc
210 4179 5576 749 0.00% 0.00% 0.00% 0 Syslog
211 8 2 4000 0.00% 0.00% 0.00% 0 Call Home proces
212 72 5 14400 0.00% 0.00% 0.00% 0 crypto sw pk pro
213 4 3 1333 0.00% 0.00% 0.00% 0 EEM ED CLI
214 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Counter
215 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Interface
216 0 3 0 0.00% 0.00% 0.00% 0 EEM ED IOSWD
217 0 3 0 0.00% 0.00% 0.00% 0 EEM ED None
218 0 3 0 0.00% 0.00% 0.00% 0 EEM ED OIR
219 0 5 0 0.00% 0.00% 0.00% 0 EEM ED RF
220 4 3 1333 0.00% 0.00% 0.00% 0 EEM ED SNMP
221 48 4726 10 0.00% 0.00% 0.00% 0 EEM ED Timer
222 0 3 0 0.00% 0.00% 0.00% 0 EEM ED SNMP Obje
223 0 2 0 0.00% 0.00% 0.00% 0 EEM ED SNMP Noti
224 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Test
225 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Config
226 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Env
227 0 3 0 0.00% 0.00% 0.00% 0 EM ED GOLD
228 4 3 1333 0.00% 0.00% 0.00% 0 EEM ED RPC
229 0 3 0 0.00% 0.00% 0.00% 0 RBM CORE
230 0 3 0 0.00% 0.00% 0.00% 0 IPv6 RIB Event H
231 2016 1965 1025 4.07% 0.35% 0.07% 1 Virtual Exec
232 168 4080 41 0.00% 0.00% 0.00% 0 Call Home Timer
233 71013 11441935 6 0.39% 0.43% 0.42% 0 HSRP Common
234 87501 1137344 76 0.07% 0.07% 0.07% 0 HSRP IPv4
235 343 368 932 0.00% 0.00% 0.00% 0 SpanTree Helper
236 0 29 0 0.00% 0.00% 0.00% 0 SNMP Timers
237 66620 310572 214 0.00% 0.06% 0.01% 0 IP SNMP
238 14905 154289 96 0.00% 0.01% 0.00% 0 PDU DISPATCHER
239 278823 165480 1684 0.00% 0.19% 0.07% 0 SNMP ENGINE
240 0 2 0 0.00% 0.00% 0.00% 0 IP SNMPV6
241 0 1 0 0.00% 0.00% 0.00% 0 SNMP ConfCopyPro
242 1984 859 2309 0.00% 0.06% 0.02% 0 SNMP Traps
243 2875 215784 13 0.00% 0.00% 0.00% 0 NTP
244 1986 93630 21 0.00% 0.00% 0.00% 0 System polling
245 24 3122 7 0.00% 0.00% 0.00% 0 GalRedConfSynPlf
246 40 3125 12 0.00% 0.00% 0.00% 0 DHCPD Database
247 12457 201012 61 0.00% 0.00% 0.00% 0 OSPF-4 Router
------------------ show process cpu history ------------------
9999999999999999999999999999777779999999999999999999999999
4444444433333333334444433333555553333333333333334444433333
100
90 **************************** *************************
80 **********************************************************
70 **********************************************************
60 **********************************************************
50 **********************************************************
40 **********************************************************
30 **********************************************************
20 **********************************************************
10 **********************************************************
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per second (last 60 seconds)
9999999999999999999999999999999999998888777778887878888877
4444555555433343343323423333444544108767999880209191402199
100 ****** *
90 ###################################*****
80 ########################################*####*####*###*###
70 ##########################################################
60 ##########################################################
50 ##########################################################
40 ##########################################################
30 ##########################################################
20 ##########################################################
10 ##########################################################
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%
9899999999999999999999999999999999994434555999989999
5944855858555544444445555565555555451695867224253338
100 * ********** ************* * *
90 #*################################** *********
80 ##################################** **#****#*
70 ###################################* **#***##*
60 ###################################* *****##*####
50 #################################### * ******#######
40 ####################################*******#########
30 ####################################*****###########
20 ####################################################
10 ####################################################
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%
10-11-2015 10:03 PM
Check out this post about the same problem, with the suggestion of rate-limiting DHCP to resolve it.
https://supportforums.cisco.com/discussion/12080486/cisco-4506-high-cpu-utilization
Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: