so finally after most clients

hegefd · ‎10-06-2014

CPU utilization for five seconds: 97%/95%; one minute: 97%; five minutes: 94%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
1 2612932 3551909 735 0.08% 0.18% 0.16% 0 Chunk Manager
2 280656 64397 4358 0.08% 0.85% 0.63% 0 Load Meter
3 0 1 0 0.00% 0.00% 0.00% 0 chkpt message ha
4 0 1 0 0.00% 0.00% 0.00% 0 EDDRI_MAIN
5 882432 52001 16969 0.00% 0.06% 0.05% 0 Check heaps
6 27312 1207 22628 0.00% 0.00% 0.00% 0 Pool Manager
7 0 2 0 0.00% 0.00% 0.00% 0 Timers
8 0 2 0 0.00% 0.00% 0.00% 0 ATM AutoVC Perio
9 0 2 0 0.00% 0.00% 0.00% 0 ATM VC Auto Crea
10 84 5369 15 0.00% 0.00% 0.00% 0 IPC Dynamic Cach
11 0 1 0 0.00% 0.00% 0.00% 0 IPC Zone Manager
12 16504 319056 51 0.00% 0.00% 0.00% 0 IPC Periodic Tim
13 11424 319065 35 0.00% 0.00% 0.00% 0 IPC Deferred Por
14 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat Manager
15 0 1 0 0.00% 0.00% 0.00% 0 IPC BackPressure
16 279212 5602711 49 0.00% 0.01% 0.00% 0 EnvMon
17 0 1 0 0.00% 0.00% 0.00% 0 OIR Handler
18 0 1 0 0.00% 0.00% 0.00% 0 Crash writer
19 36872 36934 998 0.00% 0.00% 0.00% 0 ARP Input
20 40900 334157 122 0.00% 0.00% 0.00% 0 ARP Background
21 0 2 0 0.00% 0.00% 0.00% 0 ATM Idle Timer
22 104 1074 96 0.00% 0.00% 0.00% 0 AAA high-capacit
23 0 4 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT
24 0 1 0 0.00% 0.00% 0.00% 0 Policy Manager
25 64 271 236 0.00% 0.00% 0.00% 0 DDR Timers
26 0 5 0 0.00% 0.00% 0.00% 0 Entity MIB API
27 1836 10022 183 0.00% 0.00% 0.00% 0 EEM ED Syslog
28 43928 95682 459 0.00% 0.00% 0.00% 0 HC Counter Timer
29 0 2 0 0.00% 0.00% 0.00% 0 Serial Backgroun
30 0 1 0 0.00% 0.00% 0.00% 0 RO Notify Timers
31 0 1 0 0.00% 0.00% 0.00% 0 RMI RM Notify Wa
32 0 2 0 0.00% 0.00% 0.00% 0 SMART
33 19932 320836 62 0.00% 0.00% 0.00% 0 GraphIt
34 0 2 0 0.00% 0.00% 0.00% 0 Dialer event
35 0 1 0 0.00% 0.00% 0.00% 0 SERIAL A'detect
36 0 2 0 0.00% 0.00% 0.00% 0 XML Proxy Client
37 0 5 0 0.00% 0.00% 0.00% 0 AAA Accounting
38 0 1 0 0.00% 0.00% 0.00% 0 Inode Table Dest
39 0 2 0 0.00% 0.00% 0.00% 0 VSA background
40 0 1 0 0.00% 0.00% 0.00% 0 VSA Cleanup Proc
41 0 1 0 0.00% 0.00% 0.00% 0 Critical Bkgnd
42 133924 154072 869 0.08% 0.01% 0.00% 0 Net Background
43 0 2 0 0.00% 0.00% 0.00% 0 IDB Work
44 2268 13518 167 0.00% 0.00% 0.00% 0 Logger
45 24564 319049 76 0.00% 0.00% 0.00% 0 TTY Background
46 3034496 391019 7760 0.16% 0.11% 0.12% 0 Per-Second Jobs
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
47 0 1 0 0.00% 0.00% 0.00% 0 IKE HA Mgr
48 0 1 0 0.00% 0.00% 0.00% 0 IPSEC HA Mgr
49 784 8 98000 0.00% 0.00% 0.00% 0 rf task
50 15476 48855 316 0.00% 0.00% 0.00% 0 Net Input
51 44976 66475 676 0.00% 0.00% 0.00% 0 Compute load avg
52 352144 7853 44841 0.00% 0.00% 0.00% 0 Per-minute Jobs
53 0 1 0 0.00% 0.00% 0.00% 0 Token Daemon
54 0 2 0 0.00% 0.00% 0.00% 0 VNM DSPRM MAIN
55 0 1 0 0.00% 0.00% 0.00% 0 Coproc Event Pro
56 0 1 0 0.00% 0.00% 0.00% 0 POS APS Event Pr
57 0 1 0 0.00% 0.00% 0.00% 0 SONET alarm time
58 1223816 59091052 20 0.16% 0.11% 0.12% 0 T3E3 EC IPC POLL
59 0 2 0 0.00% 0.00% 0.00% 0 T3E3 EC TASK
60 0 1 0 0.00% 0.00% 0.00% 0 CSP Timer
61 204 4 51000 0.00% 0.00% 0.00% 0 USB Startup
62 0 1 0 0.00% 0.00% 0.00% 0 FPD Management P
63 0 1 0 0.00% 0.00% 0.00% 0 FPD Action Proce
64 0 1 0 0.00% 0.00% 0.00% 0 RF_INTERDEV_DELA
65 0 1 0 0.00% 0.00% 0.00% 0 RF_INTERDEV_SCTP
66 10712 320845 33 0.00% 0.00% 0.00% 0 ISA Common Helpe
67 0 2 0 0.00% 0.00% 0.00% 0 Flash MIB Update
68 0 1 0 0.00% 0.00% 0.00% 0 Flash Card Oir
69 0 1 0 0.00% 0.00% 0.00% 0 CES Line Conditi
70 0 1 0 0.00% 0.00% 0.00% 0 CF_INTERDEV_SCTP
71 47680 478273 99 0.00% 0.00% 0.00% 0 ATM Periodic
72 0 1 0 0.00% 0.00% 0.00% 0 ATM ARP INPUT
73 1882512 4171200 451 0.08% 0.08% 0.08% 0 ATM OAM Input
74 1002512 2995901 334 0.00% 0.07% 0.08% 0 ATM OAM TIMER
75 155124 321683 482 0.00% 0.00% 0.00% 0 ATM PA Helper
76 127680 321679 396 0.00% 0.00% 0.00% 0 IMA PA Helper
77 0 2 0 0.00% 0.00% 0.00% 0 AAA Dictionary R
78 264 817 323 0.00% 0.00% 0.00% 0 AAA Server
79 1476 2333 632 0.00% 0.00% 0.00% 0 AAA ACCT Proc
80 241128 9475500 25 0.08% 0.01% 0.00% 0 ACCT Periodic Pr
81 0 2 0 0.00% 0.00% 0.00% 0 EAPoUDP Process
82 0 2 0 0.00% 0.00% 0.00% 0 IP Host Track Pr
83 31824 75886 419 0.00% 0.00% 0.00% 0 CDP Protocol
84 2828 429 6592 0.00% 0.00% 0.00% 0 IP ARP Adjacency
85 8138892 8397824 969 0.32% 0.22% 0.19% 0 IP Input
86 0 1 0 0.00% 0.00% 0.00% 0 ICMP event handl
87 0 4 0 0.00% 0.00% 0.00% 0 TurboACL
88 0 2 0 0.00% 0.00% 0.00% 0 TurboACL chunk
89 0 2 0 0.00% 0.00% 0.00% 0 KRB5 AAA
90 220 538 408 0.00% 0.00% 0.00% 0 MOP Protocols
91 0 19 0 0.00% 0.00% 0.00% 0 PPP Hooks
92 0 3 0 0.00% 0.00% 0.00% 0 ATM_PVCTRAP
93 0 1 0 0.00% 0.00% 0.00% 0 SSS Manager
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
94 1616 42909 37 0.00% 0.00% 0.00% 0 SSS Test Client
95 0 1 0 0.00% 0.00% 0.00% 0 SSS Feature Mana
96 70752 1245575 56 0.00% 0.00% 0.00% 0 SSS Feature Time
97 0 2 0 0.00% 0.00% 0.00% 0 SSM connection m
98 0 1 0 0.00% 0.00% 0.00% 0 X.25 Encaps Mana
99 0 2 0 0.00% 0.00% 0.00% 0 Border Element p
100 0 3 0 0.00% 0.00% 0.00% 0 gk process
101 49320 12041 4096 0.00% 0.00% 0.00% 0 IP Background
102 480172 50321 9542 0.00% 0.00% 0.00% 0 IP RIB Update
103 0 2 0 0.00% 0.00% 0.00% 0 SSCOP Input
104 0 2 0 0.00% 0.00% 0.00% 0 SSCOP Output
105 608 5393 112 0.00% 0.00% 0.00% 0 SSCOP Timer
106 100 34 2941 0.00% 0.00% 0.00% 0 PPP IP Route
107 4 34 117 0.00% 0.00% 0.00% 0 PPP IPCP
108 0 1 0 0.00% 0.00% 0.00% 0 IP Traceroute
109 134416 481189 279 0.00% 0.01% 0.00% 0 CEF process
110 44724 90835 492 0.00% 0.00% 0.00% 0 TCP Timer
111 1288 601 2143 0.00% 0.00% 0.00% 0 TCP Protocols
112 32708 317626 102 0.00% 0.00% 0.00% 0 Socket Timers
113 44 1079 40 0.00% 0.00% 0.00% 0 HTTP CORE
114 0 1 0 0.00% 0.00% 0.00% 0 COPS
115 0 2 0 0.00% 0.00% 0.00% 0 RLM groups Proce
116 0 1 0 0.00% 0.00% 0.00% 0 L2X Data Daemon
117 0 3 0 0.00% 0.00% 0.00% 0 SNMP Timers
118 0 2 0 0.00% 0.00% 0.00% 0 ILMI Input
119 0 2 0 0.00% 0.00% 0.00% 0 ILMI Request
120 0 2 0 0.00% 0.00% 0.00% 0 ILMI Response
121 123740 214230 577 0.00% 0.00% 0.00% 0 ILMI Timer Proce
122 4 2 2000 0.00% 0.00% 0.00% 0 ATM PVC Discover
123 0 2 0 0.00% 0.00% 0.00% 0 ATMSIG ILMI Time
124 0 2 0 0.00% 0.00% 0.00% 0 ATMSIG DRIVERAPI
125 18712 319063 58 0.00% 0.00% 0.00% 0 ATMSIG Timer
126 0 2 0 0.00% 0.00% 0.00% 0 ATMSIG Input
127 0 2 0 0.00% 0.00% 0.00% 0 ATMSIG Client
128 23952 619976 38 0.00% 0.00% 0.00% 0 Inspect process
129 404 2685 150 0.00% 0.00% 0.00% 0 DHCPD Timer
130 88 1075 81 0.00% 0.00% 0.00% 0 Authentication P
131 0 1 0 0.00% 0.00% 0.00% 0 Auth-proxy AAA B
132 27308 320313 85 0.00% 0.00% 0.00% 0 RUDPV1 Main Proc
133 0 1 0 0.00% 0.00% 0.00% 0 bsm_timers
134 9308 319067 29 0.00% 0.00% 0.00% 0 bsm_xmt_proc
135 100272 635254 157 0.00% 0.00% 0.00% 0 DHCPD Receive
136 0 2 0 0.00% 0.00% 0.00% 0 Dialer Forwarder
137 10108 5363 1884 0.00% 0.00% 0.00% 0 IP Cache Ager
138 9432 5752 1639 0.00% 0.00% 0.00% 0 Adj Manager
139 0 3 0 0.00% 0.00% 0.00% 0 Flow Exporter Ti
140 24520 619985 39 0.00% 0.00% 0.00% 0 IPS Timer
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
141 0 2 0 0.00% 0.00% 0.00% 0 IPS Auto Update
142 0 2 0 0.00% 0.00% 0.00% 0 SDEE Management
143 0 1 0 0.00% 0.00% 0.00% 0 RARP Input
144 300 641 468 0.00% 0.00% 0.00% 0 Transport Port A
145 0 1 0 0.00% 0.00% 0.00% 0 PAD InCall
146 0 2 0 0.00% 0.00% 0.00% 0 X.25 Background
147 0 2 0 0.00% 0.00% 0.00% 0 PPP Bind
148 0 2 0 0.00% 0.00% 0.00% 0 PPP SSS
149 0 1 0 0.00% 0.00% 0.00% 0 MQC Flow Event B
150 0 2 0 0.00% 0.00% 0.00% 0 SCTP Main Proces
151 0 2 0 0.00% 0.00% 0.00% 0 URL filter proc
152 0 1 0 0.00% 0.00% 0.00% 0 VPDN call manage
153 0 1 0 0.00% 0.00% 0.00% 0 CHKPT EXAMPLE
154 0 1 0 0.00% 0.00% 0.00% 0 CHKPT DevTest
155 0 1 0 0.00% 0.00% 0.00% 0 XSM_EVENT_ENGINE
156 1584 32019 49 0.00% 0.00% 0.00% 0 XSM_ENQUEUER
157 548 32019 17 0.00% 0.00% 0.00% 0 XSM Historian
158 0 1 0 0.00% 0.00% 0.00% 0 Select Timers
159 0 2 0 0.00% 0.00% 0.00% 0 HTTP Process
160 0 2 0 0.00% 0.00% 0.00% 0 CIFS API Process
161 0 2 0 0.00% 0.00% 0.00% 0 CIFS Proxy Proce
162 0 1 0 0.00% 0.00% 0.00% 0 Crypto HW Proc
163 1528 21455 71 0.00% 0.00% 0.00% 0 ACE policy loade
164 0 2 0 0.00% 0.00% 0.00% 0 VSP_MGR
165 1424 12891 110 0.00% 0.00% 0.00% 0 CRM_CALL_UPDATE_
166 0 2 0 0.00% 0.00% 0.00% 0 cpf_process_msg_
167 0 2 0 0.00% 0.00% 0.00% 0 ENABLE AAA
168 0 1 0 0.00% 0.00% 0.00% 0 EM Background Pr
169 0 1 0 0.00% 0.00% 0.00% 0 Key chain liveke
170 24 40 600 0.00% 0.00% 0.00% 0 LINE AAA
171 0 2 0 0.00% 0.00% 0.00% 0 LOCAL AAA
172 45796 13766 3326 0.08% 0.01% 0.00% 0 TPLUS
173 0 2 0 0.00% 0.00% 0.00% 0 AAA Cached Serve
174 0 3 0 0.00% 0.00% 0.00% 0 Crypto WUI
175 0 2 0 0.00% 0.00% 0.00% 0 Crypto Support
176 0 1 0 0.00% 0.00% 0.00% 0 EPM MAIN PROCESS
177 4 2 2000 0.00% 0.00% 0.00% 0 Proxy Session Ap
178 0 1 0 0.00% 0.00% 0.00% 0 CCVPM_HTSP
179 0 1 0 0.00% 0.00% 0.00% 0 CCVPM_R2
180 0 1 0 0.00% 0.00% 0.00% 0 EPHONE MWI Refre
181 12 359 33 0.00% 0.00% 0.00% 0 FB/KS Log HouseK
182 0 2 0 0.00% 0.00% 0.00% 0 EPHONE MWI BG Pr
183 0 1 0 0.00% 0.00% 0.00% 0 CCSWVOICE
184 0 1 0 0.00% 0.00% 0.00% 0 cpf_process_tpQ
185 0 1 0 0.00% 0.00% 0.00% 0 http client proc
186 272 5372 50 0.00% 0.00% 0.00% 0 DHCPD Database
187 0 1 0 0.00% 0.00% 0.00% 0 QOS_MODULE_MAIN
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
188 0 1 0 0.00% 0.00% 0.00% 0 RPMS_PROC_MAIN
189 0 1 0 0.00% 0.00% 0.00% 0 VoIP AAA
190 22532 619984 36 0.00% 0.00% 0.00% 0 CCE DP Proc
191 8 84 95 0.00% 0.00% 0.00% 0 IP VFR proc
192 0 2 0 0.00% 0.00% 0.00% 0 crypto engine pr
193 0 8 0 0.00% 0.00% 0.00% 0 Crypto ACL
194 0 1 0 0.00% 0.00% 0.00% 0 CRYPTO QoS proce
195 0 1 0 0.00% 0.00% 0.00% 0 Crypto INT
196 0 3 0 0.00% 0.00% 0.00% 0 Crypto IKE Dispa
197 0 3 0 0.00% 0.00% 0.00% 0 Crypto IKMP
198 0 1 0 0.00% 0.00% 0.00% 0 Crypto IKEv2
199 1524 16096 94 0.00% 0.00% 0.00% 0 IPSEC key engine
200 0 1 0 0.00% 0.00% 0.00% 0 IPSEC manual key
201 0 1 0 0.00% 0.00% 0.00% 0 Crypto PAS Proc
202 0 4 0 0.00% 0.00% 0.00% 0 Crypto CA
203 0 1 0 0.00% 0.00% 0.00% 0 Crypto PKI-CRL
204 0 1 0 0.00% 0.00% 0.00% 0 Crypto SSL
205 0 1 0 0.00% 0.00% 0.00% 0 encrypt proc
206 0 1 0 0.00% 0.00% 0.00% 0 Key Proc
207 0 1 0 0.00% 0.00% 0.00% 0 GDOI GM Process
208 0 1 0 0.00% 0.00% 0.00% 0 UNICAST REKEY
209 0 1 0 0.00% 0.00% 0.00% 0 UNICAST REKEY AC
210 0 1 0 0.00% 0.00% 0.00% 0 IMA Traps
211 0 2 0 0.00% 0.00% 0.00% 0 Control-plane ho
212 272 487 558 0.00% 0.00% 0.00% 0 AAA SEND STOP EV
213 0 6 0 0.00% 0.00% 0.00% 0 EEM ED Resource
214 0 6 0 0.00% 0.00% 0.00% 0 EEM ED Track
215 1080 32160 33 0.00% 0.00% 0.00% 0 RMON Recycle Pro
216 0 2 0 0.00% 0.00% 0.00% 0 RMON Deferred Se
217 0 1 0 0.00% 0.00% 0.00% 0 Syslog Traps
218 0 1 0 0.00% 0.00% 0.00% 0 Crypto cTCP proc
219 11300 315463 35 0.00% 0.00% 0.00% 0 trunk conditioni
220 0 1 0 0.00% 0.00% 0.00% 0 trunk conditioni
221 0 1 0 0.00% 0.00% 0.00% 0 RMON Packets
222 0 40 0 0.00% 0.00% 0.00% 0 EEM Server
223 0 6 0 0.00% 0.00% 0.00% 0 EEM ED CLI
224 0 6 0 0.00% 0.00% 0.00% 0 EEM ED Counter
225 0 6 0 0.00% 0.00% 0.00% 0 EEM ED Interface
226 0 6 0 0.00% 0.00% 0.00% 0 EEM ED IOSWD
227 4 6 666 0.00% 0.00% 0.00% 0 EEM ED None
228 0 6 0 0.00% 0.00% 0.00% 0 EEM ED OIR
229 0 6 0 0.00% 0.00% 0.00% 0 EEM ED SNMP
230 856 5377 159 0.00% 0.00% 0.00% 0 EEM ED Timer
231 0 7 0 0.00% 0.00% 0.00% 0 EEM Policy Direc
232 6048 6706 901 0.00% 0.00% 0.00% 0 Syslog
233 0 1 0 0.00% 0.00% 0.00% 0 VPDN Test
234 24160 2970 8134 0.00% 0.02% 0.00% 2 SSH Process
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
235 644 2686 239 0.00% 0.00% 0.00% 0 CC-API_VCM
236 246384 3118094 79 0.00% 0.02% 0.00% 0 CCPROXY_CT
237 1072 11192 95 0.00% 0.00% 0.00% 0 CEF Scanner
238 0 1 0 0.00% 0.00% 0.00% 0 tHUB
239 2032 89 22831 0.00% 0.03% 0.01% 3 SSH Process
240 56 181 309 0.00% 0.00% 0.00% 0 SSH Event handle
241 611940 9643002 63 0.00% 0.06% 0.07% 0 PPP manager
242 438556 9643579 45 0.00% 0.03% 0.05% 0 PPP Events
243 25564 320422 79 0.00% 0.00% 0.00% 0 Multilink PPP
244 1928 188 10255 0.16% 0.06% 0.01% 4 SSH Process
245 0 3 0 0.00% 0.00% 0.00% 0 TCP Listener
246 8668 64184 135 0.00% 0.00% 0.00% 0 IP SLAs Responde
247 235408 431307 545 0.00% 0.01% 0.00% 0 IP SNMP
248 82564 211616 390 0.00% 0.00% 0.00% 0 PDU DISPATCHER
249 1203824 243308 4947 0.00% 0.16% 0.11% 0 SNMP ENGINE
250 0 1 0 0.00% 0.00% 0.00% 0 SNMP ConfCopyPro
251 5496 667 8239 0.00% 0.00% 0.00% 0 SNMP Traps
252 37096 359692 103 0.00% 0.00% 0.00% 0 NTP
253 85020 578 147093 0.00% 0.00% 0.00% 0 crypto sw pk pro
254 220 4614 47 0.00% 0.00% 0.00% 0 IP-EIGRP Router
255 1558328 3866724 403 0.00% 0.02% 0.00% 0 IP-EIGRP: PDM
256 1220 32085 38 0.00% 0.00% 0.00% 0 IP-EIGRP Router
257 484656 961320 504 0.00% 0.00% 0.00% 0 IP-EIGRP: PDM
258 176532 850793 207 0.00% 0.00% 0.00% 0 BGP Router
259 827392 3908288 211 0.08% 0.06% 0.08% 0 IP-EIGRP: HELLO
260 319936 1078682 296 0.08% 0.02% 0.00% 0 IP-EIGRP: HELLO
261 65780 89309 736 0.00% 0.00% 0.00% 0 BGP I/O
262 51728 23069 2242 0.00% 0.00% 0.00% 0 BGP Scanner
263 1984 258 7689 0.00% 0.00% 0.00% 0 BGP Event
265 804 719 1118 0.00% 0.00% 0.00% 0 TACACS+

Leo Laohoo · ‎10-06-2014

Post the output to the command "sh proc cpu sorted | ex 0.00".

hegefd · ‎10-06-2014

Thanks!! yes this looks a lot cleaner - TAC said move the traffic which is what i did but the cpu remained pegged. It was a ton of traffic so i can see them thinking that is what it was.

#sh proc cpu sorted | ex 0.00
CPU utilization for five seconds: 52%/51%; one minute: 50%; five minutes: 51%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
58 1330236 60704275 21 0.16% 0.12% 0.14% 0 T3E3 EC IPC POLL
46 3160756 404366 7816 0.16% 0.16% 0.16% 0 Per-Second Jobs
259 904640 3989075 226 0.08% 0.05% 0.06% 0 IP-EIGRP: HELLO
239 68 101 673 0.08% 0.05% 0.01% 3 SSH Process
73 2034808 4295411 473 0.08% 0.05% 0.08% 0 ATM OAM Input
241 674620 9924355 67 0.08% 0.04% 0.06% 0 PPP manager
85 8402268 8501050 988 0.08% 0.09% 0.08% 0 IP Input

Leo Laohoo · ‎10-06-2014

The output doesn't "add up".

Post the output to the command "sh interface <WAN link>".

hegefd · ‎10-06-2014

thanks yes it was about 42 Mbps of constant traffic but the processor remained pegged after the move

sh proc cpu sorted | ex 0.00
CPU utilization for five seconds: 52%/51%; one minute: 50%; five minutes: 51%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
58 1330236 60704275 21 0.16% 0.12% 0.14% 0 T3E3 EC IPC POLL
46 3160756 404366 7816 0.16% 0.16% 0.16% 0 Per-Second Jobs
259 904640 3989075 226 0.08% 0.05% 0.06% 0 IP-EIGRP: HELLO
239 68 101 673 0.08% 0.05% 0.01% 3 SSH Process
73 2034808 4295411 473 0.08% 0.05% 0.08% 0 ATM OAM Input
241 674620 9924355 67 0.08% 0.04% 0.06% 0 PPP manager
85 8402268 8501050 988 0.08% 0.09% 0.08% 0 IP Input

hegefd · ‎10-06-2014

it was 98% but the output shows 52% now due to multiple clients closing by now. so it will be back at 98% when everyone opens up in the am

hegefd · ‎10-06-2014

so finally after most clients closed the cpu is less but when it gets cranked up in the morning it stays pegged. there are 2 ds3's below. i am moving one ds3 to another router since both are hammered all day. ii continued to loose eigrp neighbors on both connections all day while the circuits were bad and my router had high cpu so a lot going on at once

sh int Serial1/0
Serial1/0 is up, line protocol is up
Hardware is M1T-T3+ pa
Description: DS3 p2p
Internet address is 10.XXXXXXXXX
MTU 1500 bytes, BW 44210 Kbit, DLY 210 usec,
reliability 255/255, txload 27/255, rxload 23/255
Encapsulation HDLC, crc 16, loopback not set
Keepalive set (10 sec)
Restart-Delay is 0 secs
Last input 00:00:01, output 00:00:00, output hang never
Last clearing of "show interface" counters 00:06:38
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 147
Queueing strategy: Class-based queueing
Output queue: 0/1000/64/147 (size/max total/threshold/drops)
Conversations 0/141/256 (active/max active/max total)
Reserved Conversations 0/0 (allocated/max allocated)
Available Bandwidth 26526 kilobits/sec
30 second input rate 4118000 bits/sec, 2278 packets/sec
30 second output rate 4767000 bits/sec, 3164 packets/sec
1102737 packets input, 213807726 bytes, 0 no buffer
Received 45 broadcasts, 0 runts, 0 giants, 0 throttles
0 parity
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
1290970 packets output, 222492740 bytes, 0 underruns
0 output errors, 0 applique, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
0 carrier transitions
rxLOS inactive, rxLOF inactive, rxAIS inactive
txAIS inactive, rxRAI inactive, txRAI inactive

*****************************************************************************************************

sh int Serial3/0
Serial3/0 is up, line protocol is up
Hardware is M1T-T3+ pa
Description: DS3 p2p
Internet address is 10.XXXXXXXXXXX
MTU 4470 bytes, BW 44210 Kbit, DLY 200 usec,
reliability 255/255, txload 29/255, rxload 13/255
Encapsulation PPP, LCP Open
Open: IPCP, CDPCP, crc 16, loopback not set
Keepalive set (10 sec)
Restart-Delay is 0 secs
Last input 00:00:03, output 00:00:00, output hang never
Last clearing of "show interface" counters 00:06:45
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 1263
Queueing strategy: Class-based queueing
Output queue: 0/1000/64/1263 (size/max total/threshold/drops)
Conversations 0/150/256 (active/max active/max total)
Reserved Conversations 0/0 (allocated/max allocated)
Available Bandwidth 26526 kilobits/sec
30 second input rate 2419000 bits/sec, 1731 packets/sec
30 second output rate 5179000 bits/sec, 1809 packets/sec
969173 packets input, 305941909 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 parity
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
1233503 packets output, 810787594 bytes, 0 underruns
0 output errors, 0 applique, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
0 carrier transitions
rxLOS inactive, rxLOF inactive, rxAIS inactive
txAIS inactive, rxRAI inactive, txRAI inactive

Leo Laohoo · ‎10-06-2014

Ok, you've cleared the counters and Total Output Drops are slowly incrementing.

What is your WAN bandwidth?

I am suspecting the high CPU is caused by re-transmit. Your router is pushing as much data up the WAN link and your WAN provider is dropping the packets.

hegefd · ‎10-06-2014

2 DS3's both at a full 44.21 Mbps.

What are some of the symptoms of output drops on serial links, I am seeing them on multiple interfaces and different routers with different DS3 circuits with different carriers.

I know how to troubleshoot output drops on the core switch but these are being see on serial interfaces.

Leo Laohoo · ‎10-07-2014

2 DS3's both at a full 44.21 Mbps.

Ok, I've missed one vital question: What is your chassis' supervisor card? VXR has a number of options. Could be an NPE-G1 or NPE-G2 or something less.

Joseph W. Doherty · ‎10-07-2014

Disclaimer

The Author of this posting offers the information contained within this posting without consideration and with the reader's understanding that there's no implied or expressed suitability or fitness for any purpose. Information provided is for informational purposes only and should not be construed as rendering professional advice of any kind. Usage of this posting's information is solely at reader's own risk.

Liability Disclaimer

In no event shall Author be liable for any damages whatsoever (including, without limitation, damages for loss of use, data or profit) arising out of the use or inability to use the posting's information even if Author has been advised of the possibility of such damage.

Posting

Your posted CPU stats seem to be almost all interrupt CPU, which is normally dependent on traffic load.

What NPE is in your 7206?

High CPU 7206VXR - Removed Traffic but CPU didnt move - Any ideas what is keeping it high?