- Cisco Community
- Technology and Support
- Networking
- Routing
- Re: csr 1000v low throughput & high CPU usage
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
csr 1000v low throughput & high CPU usage
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-17-2019 11:03 PM
We have virtual router Cisco CSR 1000v in a cloud. There are 8 vCPU, based on Intel Xeon E5-2660 v3 (2,6 GHz). We have 1Gbit/sec license and heavy data-plane cpu template:
csr1000v#show platform software cpu alloc CPU alloc information: Control plane cpu alloc: 0 Data plane cpu alloc: 1-7 Service plane cpu alloc: 0 Template used: None
Our problem is low network throughput with DMVPN + IPSEC tunnels. I didn't saw network speed more than 650 mbit\sec and the CPU usage in that situation is full:
CPU utilization for five seconds: 77%, one minute: 77%, five minutes: 77% Core 0: CPU utilization for five seconds: 1%, one minute: 1%, five minutes: 1% Core 1: CPU utilization for five seconds: 100%, one minute: 99%, five minutes: 99% Core 2: CPU utilization for five seconds: 100%, one minute: 99%, five minutes: 99% Core 3: CPU utilization for five seconds: 100%, one minute: 99%, five minutes: 99% Core 4: CPU utilization for five seconds: 100%, one minute: 99%, five minutes: 99% Core 5: CPU utilization for five seconds: 100%, one minute: 99%, five minutes: 99% Core 6: CPU utilization for five seconds: 17%, one minute: 18%, five minutes: 18% Core 7: CPU utilization for five seconds: 99%, one minute: 99%, five minutes: 99% Pid PPid 5Sec 1Min 5Min Status Size Name -------------------------------------------------------------------------------- 22424 21934 624% 624% 621% R 1176592384 ucode_pkt_PPE0
csr1000v#show platform hardware qfp active datapath utilization summary
CPP 0: 5 secs 1 min 5 min 60 min
Input: Total (pps) 68889 68538 52964 41879
(bps) 663208264 658867352 464399304 409978144
Output: Total (pps) 68857 68538 52963 41880
(bps) 641941992 638171736 462007992 397564136
Processing: Load (pct) 99 99 72 63Network speed become ~750 mbit/sec if I remove crypto and send packets with 1350 bytes length.
Tunnel and crypto configuration:
interface Tunnel200 bandwidth 10000 ip address 10.10.200.229 255.255.252.0 no ip redirects ip mtu 1396 ip bandwidth-percent eigrp 1 100 ip nhrp authentication <secret> ip nhrp map 10.10.200.1 9.9.9.9 ip nhrp map multicast 9.9.9.9 ip nhrp network-id 200 ip nhrp nhs 10.10.200.1 ip tcp adjust-mss 1356 delay 1050 tunnel mode gre multipoint tunnel key 200 tunnel path-mtu-discovery
tunnel protection ipsec profile <profile-name> shared
crypto ipsec transform-set <ts-name> esp-3des esp-sha-hmac mode transport
crypto ipsec profile <profile-name>
set transform-set <ts-name>
set pfs group5
I tried to use AES-256 crypto, but the result was the same as with 3des.
Our service provider cant offer any ways of elimination this problem. Can i obtaint 1 Gbit/sec throughput in this case ? Thank you.
With best regards,
Sergey Kanovskiy.
- Labels:
-
Cisco Cloud Services Router
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-18-2019 12:18 AM
Hello,
post the output of:
show process cpu platform sorted
as well as the running configuration of the CSR1000v.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-18-2019 06:09 PM
Hi! This is output from csr1000v :
csr1000v#show proc cpu sorted CPU utilization for five seconds: 0%/0%; one minute: 0%; five minutes: 0% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 9 524504 231936 2261 0.39% 0.05% 0.00% 0 Check heaps 103 214110 17024647 12 0.07% 0.01% 0.00% 0 100ms check 186 483666 26596797 18 0.07% 0.03% 0.01% 0 VRRS Main thread 195 546139 53038999 10 0.07% 0.03% 0.01% 0 IPAM Manager 198 517459 53038999 9 0.07% 0.03% 0.00% 0 IP ARP Retry Age 213 81449 6650286 12 0.07% 0.00% 0.00% 0 SSS Feature Time 1 1 40 25 0.00% 0.00% 0.00% 0 Chunk Manager 2 71453 340496 209 0.00% 0.00% 0.00% 0 Load Meter 3 0 1 0 0.00% 0.00% 0.00% 0 XOS async sync X 4 0 1 0 0.00% 0.00% 0.00% 0 Retransmission o 5 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Dispatc 6 3 12 250 0.00% 0.00% 0.00% 0 RF Slave Main Th 7 0 1 0 0.00% 0.00% 0.00% 0 EDDRI_MAIN 8 0 1 0 0.00% 0.00% 0.00% 0 RO Notify Timers 10 1524 28391 53 0.00% 0.00% 0.00% 0 Pool Manager 11 0 1 0 0.00% 0.00% 0.00% 0 DiscardQ Backgro 12 0 2 0 0.00% 0.00% 0.00% 0 Timers 13 11 3812 2 0.00% 0.00% 0.00% 0 WATCH_AFS 14 11427 851200 13 0.00% 0.00% 0.00% 0 IOSXE heartbeat 15 0 2 0 0.00% 0.00% 0.00% 0 DB Lock Manager 16 0 1 0 0.00% 0.00% 0.00% 0 DB Notification 18 0 1 0 0.00% 0.00% 0.00% 0 VACS Background 19 0 2 0 0.00% 0.00% 0.00% 0 ATM AutoVC Perio 20 0 2 0 0.00% 0.00% 0.00% 0 ATM VC Auto Crea 21 0 1 0 0.00% 0.00% 0.00% 0 IPC Apps Task 22 0 1 0 0.00% 0.00% 0.00% 0 ifIndex Receive 23 1806 340488 5 0.00% 0.00% 0.00% 0 IPC Event Notifi 24 17757 1662417 10 0.00% 0.00% 0.00% 0 IPC Mcast Pendin 25 0 1 0 0.00% 0.00% 0.00% 0 Platform appsess 26 214 28375 7 0.00% 0.00% 0.00% 0 IPC Dynamic Cach 27 1574 340488 4 0.00% 0.00% 0.00% 0 IPC Service NonC 28 0 1 0 0.00% 0.00% 0.00% 0 IPC Zone Manager 29 18522 1662417 11 0.00% 0.00% 0.00% 0 IPC Periodic Tim 30 15467 1662416 9 0.00% 0.00% 0.00% 0 IPC Deferred Por 31 0 1 0 0.00% 0.00% 0.00% 0 IPC Process leve 32 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat Manager 33 836 97285 8 0.00% 0.00% 0.00% 0 IPC Check Queue 34 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat RX Cont 35 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat TX Cont 36 5499 170249 32 0.00% 0.00% 0.00% 0 IPC Keep Alive M 37 16239 340488 47 0.00% 0.00% 0.00% 0 IPC Loadometer 38 0 1 0 0.00% 0.00% 0.00% 0 IPC Session Deta 39 0 1 0 0.00% 0.00% 0.00% 0 SENSOR-MGR event 40 23323 231384 100 0.00% 0.00% 0.00% 0 ARP Input 41 23487 1775740 13 0.00% 0.00% 0.00% 0 ARP Background 42 0 2 0 0.00% 0.00% 0.00% 0 ATM Idle Timer 43 0 1 0 0.00% 0.00% 0.00% 0 ATM ASYNC PROC 44 0 1 0 0.00% 0.00% 0.00% 0 CEF MIB API 45 0 4 0 0.00% 0.00% 0.00% 0 DDR Timers 46 3 3 1000 0.00% 0.00% 0.00% 0 Entity MIB API 47 49 5 9800 0.00% 0.00% 0.00% 0 PrstVbl 48 0 2 0 0.00% 0.00% 0.00% 0 Serial Backgroun 49 0 1 0 0.00% 0.00% 0.00% 0 RMI RM Notify Wa 50 0 1 0 0.00% 0.00% 0.00% 0 MEMLEAK PROCESS 51 0 1 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT 52 0 1 0 0.00% 0.00% 0.00% 0 Policy Manager 53 0 1 0 0.00% 0.00% 0.00% 0 IOSXE signals IO 54 18972 1702476 11 0.00% 0.00% 0.00% 0 GraphIt 55 0 1 0 0.00% 0.00% 0.00% 0 License IPC stat 56 0 1 0 0.00% 0.00% 0.00% 0 License IPC serv 57 1 178 5 0.00% 0.00% 0.00% 0 Net Input 58 0 1 0 0.00% 0.00% 0.00% 0 client_entity_se 59 0 1 0 0.00% 0.00% 0.00% 0 RF SCTPthread 60 0 2 0 0.00% 0.00% 0.00% 0 Dialer event 61 0 1 0 0.00% 0.00% 0.00% 0 SERIAL A'detect 62 0 2 0 0.00% 0.00% 0.00% 0 XML Proxy Client 63 33 198 166 0.00% 0.00% 0.00% 0 crypto sw pk pro PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 64 158 44 3590 0.00% 0.00% 0.00% 0 License Client N 65 147476 56746 2598 0.00% 0.00% 0.00% 0 Licensing Auto U 66 0 1 0 0.00% 0.00% 0.00% 0 License HA Consi 67 0 1 0 0.00% 0.00% 0.00% 0 Image License br 68 2 7 285 0.00% 0.00% 0.00% 0 SAStorage 69 0 4 0 0.00% 0.00% 0.00% 0 SASConnect 70 15505 892883 17 0.00% 0.00% 0.00% 0 SASRcvWQ 71 1 5 200 0.00% 0.00% 0.00% 0 SACConnect 72 7639 892893 8 0.00% 0.00% 0.00% 0 SACRcvWQ 73 0 1 0 0.00% 0.00% 0.00% 0 Critical Bkgnd 74 29589 1137227 26 0.00% 0.00% 0.00% 0 Net Background 75 0 3 0 0.00% 0.00% 0.00% 0 IDB Work 76 10074 758191 13 0.00% 0.00% 0.00% 0 Logger 77 31405 1702284 18 0.00% 0.00% 0.00% 0 TTY Background 78 24 4 6000 0.00% 0.00% 0.00% 0 CTS CORE 79 0 1 0 0.00% 0.00% 0.00% 0 LICENSE AGENT 80 0 5 0 0.00% 0.00% 0.00% 0 SACRcvWQWrk1 81 5 71 70 0.00% 0.00% 0.00% 0 SXP CORE 82 261330 3112349 83 0.00% 0.00% 0.00% 0 IOSD ipc task 83 1669 341917 4 0.00% 0.00% 0.00% 0 IOSD chasfs task 84 1 2 500 0.00% 0.00% 0.00% 0 Crimson flush tr 85 107 2839 37 0.00% 0.00% 0.00% 0 Cloud HA 86 2691 243208 11 0.00% 0.00% 0.00% 0 REDUNDANCY FSM 87 0 1 0 0.00% 0.00% 0.00% 0 Punt FP Stats Du 88 89549 851136 105 0.00% 0.00% 0.00% 0 PuntInject Keepa 89 0 6 0 0.00% 0.00% 0.00% 0 IF-MGR control p 90 0 17 0 0.00% 0.00% 0.00% 0 IF-MGR event pro 91 0 2 0 0.00% 0.00% 0.00% 0 CTS HA 92 0 2 0 0.00% 0.00% 0.00% 0 CTS HA IPC flow 93 0 1 0 0.00% 0.00% 0.00% 0 CTS HA operation 94 13973 1702291 8 0.00% 0.00% 0.00% 0 Environmental Mo 95 13769 1702291 8 0.00% 0.00% 0.00% 0 RP HA Periodic 96 0 2 0 0.00% 0.00% 0.00% 0 cpf_msg_holdq_pr 97 0 1 0 0.00% 0.00% 0.00% 0 cpf_msg_rcvq_pro 98 0 1 0 0.00% 0.00% 0.00% 0 cpf_process_tpQ 99 0 1 0 0.00% 0.00% 0.00% 0 CONSOLE helper p 100 9 16 562 0.00% 0.00% 0.00% 0 DBAL EVENTS 101 0 1 0 0.00% 0.00% 0.00% 0 CEF RRP RF waite 102 22468 1702323 13 0.00% 0.00% 0.00% 0 REDUNDANCY peer 104 0 4 0 0.00% 0.00% 0.00% 0 ANCP HA 105 0 2 0 0.00% 0.00% 0.00% 0 ANCP HA IPC flow 106 0 1 0 0.00% 0.00% 0.00% 0 QoS HA ID RETAIN 107 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien 108 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien 109 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien 110 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien 111 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien 112 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien 113 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien 114 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien 115 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien 116 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien 117 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien 118 0 1 0 0.00% 0.00% 0.00% 0 Network-rf Notif 119 0 3 0 0.00% 0.00% 0.00% 0 ARP HA 120 0 1 0 0.00% 0.00% 0.00% 0 XDR RRP RF waite 121 130247 2433754 53 0.00% 0.00% 0.00% 0 IOSXE-RP Punt Se 122 0 1 0 0.00% 0.00% 0.00% 0 IOSXE-RP Punt IP 123 0 1 0 0.00% 0.00% 0.00% 0 ACL Log Punt Ser 124 0 1 0 0.00% 0.00% 0.00% 0 ACL deny punt se 125 0 1 0 0.00% 0.00% 0.00% 0 OFSDN Punject Pr 126 0 1 0 0.00% 0.00% 0.00% 0 IOSXE-RP QFP HA 127 0 1 0 0.00% 0.00% 0.00% 0 DHCPC HA 128 0 1 0 0.00% 0.00% 0.00% 0 DHCPD HA 129 0 1 0 0.00% 0.00% 0.00% 0 DHCPv6 Relay HA 130 0 1 0 0.00% 0.00% 0.00% 0 DHCPv6 Server HA 131 0 1 0 0.00% 0.00% 0.00% 0 Crypto PKI-HA 132 0 1 0 0.00% 0.00% 0.00% 0 IKE HA Mgr 133 0 1 0 0.00% 0.00% 0.00% 0 IPSEC HA Mgr PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 134 3 12 250 0.00% 0.00% 0.00% 0 RF Master Main T 135 0 7 0 0.00% 0.00% 0.00% 0 RF Master Status 136 0 6 0 0.00% 0.00% 0.00% 0 SASRcvWQWrk1 137 237 41741 5 0.00% 0.00% 0.00% 0 SACRcvWQWrk2 138 1010 41739 24 0.00% 0.00% 0.00% 0 SASRcvWQWrk2 139 6099 170250 35 0.00% 0.00% 0.00% 0 Compute load avg 140 180360 56749 3178 0.00% 0.00% 0.00% 0 Per-minute Jobs 141 41509 1702477 24 0.00% 0.00% 0.00% 0 Per-Second Jobs 142 14 742 18 0.00% 0.00% 0.00% 0 Transport Port A 143 0 1 0 0.00% 0.00% 0.00% 0 IOSXE-RP FastPat 144 15430 1662413 9 0.00% 0.00% 0.00% 0 fanrp_l2fib 145 0 2 0 0.00% 0.00% 0.00% 0 FEC_Link_event_h 146 0 1 0 0.00% 0.00% 0.00% 0 BFD HW EVENT 147 0 1 0 0.00% 0.00% 0.00% 0 BFD IPV6 ADDR CH 148 2 4 500 0.00% 0.00% 0.00% 0 EEM ED MAT 149 0 35 0 0.00% 0.00% 0.00% 0 EEM ED ND 150 0 1 0 0.00% 0.00% 0.00% 0 SSLVPN Register 151 19581 191323 102 0.00% 0.00% 0.00% 0 IPSec background 152 264278 8507733 31 0.00% 0.01% 0.00% 0 ONEP Network Ele 153 7456 340479 21 0.00% 0.00% 0.00% 0 vNIC stats Proce 154 28 2 14000 0.00% 0.00% 0.00% 0 CWAN OIR Handler 155 0 1 0 0.00% 0.00% 0.00% 0 TP CUTOVER EVENT 156 7272 567475 12 0.00% 0.00% 0.00% 0 ACE event 157 2909 76570 37 0.00% 0.00% 0.00% 0 ACE HAPI 158 135 14188 9 0.00% 0.00% 0.00% 0 ACE policy loade 159 0 1 0 0.00% 0.00% 0.00% 0 RTTYS Process 160 10242 432724 23 0.00% 0.00% 0.00% 0 EIGRP-IPv4 161 0 2 0 0.00% 0.00% 0.00% 0 Ethernet LMI 162 0 2 0 0.00% 0.00% 0.00% 0 Ethernet OAM Pro 163 0 2 0 0.00% 0.00% 0.00% 0 Ethernet CFM 164 0 1 0 0.00% 0.00% 0.00% 0 PPCP RP Stats Ba 165 0 1 0 0.00% 0.00% 0.00% 0 L2FIB Timer Disp 166 0 2 0 0.00% 0.00% 0.00% 0 IGMP Route Msg H 167 0 1 0 0.00% 0.00% 0.00% 0 IGMP Route Rx Pr 168 0 1 0 0.00% 0.00% 0.00% 0 MLRIB L2 Msg Thr 169 0 1 0 0.00% 0.00% 0.00% 0 TEMPLATE HA 170 0 1 0 0.00% 0.00% 0.00% 0 DVLAN HA 171 0 1 0 0.00% 0.00% 0.00% 0 RABAPOL HA 172 0 2 0 0.00% 0.00% 0.00% 0 RABAPOL HA IPC f 173 0 2 0 0.00% 0.00% 0.00% 0 RG Faults Timer 174 0 1 0 0.00% 0.00% 0.00% 0 RG VP 175 0 2 0 0.00% 0.00% 0.00% 0 RG AR 176 0 2 0 0.00% 0.00% 0.00% 0 RG Protocol Time 177 0 2 0 0.00% 0.00% 0.00% 0 RG Transport Tim 178 0 1 0 0.00% 0.00% 0.00% 0 HDLC HA 179 0 5 0 0.00% 0.00% 0.00% 0 EPM IAL Process 180 0 2 0 0.00% 0.00% 0.00% 0 CEF switching ba 181 0 1 0 0.00% 0.00% 0.00% 0 ADJ NSF process 182 34356 1702288 20 0.00% 0.00% 0.00% 0 FHRP Main thread 183 8459 340487 24 0.00% 0.00% 0.00% 0 TRACK Main threa 184 1 2 500 0.00% 0.00% 0.00% 0 TRACK Client thr 185 0 1 0 0.00% 0.00% 0.00% 0 VRRP Main thread 187 0 1 0 0.00% 0.00% 0.00% 0 HQF TARGET DYNAM 188 0 1 0 0.00% 0.00% 0.00% 0 IEDGE ACCT TIMER 189 0 1 0 0.00% 0.00% 0.00% 0 ISG CMD HANDLER 190 0 2 0 0.00% 0.00% 0.00% 0 IP PORTBUNDLE 191 2052 415644 4 0.00% 0.00% 0.00% 0 IP Static Sessio 192 0 2 0 0.00% 0.00% 0.00% 0 DVLAN Config Pro 193 3980 415644 9 0.00% 0.00% 0.00% 0 IP Lite session 194 0 2 0 0.00% 0.00% 0.00% 0 IPAM/ODAP Events 196 0 2 0 0.00% 0.00% 0.00% 0 IPAM Events 197 2 11 181 0.00% 0.00% 0.00% 0 IP ARP Adjacency 199 1513 42328 35 0.00% 0.00% 0.00% 0 IP Input 200 0 1 0 0.00% 0.00% 0.00% 0 ICMP event handl 201 18066 1702288 10 0.00% 0.00% 0.00% 0 mDNS 202 0 1 0 0.00% 0.00% 0.00% 0 Policy bind Proc 203 0 1 0 0.00% 0.00% 0.00% 0 AAA EPD HANDLER 204 0 1 0 0.00% 0.00% 0.00% 0 PM EPD API 205 0 1 0 0.00% 0.00% 0.00% 0 DM Proc PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 206 0 2 0 0.00% 0.00% 0.00% 0 PPP SIP 207 0 2 0 0.00% 0.00% 0.00% 0 PPP Bind 208 0 2 0 0.00% 0.00% 0.00% 0 PPP IP Route 209 0 2 0 0.00% 0.00% 0.00% 0 SSM connection m 210 229 28375 8 0.00% 0.00% 0.00% 0 SSS Manager 211 0 1 0 0.00% 0.00% 0.00% 0 SSS Policy Manag 212 0 1 0 0.00% 0.00% 0.00% 0 SSS Feature Mana 214 0 1 0 0.00% 0.00% 0.00% 0 SSS PM SHIM QOS 215 0 1 0 0.00% 0.00% 0.00% 0 LONG TO SHORT NA 216 0 1 0 0.00% 0.00% 0.00% 0 Timer handler fo 217 0 1 0 0.00% 0.00% 0.00% 0 Prepaid response 218 0 1 0 0.00% 0.00% 0.00% 0 Timed Policy act 219 0 1 0 0.00% 0.00% 0.00% 0 AAA response han 220 1433 113499 12 0.00% 0.00% 0.00% 0 Spanning Tree 221 0 2 0 0.00% 0.00% 0.00% 0 SpanTree Msg 222 163861 13290393 12 0.00% 0.01% 0.00% 0 Tunnel BGP 223 0 1 0 0.00% 0.00% 0.00% 0 VRRS 224 49 5675 8 0.00% 0.00% 0.00% 0 Appnav auto disc 225 10750 1702288 6 0.00% 0.00% 0.00% 0 cdp init process 226 731 28375 25 0.00% 0.00% 0.00% 0 Call Home Timer 227 2 182 10 0.00% 0.00% 0.00% 0 AAA Server 228 0 1 0 0.00% 0.00% 0.00% 0 AAA ACCT Proc 229 0 1 0 0.00% 0.00% 0.00% 0 ACCT Periodic Pr 230 0 2 0 0.00% 0.00% 0.00% 0 AAA Dictionary R 231 0 2 0 0.00% 0.00% 0.00% 0 KRB5 AAA 232 0 1 0 0.00% 0.00% 0.00% 0 PKI Trustpool 233 0 1 0 0.00% 0.00% 0.00% 0 RADIUS Proxy 234 0 1 0 0.00% 0.00% 0.00% 0 radius radsec cl 235 0 2 0 0.00% 0.00% 0.00% 0 SNMP DBAL WRAPPE 236 0 1 0 0.00% 0.00% 0.00% 0 SNMP DBAL Cache 237 0 1 0 0.00% 0.00% 0.00% 0 SNMP DBAL Cache 238 0 1 0 0.00% 0.00% 0.00% 0 IPv6 ping proces 239 30081 1662559 18 0.00% 0.00% 0.00% 0 L2RIB Thread 240 0 3 0 0.00% 0.00% 0.00% 0 PIM register asy 241 0 2 0 0.00% 0.00% 0.00% 0 RIB LM VALIDATE 242 0 1 0 0.00% 0.00% 0.00% 0 XDR background p 243 392 28375 13 0.00% 0.00% 0.00% 0 XDR mcast 244 0 1 0 0.00% 0.00% 0.00% 0 XDR RP Ping Back 245 0 1 0 0.00% 0.00% 0.00% 0 XDR receive 246 0 1 0 0.00% 0.00% 0.00% 0 IPC LC Message H 247 0 1 0 0.00% 0.00% 0.00% 0 XDR RP Test Back 248 194 28375 6 0.00% 0.00% 0.00% 0 FRR Background P 249 3237 171544 18 0.00% 0.00% 0.00% 0 CEF background p 250 0 1 0 0.00% 0.00% 0.00% 0 fib_fib_bfd_sb e 251 0 1 0 0.00% 0.00% 0.00% 0 IP IRDP 252 0 1 0 0.00% 0.00% 0.00% 0 CEF RP Backgroun 253 0 2 0 0.00% 0.00% 0.00% 0 Routing Topology 254 4499 14595 308 0.00% 0.00% 0.00% 0 IP RIB Update 255 308 28396 10 0.00% 0.00% 0.00% 0 IP Background 256 1 47 21 0.00% 0.00% 0.00% 0 IP Connected Rou 257 0 1 0 0.00% 0.00% 0.00% 0 Tunnel FIB 258 15369 1702288 9 0.00% 0.00% 0.00% 0 nbar-graph-sende 259 4474 340488 13 0.00% 0.00% 0.00% 0 nbar-custom-prot 260 502 28376 17 0.00% 0.00% 0.00% 0 nbar-auto-custom 261 30074 1702287 17 0.00% 0.00% 0.00% 0 nbar-sdavc-sched 262 446 28376 15 0.00% 0.00% 0.00% 0 nbar-pp-monitor 263 0 2 0 0.00% 0.00% 0.00% 0 EFP Errd 264 1 2 500 0.00% 0.00% 0.00% 0 Ether EFP Proces 265 0 2 0 0.00% 0.00% 0.00% 0 Ether Infra RP 266 0 2 0 0.00% 0.00% 0.00% 0 CFM HA IPC messa 267 0 1 0 0.00% 0.00% 0.00% 0 Ethernet PM Proc 268 0 2 0 0.00% 0.00% 0.00% 0 Ethernet PM Soft 269 4529 510594 8 0.00% 0.00% 0.00% 0 Ethernet PM Moni 270 0 1 0 0.00% 0.00% 0.00% 0 IP Traceroute 271 61 12256 4 0.00% 0.00% 0.00% 0 TCP Timer 272 23 909 25 0.00% 0.00% 0.00% 0 TCP Protocols 273 0 1 0 0.00% 0.00% 0.00% 0 Socket Timers 274 65 5678 11 0.00% 0.00% 0.00% 0 HTTP CORE 275 0 21 0 0.00% 0.00% 0.00% 0 IGMPSN L2MCM PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 276 0 1 0 0.00% 0.00% 0.00% 0 IGMPSN MRD 277 0 1 0 0.00% 0.00% 0.00% 0 IGMPSN 278 0 1 0 0.00% 0.00% 0.00% 0 TCP HA PROC 279 0 2 0 0.00% 0.00% 0.00% 0 Tunnel 280 6446 851151 7 0.00% 0.00% 0.00% 0 CEF: IPv4 proces 281 9 681 13 0.00% 0.00% 0.00% 0 ADJ background 282 24 1374 17 0.00% 0.00% 0.00% 0 Collection proce 283 0 1 0 0.00% 0.00% 0.00% 0 RETRY_REPOPULATE 284 0 2 0 0.00% 0.00% 0.00% 0 XDR FOF process 285 0 23 0 0.00% 0.00% 0.00% 0 Flow Exporter Ti 286 0 2 0 0.00% 0.00% 0.00% 0 Flow Exporter Pa 287 0 2 0 0.00% 0.00% 0.00% 0 L2FIB Event Disp 288 0 1 0 0.00% 0.00% 0.00% 0 IGMPQR 289 0 2 0 0.00% 0.00% 0.00% 0 App Route Proces 290 0 1 0 0.00% 0.00% 0.00% 0 IPv6 RIB Cleanup 291 0 1 0 0.00% 0.00% 0.00% 0 IPv6 RIB Event H 292 0 1 0 0.00% 0.00% 0.00% 0 ATM HA 293 0 2 0 0.00% 0.00% 0.00% 0 ATM HA IPC flow 294 0 24 0 0.00% 0.00% 0.00% 0 EVPN Mgr Thread 295 0 1 0 0.00% 0.00% 0.00% 0 FR HA 296 0 2 0 0.00% 0.00% 0.00% 0 GLBP HA 297 0 1 0 0.00% 0.00% 0.00% 0 Probe Input 298 0 2 0 0.00% 0.00% 0.00% 0 HSRP HA 299 0 2 0 0.00% 0.00% 0.00% 0 RBSCP Background 300 0 2 0 0.00% 0.00% 0.00% 0 SNMP Timers 301 0 1 0 0.00% 0.00% 0.00% 0 RG If-Mgr Timer 302 0 2 0 0.00% 0.00% 0.00% 0 RG Media Timer 303 0 2 0 0.00% 0.00% 0.00% 0 VRRP HA 304 0 1 0 0.00% 0.00% 0.00% 0 IOSXE-RP Punt Qo 305 4 4 1000 0.00% 0.00% 0.00% 0 MCPRP RG Timer 306 0 2 0 0.00% 0.00% 0.00% 0 L2X Switching Ev 307 0 2 0 0.00% 0.00% 0.00% 0 VTEMPLATE IPC fl 308 0 1 0 0.00% 0.00% 0.00% 0 BFD HA 309 0 2 0 0.00% 0.00% 0.00% 0 PPP Compress Inp 310 0 2 0 0.00% 0.00% 0.00% 0 PPP Compress Res 311 0 3 0 0.00% 0.00% 0.00% 0 ADJ resolve proc 312 0 1 0 0.00% 0.00% 0.00% 0 COPS 313 0 2 0 0.00% 0.00% 0.00% 0 Dialer Forwarder 314 0 3 0 0.00% 0.00% 0.00% 0 Service Routing 315 1 27 37 0.00% 0.00% 0.00% 0 SR CapMan Proces 316 2450 415644 5 0.00% 0.00% 0.00% 0 IP SIP Process 317 0 2 0 0.00% 0.00% 0.00% 0 IP Inband Sessio 318 0 18 0 0.00% 0.00% 0.00% 0 DNS Service 319 4 178 22 0.00% 0.00% 0.00% 0 RARP Input 320 0 21 0 0.00% 0.00% 0.00% 0 static 321 0 1 0 0.00% 0.00% 0.00% 0 PAD InCall 322 0 2 0 0.00% 0.00% 0.00% 0 X.25 Background 323 0 1 0 0.00% 0.00% 0.00% 0 X.25 Encaps Mana 324 0 2 0 0.00% 0.00% 0.00% 0 SCTP Main Proces 325 0 1 0 0.00% 0.00% 0.00% 0 VPDN call manage 326 1 2 500 0.00% 0.00% 0.00% 0 AN 327 0 1 0 0.00% 0.00% 0.00% 0 AN HELPER 328 0 1 0 0.00% 0.00% 0.00% 0 AN CONFIG DOWNLO 329 34573 3324498 10 0.00% 0.00% 0.00% 0 Inspect process 330 1633 286000 5 0.00% 0.00% 0.00% 0 CRYPTO IKMP IPC 331 0 2 0 0.00% 0.00% 0.00% 0 URL filter proc 332 0 1 0 0.00% 0.00% 0.00% 0 AAA System Acct 333 0 1 0 0.00% 0.00% 0.00% 0 DHCP SIP 334 1 2 500 0.00% 0.00% 0.00% 0 DHCPv6 LQ client 335 0 1 0 0.00% 0.00% 0.00% 0 IPv6 ACL RP Proc 336 0 1 0 0.00% 0.00% 0.00% 0 IPv6 Static Hand 337 4692 170247 27 0.00% 0.00% 0.00% 0 QoS stats proces 338 0 1 0 0.00% 0.00% 0.00% 0 EVPN HA Bulk Syn 339 0 19 0 0.00% 0.00% 0.00% 0 MVPN Mgr Process 340 0 2 0 0.00% 0.00% 0.00% 0 Multicast Offloa 341 9 475 18 0.00% 0.00% 0.00% 0 SSH Event handle 342 0 1 0 0.00% 0.00% 0.00% 0 ONEP Dispatch po 343 0 1 0 0.00% 0.00% 0.00% 0 MRIB RP PROCESS 344 0 1 0 0.00% 0.00% 0.00% 0 MRIB RP Proxy PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 345 81 5585 14 0.00% 0.00% 0.00% 0 MFIB Master back 346 0 1 0 0.00% 0.00% 0.00% 0 BGP HA SSO 347 40606 3324498 12 0.00% 0.00% 0.00% 0 TLSCLIENT_PROCES 348 0 1 0 0.00% 0.00% 0.00% 0 SSL background p 349 0 1 0 0.00% 0.00% 0.00% 0 Select Timers 350 0 2 0 0.00% 0.00% 0.00% 0 HTTP Process 351 2 2 1000 0.00% 0.00% 0.00% 0 DynCmd Package P 352 0 2 0 0.00% 0.00% 0.00% 0 Diameter Base pr 353 0 1 0 0.00% 0.00% 0.00% 0 EM Background Pr 354 0 1 0 0.00% 0.00% 0.00% 0 IDMGR CORE 355 0 1 0 0.00% 0.00% 0.00% 0 Key chain liveke 356 2902 29245 99 0.00% 0.00% 0.00% 2 SSH Process 357 0 3 0 0.00% 0.00% 0.00% 0 Crypto WUI 358 0 3 0 0.00% 0.00% 0.00% 0 EST Client 359 0 2 0 0.00% 0.00% 0.00% 0 AAA Cached Serve 360 0 2 0 0.00% 0.00% 0.00% 0 ENABLE AAA 361 0 3 0 0.00% 0.00% 0.00% 0 LDAP process 362 0 2 0 0.00% 0.00% 0.00% 0 LINE AAA 363 46 5475 8 0.00% 0.00% 0.00% 0 LOCAL AAA 364 0 2 0 0.00% 0.00% 0.00% 0 TPLUS 365 0 1 0 0.00% 0.00% 0.00% 0 Opaque Database 366 49376 3324502 14 0.00% 0.00% 0.00% 0 Timer Library 367 0 16 0 0.00% 0.00% 0.00% 0 Crypto Support 368 0 1 0 0.00% 0.00% 0.00% 0 IPSECv6 PS Proc 369 0 1 0 0.00% 0.00% 0.00% 0 EAP Process 370 130 473 274 0.00% 0.00% 0.00% 0 NIST rng proc 371 0 2 0 0.00% 0.00% 0.00% 0 File Copy Handle 372 0 2 0 0.00% 0.00% 0.00% 0 COND_DEBUG HA IP 373 0 1 0 0.00% 0.00% 0.00% 0 AAA Proxy 374 0 1 0 0.00% 0.00% 0.00% 0 TPS IPC Process 375 1707 154479 11 0.00% 0.00% 0.00% 0 crypto engine pr 376 0 1 0 0.00% 0.00% 0.00% 0 RSA background p 377 44 1895 23 0.00% 0.00% 0.00% 0 Crypto CA 378 0 3 0 0.00% 0.00% 0.00% 0 Crypto PKI-CRL 379 0 1 0 0.00% 0.00% 0.00% 0 Crypto PKI-Rev-P 380 0 1 0 0.00% 0.00% 0.00% 0 PKI OCSP 381 0 1 0 0.00% 0.00% 0.00% 0 PKI Revocation 382 0 1 0 0.00% 0.00% 0.00% 0 QOS PERUSER 383 0 2 0 0.00% 0.00% 0.00% 0 PIM HA 384 44956 1759000 25 0.00% 0.00% 0.00% 0 Crypto IKEv2 385 0 1 0 0.00% 0.00% 0.00% 0 IKEv2 AAA handle 386 0 1 0 0.00% 0.00% 0.00% 0 encrypt proc 387 416 51264 8 0.00% 0.00% 0.00% 0 CRYPTO MAP FREE 388 0 1 0 0.00% 0.00% 0.00% 0 Crypto INT 389 34963 797864 43 0.00% 0.00% 0.00% 0 Crypto IKE Dispa 390 589485 3146638 187 0.00% 0.04% 0.02% 0 Crypto IKMP 391 0 1 0 0.00% 0.00% 0.00% 0 IPSEC manual key 392 0 1 0 0.00% 0.00% 0.00% 0 IPsec vesen keym 393 18234 278166 65 0.00% 0.00% 0.00% 0 IPSEC key engine 394 0 1 0 0.00% 0.00% 0.00% 0 Crypto ACL 395 0 1 0 0.00% 0.00% 0.00% 0 Crypto PAS Proc 396 0 2 0 0.00% 0.00% 0.00% 0 GKM GM Process 397 0 1 0 0.00% 0.00% 0.00% 0 GKM KS PROCESS 398 0 1 0 0.00% 0.00% 0.00% 0 Licensing MIB pr 400 3145 56751 55 0.00% 0.00% 0.00% 0 Flash low disk s 401 14030 625779 22 0.00% 0.00% 0.00% 0 EIGRP-IPv4 402 0 2 0 0.00% 0.00% 0.00% 0 ICRM 403 0 1 0 0.00% 0.00% 0.00% 0 Online Diag EEM 404 244 28375 8 0.00% 0.00% 0.00% 0 SPA ENTITY Proce 405 0 1 0 0.00% 0.00% 0.00% 0 dcm_cli_engine 406 0 3 0 0.00% 0.00% 0.00% 0 dcm_cli_provider 407 1 4 250 0.00% 0.00% 0.00% 0 DCM Core Thread 408 7799 446537 17 0.00% 0.00% 0.00% 0 EEM ED Syslog 409 1 4 250 0.00% 0.00% 0.00% 0 EEM ED Generic 410 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Track 411 1 4 250 0.00% 0.00% 0.00% 0 EEM ED Routing 412 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Resource 414 0 2 0 0.00% 0.00% 0.00% 0 MCPRP UTD Timer 415 4 182 21 0.00% 0.00% 0.00% 0 AAA SEND STOP EV PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 416 0 1 0 0.00% 0.00% 0.00% 0 Test AAA Client 417 0 1 0 0.00% 0.00% 0.00% 0 IKEv2 FlexVPN Pr 418 0 1 0 0.00% 0.00% 0.00% 0 IKEv2 Cluster Lo 419 0 1 0 0.00% 0.00% 0.00% 0 ISSU Utility Pro 420 0 1 0 0.00% 0.00% 0.00% 0 IOSXE-RP Virtual 422 0 1 0 0.00% 0.00% 0.00% 0 IP SLAs ICMP Jit 424 0 1 0 0.00% 0.00% 0.00% 0 IP SLAs Ethernet 425 1 3 333 0.00% 0.00% 0.00% 0 WSMAN Process 426 0 1 0 0.00% 0.00% 0.00% 0 Online Diag CNS 427 0 1 0 0.00% 0.00% 0.00% 0 Online Diag CNS 428 505 1069 472 0.00% 0.00% 0.00% 0 DCM snmp dp Thre 429 0 3 0 0.00% 0.00% 0.00% 0 snmp dcm ma shim 430 2674 170250 15 0.00% 0.00% 0.00% 0 Bulkstat-Client 431 0 3 0 0.00% 0.00% 0.00% 0 dcm_expression_p 432 2 113 17 0.00% 0.00% 0.00% 0 EEM Server 433 3 18 166 0.00% 0.00% 0.00% 0 Call Home proces 434 0 1 0 0.00% 0.00% 0.00% 0 Call Home DS 435 0 1 0 0.00% 0.00% 0.00% 0 Call Home DSfile 436 0 3 0 0.00% 0.00% 0.00% 0 EEM Policy Direc 437 0 1 0 0.00% 0.00% 0.00% 0 ONEP Dispatch po 438 1 4 250 0.00% 0.00% 0.00% 0 EEM ED CLI 439 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Counter 440 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Interface 441 0 4 0 0.00% 0.00% 0.00% 0 EEM ED IOSWD 442 0 4 0 0.00% 0.00% 0.00% 0 EEM ED None 443 0 4 0 0.00% 0.00% 0.00% 0 EEM ED OIR 444 0 4 0 0.00% 0.00% 0.00% 0 EEM ED RF 445 0 4 0 0.00% 0.00% 0.00% 0 EEM ED SNMP 446 0 4 0 0.00% 0.00% 0.00% 0 EEM ED SNMP Obje 447 0 4 0 0.00% 0.00% 0.00% 0 EEM ED SNMP Noti 448 773 29202 26 0.00% 0.00% 0.00% 0 EEM ED Timer 449 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Test 450 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Config 451 0 4 0 0.00% 0.00% 0.00% 0 EEM ED Env 452 0 4 0 0.00% 0.00% 0.00% 0 EEM ED DS 453 0 4 0 0.00% 0.00% 0.00% 0 EEM ED CRASH 454 0 4 0 0.00% 0.00% 0.00% 0 EM ED GOLD 455 2483 16677 148 0.00% 0.00% 0.00% 0 Syslog 457 3084 170246 18 0.00% 0.00% 0.00% 0 qos_mon_periodic 458 0 4 0 0.00% 0.00% 0.00% 0 EEM ED RPC 459 1 6 166 0.00% 0.00% 0.00% 0 RBM CORE 460 1 3 333 0.00% 0.00% 0.00% 0 CTS credentials 461 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 462 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 463 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 464 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 465 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 466 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 467 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 468 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 469 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 470 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 471 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 472 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 473 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 474 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 475 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 476 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 477 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 478 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 479 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 480 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 481 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 482 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 483 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 484 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 485 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 486 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 487 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 488 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 489 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 490 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 491 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 492 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 493 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 494 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 495 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 496 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 497 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 498 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 499 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 500 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 501 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 502 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 503 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 504 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 505 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 506 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 507 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 508 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 509 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 510 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 511 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 512 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 513 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 514 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 515 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 516 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 517 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 518 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 519 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 520 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 521 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 522 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 523 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version 524 12304 103911 118 0.00% 0.00% 0.00% 0 mdns Timer Proce 525 0 2 0 0.00% 0.00% 0.00% 0 MRIB Process 526 1 143 6 0.00% 0.00% 0.00% 0 EEM Helper Threa 527 0 1 0 0.00% 0.00% 0.00% 0 ONEP Dispatch po 529 0 1 0 0.00% 0.00% 0.00% 0 ONEP Dispatch po 530 0 1 0 0.00% 0.00% 0.00% 0 ONEP Dispatch po 531 0 1 0 0.00% 0.00% 0.00% 0 ONEP Dispatch po 532 0 1 0 0.00% 0.00% 0.00% 0 ONEP Dispatch po 533 0 1 0 0.00% 0.00% 0.00% 0 ONEP Dispatch po 534 0 1 0 0.00% 0.00% 0.00% 0 ONEP Dispatch XD 535 27582 330915 83 0.00% 0.00% 0.00% 0 NHRP 536 57945 1105758 52 0.00% 0.00% 0.00% 0 Multicast Replic 537 37933 3324509 11 0.00% 0.00% 0.00% 0 IP NAT Ager 538 0 1 0 0.00% 0.00% 0.00% 0 IP VFR proc 539 3300 152569 21 0.00% 0.00% 0.00% 0 Tunnel Security 540 34387 151749 226 0.00% 0.00% 0.00% 0 Crypto SS Proces 542 26566 566297 46 0.00% 0.00% 0.00% 0 IP SNMP 543 9774 283229 34 0.00% 0.00% 0.00% 0 PDU DISPATCHER 544 45310 283232 159 0.00% 0.00% 0.00% 0 SNMP ENGINE 545 0 2 0 0.00% 0.00% 0.00% 0 IP SNMPV6 546 0 1 0 0.00% 0.00% 0.00% 0 SNMP ConfCopyPro 547 0 2 0 0.00% 0.00% 0.00% 0 SNMP Traps 548 0 1 0 0.00% 0.00% 0.00% 0 NAT MIB Helper 549 48811 1730099 28 0.00% 0.00% 0.00% 0 NTP 552 0 5 0 0.00% 0.00% 0.00% 0 EIGRP-IPv4 553 38482 759677 50 0.00% 0.00% 0.00% 0 EIGRP-IPv4 Hello 554 71859 1314503 54 0.00% 0.00% 0.00% 0 EIGRP-IPv4 Hello 555 0 1 0 0.00% 0.00% 0.00% 0 EIGRP-IPv4 Hello 556 0 1 0 0.00% 0.00% 0.00% 0 WSMA_NOTIFY 557 0 1 0 0.00% 0.00% 0.00% 0 SEP_webui_wsma_h 558 0 1 0 0.00% 0.00% 0.00% 0 SEP_webui_wsma_h 559 50929 680894 74 0.00% 0.00% 0.00% 0 DiagCard1/-1 560 0 2 0 0.00% 0.00% 0.00% 0 DiagCard2/-1
But in this time :
csr1000v#show proc cpu platform sorted
CPU utilization for five seconds: 72%, one minute: 71%, five minutes: 39%
Core 0: CPU utilization for five seconds: 1%, one minute: 1%, five minutes: 1%
Core 1: CPU utilization for five seconds: 90%, one minute: 92%, five minutes: 51%
Core 2: CPU utilization for five seconds: 90%, one minute: 92%, five minutes: 51%
Core 3: CPU utilization for five seconds: 90%, one minute: 92%, five minutes: 51%
Core 4: CPU utilization for five seconds: 91%, one minute: 94%, five minutes: 57%
Core 5: CPU utilization for five seconds: 90%, one minute: 92%, five minutes: 51%
Core 6: CPU utilization for five seconds: 15%, one minute: 16%, five minutes: 12%
Core 7: CPU utilization for five seconds: 89%, one minute: 91%, five minutes: 56%
Pid PPid 5Sec 1Min 5Min Status Size Name
--------------------------------------------------------------------------------
22424 21934 563% 578% 339% R 1176592384 ucode_pkt_PPE0
22694 7692 0% 0% 0% S 152096768 vmtoolsd
22622 15136 0% 0% 0% R 5318287360 linux_iosd-imag
22345 21262 0% 0% 0% S 2227830784 fman_fp_image
22152 1 0% 0% 0% S 66916352 rotee
21934 18311 0% 0% 0% S 19496960 pman.sh
21535 20877 0% 0% 0% S 1068830720 cpp_sp_svr
21527 1 0% 0% 0% S 66916352 rotee
21475 19781 0% 0% 0% S 1716887552 cpp_cp_svr
21262 18311 0% 0% 0% S 19501056 pman.sh
21182 20556 0% 0% 0% S 1047699456 cpp_ha_top_leve
21118 1 0% 0% 0% S 66916352 rotee
20877 18311 0% 0% 0% S 19496960 pman.sh
20834 20101 0% 0% 0% S 1026043904 cpp_driver
20782 1 0% 0% 0% S 66916352 rotee
20556 18311 0% 0% 0% S 19496960 pman.sh
20472 1 0% 0% 0% S 66916352 rotee
20101 18311 0% 0% 0% S 19496960 pman.sh
20088 19489 0% 0% 0% S 878260224 cman_fp
20016 1 0% 0% 0% S 66916352 rotee
19841 19193 0% 0% 0% S 215998464 btman
19781 18311 0% 0% 0% S 19496960 pman.sh
19694 1 0% 0% 0% S 66916352 rotee
19568 2 0% 0% 0% S 0 kworker/u16:0
19489 18311 0% 0% 0% S 19496960 pman.sh
19433 1 0% 0% 0% S 66916352 rotee
19193 18311 0% 0% 0% S 19501056 pman.sh
18840 18227 0% 0% 0% S 355258368 vman
18764 18311 0% 0% 0% S 6877184 inotifywait
18568 1 0% 0% 0% S 67039232 rotee
18398 1 0% 0% 0% S 66916352 rotee
18311 1 0% 0% 0% S 21590016 pvp.sh
18267 17925 0% 0% 0% S 18800640 sort_files_by_i
18227 13015 0% 0% 0% S 19501056 pman.sh
18201 17653 0% 0% 0% S 657612800 smd
18084 1 0% 0% 0% S 66916352 rotee
17925 13015 0% 0% 0% S 19505152 pman.sh
17872 17415 0% 0% 0% S 496672768 smand
17828 1 0% 0% 0% S 66916352 rotee
17655 17254 0% 0% 0% S 316923904 repm
17653 13015 0% 0% 0% S 19501056 pman.sh
17566 1 0% 0% 0% S 66916352 rotee
17415 13015 0% 0% 0% S 19496960 pman.sh
17365 1 0% 0% 0% S 67039232 rotee
17254 13015 0% 0% 0% S 19496960 pman.sh
17133 16510 0% 0% 0% S 219795456 psd
16883 1 0% 0% 0% S 66916352 rotee
16880 16846 0% 0% 0% S 33345536 journalctl
16846 16201 0% 0% 0% S 186753024 plogd
16510 13015 0% 0% 0% S 19501056 pman.sh
16435 1 0% 0% 0% S 66920448 rotee
16389 1 0% 0% 0% S 67039232 rotee
16338 15947 0% 0% 0% S 23875584 periodic.sh
16201 13015 0% 0% 0% S 19505152 pman.sh
16128 15680 0% 0% 0% S 206798848 ofa
16117 1 0% 0% 0% S 66916352 rotee
15947 13015 0% 0% 0% S 19501056 pman.sh
15904 15499 0% 0% 0% S 260403200 lman
15837 1 0% 0% 0% S 66916352 rotee
15680 13015 0% 0% 0% S 19501056 pman.sh
15605 1 0% 0% 0% S 66916352 rotee
15499 13015 0% 0% 0% S 19501056 pman.sh
15241 1 0% 0% 0% S 66916352 rotee
15136 13015 0% 0% 0% S 19628032 pman.sh
15108 14819 0% 0% 0% R 243707904 hman
14947 14427 0% 0% 0% S 1348874240 fman_rp
14936 1 0% 0% 0% S 66916352 rotee
14819 13015 0% 0% 0% S 19501056 pman.sh
14565 1 0% 0% 0% S 66916352 rotee
14513 14181 0% 0% 0% S 228700160 emd
14427 13015 0% 0% 0% S 19496960 pman.sh
14325 1 0% 0% 0% S 66916352 rotee
14282 13915 0% 0% 0% S 674086912 dbm
14181 13015 0% 0% 0% S 19496960 pman.sh
14076 1 0% 0% 0% S 67039232 rotee
14063 13622 0% 0% 0% S 412176384 cmand
13915 13015 0% 0% 0% S 19501056 pman.sh
13885 13391 0% 0% 0% S 839643136 cli_agent
13799 1 0% 0% 0% S 66916352 rotee
13693 13234 0% 0% 0% S 216076288 btman
13622 13015 0% 0% 0% S 19501056 pman.sh
13529 1 0% 0% 0% S 67039232 rotee
13391 13015 0% 0% 0% S 19501056 pman.sh
13344 1 0% 0% 0% S 66916352 rotee
13234 13015 0% 0% 0% S 19496960 pman.sh
13125 13015 0% 0% 0% S 6877184 inotifywait
13073 1 0% 0% 0% S 67039232 rotee
13015 1 0% 0% 0% S 21729280 pvp.sh
13006 12770 0% 0% 0% S 6877184 inotifywait
13003 12774 0% 0% 0% S 6877184 inotifywait
12984 1 0% 0% 0% S 66916352 rotee
12983 1 0% 0% 0% S 67039232 rotee
12774 1 0% 0% 0% S 23920640 psvp.sh
12771 1 0% 0% 0% S 15577088 xinetd
12770 1 0% 0% 0% S 22237184 rollback_timer.
12768 1 0% 0% 0% S 15577088 xinetd
11606 1 0% 0% 0% S 15577088 xinetd
11599 2 0% 0% 0% S 0 kworker/1:2
11592 1 0% 0% 0% S 15577088 xinetd
11169 2 0% 0% 0% S 0 kworker/u16:2
10310 1 0% 0% 0% S 4685824 acpid
9577 9526 0% 0% 0% S 19062784 iodbd.sh
9526 1 0% 0% 0% T 18931712 iodbd.sh
9384 2 0% 0% 0% S 0 ena
9151 7688 0% 0% 0% S 6877184 inotifywait
9013 7693 0% 0% 0% S 6877184 inotifywait
8898 2 0% 0% 0% S 0 loop1
8884 1 0% 0% 0% S 67379200 rotee
8854 1 0% 0% 0% S 66916352 rotee
8693 8386 0% 0% 0% S 6877184 inotifywait
8669 1 0% 0% 0% S 66916352 rotee
8514 1 0% 0% 0% S 66916352 rotee
8386 1 0% 0% 0% S 20361216 iptbl.sh
8059 7687 0% 0% 0% S 4669440 sleep
7903 1 0% 0% 0% S 66916352 rotee
7846 1 0% 0% 0% S 15577088 xinetd
7714 7699 0% 0% 0% S 279855104 libvirtd
7710 1 0% 0% 0% S 16031744 rpc.statd
7699 1 0% 0% 0% S 18661376 libvirtd.sh
7694 1 0% 0% 0% S 32645120 rpcbind
7693 1 0% 0% 0% S 21573632 droputil.sh
7692 1 0% 0% 0% S 85868544 bhytoolsd
7691 1 0% 0% 0% S 49127424 virtlogd
7688 1 0% 0% 0% S 21569536 reflector.sh
7687 1 0% 0% 0% S 19202048 oom.sh
7365 2 0% 0% 0% S 0 lsmpi-rx
7364 2 0% 0% 0% S 0 lsmpi-xmit
7363 2 0% 0% 0% S 0 lsmpi-refill
5096 2 0% 0% 0% S 0 loop0
4617 2 0% 0% 0% S 0 bioset
4616 2 0% 0% 0% S 0 dmcrypt_write
4615 2 0% 0% 0% S 0 kcryptd
4614 2 0% 0% 0% S 0 kcryptd_io
4612 2 0% 0% 0% S 0 bioset
4611 2 0% 0% 0% S 0 kdmflush
4600 2 0% 0% 0% S 0 bioset
4599 2 0% 0% 0% S 0 dmcrypt_write
4598 2 0% 0% 0% S 0 kcryptd
4597 2 0% 0% 0% S 0 kcryptd_io
4596 2 0% 0% 0% S 0 bioset
4595 2 0% 0% 0% S 0 kdmflush
4583 2 0% 0% 0% S 0 bioset
4582 2 0% 0% 0% S 0 dmcrypt_write
4581 2 0% 0% 0% S 0 kcryptd
4580 2 0% 0% 0% S 0 kcryptd_io
4579 2 0% 0% 0% S 0 bioset
4578 2 0% 0% 0% S 0 kdmflush
4566 2 0% 0% 0% S 0 bioset
4565 2 0% 0% 0% S 0 dmcrypt_write
4564 2 0% 0% 0% S 0 kcryptd
4563 2 0% 0% 0% S 0 kcryptd_io
4562 2 0% 0% 0% S 0 bioset
4561 2 0% 0% 0% S 0 kdmflush
4549 2 0% 0% 0% S 0 bioset
4547 2 0% 0% 0% S 0 dmcrypt_write
4546 2 0% 0% 0% S 0 kcryptd
4545 2 0% 0% 0% S 0 kcryptd_io
4544 2 0% 0% 0% S 0 bioset
4543 2 0% 0% 0% S 0 kdmflush
4419 2 0% 0% 0% S 0 kworker/1:1H
4392 2 0% 0% 0% S 0 kworker/3:1H
4352 2 0% 0% 0% S 0 kworker/2:1H
4300 2 0% 0% 0% S 0 kworker/5:1H
4299 2 0% 0% 0% S 0 kworker/7:1H
4291 2 0% 0% 0% S 0 kworker/0:2
4281 2 0% 0% 0% S 0 kworker/4:1H
4268 2 0% 0% 0% S 0 kworker/6:2
4265 2 0% 0% 0% S 0 kworker/0:1H
4244 2 0% 0% 0% S 0 kworker/6:1H
4177 2 0% 0% 0% S 0 kworker/1:1
4163 2 0% 0% 0% S 0 kworker/4:2
4157 2 0% 0% 0% S 0 bioset
4134 2 0% 0% 0% S 0 bioset
4129 2 0% 0% 0% S 0 scsi_tmf_2
4128 2 0% 0% 0% S 0 scsi_eh_2
4124 2 0% 0% 0% S 0 mpt/0
4115 2 0% 0% 0% S 0 mpt_poll_0
4106 2 0% 0% 0% S 0 scsi_tmf_1
4105 2 0% 0% 0% S 0 scsi_eh_1
4065 2 0% 0% 0% S 0 scsi_tmf_0
4058 2 0% 0% 0% S 0 scsi_eh_0
2837 9577 0% 0% 0% S 4669440 sleep
2785 16338 0% 0% 0% S 4677632 sleep
2442 1 0% 0% 0% S 35622912 systemd-udevd
2440 2 0% 0% 0% S 0 kworker/2:2
2207 2 0% 0% 0% S 0 kauditd
2179 2 0% 0% 0% S 0 kworker/3:1
2174 1 0% 0% 0% S 26828800 systemd-journal
2170 2 0% 0% 0% S 0 deferwq
2163 2 0% 0% 0% S 0 kworker/7:2
2152 2 0% 0% 0% S 0 ipv6_addrconf
2112 2 0% 0% 0% S 0 dm_bufio_cache
2030 2 0% 0% 0% S 0 bioset
2029 2 0% 0% 0% S 0 bioset
2028 2 0% 0% 0% S 0 bioset
2027 2 0% 0% 0% S 0 bioset
2026 2 0% 0% 0% S 0 bioset
2025 2 0% 0% 0% S 0 bioset
2024 2 0% 0% 0% S 0 bioset
2023 2 0% 0% 0% S 0 bioset
2022 2 0% 0% 0% S 0 bioset
2021 2 0% 0% 0% S 0 bioset
2020 2 0% 0% 0% S 0 bioset
2019 2 0% 0% 0% S 0 bioset
2018 2 0% 0% 0% S 0 bioset
2017 2 0% 0% 0% S 0 bioset
2016 2 0% 0% 0% S 0 bioset
2015 2 0% 0% 0% S 0 bioset
2012 2 0% 0% 0% S 0 bioset
2009 2 0% 0% 0% S 0 bioset
2006 2 0% 0% 0% S 0 bioset
2003 2 0% 0% 0% S 0 bioset
2000 2 0% 0% 0% S 0 bioset
1997 2 0% 0% 0% S 0 bioset
1994 2 0% 0% 0% S 0 bioset
1991 2 0% 0% 0% S 0 bioset
1988 2 0% 0% 0% S 0 bioset
1985 2 0% 0% 0% S 0 bioset
1982 2 0% 0% 0% S 0 bioset
1979 2 0% 0% 0% S 0 bioset
1976 2 0% 0% 0% S 0 bioset
1973 2 0% 0% 0% S 0 bioset
1970 2 0% 0% 0% S 0 bioset
1967 2 0% 0% 0% S 0 bioset
1964 2 0% 0% 0% S 0 bioset
1961 2 0% 0% 0% S 0 bioset
1958 2 0% 0% 0% S 0 bioset
1955 2 0% 0% 0% S 0 bioset
1952 2 0% 0% 0% S 0 bioset
1949 2 0% 0% 0% S 0 bioset
1946 2 0% 0% 0% S 0 bioset
1943 2 0% 0% 0% S 0 bioset
1940 2 0% 0% 0% S 0 bioset
1937 2 0% 0% 0% S 0 bioset
1934 2 0% 0% 0% S 0 bioset
1931 2 0% 0% 0% S 0 bioset
1928 2 0% 0% 0% S 0 bioset
1925 2 0% 0% 0% S 0 bioset
1922 2 0% 0% 0% S 0 bioset
1919 2 0% 0% 0% S 0 bioset
1916 2 0% 0% 0% S 0 bioset
1913 2 0% 0% 0% S 0 bioset
1910 2 0% 0% 0% S 0 bioset
1907 2 0% 0% 0% S 0 bioset
1904 2 0% 0% 0% S 0 bioset
1901 2 0% 0% 0% S 0 bioset
1898 2 0% 0% 0% S 0 bioset
1895 2 0% 0% 0% S 0 bioset
1892 2 0% 0% 0% S 0 bioset
1889 2 0% 0% 0% S 0 bioset
1886 2 0% 0% 0% S 0 bioset
1883 2 0% 0% 0% S 0 bioset
1880 2 0% 0% 0% S 0 bioset
1877 2 0% 0% 0% S 0 bioset
1874 2 0% 0% 0% S 0 bioset
1871 2 0% 0% 0% S 0 bioset
1868 2 0% 0% 0% S 0 bioset
1865 2 0% 0% 0% S 0 bioset
1862 2 0% 0% 0% S 0 bioset
1859 2 0% 0% 0% S 0 bioset
1856 2 0% 0% 0% S 0 bioset
1853 2 0% 0% 0% S 0 bioset
1850 2 0% 0% 0% S 0 bioset
1847 2 0% 0% 0% S 0 bioset
1844 2 0% 0% 0% S 0 bioset
1841 2 0% 0% 0% S 0 bioset
1838 2 0% 0% 0% S 0 bioset
1836 2 0% 0% 0% S 0 kworker/7:1
1834 2 0% 0% 0% S 0 bioset
1831 2 0% 0% 0% S 0 bioset
1828 2 0% 0% 0% S 0 bioset
1825 2 0% 0% 0% S 0 bioset
1822 2 0% 0% 0% S 0 bioset
1788 2 0% 0% 0% S 0 bioset
1787 2 0% 0% 0% S 0 bioset
1786 2 0% 0% 0% S 0 bioset
1785 2 0% 0% 0% S 0 bioset
1784 2 0% 0% 0% S 0 bioset
1783 2 0% 0% 0% S 0 bioset
1782 2 0% 0% 0% S 0 bioset
1781 2 0% 0% 0% S 0 bioset
1780 2 0% 0% 0% S 0 bioset
1779 2 0% 0% 0% S 0 bioset
1778 2 0% 0% 0% S 0 bioset
1777 2 0% 0% 0% S 0 bioset
1776 2 0% 0% 0% S 0 bioset
1775 2 0% 0% 0% S 0 bioset
1774 2 0% 0% 0% S 0 bioset
1773 2 0% 0% 0% S 0 bioset
1463 18267 0% 0% 0% S 4677632 sleep
1239 2 0% 0% 0% S 0 acpi_thermal_pm
1229 2 0% 0% 0% S 0 kworker/5:1
1088 2 0% 0% 0% S 0 nfsiod
1071 2 0% 0% 0% S 0 fsnotify_mark
996 2 0% 0% 0% S 0 vmstat
995 2 0% 0% 0% S 0 kswapd0
952 2 0% 0% 0% S 0 kworker/4:1
951 2 0% 0% 0% S 0 kworker/0:1
950 2 0% 0% 0% S 0 rpciod
854 2 0% 0% 0% S 0 md
841 2 0% 0% 0% S 0 ata_sff
302 2 0% 0% 0% S 0 kblockd
300 2 0% 0% 0% S 0 bioset
299 2 0% 0% 0% S 0 crypto
297 2 0% 0% 0% S 0 writeback
296 2 0% 0% 0% S 0 khungtaskd
40 2 0% 0% 0% S 0 perf
39 2 0% 0% 0% S 0 netns
38 2 0% 0% 0% S 0 kdevtmpfs
37 2 0% 0% 0% S 0 kworker/7:0H
35 2 0% 0% 0% S 0 ksoftirqd/7
34 2 0% 0% 0% S 0 migration/7
33 2 0% 0% 0% S 0 kworker/6:0H
32 2 0% 0% 0% S 0 kworker/6:0
31 2 0% 0% 0% S 0 ksoftirqd/6
30 2 0% 0% 0% S 0 migration/6
29 2 0% 0% 0% S 0 kworker/5:0H
28 2 0% 0% 0% S 0 kworker/5:0
27 2 0% 0% 0% S 0 ksoftirqd/5
26 2 0% 0% 0% S 0 migration/5
25 2 0% 0% 0% S 0 kworker/4:0H
23 2 0% 0% 0% S 0 ksoftirqd/4
22 2 0% 0% 0% S 0 migration/4
21 2 0% 0% 0% S 0 kworker/3:0H
20 2 0% 0% 0% S 0 kworker/3:0
19 2 0% 0% 0% S 0 ksoftirqd/3
18 2 0% 0% 0% S 0 migration/3
17 2 0% 0% 0% S 0 kworker/2:0H
16 2 0% 0% 0% S 0 kworker/2:0
15 2 0% 0% 0% S 0 ksoftirqd/2
14 2 0% 0% 0% S 0 migration/2
13 2 0% 0% 0% S 0 kworker/1:0H
11 2 0% 0% 0% S 0 ksoftirqd/1
10 2 0% 0% 0% S 0 migration/1
9 2 0% 0% 0% S 0 migration/0
8 2 0% 0% 0% S 0 rcu_bh
7 2 0% 0% 0% R 0 rcu_sched
5 2 0% 0% 0% S 0 kworker/0:0H
3 2 0% 0% 0% S 0 ksoftirqd/0
2 0 0% 0% 0% S 0 kthreadd
1 0 0% 0% 0% S 40579072 systemd And:
csr1000v# show platform hardware qfp active datapath utilization summary
CPP 0: 5 secs 1 min 5 min 60 min
Input: Total (pps) 60721 54738 55714 8693
(bps) 657633304 587731152 582688120 87551096
Output: Total (pps) 60687 54731 55715 8694
(bps) 632837712 566044688 561997504 84602048
Processing: Load (pct) 99 92 91 14
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-18-2019 06:52 PM
Hello,
post the full running configuration of your router...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-22-2019 06:28 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-23-2019 12:45 AM
Hello,
you have a lot of ACL logging configured. Everything that is logged gets punted to the CPU and is process switched, that could explain the high CPU. I have marked all the 'log' keywords (in bold) in your configuration. try and remove these and check if that makes a difference. Also, the IP SLA tracking seems redundant, since there is nothing configured that can be tracked, so you might want to remove these lines as well...
version 16.9
service timestamps debug datetime localtime show-timezone
service timestamps log datetime localtime show-timezone
platform qfp utilization monitor load 80
no platform punt-keepalive disable-kernel-core
platform console virtual
!
hostname csr1000v
!
boot-start-marker
boot-end-marker
!
logging buffered 256000
logging console critical
enable secret <secret>
!
aaa new-model
!
aaa authentication login default local
aaa authentication login CONSOLE local
aaa authorization console
!
aaa session-id common
clock timezone
!
no ip domain lookup
ip admission watch-list expiry-time 0
!
subscriber templating
!
multilink bundle-name authenticated
!
object-group network hub.spoke.int
<hidden>
!
redundancy
!
--> no track 10 ip sla 10 reachability
delay down 60 up 60
!
--> no track 20 ip sla 20 reachability
delay down 60 up 60
!
crypto isakmp policy 10
encr 3des
authentication pre-share
group 5
lifetime 3600
crypto isakmp key <key> address 0.0.0.0
crypto isakmp invalid-spi-recovery
crypto isakmp keepalive 15 periodic
!
crypto ipsec transform-set DMVPN-TS esp-3des esp-sha-hmac
mode tunnel
crypto ipsec transform-set DMVPN-MTRANS esp-3des esp-sha-hmac
mode transport
crypto ipsec transform-set DMVPN-TS esp-3des esp-sha-hmac
mode transport
crypto ipsec transform-set GRE-AES-TEST esp-aes 256 esp-sha-hmac
mode transport
!
crypto ipsec profile AES-TEST
set transform-set GRE-AES-TEST
set pfs group2
!
crypto ipsec profile DMVPN-PROFILE
set transform-set DMVPN-TS
set pfs group5
!
crypto ipsec profile DMVPN-TUN
set transform-set DMVPN-TS
set pfs group5
!
crypto ipsec profile DMVPN-TR
set transform-set DMVPN-MTRANS
set pfs group5
!
interface Tunnel35
description [BKP] DMVPN
bandwidth 10000
ip address 10.35.101.229 255.255.252.0
no ip redirects
ip mtu 1396
ip nhrp authentication VLx18
ip nhrp network-id 35
ip nhrp nhs 10.35.100.1 nbma 9.9.9.9 multicast
ip tcp adjust-mss 1356
delay 1100
tunnel source GigabitEthernet4
tunnel mode gre multipoint
tunnel key 35
tunnel path-mtu-discovery
tunnel protection ipsec profile DMVPN-TR shared
!
interface Tunnel36
description [PRI] DMVPN
bandwidth 10000
ip address 10.36.101.229 255.255.252.0
no ip redirects
ip mtu 1396
ip nhrp authentication VLx18
ip nhrp network-id 36
ip nhrp nhs 10.36.100.1 nbma 11.11.11.11 multicast
ip tcp adjust-mss 1356
delay 1000
tunnel source GigabitEthernet4
tunnel mode gre multipoint
tunnel key 36
tunnel path-mtu-discovery
tunnel protection ipsec profile DMVPN-TR shared
!
interface Tunnel188
description [PRI]
bandwidth 10000
ip address 10.188.100.229 255.255.252.0
no ip redirects
ip mtu 1396
ip bandwidth-percent eigrp 1 100
ip nhrp authentication 18dm
ip nhrp map 10.188.100.1 12.12.12.12
ip nhrp map multicast 12.12.12.12
ip nhrp network-id 188
ip nhrp nhs 10.188.100.1
ip tcp adjust-mss 1356
delay 1000
tunnel source GigabitEthernet4
tunnel mode gre multipoint
tunnel key 188
tunnel path-mtu-discovery
tunnel protection ipsec profile DMVPN-TR shared
ip virtual-reassembly
!
interface Tunnel189
description [PRI] DMVPN
bandwidth 10000
ip address 10.189.200.229 255.255.252.0
no ip redirects
ip mtu 1396
ip bandwidth-percent eigrp 1 100
ip nhrp authentication x18dm
ip nhrp map 10.189.200.1 13.13.13.13
ip nhrp map multicast 13.13.13.13
ip nhrp network-id 189
ip nhrp nhs 10.189.200.1
ip tcp adjust-mss 1356
delay 1050
shutdown
tunnel mode gre multipoint
tunnel key 189
tunnel path-mtu-discovery
tunnel protection ipsec profile DMVPN-TR shared
!
interface GigabitEthernet2
description Link Servers network [172.17.16.1]
ip address 172.17.16.1 255.255.255.0
ip nat inside
negotiation auto
!
interface GigabitEthernet3
ip address 172.17.17.1 255.255.255.0
ip nat outside
negotiation auto
!
interface GigabitEthernet4
description -- ISP-1 Optical, 1000 Mbps --
ip address 4.4.4.2 255.255.255.252
no ip redirects
no ip proxy-arp
ip nat outside
ip access-group 111 in
ip access-group 121 out
ip tcp adjust-mss 1360
load-interval 30
negotiation auto
!
router eigrp 1
network 10.188.0.0 0.0.255.255
network 10.189.0.0 0.0.255.255
network 172.17.16.0 0.0.0.255
offset-list TmpWorseRoute in 300000
passive-interface default
no passive-interface Tunnel188
no passive-interface Tunnel189
eigrp stub connected summary
!
router eigrp 3
network 10.35.0.0 0.0.255.255
network 10.36.0.0 0.0.255.255
network 172.17.16.0 0.0.0.255
network 172.17.17.0 0.0.0.255
passive-interface default
no passive-interface Tunnel36
no passive-interface Tunnel35
!
router eigrp 81
network 10.32.81.0 0.0.0.3
network 172.17.16.0 0.0.0.255
passive-interface default
eigrp stub connected summary
!
ip nat inside source route-map MATCH-ISP1-NAT interface GigabitEthernet4 overload
ip forward-protocol nd
no ip http server
no ip http secure-server
ip route 0.0.0.0 0.0.0.0 GigabitEthernet4 4.4.4.1 100
!
ip access-list standard TmpWorseRoute
permit 172.20.20.0 0.0.0.255
ip access-list standard acl-mgmt
permit <our mgmt networks>
--> no deny any log
ip access-list standard acl-snmp
permit 172.21.79.142
permit 172.21.79.80
permit 172.21.1.101
--> no deny any log
ip access-list standard no-redisrt-eigrp
permit 172.18.0.0 0.0.255.255
permit 172.21.0.0 0.0.255.255
deny any
!
<some DMZ access-lists>
!
logging trap notifications
logging host 172.21.79.142
access-list 105 deny ip 10.0.0.0 0.255.255.255 10.0.0.0 0.255.255.255
access-list 105 deny ip 192.168.0.0 0.0.255.255 192.168.0.0 0.0.255.255
access-list 105 deny ip 172.16.0.0 0.15.255.255 172.16.0.0 0.15.255.255
access-list 105 permit ip host 172.17.16.13 host <our public host>
access-list 105 permit ip host 172.17.16.10 host <our public host>
access-list 105 permit ip host 172.17.16.10 host <our public host>
access-list 105 permit ip host 172.17.16.13 host <our public host>
access-list 105 permit ip host 172.17.16.11 host <our public host>
access-list 105 permit ip host 172.17.16.10 host <our public host>
access-list 105 permit ip host 172.17.16.13 host <our public host>
access-list 105 deny ip any any
access-list 111 permit icmp any any
access-list 111 permit udp any eq isakmp any eq isakmp
access-list 111 permit udp any eq non500-isakmp any eq non500-isakmp
access-list 111 permit udp any eq ntp any eq ntp
access-list 111 permit tcp any any established
access-list 111 permit ip host <our public host> any
access-list 111 permit ip host <our public host> any
access-list 111 permit ip host <our public host> any
access-list 111 permit ip <our public host> any
access-list 111 permit ip host <our public host> any
access-list 111 permit ip host <our public host> any
access-list 111 permit ip host <our public host> any
access-list 111 permit ip host <our public host> any
access-list 111 permit ip host <our public host> any
access-list 111 permit ip host <our public host> any
access-list 111 permit ip object-group hub.spoke.int any
access-list 111 permit gre host <our public host> host <our ext ip>
access-list 111 deny ip 10.0.0.0 0.255.255.255 any log
access-list 111 deny ip 172.16.0.0 0.15.255.255 any log
access-list 111 deny ip 192.168.0.0 0.0.255.255 any log
access-list 111 deny udp any eq ntp any log
access-list 111 deny ip any host 255.255.255.255
access-list 111 deny ip any any
access-list 112 permit ip host <our public host> any
access-list 112 permit ip host <our public host> any
access-list 121 permit icmp any any
access-list 121 deny ip host 0.0.0.0 any log
access-list 121 deny ip 127.0.0.0 0.255.255.255 any log
access-list 121 deny ip 10.0.0.0 0.255.255.255 any log
access-list 121 deny ip 172.16.0.0 0.15.255.255 host 172.30.165.255
access-list 121 deny ip 172.16.0.0 0.15.255.255 any log
access-list 121 deny ip 192.168.0.0 0.0.255.255 any log
access-list 121 deny ip 169.254.0.0 0.0.255.255 any log
access-list 121 deny ip 192.0.2.0 0.0.0.255 any log
access-list 121 deny ip 224.0.0.0 15.255.255.255 any log
access-list 121 deny ip 240.0.0.0 15.255.255.255 any log
access-list 121 permit ip any any
!
route-map MATCH-ISP1-NAT permit 10
match ip address 105
!
snmp-server community <our_ro_community> RO acl-snmp
snmp ifmib ifindex persist
!
control-plane
!
line con 0
exec-timeout 5 0
logging synchronous
login authentication CONSOLE
stopbits 1
line vty 0
access-class acl-mgmt in
exec-timeout 0 0
transport input all
line vty 1 4
access-class acl-mgmt in
exec-timeout 0 0
length 0
transport input all
line vty 5 15
access-class acl-mgmt in
exec-timeout 0 0
length 0
transport input all
!
--> no ntp logging
ntp server 172.21.66.11
ntp server 172.21.65.11
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-23-2019 07:55 PM
Thank you for your reply, but I think this is no right way: CPU usage is so high when there is traffic in tunnels with crypto, and is near zero when there is no traffic in tunnels. Fortunately no one floods our router with prohibitted traffic ;)
Thank you
With best regards,
Sergey Kanovskiy.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-23-2019 11:54 PM
Hello,
looking at your original post again:
--> Our problem is low network throughput with DMVPN + IPSEC tunnels. I didn't saw network speed more than 650 mbit\sec and the CPU usage in that situation is full:
--> Network speed become ~750 mbit/sec if I remove crypto and send packets with 1350 bytes length.
You are talking about a 13 percent drop in throughput for IPSec traffic. That by itself is pretty much to be expected. Are the users experiencing any problems with delays or drops ?
The only other thing I noticed is that one of your tunnels has 'virtual-reassembly' enabled, you might want to try and turn that off...
interface Tunnel188
description [PRI]
bandwidth 10000
ip address 10.188.100.229 255.255.252.0
no ip redirects
ip mtu 1396
ip bandwidth-percent eigrp 1 100
ip nhrp authentication 18dm
ip nhrp map 10.188.100.1 12.12.12.12
ip nhrp map multicast 12.12.12.12
ip nhrp network-id 188
ip nhrp nhs 10.188.100.1
ip tcp adjust-mss 1356
delay 1000
tunnel source GigabitEthernet4
tunnel mode gre multipoint
tunnel key 188
tunnel path-mtu-discovery
tunnel protection ipsec profile DMVPN-TR shared
--> no ip virtual-reassembly
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-24-2019 01:06 AM
All of applications are using tcp protocol and have no loose of packets, but delays increases by 3-4 msec when throughput reaches 650-670 Mbit/sec.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-24-2019 05:48 AM
Hello,
how do you notice these delays ? 3 or 4 msecs would only ne noticeable in real time traffic such as voice and video, I guess. You could consider implementing some sort of QoS to prioritize sensitive traffic, is that an option ?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-18-2019 06:37 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-28-2020 02:08 AM
Thank you for your reply.
What does this process do? "ucode_pkt_PPE0"
With best regards, Sergey.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-28-2020 07:15 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-17-2020 04:12 AM
Hi Sergey!
Have you found a solution?
Regards,
Aleksandr Roldugin
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-07-2021 03:28 AM
Hello, did you foun any sollution for this problem?
Thank you
Jiri
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide