Cisco ASR 1001-X IP Input high CPU utilization

bekarys · ‎09-19-2023

Hi. We have recently started receiving the following logs from our Cisco ASR 1001-X: Sep 19 14:23:51: %SYS-1-CPURISINGTHRESHOLD: Threshold: Total CPU Utilization(Total/Intr): 82%/35%, Top 3 processes(Pid/Util): 221/32%, 137/19%, 354/0%. At different times, different loads, but about 80%.

the command show processes cpu sorted | e 0.00 shows:

ala-dostyk-pe-0301#show processes cpu sorted | e 0.00
Load for five secs: 79%/34%; one minute: 80%; five minutes: 78%
Time source is NTP, 14:24:50.744 ALA Tue Sep 19 2023

CPU utilization for five seconds: 79%/34%; one minute: 80%; five minutes: 78%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
221 48118737 386412209 124 32.23% 33.20% 32.06% 0 IP Input
137 25678157 526365230 48 16.39% 17.23% 17.08% 0 IOSXE-RP Punt Se
694 34 135 251 0.15% 0.04% 0.01% 3 SSH Process
710 118720 36802487 3 0.07% 0.08% 0.07% 0 IP SLAs XOS Even
713 90028 414475 217 0.07% 0.05% 0.07% 0 SNMP ENGINE
238 61200 2634074 23 0.07% 0.03% 0.03% 0 Spanning Tree
711 51939 738661 70 0.07% 0.04% 0.02% 0 IP SNMP
88 204103 553797 368 0.07% 0.13% 0.14% 0 IOSD ipc task
15 41234 406617 101 0.07% 0.02% 0.02% 0 ARP Input

This command only shows processes inside the IOS daemon.
Please use 'show processes cpu platform sorted'
to show processes from the underlying operating system.

we have a IOS-XE 17.9.3a version now.

can you help solve the problem?

Leo Laohoo · ‎09-19-2023

The next time that error message comes out, post the complete output to the following commands:

sh platform resources
sh platform software status conn brief

bekarys · ‎09-19-2023

ala-dostyk-pe-0301# show platform resources
Load for five secs: 80%/34%; one minute: 75%; five minutes: 76%
Time source is NTP, 15:52:12.842 ALA Tue Sep 19 2023
**State Acronym: H - Healthy, W - Warning, C - Critical
Resource Usage Max Warning Critical State

RP0 (ok, active) H
Control Processor 14.74% 100% 80% 90% H
DRAM 2852MB(36%) 7782MB 88% 93% H
bootflash 3685MB(58%) 6338MB 88% 93% H
harddisk 0MB(0%) 0MB 88% 93% H
ESP0(ok, active) H
QFP H
TCAM 10cells(0%) 131072cells 65% 85% H
DRAM 434479KB(11%) 3670016KB 85% 95% H
IRAM 13525KB(10%) 131072KB 85% 95% H
CPU Utilization 7.00% 100% 90% 95% H
Crypto Utilization 3.00% 100% 90% 95% H

Pkt Buf Mem (0) 67KB(0%) 524288KB 85% 95% H

ala-dostyk-pe-0301#show platform software status control-processor brief
Load for five secs: 80%/33%; one minute: 78%; five minutes: 77%
Time source is NTP, 15:52:47.578 ALA Tue Sep 19 2023
Load Average
Slot Status 1-Min 5-Min 15-Min
RP0 Healthy 1.50 1.47 1.43

Memory (kB)
Slot Status Total Used (Pct) Free (Pct) Committed (Pct)
RP0 Healthy 7969636 2927456 (37%) 5042180 (63%) 5951320 (75%)

CPU Utilization
Slot CPU User System Nice Idle IRQ SIRQ IOwait
RP0 0 13.10 4.00 0.00 82.90 0.00 0.00 0.00
1 2.70 6.30 0.00 76.40 0.00 14.60 0.00
2 11.91 5.30 0.00 82.78 0.00 0.00 0.00
3 4.90 1.60 0.00 93.50 0.00 0.00 0.00
4 7.30 4.10 0.00 88.60 0.00 0.00 0.00
5 16.98 7.79 0.00 75.22 0.00 0.00 0.00
6 10.18 5.09 0.00 84.71 0.00 0.00 0.00
7 4.29 4.09 0.00 91.60 0.00 0.00 0.00

----------------------------------------------------------------------------------------------------

Leo Laohoo · ‎09-19-2023

@bekarys wrote:
221 48118737 386412209 124 32.23% 33.20% 32.06% 0 IP Input

Post the complete output to the command "sh interface <WAN LINK>".

bekarys · ‎09-19-2023

ala-dostyk-pe-0301# show interfaces TenGigabitEthernet 0/0/1
Load for five secs: 76%/33%; one minute: 77%; five minutes: 77%
Time source is NTP, 16:03:56.054 ALA Tue Sep 19 2023

TenGigabitEthernet0/0/1 is up, line protocol is up
Hardware is BUILT-IN-2T+6X1GE, address is 7069.5a57.9d81 (bia 7069.5a57.9d81)
Description: #UPLINK#ala-dostyk-sr-0301:Te1/15#
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 7/255, rxload 5/255
Encapsulation 802.1Q Virtual LAN, Vlan ID 1., loopback not set
Keepalive not supported
Full Duplex, 10000Mbps, link type is force-up, media type is 10GBase-SR
output flow-control is on, input flow-control is on
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/375/0/14737 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
30 second input rate 200455000 bits/sec, 46064 packets/sec
30 second output rate 280909000 bits/sec, 45207 packets/sec
3383668425 packets input, 1804539040690 bytes, 0 no buffer
Received 125 broadcasts (0 IP multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 159910 multicast, 0 pause input
3654872952 packets output, 2913441363674 bytes, 0 underruns
Output 17 broadcasts (0 IP multicasts)
0 output errors, 0 collisions, 2 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
3 carrier transitions

ala-dostyk-pe-0301# show interfaces TenGigabitEthernet 0/0/1.305
Load for five secs: 74%/30%; one minute: 78%; five minutes: 78%
Time source is NTP, 16:03:22.784 ALA Tue Sep 19 2023

TenGigabitEthernet0/0/1.305 is up, line protocol is up
Hardware is BUILT-IN-2T+6X1GE, address is 7069.5a57.9d81 (bia 7069.5a57.9d81)
Description: BGP_Upstream_Transtelecom
Internet address is
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 5/255, rxload 4/255
Encapsulation 802.1Q Virtual LAN, Vlan ID 305.
ARP type: ARPA, ARP Timeout 04:00:00
Keepalive not supported
Last clearing of "show interface" counters never

We have a bgp connection with upstream provider