cisco 3650 CPU占用高

[小斌]

C3650#show processes cpu sorted 5sec
Core 0: CPU utilization for five seconds: 44%; one minute: 82%; five minutes: 86%
Core 1: CPU utilization for five seconds: 99%; one minute: 99%; five minutes: 98%
Core 2: CPU utilization for five seconds: 74%; one minute: 69%; five minutes: 68%
Core 3: CPU utilization for five seconds: 86%; one minute: 58%; five minutes: 56%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
6016 2280181 16406913 1192 75.04 75.10 75.23 1088 fed
11272 4202201 18586860 126 0.78 1.73 1.71 0 iosd
C3650#show controllers cpu-interface
cpu-queue-frames retrieved dropped invalid hol-block
---------------- --------- ------- ------- ---------
Routing Protocol 89395860 0 0 0
L2 Protocol 11636135 3 0 0
sw forwarding 185946 0 0 0
broadcast 4510262 0 0 0
Forus Traffic 852710119 0 0 0
Forus Resolution 11709218 0 0 0
Wireless q5 0 0 0 0
Wireless q1 0 0 0 0
Wireless q2 0 0 0 0
Wireless q3 0 0 0 0
Wireless q4 0 0 0 0
Learning cache 0 0 0 0
Topology control 1548138408 62 0 0

[Jim—Jin · Accepted solution]

你这个如果业务不是感受到很多的影响话，那么应该是中了一个bug,这个bug需要cisco tac去linux kernal确认。通过升级到推荐的版本应该会解决这个问题，鉴于不知道您的设备是什么型号，所以我也没有办法帮您推荐版本。bug相关链接：https://bst.cloudapps.cisco.com/bugsearch/bug/CSCuz57493/?reffering_site=dumpcr

[小斌]

C3650#show processes cpu detailed process fed sorted | ex 0.0
Core 0: CPU utilization for five seconds: 90%; one minute: 89%; five minutes: 84%
Core 1: CPU utilization for five seconds: 99%; one minute: 93%; five minutes: 79%
Core 2: CPU utilization for five seconds: 75%; one minute: 47%; five minutes: 57%
Core 3: CPU utilization for five seconds: 45%; one minute: 81%; five minutes: 90%
PID T C TID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
(%) (%) (%)
6016 L 561530 1626379 1190 75.09 75.21 75.24 1088 fed
6016 L 1 10971 354955 1348035 0 24.67 24.73 24.71 0 PunjectRx
6016 L 2 6463 898878 1267875 0 24.62 24.67 24.65 1088 fed-ots-main
6016 L 0 10962 2224751 3437894 0 22.01 22.10 22.22 0 Xcvr
6016 L 3 11056 2885870 2510229 0 2.70 2.64 2.54 0 XcvrPoll
6016 L 3 6466 3436949 5725985 0 0.59 0.55 0.54 0 fed-ots-nfl
6016 L 3 6470 1365531 1959929 0 0.29 0.25 0.28 0 Timer
6016 L 3 10972 3102538 1078695 0 0.15 0.15 0.17 0 PunjectTx
这是不是3650的软件Bug，版本号：IOS-XE Version 03.07.01E (CAT3K_CAA-UNIVERSALK9-M)

[小斌]

C3650#show ip traffic
IP statistics:
Rcvd: 1840920518 total, 913396876 local destination
0 format errors, 0 checksum errors, 91012832 bad hop count
0 unknown protocol, 0 not a gateway
0 security failures, 0 bad options, 166618525 with options
Opts: 0 end, 0 nop, 0 basic security, 0 loose source route
0 timestamp, 0 extended security, 0 record route
0 stream ID, 0 strict source route, 166618525 alert, 0 cipso, 0 ump
0 other
Frags: 0 reassembled, 0 timeouts, 0 couldn't reassemble
0 fragmented, 0 couldn't fragment
Bcast: 7558268 received, 0 sent
Mcast: 68474143 received, 27728111 sent
Sent: 868991171 generated, 328497601 forwarded
Drop: 88 encapsulation failed, 0 unresolved, 184775 no adjacency
120362 no route, 0 unicast RPF, 0 forced drop
0 options denied, 0 source IP address zero
ICMP statistics:
Rcvd: 0 format errors, 0 checksum errors, 0 redirects, 3363 unreachable
2577088 echo, 507 echo reply, 0 mask requests, 0 mask replies, 0 quench
0 parameter, 0 timestamp, 0 info request, 0 other
0 irdp solicitations, 0 irdp advertisements
Sent: 0 redirects, 201645 unreachable, 627 echo, 2577088 echo reply
0 mask requests, 0 mask replies, 0 quench, 0 timestamp
0 info reply, 857 time exceeded, 0 parameter problem
0 irdp solicitations, 0 irdp advertisements
PIMv2 statistics: Sent/Received
Total: 0/0, 0 checksum errors, 0 format errors
Registers: 0/0 (0 non-rp, 0 non-sm-group), Register Stops: 0/0, Hellos: 0/0
Join/Prunes: 0/0, Asserts: 0/0, grafts: 0/0
Bootstraps: 0/0, Candidate_RP_Advertisements: 0/0
Queue drops: 0
State-Refresh: 0/0
IGMP statistics: Sent/Received
Total: 0/0, Format errors: 0/0, Checksum errors: 0/0
Host Queries: 0/0, Host Reports: 0/0, Host Leaves: 0/0
DVMRP: 0/0, PIM: 0/0
Queue drops: 0
TCP statistics:
Rcvd: 33199 total, 0 checksum errors, 4 no port
Sent: 29941 total
BGP statistics:
Rcvd: 0 total, 0 opens, 0 notifications, 0 updates
0 keepalives, 0 route-refresh, 0 unrecognized
Sent: 0 total, 0 opens, 0 notifications, 0 updates
0 keepalives, 0 route-refresh
EIGRP-IPv4 statistics:
Rcvd: 0 total
Sent: 0 total
UDP statistics:
Rcvd: 842307502 total, 0 checksum errors, 3884137 no port 0 finput
Sent: 838452237 total, 0 forwarded broadcasts
OSPF statistics:
Last clearing of OSPF traffic counters never
Rcvd: 68474664 total, 0 checksum errors
64717957 hello, 193 database desc, 13 link state req
2501712 link state updates, 1254709 link state acks
Sent: 27728823 total
26476413 hello, 219 database desc, 16 link state req
28104 link state updates, 1224117 link state acks
ARP statistics:
Rcvd: 23863910 requests, 121512 replies, 0 reverse, 0 other
Sent: 130987 requests, 23316650 replies (0 proxy), 0 reverse
Drop due to input queue full: 0

[lingyu-cheng]

检查一下STP，有环路

[adu102501]

本帖最后由 adu102501 于 2017-8-17 10:22 编辑

lingyu-cheng 发表于 2017-8-14 16:57
检查一下STP，有环路

您好，想请教一下是如何判断为环路问题
show ip traffic 内的讯息我不太会看
我自己以前是遇过一个 bug 导致 cpu占用高，cpu的占用程度跟楼主的差不多，升版后解决
当时的情形是stack-mgr process异常高

[adu102501]

我自己上网查了一下， bad hop count 的数值过高应该能当判断环路的依据，当TTL为0时，bad hop count 会增加

[jingjian]

https://www.cisco.com/c/en/us/su ... e-hicpu3850-00.html请参考思科关于此问题的处理过程与方法

[小斌]

后来还是升级版本了，问题解决。