Good Morning All,
Am currently looking into high cpu figures on one of our 3850 switches the model is WS-C3850-24P running 03.02.03.SE. we had an alert through for a sustained period of high cpu usage, upon investigation we observed the following.
#sh proc cpu sort | e 0.00
Core 0: CPU utilization for five seconds: 58%; one minute: 59%; five minutes: 67%
Core 1: CPU utilization for five seconds: 99%; one minute: 81%; five minutes: 75%
Core 2: CPU utilization for five seconds: 66%; one minute: 80%; five minutes: 83%
Core 3: CPU utilization for five seconds: 100%; one minute: 99%; five minutes: 97%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
5624 2479771 22418540 822 79.54 78.61 78.64 1088 fed
9218 3942324 28163912 175 0.88 0.95 1.38 0 iosd
5625 3917259 26073687 19 0.15 0.13 0.14 0 platform_mgr
6288 3640666 78478057 1195 0.15 0.15 0.15 0 cpumemd
5319 2506952 77021906 88 0.10 0.02 0.03 0 system_mgr
5626 2054673 55371158 42 0.05 0.05 0.05 0 stack-mgr
6118 2523710 31051664 81 0.05 0.02 0.05 0 idope.py
6274 955400 63186867 15 0.05 0.01 0.03 0 system_mgr_cli
6277 3283605 25505456 29 0.05 0.03 0.04 0 pdsd
6282 2035562 77003566 82 0.05 0.01 0.03 0 mem_mgmt
Obviously the fed process seems to be the culprit, upon further probing this was the result
#sh processes cpu detailed process fed sorted 1min | e 0.00
Core 0: CPU utilization for five seconds: 78%; one minute: 82%; five minutes: 78%
Core 1: CPU utilization for five seconds: 44%; one minute: 73%; five minutes: 74%
Core 2: CPU utilization for five seconds: 99%; one minute: 96%; five minutes: 89%
Core 3: CPU utilization for five seconds: 99%; one minute: 72%; five minutes: 83%
PID T C TID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
(%) (%) (%)
5624 L 3921121 2242961 822 78.75 79.03 78.96 1088 fed
5624 L 3 9868 2867420 1477756 0 24.85 24.75 24.75 0 Replenish
5624 L 2 9870 1259297 1585013 0 24.80 24.74 24.73 0 PunjectRx
5624 L 0 6081 2246478 3162559 0 23.72 23.80 23.74 0 fed-ots-nfl
5624 L 0 6065 2252465 5139954 0 4.63 5.19 5.21 1088 fed
5624 L 1 6078 1504013 3270667 0 0.34 0.22 0.21 0 fed-ots-main
5624 L 1 9851 4077914 3650293 0 0.25 0.20 0.20 0 Xcvr
5624 L 1 6085 2344196 6685688 0 0.15 0.04 0.05 0 Timer
I tried Google to find out what the Replenish, PunjectRx and fed-ots-main are or likely causes but didn't really find anything. Does anyone know what function these process control or a likely cause?
Thanks in advance
Wes
