08-10-2015 02:57 AM - edited 03-08-2019 01:18 AM
Good Morning All,
Am currently looking into high cpu figures on one of our 3850 switches the model is WS-C3850-24P running 03.02.03.SE. we had an alert through for a sustained period of high cpu usage, upon investigation we observed the following.
#sh proc cpu sort | e 0.00 Core 0: CPU utilization for five seconds: 58%; one minute: 59%; five minutes: 67% Core 1: CPU utilization for five seconds: 99%; one minute: 81%; five minutes: 75% Core 2: CPU utilization for five seconds: 66%; one minute: 80%; five minutes: 83% Core 3: CPU utilization for five seconds: 100%; one minute: 99%; five minutes: 97% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 5624 2479771 22418540 822 79.54 78.61 78.64 1088 fed 9218 3942324 28163912 175 0.88 0.95 1.38 0 iosd 5625 3917259 26073687 19 0.15 0.13 0.14 0 platform_mgr 6288 3640666 78478057 1195 0.15 0.15 0.15 0 cpumemd 5319 2506952 77021906 88 0.10 0.02 0.03 0 system_mgr 5626 2054673 55371158 42 0.05 0.05 0.05 0 stack-mgr 6118 2523710 31051664 81 0.05 0.02 0.05 0 idope.py 6274 955400 63186867 15 0.05 0.01 0.03 0 system_mgr_cli 6277 3283605 25505456 29 0.05 0.03 0.04 0 pdsd 6282 2035562 77003566 82 0.05 0.01 0.03 0 mem_mgmt
Obviously the fed process seems to be the culprit, upon further probing this was the result
#sh processes cpu detailed process fed sorted 1min | e 0.00 Core 0: CPU utilization for five seconds: 78%; one minute: 82%; five minutes: 78% Core 1: CPU utilization for five seconds: 44%; one minute: 73%; five minutes: 74% Core 2: CPU utilization for five seconds: 99%; one minute: 96%; five minutes: 89% Core 3: CPU utilization for five seconds: 99%; one minute: 72%; five minutes: 83% PID T C TID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process (%) (%) (%) 5624 L 3921121 2242961 822 78.75 79.03 78.96 1088 fed 5624 L 3 9868 2867420 1477756 0 24.85 24.75 24.75 0 Replenish 5624 L 2 9870 1259297 1585013 0 24.80 24.74 24.73 0 PunjectRx 5624 L 0 6081 2246478 3162559 0 23.72 23.80 23.74 0 fed-ots-nfl 5624 L 0 6065 2252465 5139954 0 4.63 5.19 5.21 1088 fed 5624 L 1 6078 1504013 3270667 0 0.34 0.22 0.21 0 fed-ots-main 5624 L 1 9851 4077914 3650293 0 0.25 0.20 0.20 0 Xcvr 5624 L 1 6085 2344196 6685688 0 0.15 0.04 0.05 0 Timer
I tried Google to find out what the Replenish, PunjectRx and fed-ots-main are or likely causes but didn't really find anything. Does anyone know what function these process control or a likely cause?
Thanks in advance
Wes
08-10-2015 05:34 AM
Hi this explains FED an iosd
http://www.cisco.com/c/en/us/support/docs/switches/catalyst-3850-series-switches/117594-technote-hicpu3850-00.html
Forwarding Engine Driver (FED): This is the heart of the Cisco Catalyst 3850 Series Switch and is responsible for all hardware programming/forwarding.
IOSd: This is the Cisco IOS daemon that runs on the Linux kernel. It is run as a software process within the kernel.
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide