Cisco 3560-48 port Switch with ISO version 16.3.6 Platform 4 element warning

jorge75medina · ‎04-06-2019

I am getting this error on a 3560 switch I have currently in production: Apr 6 10:28:59: %PLATFORM-4-ELEMENT_WARNING:Switch 1 R0/0: smand: 1/RP/0: 5-Minute Load Average value 5.51 exceeds warning level00

There are several servers, hosts and most importantly a domain controller that is no letting people get group policy, ping times to the domain controller go out the window, and other symptoms. Is the error above a memory leak? Also I was under the impression that this bug was only on earlier version of IOS 16, and this switch has the latest:

SW Version SW Image Mode
------ ----- ----- ---------- ---------- ----
* 1 52 WS-C3650-48PS 16.3.6 CAT3K_CAA-UNIVERSALK9 INSTALL

Please help!!

balaji.bandi · ‎04-06-2019

Cann you post : output of

#show platform software process slot rp active monitor

I have observerd there may be some bug reported 16.3X

BB

***** Rate All Helpful Responses *****

How to Ask The Cisco Community for Help

jorge75medina · ‎04-06-2019

show platform software process slot rp active monitor
top - 12:11:07 up 2 days, 2:50, 0 users, load average: 5.59, 5.60, 5.64
Tasks: 254 total, 5 running, 249 sleeping, 0 stopped, 0 zombie
Cpu(s): 38.7%us, 15.7%sy, 0.0%ni, 45.3%id, 0.0%wa, 0.0%hi, 0.3%si, 0.0%st
Mem: 3959052k total, 2997312k used, 961740k free, 300072k buffers
Swap: 0k total, 0k used, 0k free, 1143476k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
864 root 20 0 1779m 652m 254m R 62 16.9 1590:18 linux_iosd-imag
16296 root 20 0 2421m 300m 134m S 62 7.8 1391:31 fed main event
21675 root 20 0 4268 1612 1020 R 33 0.0 0:00.18 ls
28924 root 20 0 578m 155m 103m S 29 4.0 682:00.81 smd
32116 root 20 0 513m 114m 96m S 25 3.0 565:25.91 fman_rp
27267 root 20 0 604m 119m 93m S 16 3.1 413:06.95 fman_fp_image
21667 root 20 0 3316 1324 912 R 7 0.0 0:00.08 top
27749 root 20 0 248m 58m 47m S 7 1.5 177:33.46 repm
14648 root 20 0 6348 3940 1484 S 4 0.1 11:13.08 btrace_rotate.s
16 root 20 0 0 0 0 S 2 0.0 41:43.75 rcuc/2
21 root 20 0 0 0 0 R 2 0.0 41:45.57 rcuc/3
2248 root 15 -5 0 0 0 S 2 0.0 21:11.31 lsmpi-xmit
2249 root 15 -5 0 0 0 S 2 0.0 17:54.65 lsmpi-rx
1 root 20 0 8300 4352 2184 S 0 0.1 0:14.19 systemd
2 root 20 0 0 0 0 S 0 0.0 0:00.00 kthreadd
3 root 20 0 0 0 0 S 0 0.0 0:05.88 ksoftirqd/0
5 root 0 -20 0 0 0 S 0 0.0 0:00.00 kworker/0:0H
7 root RT 0 0 0 0 S 0 0.0 0:04.43 migration/0
8 root 20 0 0 0 0 S 0 0.0 0:00.00 rcu_bh
9 root 20 0 0 0 0 S 0 0.0 1:54.83 rcu_sched
10 root 20 0 0 0 0 S 0 0.0 3:56.73 rcuc/0
11 root 20 0 0 0 0 S 0 0.0 41:35.36 rcuc/1
12 root RT 0 0 0 0 S 0 0.0 0:04.48 migration/1
13 root 20 0 0 0 0 S 0 0.0 0:08.99 ksoftirqd/1
14 root 20 0 0 0 0 S 0 0.0 0:01.76 kworker/1:0
15 root 0 -20 0 0 0 S 0 0.0 0:00.00 kworker/1:0H
17 root RT 0 0 0 0 S 0 0.0 0:05.08 migration/2
18 root 20 0 0 0 0 S 0 0.0 0:10.50 ksoftirqd/2
20 root 0 -20 0 0 0 S 0 0.0 0:00.00 kworker/2:0H
22 root RT 0 0 0 0 S 0 0.0 0:04.38 migration/3
23 root 20 0 0 0 0 S 0 0.0 0:08.44 ksoftirqd/3
25 root 0 -20 0 0 0 S 0 0.0 0:00.00 kworker/3:0H
26 root 0 -20 0 0 0 S 0 0.0 0:00.00 khelper
27 root 20 0 0 0 0 S 0 0.0 0:00.01 kdevtmpfs
28 root 0 -20 0 0 0 S 0 0.0 0:00.00 netns
29 root -51 0 0 0 0 S 0 0.0 0:00.00 irq/60-octeon-h
30 root -51 0 0 0 0 S 0 0.0 0:00.00 irq/89-octeon-h
31 root -51 0 0 0 0 S 0 0.0 0:00.00 irq/90-octeon-h
32 root -51 0 0 0 0 S 0 0.0 0:00.00 irq/94-octeon-h
33 root -51 0 0 0 0 S 0 0.0 0:00.00 irq/91-octeon-h
34 root -51 0 0 0 0 S 0 0.0 0:00.00 irq/92-octeon-h
35 root -51 0 0 0 0 S 0 0.0 0:00.00 irq/93-octeon-h
36 root -51 0 0 0 0 S 0 0.0 0:00.00 irq/95-octeon-h
37 root -51 0 0 0 0 S 0 0.0 0:00.00 irq/127-octeon-
38 root -51 0 0 0 0 S 0 0.0 0:00.00 irq/96-octeon-h
39 root -51 0 0 0 0 S 0 0.0 0:00.00 irq/98-octeon-h
40 root -51 0 0 0 0 S 0 0.0 0:00.74 irq/99-octeon-h
41 root 0 -20 0 0 0 S 0 0.0 0:00.00 writeback
42 root 0 -20 0 0 0 S 0 0.0 0:00.00 bioset
43 root 0 -20 0 0 0 S 0 0.0 0:00.00 crypto
44 root 0 -20 0 0 0 S 0 0.0 0:00.00 kblockd
45 root 0 -20 0 0 0 S 0 0.0 0:00.00 ata_sff
46 root 20 0 0 0 0 S 0 0.0 0:00.00 khubd
47 root 0 -20 0 0 0 S 0 0.0 0:00.00 md
48 root 0 -20 0 0 0 S 0 0.0 0:00.00 edac-poller
49 root 0 -20 0 0 0 S 0 0.0 0:00.00 rpciod
50 root 20 0 0 0 0 S 0 0.0 0:04.66 kworker/2:1
51 root 20 0 0 0 0 S 0 0.0 0:00.63 kworker/0:1
52 root 20 0 0 0 0 S 0 0.0 0:00.00 kswapd0
53 root 25 5 0 0 0 S 0 0.0 0:00.00 ksmd
54 root 20 0 0 0 0 S 0 0.0 0:00.61 fsnotify_mark
55 root 0 -20 0 0 0 S 0 0.0 0:00.00 nfsiod
62 root 20 0 0 0 0 S 0 0.0 0:00.00 scsi_eh_0
67 root 0 -20 0 0 0 S 0 0.0 0:00.00 octeon-ethernet
68 root -51 0 0 0 0 S 0 0.0 0:00.00 irq/97-octeon-h
79 root 0 -20 0 0 0 S 0 0.0 0:00.00 deferwq
90 root 20 0 0 0 0 S 0 0.0 0:02.17 kworker/3:1
94 root 20 0 12436 2560 2276 S 0 0.1 0:00.52 systemd-journal
99 root 20 0 0 0 0 S 0 0.0 0:00.00 kworker/2:2
102 root 20 0 5200 1800 1324 S 0 0.0 0:00.35 systemd-udevd
183 root 0 -20 0 0 0 S 0 0.0 0:00.31 kworker/2:1H
193 root 0 -20 0 0 0 S 0 0.0 0:00.46 kworker/1:1H
194 root 0 -20 0 0 0 S 0 0.0 0:00.42 kworker/0:1H
204 root 0 -20 0 0 0 S 0 0.0 0:00.49 kworker/3:1H
207 root 20 0 0 0 0 S 0 0.0 0:00.00 kworker/0:2
219 root 20 0 0 0 0 S 0 0.0 0:00.20 kworker/1:2
448 root 0 -20 0 0 0 S 0 0.0 0:00.00 loop0
485 root 0 -20 0 0 0 S 0 0.0 0:01.56 loop1
505 root 0 -20 0 0 0 S 0 0.0 0:08.67 loop2
570 root 0 -20 0 0 0 S 0 0.0 0:00.17 loop3
590 root 0 -20 0 0 0 S 0 0.0 0:01.24 loop4
631 root 0 -20 0 0 0 S 0 0.0 0:00.00 loop5
651 root 0 -20 0 0 0 S 0 0.0 0:00.00 loop6
674 root 0 -20 0 0 0 S 0 0.0 0:00.08 loop7
724 root 0 -20 0 0 0 S 0 0.0 0:00.00 loop8
744 root 0 -20 0 0 0 S 0 0.0 0:00.00 loop9
851 root 0 -20 0 0 0 S 0 0.0 0:00.00 loop10
938 root 14 -6 5876 3412 1480 S 0 0.1 0:00.77 pman.sh
1002 root 20 0 6392 3876 1476 S 0 0.1 0:00.80 droputil.sh
1003 root 20 0 6392 3960 1496 S 0 0.1 1:18.28 reflector.sh
1008 root 20 0 4628 2140 1464 S 0 0.1 0:00.18 oom.sh
1017 root 20 0 3068 880 720 S 0 0.0 0:00.00 xinetd
1034 root 20 0 4168 1464 1240 S 0 0.0 0:00.01 libvirtd.sh
1053 root 20 0 3132 884 648 S 0 0.0 0:00.27 rpcbind
1066 root 20 0 4232 924 664 S 0 0.0 0:00.00 boothelper_evt.
1070 root 20 0 165m 3316 2668 S 0 0.1 0:00.18 libvirtd
1072 root 20 0 2500 400 304 S 0 0.0 0:00.00 inotifywait
1073 root 20 0 2724 916 740 S 0 0.0 0:00.00 rpc.statd
1083 root 20 0 0 0 0 S 0 0.0 0:00.00 kworker/3:2
1090 root 20 0 0 0 0 S 0 0.0 0:00.00 lockd
1094 root 20 0 0 0 0 S 0 0.0 0:00.00 nfsd
1095 root 20 0 0 0 0 S 0 0.0 0:00.00 nfsd
1096 root 20 0 0 0 0 S 0 0.0 0:00.00 nfsd
1097 root 20 0 0 0 0 S 0 0.0 0:00.00 nfsd
1098 root 20 0 0 0 0 S 0 0.0 0:00.00 nfsd
1099 root 20 0 0 0 0 S 0 0.0 0:00.00 nfsd
1100 root 20 0 0 0 0 S 0 0.0 0:00.00 nfsd
1101 root 20 0 0 0 0 S 0 0.0 0:00.00 nfsd
1128 root 20 0 3328 524 220 S 0 0.0 0:00.00 rpc.mountd
1273 root 20 0 13192 2688 1932 S 0 0.1 0:00.04 rotee
1457 root 20 0 13188 2684 1932 S 0 0.1 0:00.06 rotee
1502 root 20 0 2336 388 300 S 0 0.0 0:00.00 sleep
1552 root 20 0 13188 2780 2016 S 0 0.1 0:00.04 rotee
1579 root 20 0 13188 2784 2020 S 0 0.1 0:01.49 rotee
1613 root 20 0 2564 608 492 S 0 0.0 0:00.00 inotifywait
1645 root 20 0 5296 2812 1460 S 0 0.1 0:00.29 iptbl.sh
1653 root 20 0 481m 81m 67m S 0 2.1 0:35.03 psd
1962 root 20 0 13188 2684 1932 S 0 0.1 0:00.04 rotee
1995 root 20 0 2500 608 492 S 0 0.0 0:00.00 inotifywait
2247 root 15 -5 0 0 0 S 0 0.0 6:48.77 lsmpi-refill
2430 root 20 0 0 0 0 S 0 0.0 0:00.02 kworker/u8:0
4600 root 20 0 2568 612 492 S 0 0.0 0:00.00 inotifywait
6861 root 20 0 4168 1488 1248 S 0 0.0 0:00.00 mcp_chvrf.sh
6864 root 20 0 4628 2180 1464 S 0 0.1 0:00.17 rollback_timer.
6868 root 20 0 3068 944 788 S 0 0.0 0:00.00 xinetd
7158 root 20 0 13188 2684 1932 S 0 0.1 0:00.03 rotee
7192 root 20 0 2500 612 492 S 0 0.0 0:00.00 inotifywait
7469 root 20 0 6408 3884 1484 S 0 0.1 0:00.55 psvp.sh
7581 root 20 0 13308 2684 1932 S 0 0.1 0:00.04 rotee
7597 root 20 0 2564 612 492 S 0 0.0 0:00.00 inotifywait
7601 root 20 0 6784 4296 1512 S 0 0.1 0:26.60 pvp.sh
7723 root 20 0 13308 2780 2016 S 0 0.1 0:00.13 rotee
7864 root 20 0 2564 612 492 S 0 0.0 0:00.00 inotifywait
7959 root 14 -6 5876 3412 1480 S 0 0.1 0:00.73 pman.sh
8122 root 14 -6 5996 3416 1480 S 0 0.1 0:00.74 pman.sh
8268 root 20 0 13188 2784 2016 S 0 0.1 0:00.05 rotee
8377 root 14 -6 5996 3416 1480 S 0 0.1 0:00.74 pman.sh
8584 root 20 0 13188 2688 1932 S 0 0.1 0:00.04 rotee
8688 root 14 -6 5876 3412 1480 S 0 0.1 0:00.74 pman.sh
8904 root 20 0 9316 6796 1484 S 0 0.2 0:01.33 auto_upgrade_cl
8945 root 20 0 13188 2688 1932 S 0 0.1 0:00.04 rotee
9324 root 20 0 13308 2788 2020 S 0 0.1 0:00.56 rotee
9359 root 20 0 13128 2688 1932 S 0 0.1 0:00.04 auto_upgrade_se
9552 root 14 -6 5996 3416 1480 S 0 0.1 0:00.74 pman.sh
9689 root 20 0 488m 79m 65m S 0 2.1 0:34.46 bt_logger
9887 root 20 0 6440 3952 1492 S 0 0.1 35:49.78 btrace_rotate.s
10050 root 20 0 13308 2688 1932 S 0 0.1 0:00.03 rotee
10067 root 20 0 13192 2688 1932 S 0 0.1 0:00.04 rotee
10092 root 14 -6 5996 3416 1480 S 0 0.1 0:00.74 pman.sh
10500 root 14 -6 5996 3416 1480 S 0 0.1 0:00.73 pman.sh
10516 root 20 0 13312 2788 2020 S 0 0.1 0:02.92 rotee
10691 root 20 0 13308 2688 1932 S 0 0.1 0:00.04 rotee
10772 root 20 0 484m 84m 68m S 0 2.2 29:43.64 hman
10843 root 14 -6 5884 3412 1480 S 0 0.1 0:00.74 pman.sh
11016 root 20 0 13188 2688 1932 S 0 0.1 0:00.04 rotee
11198 root 14 -6 5880 3416 1480 S 0 0.1 0:00.75 pman.sh
11302 root 20 0 9436 6872 1488 S 0 0.2 0:01.54 issu_stack.sh
11403 root 20 0 13308 2688 1932 S 0 0.1 0:00.04 rotee
11710 root 20 0 6348 3968 1508 S 0 0.1 0:02.92 pvp.sh
11752 root 20 0 469m 78m 65m S 0 2.0 0:22.98 keyman
11801 root 20 0 13308 2688 1932 S 0 0.1 0:00.05 rotee
12210 root 20 0 480m 80m 66m S 0 2.1 0:36.23 lman
12318 root 20 0 13308 2684 1932 S 0 0.1 0:00.05 rotee
12421 root 14 -6 5996 3416 1480 S 0 0.1 0:00.76 pman.sh
12423 root 20 0 9568 7072 1500 S 0 0.2 0:02.07 ncd.sh
12561 root 20 0 13308 2688 1932 S 0 0.1 0:00.04 rotee
12629 root 14 -6 5880 3416 1480 S 0 0.1 0:00.75 pman.sh
12656 root 20 0 2564 612 492 S 0 0.0 0:00.00 inotifywait
12894 root 14 -6 5996 3416 1480 S 0 0.1 0:00.76 pman.sh
12908 root 14 -6 5996 3416 1480 S 0 0.1 0:00.77 pman.sh
12933 root 14 -6 5748 3204 1480 S 0 0.1 0:00.51 pman.sh
12968 root 20 0 13188 2688 1932 S 0 0.1 0:00.04 rotee
13075 root 20 0 13192 2688 1932 S 0 0.1 0:00.04 rotee
13324 root 14 -6 5996 3416 1480 S 0 0.1 0:00.75 pman.sh
13354 root 14 -6 5748 3204 1480 S 0 0.1 0:00.50 pman.sh
13424 root 20 0 13192 2688 1932 S 0 0.1 0:00.04 rotee
13744 root 20 0 473m 77m 64m S 0 2.0 0:42.82 tamd_proc
13772 root 20 0 13188 2688 1932 S 0 0.1 0:00.03 rotee
13818 root 20 0 13308 2788 2020 S 0 0.1 0:00.78 rotee
13903 root 20 0 473m 77m 63m S 0 2.0 0:57.85 tams_proc
13924 root 20 0 13308 2688 1932 S 0 0.1 0:00.04 rotee
13975 root 14 -6 5748 3204 1480 S 0 0.1 0:00.50 pman.sh
14189 root 20 0 485m 77m 64m S 0 2.0 0:10.43 nif_mgr
14429 root 20 0 13308 2688 1932 S 0 0.1 0:00.04 rotee
14469 root 20 0 13188 2688 1932 S 0 0.1 0:00.04 rotee
14686 root 14 -6 5996 3416 1480 S 0 0.1 0:00.76 pman.sh
14934 root 20 0 7944 5504 1468 S 0 0.1 0:54.94 periodic.sh
15171 root 20 0 13308 2688 1932 S 0 0.1 0:00.05 rotee
15404 root 14 -6 5876 3412 1480 S 0 0.1 0:00.74 pman.sh
15413 root 20 0 478m 78m 64m S 0 2.0 2:11.14 epc_ws_liaison
15718 root 20 0 13308 2688 1932 S 0 0.1 0:00.05 rotee
15784 root 20 0 13308 2688 1932 S 0 0.1 0:00.04 rotee
15894 root 20 0 1064m 138m 118m S 0 3.6 15:13.16 platform_mgr
16063 root 14 -6 5996 3416 1480 S 0 0.1 0:00.75 pman.sh
16093 root 20 0 13188 2688 1932 S 0 0.1 0:00.05 rotee
16356 root 20 0 13188 2688 1932 S 0 0.1 0:00.04 rotee
16463 root 14 -6 5876 3412 1480 S 0 0.1 0:00.75 pman.sh
16789 root 20 0 1333m 135m 114m S 0 3.5 13:12.79 sif_mgr
16840 root 20 0 13308 2688 1932 S 0 0.1 0:00.04 rotee
16881 root 20 0 4684 2144 1356 S 0 0.1 0:50.27 sort_files_by_i
16937 root 20 0 0 0 0 S 0 0.0 0:00.03 kworker/u8:2
17236 root 20 0 13188 2688 1932 S 0 0.1 0:00.03 rotee
17480 root 20 0 481m 82m 67m S 0 2.1 0:47.92 stack_mgr
17617 root 14 -6 5996 3416 1480 S 0 0.1 0:00.76 pman.sh
17681 root 20 0 476m 77m 64m S 0 2.0 0:22.58 swift_sampled
17688 root 20 0 2336 392 300 S 0 0.0 0:00.00 sleep
17937 root 20 0 13188 2688 1932 S 0 0.1 0:00.04 rotee
18279 root 20 0 467m 75m 62m S 0 2.0 0:18.61 torchd
21401 root 20 0 2336 392 300 S 0 0.0 0:00.00 sleep
21661 root 20 0 4172 1660 1360 S 0 0.0 0:00.03 bexec.sh
21663 root 20 0 4172 1504 1244 S 0 0.0 0:00.00 mcp_chvrf.sh
21664 root 20 0 4172 1504 1244 S 0 0.0 0:00.07 mcp_monitor_pro
21676 root 20 0 2752 812 608 S 0 0.0 0:00.00 grep
21677 root 20 0 6348 2904 444 R 0 0.1 0:00.00 btrace_rotate.s
21678 root 20 0 2568 660 532 S 0 0.0 0:00.00 grep
23382 root 20 0 2564 612 492 S 0 0.0 0:00.00 inotifywait
23597 root 20 0 2500 680 556 S 0 0.0 0:00.00 inotifywait
23599 root 20 0 9292 5788 448 S 0 0.1 0:00.00 issu_stack.sh
23606 root 20 0 2564 612 492 S 0 0.0 0:00.00 inotifywait
23646 root 20 0 2564 608 492 S 0 0.0 0:00.00 inotifywait
24523 root 20 0 3068 924 752 S 0 0.0 0:00.00 xinetd
24530 root 20 0 4168 1488 1248 S 0 0.0 0:00.00 mcp_chvrf.sh
24538 root 20 0 3068 948 788 S 0 0.0 0:00.00 xinetd
25519 root 14 -6 5884 3416 1480 S 0 0.1 0:00.75 pman.sh
25815 root 20 0 4168 1648 1368 S 0 0.0 0:00.01 stack_sntp.sh
25832 root 20 0 3944 828 696 S 0 0.0 0:00.01 sntp
25838 root 14 -6 5880 3400 1480 S 0 0.1 0:00.76 pman.sh
25839 root 14 -6 5748 3208 1480 S 0 0.1 0:00.49 pman.sh
26042 root 20 0 13188 2688 1932 S 0 0.1 0:00.03 rotee
26516 root 20 0 13308 2688 1932 S 0 0.1 0:00.04 rotee
26689 root 20 0 13308 2688 1932 S 0 0.1 0:00.04 rotee
27072 root 20 0 478m 79m 64m S 0 2.0 0:40.23 plogd
27153 root 14 -6 5880 3412 1480 S 0 0.1 0:00.76 pman.sh
27605 root 14 -6 5880 3408 1480 S 0 0.1 0:00.76 pman.sh
27863 root 20 0 13308 2688 1932 S 0 0.1 0:00.03 rotee
28245 root 20 0 13308 2788 2020 S 0 0.1 0:00.22 rotee
28637 root 20 0 612m 213m 70m S 0 5.5 3:39.33 smand
29064 root 14 -6 5884 3416 1480 S 0 0.1 0:00.75 pman.sh
29408 root 20 0 13308 2688 1932 S 0 0.1 0:00.04 rotee
29584 root 20 0 0 0 0 S 0 0.0 0:00.32 kworker/u8:1
29840 root 20 0 494m 86m 67m S 0 2.2 0:37.54 tms
30146 root 14 -6 5880 3416 1480 S 0 0.1 0:00.77 pman.sh
30316 root 14 -6 5996 3416 1480 S 0 0.1 0:00.76 pman.sh
30446 root 20 0 13308 2688 1932 S 0 0.1 0:00.04 rotee
30699 root 14 -6 5996 3416 1480 S 0 0.1 0:00.77 pman.sh
30745 root 20 0 13308 2688 1932 S 0 0.1 0:00.03 rotee
31116 root 20 0 757m 153m 102m S 0 4.0 0:49.44 cli_agent
31206 root 20 0 13308 2688 1932 S 0 0.1 0:00.04 rotee
31211 root 14 -6 5880 3416 1480 S 0 0.1 0:00.76 pman.sh
31364 root 20 0 485m 79m 65m S 0 2.1 0:55.97 cmm
31722 root 20 0 13308 2688 1932 S 0 0.1 0:00.05 rotee
31837 root 20 0 570m 140m 118m S 0 3.6 0:57.94 dbm
32177 root 14 -6 5880 3412 1480 S 0 0.1 0:02.09 pman.sh
32463 root 20 0 13312 2688 1932 S 0 0.1 0:00.05 rotee
*** Delay time Not changed ***
Thank you for your help!