Re: WLC 9800 Process iosd Eror

RoeyF · ‎04-14-2024

hello,

i'm running wlc9800-40 17.6.4 version and i'v got this error

Severity	Process Name	Message
Critical	iosd	Apr 10 23:47:04.326: %IOSXE_QFP-2-LOAD_RECOVER: Slot: 0, QFP:0, Load 45% recovered. 5 secs traffic rate on QFP: Total Input: 13034 pps (13.0 kpps), 27199160 bps (27.2 mbps), Total Output: 3040723 pps (3040.7 kpps), 5885627216 bps (5885.6 mbps).
Critical	iosd	Apr 10 23:46:54.326: %IOSXE_QFP-2-LOAD_EXCEED: Slot: 0, QFP:0, Load 86% exceeds the setting threshold 80%. 5 secs traffic rate on QFP: Total Input: 25640 pps (25.6 kpps), 65863984 bps (65.9 mbps), Total Output: 4369691 pps (4369.7 kpps), 8469788640 bps (8469.8 mbps).
Critical	iosd	Apr 9 23:47:13.298: %IOSXE_QFP-2-LOAD_RECOVER: Slot: 0, QFP:0, Load 13% recovered. 5 secs traffic rate on QFP: Total Input: 7612 pps (7.6 kpps), 39925576 bps (39.9 mbps), Total Output: 684281 pps (684.3 kpps), 1350940856 bps (1350.9 mbps).

and many more columns

Leo Laohoo · ‎04-14-2024

How many APs is this controller hosting?

RoeyF · ‎04-14-2024

460 Ap's

marce1000 · ‎04-14-2024

- Review outputs from the commands below :
show platform software status control brief
show platform resources
show processes cpu platform sorted | ex 0% 0% 0%
show platform hardware chassis active qfp datapath utilization | i load
show processes memory platform sorted
show processes memory platform accounting
show platform software process memory chassis active r0 all sorted
show platform software process memory chassis standby r0 all sorted
show int po1 | i line protocol|put rate|drops|broadcast (Check volume of traffic received and tx by WLC)
show platform hardware chassis active qfp statistics drop (check for packet drops)
show platform hardware chassis active qfp feature wireless punt statistics (Check for packets punted to CPU)
show buffers | i buffers|failures (Check for buffer failures)
show platform hardware chassis active qfp datapath utilization | i Load

- Have a checkup of the 9800 WLC configuration with the CLI command show tech wireless and feed the output to : Wireless Config Analyzer

- Consider upgrading to 17.9.5 which has become advisory ; and or check if that can help ,

M.

-- Each morning when I wake up and look into the mirror I always say ' Why am I so brilliant ? '
When the mirror will then always repond to me with ' The only thing that exceeds your brilliance is your beauty! '

RoeyF · ‎04-14-2024

hi,

i'v been running the commands of:show platform software status control brief
show platform resources
show processes cpu platform sorted | ex 0% 0% 0%
show platform hardware chassis active qfp datapath utilization | i load
show processes memory platform sorted
show processes memory platform accounting
show platform software process memory chassis active r0 all sorted
show platform software process memory chassis standby r0 all sorted
show int po1 | i line protocol|put rate|drops|broadcast (Check volume of traffic received and tx by WLC)
show platform hardware chassis active qfp statistics drop (check for packet drops)
show platform hardware chassis active qfp feature wireless punt statistics (Check for packets punted to CPU)
show buffers | i buffers|failures (Check for buffer failures)

sh platform software status control brief
Load Average
Slot Status 1-Min 5-Min 15-Min
1-RP0 Healthy 0.29 0.26 0.27
2-RP0 Healthy 0.85 0.96 0.90

Memory (kB)
Slot Status Total Used (Pct) Free (Pct) Committed (Pct)
1-RP0 Healthy 32384792 8935456 (28%) 23449336 (72%) 8549968 (26%)
2-RP0 Healthy 32384792 8657068 (27%) 23727724 (73%) 11101768 (34%)

CPU Utilization
Slot CPU User System Nice Idle IRQ SIRQ IOwait
1-RP0 0 2.00 0.70 0.00 97.30 0.00 0.00 0.00
1 0.70 0.40 0.00 98.90 0.00 0.00 0.00
2 0.90 1.50 0.00 97.59 0.00 0.00 0.00
3 3.10 1.30 0.00 94.70 0.00 0.90 0.00
4 0.19 0.29 0.00 99.40 0.00 0.09 0.00
5 0.89 0.29 0.00 98.80 0.00 0.00 0.00
6 0.40 0.30 0.00 99.29 0.00 0.00 0.00
7 0.49 0.29 0.00 99.20 0.00 0.00 0.00
8 0.50 0.30 0.00 99.20 0.00 0.00 0.00
9 0.59 0.59 0.00 98.70 0.00 0.00 0.09
10 0.20 0.10 0.00 99.70 0.00 0.00 0.00
11 1.29 0.49 0.00 98.10 0.00 0.09 0.00
12 0.60 15.30 0.00 84.10 0.00 0.00 0.00
13 0.40 0.20 0.00 99.39 0.00 0.00 0.00
14 0.80 0.70 0.00 98.50 0.00 0.00 0.00
15 1.19 0.69 0.00 98.10 0.00 0.00 0.00
2-RP0 0 3.90 1.00 0.00 95.10 0.00 0.00 0.00
1 3.00 1.30 0.00 95.69 0.00 0.00 0.00
2 1.80 0.90 0.00 97.30 0.00 0.00 0.00
3 4.20 1.00 0.00 94.80 0.00 0.00 0.00
4 7.19 1.69 0.00 90.70 0.00 0.39 0.00
5 1.40 0.70 0.00 97.90 0.00 0.00 0.00
6 2.19 0.79 0.00 97.00 0.00 0.00 0.00
7 2.40 0.90 0.00 96.60 0.00 0.10 0.00
8 7.69 1.19 0.00 91.10 0.00 0.00 0.00
9 3.39 1.09 0.00 95.50 0.00 0.00 0.00
10 7.30 1.40 0.00 91.30 0.00 0.00 0.00
11 0.89 0.89 0.00 97.10 0.00 1.09 0.00
12 2.70 1.30 0.00 95.90 0.00 0.10 0.00
13 4.40 1.40 0.00 94.20 0.00 0.00 0.00
14 3.20 1.00 0.00 95.80 0.00 0.00 0.00
15 2.30 0.70 0.00 96.99 0.00 0.00 0.00

show processes cpu platform sorted | ex 0% 0% 0%
CPU utilization for five seconds: 4%, one minute: 4%, five minutes: 5%
Core 0: CPU utilization for five seconds: 4%, one minute: 4%, five minutes: 4%
Core 1: CPU utilization for five seconds: 1%, one minute: 4%, five minutes: 5%
Core 2: CPU utilization for five seconds: 3%, one minute: 4%, five minutes: 4%
Core 3: CPU utilization for five seconds: 8%, one minute: 3%, five minutes: 4%
Core 4: CPU utilization for five seconds: 5%, one minute: 4%, five minutes: 6%
Core 5: CPU utilization for five seconds: 2%, one minute: 3%, five minutes: 9%
Core 6: CPU utilization for five seconds: 2%, one minute: 3%, five minutes: 9%
Core 7: CPU utilization for five seconds: 0%, one minute: 7%, five minutes: 6%
Core 8: CPU utilization for five seconds: 1%, one minute: 4%, five minutes: 5%
Core 9: CPU utilization for five seconds: 2%, one minute: 3%, five minutes: 5%
Core 10: CPU utilization for five seconds: 1%, one minute: 10%, five minutes: 5%
Core 11: CPU utilization for five seconds: 5%, one minute: 3%, five minutes: 4%
Core 12: CPU utilization for five seconds: 4%, one minute: 2%, five minutes: 4%
Core 13: CPU utilization for five seconds: 2%, one minute: 3%, five minutes: 5%
Core 14: CPU utilization for five seconds: 14%, one minute: 6%, five minutes: 5%
Core 15: CPU utilization for five seconds: 2%, one minute: 5%, five minutes: 5%
Pid PPid 5Sec 1Min 5Min Status Size Name
--------------------------------------------------------------------------------
17605 17595 14% 16% 16% R 713420 wncd_0
18467 18459 9% 9% 9% S 441692 nmspd
19578 19568 4% 5% 5% S 337396 odm_0
3416 3343 4% 6% 7% S 1741348 linux_iosd-imag
21688 21674 2% 2% 2% S 268952 fman_fp_image
19229 19221 2% 3% 3% S 390420 repm
24728 24719 1% 0% 0% S 135728 mcpcc-lc-ms
22781 22773 1% 1% 1% S 117096 ezman
2950 2 1% 1% 1% S 0 lsmpi-rx
31518 29488 0% 0% 1% S 183976 confd
29644 29636 0% 0% 2% S 249360 ndbmand
20857 20840 0% 0% 1% S 617268 dbm
18324 18314 0% 17% 17% R 345312 rogued
17459 17450 0% 0% 1% S 702684 wncmgrd
4168 4160 0% 4% 4% S 35028 emd
959 951 0% 0% 10% S 115624 smand
show platform hardware chassis active qfp datapath utilization
CPP 0: Subdev 0 5 secs 1 min 5 min 60 min
Input: Priority (pps) 575 550 567 531
(bps) 2582216 2496776 2483200 2179064
Non-Priority (pps) 3515 2980 3775 3473
(bps) 13983920 11666040 16878416 15331176
Total (pps) 4090 3530 4342 4004
(bps) 16566136 14162816 19361616 17510240
Output: Priority (pps) 193 182 180 182
(bps) 555048 544104 541552 544688
Non-Priority (pps) 12216 13421 14365 13998
(bps) 34084592 35149976 40411840 38279712
Total (pps) 12409 13603 14545 14180
(bps) 34639640 35694080 40953392 38824400
Processing: Load (pct) 1 1 1 1

show processes memory platform sorted
System memory: 32384792K total, 8673476K used, 23711316K free,
Lowest: 23642716K
Pid Text Data Stack Dynamic RSS Name
----------------------------------------------------------------------
21780 87 1794252 136 1221304 1794252 pubd
3416 367978 1741868 136 480 1741868 linux_iosd-imag
17605 847 717348 136 126756 717348 wncd_0
17459 160 702900 320 7280 702900 wncmgrd
20857 435 617300 136 7724 617300 dbm
17719 847 473584 136 13364 473584 wncd_1
17834 847 462172 136 13240 462172 wncd_2
18060 847 444060 136 12368 444060 wncd_4
18467 477 441772 136 14756 441772 nmspd
17947 847 439100 136 13380 439100 wncd_3
19229 348 390532 136 35820 390532 repm
18324 53 345612 136 18348 345612 rogued
19578 915 337552 136 10200 337552 odm_0
21688 11111 268052 136 3260 268052 fman_fp_image
21465 280 251256 136 1440 251256 cpp_cp_svr
29644 330 249364 136 388 249364 ndbmand
17315 71 227040 136 2472 227040 wstatsd
18613 128 217740 136 4128 217740 mobilityd
18177 56 196800 136 11260 196800 rrm
21093 56 183976 136 108 183976 cli_agent
31518 2583 180056 156 83084 180056 confd
18951 176 174040 136 6944 174040 sessmgrd
20425 8531 154300 136 4440 154300 fman_rp
24728 15843 135964 136 248 135964 mcpcc-lc-ms
959 790 122280 136 98484 122280 smand
22781 656 118428 136 4772 118428 ezman
18779 70 113820 136 2836 113820 psd
21268 111 105516 136 2984 105516 cpp_sp_svr
19693 915 90948 136 2540 90948 odm_1
21071 188 69100 136 5520 69100 cpp_driver
20860 318 62316 136 4488 62316 cpp_ha_top_leve
29894 233 57128 136 316 57128 dmiauthd
21893 377 52388 140 2332 52388 cman_fp
3604 1547 48832 136 2992 48832 cmand
12585 829 45004 136 1752 45004 install_mgr
20665 106 39400 136 1228 39400 cpp_cdm_svr
23356 1270 37360 136 2000 37360 cmcc
3493 471 35900 136 2040 35900 stack_mgr
4543 159 35380 136 2040 35380 rif_mgr
4168 105 35100 136 1808 35100 emd
5026 1653 34892 136 2916 34892 nginx
10354 901 34352 136 1960 34352 vman
19458 72 34172 136 1952 34172 odm_proxy
19092 47 33572 136 1592 33572 service_mgr
23464 105 31556 136 1572 31556 emd
4924 471 27752 132 1780 27752 libvirtd
20102 414 27596 488 2716 27596 hman
4429 209 27168 136 3744 27168 btman
20288 47 26564 136 1736 26564 service_mgr
11046 153 25492 136 1960 25492 lman
23572 209 23704 136 1484 23704 btman
22058 209 23696 136 1724 23696 btman
4309 116 23552 136 2528 23552 keyman
22670 414 20776 136 1256 20776 hman
19343 78 18608 136 2060 18608 plogd
30202 874 18024 136 1264 18024 ncsshd_bp
9918 318 17640 136 400 17640 ncsshd
30499 318 17064 136 400 17064 ncsshd
5115 747 13976 132 10836 13976 chasync.sh
3822 489 13752 136 1116 13752 tamd_proc
5025 1653 13436 136 2916 13436 nginx
3935 62 12960 136 1648 12960 tams_proc
4903 84 12296 132 396 12296 virtlogd
4048 51 11736 136 804 11736 tam_svcs_esg_cf
1 917 11608 132 2660 11608 systemd
10749 747 11516 376 8712 11516 ncd.sh
13323 747 11488 380 8528 11488 auto_upgrade_cl
11624 747 11328 384 8400 11328 issu_stack.sh
199 107 10600 132 2704 10600 systemd-journal
12484 747 10336 384 8252 10336 issu_stack.sh
9477 747 10324 384 7008 10324 rollback_timer.
12477 747 10272 384 8252 10272 issu_stack.sh
22035 57 9772 136 400 9772 pttcd
6809 320 9344 132 132 9344 dhcpd
14035 747 8608 380 5716 8608 periodic.sh
2928 747 7916 380 5004 7916 psvp.sh
3063 747 7872 376 4940 7872 pvp.sh
22317 747 7628 380 4536 7628 pvp.sh
19375 46 7396 136 2296 7396 journalctl
19702 747 7388 376 4528 7388 pvp.sh
4898 747 7216 372 3668 7216 droputil.sh
5498 747 7160 376 3628 7160 reflector.sh
5027 1653 6776 136 2916 6776 nginx
29480 8 6384 136 268 6384 pman
252 470 6372 132 924 6372 systemd-udevd
6030 747 6328 376 2892 6328 iptbl.sh
9922 318 6072 136 400 6072 ncsshd
21768 8 5676 136 268 5676 pman
20392 8 5652 136 268 5652 pman
19449 8 5648 136 268 5648 pman
10696 8 5644 136 268 5644 pman
23564 8 5636 136 268 5636 pman
22773 8 5636 136 268 5636 pman
4040 8 5636 136 268 5636 pman
3927 8 5636 136 268 5636 pman
19084 8 5620 136 268 5620 pman
18771 8 5620 136 268 5620 pman
29636 8 5616 136 268 5616 pman
17711 8 5616 136 268 5616 pman
17595 8 5616 136 268 5616 pman
19335 8 5608 136 268 5608 pman
11607 8 5604 136 268 5604 pman
18314 8 5596 136 268 5596 pman
22018 8 5592 136 268 5592 pman
24719 8 5580 136 268 5580 pman
20273 8 5580 136 268 5580 pman
18941 8 5576 136 268 5576 pman
3483 8 5576 136 268 5576 pman
20840 8 5568 136 268 5568 pman
13831 8 5568 136 268 5568 pman
29878 8 5552 136 268 5552 pman
23348 8 5552 136 268 5552 pman
18169 8 5552 136 268 5552 pman
17825 8 5548 136 268 5548 pman
4301 8 5544 136 268 5544 pman
3343 8 5544 136 268 5544 pman
20854 8 5540 136 268 5540 pman
23456 8 5536 136 268 5536 pman
17939 8 5528 136 268 5528 pman
3596 8 5528 136 268 5528 pman
20655 8 5524 136 268 5524 pman
17305 8 5524 136 268 5524 pman
21674 8 5516 136 268 5516 pman
21079 8 5516 136 268 5516 pman
19681 8 5516 136 268 5516 pman
14027 8 5516 136 268 5516 pman
13313 8 5516 136 268 5516 pman
4535 8 5516 136 268 5516 pman
21049 8 5512 136 268 5512 pman
20084 8 5512 136 268 5512 pman
19568 8 5512 136 268 5512 pman
11029 8 5512 136 268 5512 pman
4160 8 5512 136 268 5512 pman
951 8 5512 136 268 5512 pman
4421 8 5508 136 268 5508 pman
21254 8 5504 136 268 5504 pman
18459 8 5504 136 268 5504 pman
21453 8 5492 136 268 5492 pman
12569 8 5492 136 268 5492 pman
30187 8 5484 136 268 5484 pman
22662 8 5484 136 268 5484 pman
21876 8 5480 136 268 5480 pman
18606 8 5480 136 268 5480 pman
19221 8 5472 136 268 5472 pman
22051 8 5464 136 268 5464 pman
18053 8 5456 136 268 5456 pman
30485 8 5448 136 268 5448 pman
17450 8 5448 136 268 5448 pman
10344 8 5448 136 268 5448 pman
29488 747 5444 376 2296 5444 confd-startup.s
3814 8 5444 136 268 5444 pman
5016 8 5436 136 268 5436 pman
9923 59 4948 132 400 4948 netconf-subsys
31625 747 4396 376 2296 4396 confd-startup.s
4930 103 4084 132 1300 4084 rpc.mountd
4900 747 3952 132 792 3952 oom.sh
3135 9 3880 132 268 3880 rotee
19937 9 3828 132 268 3828 rotee
5563 9 3816 132 268 3816 rotee
3053 9 3792 132 268 3792 rotee
6192 9 3732 132 268 3732 rotee
5024 9 3732 132 268 3732 rotee
22392 9 3708 132 268 3708 rotee
5442 9 3696 132 268 3696 rotee
6267 9 3680 132 268 3680 rotee
9744 9 3644 132 268 3644 rotee
9474 747 3096 132 132 3096 auxinit.sh
413 45 3060 132 132 3060 nfsdcld
13839 747 2812 136 132 2812 sort_files_by_i
389 89 2796 132 132 2796 auditd
31768 747 2660 136 132 2660 stack_sntp.sh
411 38 2600 132 132 2600 rpc.idmapd
9482 122 2524 132 132 2524 xinetd
9479 122 2500 132 132 2500 xinetd
4946 122 2300 132 132 2300 xinetd
4935 75 2300 132 132 2300 rpc.statd
8101 122 2232 132 132 2232 xinetd
4905 43 2204 132 132 2204 rpcbind
399 31 2016 132 132 2016 audispd
31773 45 1996 136 132 1996 sntp
5114 37 1892 136 132 1892 inet_gethost
12475 21 1808 136 132 1808 inotifywait
5113 37 1744 136 132 1744 inet_gethost
5585 21 1740 132 132 1740 inotifywait
10005 21 1732 132 132 1732 inotifywait
13809 21 1720 136 132 1720 inotifywait
3058 21 1696 132 132 1696 inotifywait
5462 21 1644 132 132 1644 inotifywait
12492 21 1636 136 132 1636 inotifywait
6360 21 1628 132 132 1628 inotifywait
12482 21 1620 136 132 1620 inotifywait
31624 21 1568 136 132 1568 inotifywait
10221 30 1564 136 132 1564 sleep
22445 21 1560 132 132 1560 inotifywait
9803 21 1556 136 132 1556 inotifywait
9806 21 1540 132 132 1540 inotifywait
20100 21 1508 132 132 1508 inotifywait
11477 21 1508 136 132 1508 inotifywait
9544 30 1484 136 132 1484 sleep
31552 12 1392 136 132 1392 erl_child_setup
5107 30 1392 132 132 1392 sleep

show processes memory platform accounting
Hourly Stats

process callsite_ID(bytes) max_diff_bytes callsite_ID(calls) max_diff_calls tracekey timestamp(UTC)
------------------------------------------------------------------------------------------------------------------------------------------------------------
pubd_rp_0 2286216204 255999599 2153597954 6878 1#a735f78af58c341fae6b3cf3f5d5ae78 2024-01-15 10:08
wncd_0_rp_0 1953030147 71995392 2153597966 1198 1#f18a39cfccd9b076be3b963f85167e15 2024-04-15 04:26
nmspd_rp_0 1955606529 38501232 2153322500 9222 1#a5973a198fd3338c85bcb95fbb9dff9b 2024-01-16 08:17
cpp_cp_svr_fp_0 2025690117 34139688 2025690117 25057 1#a30850b92b696e212eb4615752cd7364 2024-03-18 11:01
ndbmand_rp_0 2085982212 29976584 2283581440 8705 1#be022bb6d9ba61a71406762d45d28abe 2023-12-26 03:56
repm_rp_0 2490305541 24176016 2153597954 10 1#1534491d9bd6c5b18e0627a0c413a5a7 2024-04-03 22:03
linux_iosd-imag_rp_0 2081352713 17166612 2153597954 7283 1#b88ebfb996f901dda822c19877714d2e 2024-03-26 20:51
cli_agent_rp_0 2085982212 15080192 2283371523 58932 1#325c629edb100b9348865ffca2e6f45a 2023-12-20 20:01
rogued_rp_0 605867012 12320768 1953874944 38 1#3373369a1e18f23c0e769c33d5a7d094 2024-02-09 11:17
rrm_rp_0 1956510722 7573760 1956494340 3790 1#7637befe94e68380fae119331b433306 2024-03-01 04:54
smand_rp_0 2083813380 6369624 2153597957 114 1#c703559d949c27e7d381f59e3c562210 2023-11-08 12:04
fman_fp_image_fp_0 2153597954 4537096 2025690114 13191 1#35e857bb22e19507655106ec06107735 2024-03-22 07:40
wncmgrd_rp_0 2153597954 3587903 2153597954 366 1#ef821435b7539ec489df6793139165c4 2024-02-24 13:15
odm_0_rp_0 2283987972 3273480 2153588737 6 1#89ec41610389477b89398473c3f67ed4 2024-04-03 07:50
wncd_3_rp_0 1953030147 1363968 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-17 08:20
wncd_1_rp_0 1953030147 1363968 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-18 22:42
wncd_2_rp_0 1953030147 1327104 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-18 17:10
wncd_4_rp_0 1953030147 1327104 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-16 12:37
sessmgrd_rp_0 2083471363 1320433 2023785472 20906 1#1ec2548a0ca3f038f69cbaff5dfe427c 2023-08-29 12:46
dbm_rp_0 2153597954 1077013 2153597954 5544 1#ecb815e2dc3c971a523d4580b3a37617 2024-03-11 23:23
btman_rp_0 2026174464 821792 1211418626 1770 1#ca4871e9dd0346102584cb4372d8fb45 2024-03-03 10:49
dmiauthd_rp_0 2083471363 786963 2158295056 280 1#32e59ac12674c351f3afd4235ab46174 2023-11-06 11:33
keyman_rp_0 2025647104 344160 2153597952 101 1#e9f59b1057a599543d8a70e47827c8b5 2023-11-06 21:37
mobilityd_rp_0 1953725443 286880 1953725441 652 1#2a10a7aa288884e6b8ac30245134d460 2024-03-18 10:42
cpp_ha_top_leve_fp_0 2085982213 270352 2153597952 165 1#e47ad3a674df1d339ea73c60d25c901b 2023-07-18 10:48
hman_rp_0 2018572295 268656 2018572295 386 1#06355345e426d7cf03a7311e90fa5e27 2024-04-15 04:23
psd_rp_0 2083471363 262144 2153597952 101 1#ac1d69af3bab39e83ca082147a7f0de7 2023-07-18 10:48
service_mgr_rp_0 2025647104 229440 2153597952 101 1#c109fc93e18612c62d3da78de8980b10 2023-11-06 11:33
plogd_rp_0 2025647104 172080 2153597952 101 1#b0ba702a78022e17699424d1e7b0c445 2023-11-06 11:33
install_mgr_rp_0 2025647104 172080 2153597952 165 1#d35dac159a8f0f83d7ed6e49dd890764 2023-11-06 11:33
cmand_rp_0 2083813380 114768 2153597952 165 1#1dffe7863aa5ee117130a010849b2e8b 2023-07-18 10:48
service_mgr_fp_0 2025647104 114720 2153597952 101 1#c109fc93e18612c62d3da78de8980b10 2023-11-06 11:33
rif_mgr_rp_0 2025647104 114720 2153597952 101 1#afa6853f53f0d24a2b5c768d55647ece 2023-11-06 11:33
cpp_sp_svr_fp_0 2025647104 114720 2025690117 410 1#139d78ae5f43ed2856b5ac62b30ea6e9 2023-11-08 08:04
stack_mgr_rp_0 2025647104 114720 2153597952 101 1#b8b00469cc3e27e96b098f0374e465ba 2023-11-06 11:33
wstatsd_rp_0 1951458306 73834 2082392065 1 1#9d6d8c5477b54b4f17afef7ff40a8f4a 2023-11-30 15:58
odm_proxy_rp_0 2083813386 57384 2153597952 101 1#d0e10ab0a2c19fab4ef58807d0c8dd5d 2023-11-06 11:33
cpp_driver_fp_0 2083813386 57384 2153597952 101 1#bbb78d9eaf52281e2b584e950a1d2e2b 2023-11-06 10:33
cman_fp_fp_0 2083813386 57384 2153597952 101 1#7a929da5718168124a37ad6bdfb2bd7e 2023-11-06 10:33
btman_fp_0 2083813386 57384 1211418626 103 1#ca4871e9dd0346102584cb4372d8fb45 2023-11-06 10:33
vman_rp_0 2083813386 57384 2153597952 101 1#3bc6ead2eb5a025990d1eef49bf36aa2 2023-11-06 10:33
emd_rp_0 2083813386 57384 2153597952 101 1#86e911700917169a275774ace3e59e9b 2023-11-06 11:33
lman_rp_0 2083813386 57384 2153597952 101 1#c8658e8c4509fac7f0665c8e62f41647 2023-11-06 10:33
fman_rp_rp_0 2083813386 57384 2153597952 101 1#1172d9bb9551115d0ad12c27521d7e50 2023-11-06 11:33
odm_1_rp_0 2083813386 57384 2153597952 101 1#89ec41610389477b89398473c3f67ed4 2023-11-06 11:33
ncsshd_bp_rp_0 2083813386 57384 2153597952 101 1#ff5c906f79060a6db57fc9182f1ca43c 2023-11-06 11:33
mcpcc-lc-ms_cc_0 2025647104 57360 2153597954 5 1#7ce339e7fa1999085b4ef805040b1dfa 2023-11-06 11:33
btman_cc_0 2026174464 21472 1211418626 50 1#ca4871e9dd0346102584cb4372d8fb45 2023-05-23 15:03
ezman_cc_0 2014036997 19456 2153597954 5 1#e5647b24ac1d8a379a24767c270a2c09 2023-11-06 10:33
cmcc_cc_0 2081352713 16396 2153597954 5 1#1f115f5d3d87a4d57bef167a46ea142a 2023-11-06 11:33
hman_cc_0 2081352713 16396 2018520068 65 1#06355345e426d7cf03a7311e90fa5e27 2023-11-06 10:33
tams_proc_rp_0 2153597954 6094 2153597954 5 1#30a3d48a62d16c8848c3ea4a37d48d57 2023-11-06 11:36
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
rotee_FRU_SLOT_NUM 2026051619 4097 2026051621 13 1#fbfe31a726ca44d0a8b3cc5765fa0581 2023-01-24 15:55
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051621 13 1#08a71073a3b6f7ec5616797ed9256c5a 2024-01-22 05:36
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051621 13 1#08a71073a3b6f7ec5616797ed9256c5a 2023-11-08 08:03
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-11-06 10:33
emd_cc_0 2147738628 4096 2153597954 4 1#86e911700917169a275774ace3e59e9b 2023-03-20 15:19
tamd_proc_rp_0 2153597954 3101 2153597954 5 1#3c74606697d83a1e464aca7f25d38b49 2023-11-06 11:36
pttcd_rp_0 2282963968 4 2282963968 1 1#eb434979804a1bce4143423d0e1cd917 2023-11-06 10:33

Daily Stats

process callsite_ID(bytes) max_diff_bytes callsite_ID(calls) max_diff_calls tracekey timestamp(UTC)
------------------------------------------------------------------------------------------------------------------------------------------------------------
wncd_0_rp_0 1953030147 71995392 2153597966 1197 1#f18a39cfccd9b076be3b963f85167e15 2024-04-15 03:26
nmspd_rp_0 1955606529 38501232 2153322500 9222 1#a5973a198fd3338c85bcb95fbb9dff9b 2024-01-16 08:17
cpp_cp_svr_fp_0 2025690117 34139688 2025690117 25017 1#a30850b92b696e212eb4615752cd7364 2024-03-18 10:01
pubd_rp_0 2286216204 33713846 2153597954 6878 1#a735f78af58c341fae6b3cf3f5d5ae78 2024-01-15 09:08
ndbmand_rp_0 2085982212 29976584 2283581440 8623 1#be022bb6d9ba61a71406762d45d28abe 2023-12-26 02:56
repm_rp_0 2490305541 24166848 2153597954 10 1#1534491d9bd6c5b18e0627a0c413a5a7 2024-04-03 07:04
linux_iosd-imag_rp_0 2081352713 17166612 2153597954 7283 1#b88ebfb996f901dda822c19877714d2e 2024-03-26 20:51
cli_agent_rp_0 2085982212 15080192 2283371523 58931 1#325c629edb100b9348865ffca2e6f45a 2023-12-20 19:01
rogued_rp_0 605867012 12320768 1953874944 38 1#3373369a1e18f23c0e769c33d5a7d094 2024-02-09 11:17
rrm_rp_0 1956510722 7573760 1956494340 3780 1#7637befe94e68380fae119331b433306 2024-03-01 03:54
smand_rp_0 2083813380 5279328 2153597952 101 1#c703559d949c27e7d381f59e3c562210 2023-11-08 08:04
fman_fp_image_fp_0 2153597954 4537096 2085976066 66908 1#35e857bb22e19507655106ec06107735 2024-03-22 01:38
wncmgrd_rp_0 2153597954 3587903 2153597954 351 1#ef821435b7539ec489df6793139165c4 2024-02-24 12:15
odm_0_rp_0 2283987972 3272640 2153588737 6 1#89ec41610389477b89398473c3f67ed4 2024-04-03 06:50
wncd_1_rp_0 1953030147 1363968 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-18 22:42
wncd_3_rp_0 1953030147 1327104 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-16 22:48
wncd_2_rp_0 1953030147 1327104 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-18 17:10
sessmgrd_rp_0 2083471363 1320397 2023785472 20906 1#1ec2548a0ca3f038f69cbaff5dfe427c 2023-08-29 11:46
wncd_4_rp_0 1953030147 1253376 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-16 11:37
dbm_rp_0 2153597954 1077013 2153597954 5531 1#ecb815e2dc3c971a523d4580b3a37617 2024-03-11 22:23
btman_rp_0 2026174464 819840 1211418626 1765 1#ca4871e9dd0346102584cb4372d8fb45 2024-03-03 09:49
mobilityd_rp_0 1953725443 286000 1953725441 651 1#2a10a7aa288884e6b8ac30245134d460 2024-03-18 09:42
psd_rp_0 2083471363 262144 2153597952 28 1#ac1d69af3bab39e83ca082147a7f0de7 2023-07-18 09:48
hman_rp_0 2025647104 172080 2018572295 166 1#06355345e426d7cf03a7311e90fa5e27 2024-04-14 10:02
cpp_sp_svr_fp_0 2025647104 114720 2025690117 410 1#139d78ae5f43ed2856b5ac62b30ea6e9 2023-11-08 08:04
wstatsd_rp_0 1951458306 73834 2082392065 1 1#9d6d8c5477b54b4f17afef7ff40a8f4a 2023-11-30 15:58
cpp_driver_fp_0 2083813386 57384 2153597952 101 1#bbb78d9eaf52281e2b584e950a1d2e2b 2023-11-06 10:33
btman_fp_0 2083813386 57384 1211418626 103 1#ca4871e9dd0346102584cb4372d8fb45 2023-11-06 10:33
lman_rp_0 2083813386 57384 2153597952 101 1#c8658e8c4509fac7f0665c8e62f41647 2023-11-06 10:33
vman_rp_0 2083813386 57384 2153597952 101 1#3bc6ead2eb5a025990d1eef49bf36aa2 2023-11-06 10:33
cman_fp_fp_0 2083813386 57384 2153597952 101 1#7a929da5718168124a37ad6bdfb2bd7e 2023-11-06 10:33
cmand_rp_0 2025647104 57360 2153597954 4 1#1dffe7863aa5ee117130a010849b2e8b 2023-07-18 09:48
mcpcc-lc-ms_cc_0 2025647104 57360 2153597954 4 1#7ce339e7fa1999085b4ef805040b1dfa 2023-11-06 10:33
btman_cc_0 2026174464 21472 1211418626 49 1#ca4871e9dd0346102584cb4372d8fb45 2023-05-23 14:03
ezman_cc_0 2014036997 19456 2153597954 5 1#e5647b24ac1d8a379a24767c270a2c09 2023-11-06 10:33
cpp_ha_top_leve_fp_0 2025639936 16960 2026051621 13 1#e47ad3a674df1d339ea73c60d25c901b 2023-07-18 09:48
keyman_rp_0 2025639936 16960 2153597952 101 1#e9f59b1057a599543d8a70e47827c8b5 2023-11-06 10:33
service_mgr_fp_0 2025639936 16960 2153597952 101 1#c109fc93e18612c62d3da78de8980b10 2023-11-06 10:33
install_mgr_rp_0 2153597966 16564 2153597952 101 1#d35dac159a8f0f83d7ed6e49dd890764 2023-11-06 10:33
odm_1_rp_0 2081352713 16396 2153597952 101 1#89ec41610389477b89398473c3f67ed4 2023-11-06 10:33
rif_mgr_rp_0 2081352713 16396 2153597952 101 1#afa6853f53f0d24a2b5c768d55647ece 2023-11-06 10:33
service_mgr_rp_0 2081352713 16396 2153597952 101 1#c109fc93e18612c62d3da78de8980b10 2023-11-06 10:33
ncsshd_bp_rp_0 2081352713 16396 2153597952 101 1#ff5c906f79060a6db57fc9182f1ca43c 2023-11-06 10:33
odm_proxy_rp_0 2081352713 16396 2153597952 101 1#d0e10ab0a2c19fab4ef58807d0c8dd5d 2023-11-06 10:33
hman_cc_0 2081352713 16396 2018520068 65 1#06355345e426d7cf03a7311e90fa5e27 2023-11-06 10:33
stack_mgr_rp_0 2081352713 16396 2153597952 101 1#b8b00469cc3e27e96b098f0374e465ba 2023-11-06 10:33
plogd_rp_0 2081352713 16396 2153597952 101 1#b0ba702a78022e17699424d1e7b0c445 2023-11-06 10:33
cmcc_cc_0 2081352713 16396 2153597954 4 1#1f115f5d3d87a4d57bef167a46ea142a 2023-11-06 10:33
fman_rp_rp_0 2081352713 16396 2153597952 101 1#1172d9bb9551115d0ad12c27521d7e50 2023-11-06 10:33
dmiauthd_rp_0 2081352713 16396 2153597952 101 1#32e59ac12674c351f3afd4235ab46174 2023-11-06 10:33
emd_rp_0 2081352713 16396 2153597952 101 1#86e911700917169a275774ace3e59e9b 2023-11-06 10:33
rotee_FRU_SLOT_NUM 2026051619 4097 2026051619 1 1#fbfe31a726ca44d0a8b3cc5765fa0581 2023-01-24 14:54
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-11-07 09:43
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-11-06 10:33
pman_rp_0 2026051619 4097 2026051621 13 1#08a71073a3b6f7ec5616797ed9256c5a 2024-01-22 05:36
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
emd_cc_0 2147738628 4096 2153597954 4 1#86e911700917169a275774ace3e59e9b 2023-03-20 15:19
tams_proc_rp_0 2153597954 4032 2153597954 5 1#30a3d48a62d16c8848c3ea4a37d48d57 2023-11-06 10:36
tamd_proc_rp_0 2153597954 3053 2153597954 5 1#3c74606697d83a1e464aca7f25d38b49 2023-11-06 10:36
pttcd_rp_0 2282963968 4 2282963968 1 1#eb434979804a1bce4143423d0e1cd917 2023-11-06 10:33

Weekly Stats

process callsite_ID(bytes) max_diff_bytes callsite_ID(calls) max_diff_calls tracekey timestamp(UTC)
------------------------------------------------------------------------------------------------------------------------------------------------------------
wncd_0_rp_0 1953030147 71995392 2153597966 1197 1#f18a39cfccd9b076be3b963f85167e15 2024-04-15 03:26
nmspd_rp_0 1955606529 37501200 2153322500 9221 1#a5973a198fd3338c85bcb95fbb9dff9b 2024-01-09 10:42
cpp_cp_svr_fp_0 2025690117 34139688 2025690117 25017 1#a30850b92b696e212eb4615752cd7364 2024-03-18 10:01
pubd_rp_0 2286216204 32351667 2153597954 6878 1#a735f78af58c341fae6b3cf3f5d5ae78 2024-01-11 17:00
ndbmand_rp_0 2085982212 29976584 2283581440 8623 1#be022bb6d9ba61a71406762d45d28abe 2023-12-26 02:56
repm_rp_0 2490305541 24116424 2153597954 10 1#1534491d9bd6c5b18e0627a0c413a5a7 2024-04-02 05:47
linux_iosd-imag_rp_0 2081352713 17166612 2153597954 7283 1#b88ebfb996f901dda822c19877714d2e 2024-03-26 20:51
cli_agent_rp_0 2085982212 15080192 2283371523 58931 1#325c629edb100b9348865ffca2e6f45a 2023-12-20 19:01
rogued_rp_0 605867012 12320768 1953874944 38 1#3373369a1e18f23c0e769c33d5a7d094 2024-02-09 11:17
rrm_rp_0 1956510722 7573760 1956494340 3780 1#7637befe94e68380fae119331b433306 2024-03-01 03:54
fman_fp_image_fp_0 2153597954 4537096 2085976066 66730 1#35e857bb22e19507655106ec06107735 2024-03-21 01:17
wncmgrd_rp_0 2153597954 3587903 2153597954 351 1#ef821435b7539ec489df6793139165c4 2024-02-24 12:15
odm_0_rp_0 2283987972 2924880 2153588737 6 1#89ec41610389477b89398473c3f67ed4 2024-04-02 05:47
wncd_1_rp_0 1953030147 1327104 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-17 19:40
sessmgrd_rp_0 2083471363 1320397 2023785472 20906 1#1ec2548a0ca3f038f69cbaff5dfe427c 2023-08-29 11:46
dbm_rp_0 2153597954 1077013 2153597954 5531 1#ecb815e2dc3c971a523d4580b3a37617 2024-03-11 22:23
wncd_3_rp_0 1953030147 921600 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-14 00:38
btman_rp_0 2026174464 812032 1211418626 1750 1#ca4871e9dd0346102584cb4372d8fb45 2024-02-27 20:19
wncd_4_rp_0 1953030147 479232 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-14 13:31
wncd_2_rp_0 1953030147 479232 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-13 23:12
mobilityd_rp_0 1953725443 286000 1953725441 651 1#2a10a7aa288884e6b8ac30245134d460 2024-03-18 09:42
psd_rp_0 2083471363 262144 2153597952 28 1#ac1d69af3bab39e83ca082147a7f0de7 2023-07-18 09:48
hman_rp_0 2025647104 172080 2018572295 166 1#06355345e426d7cf03a7311e90fa5e27 2024-04-14 10:02
wstatsd_rp_0 1951458306 73834 2082392065 1 1#9d6d8c5477b54b4f17afef7ff40a8f4a 2023-11-30 15:58
cman_fp_fp_0 2083813386 57384 2153597952 101 1#7a929da5718168124a37ad6bdfb2bd7e 2023-11-06 10:33
btman_fp_0 2083813386 57384 1211418626 103 1#ca4871e9dd0346102584cb4372d8fb45 2023-11-06 10:33
lman_rp_0 2083813386 57384 2153597952 101 1#c8658e8c4509fac7f0665c8e62f41647 2023-11-06 10:33
cpp_driver_fp_0 2083813386 57384 2153597952 101 1#bbb78d9eaf52281e2b584e950a1d2e2b 2023-11-06 10:33
vman_rp_0 2083813386 57384 2153597952 101 1#3bc6ead2eb5a025990d1eef49bf36aa2 2023-11-06 10:33
cmand_rp_0 2025647104 57360 2153597954 4 1#1dffe7863aa5ee117130a010849b2e8b 2023-07-18 09:48
mcpcc-lc-ms_cc_0 2025647104 57360 2153597954 4 1#7ce339e7fa1999085b4ef805040b1dfa 2023-11-06 10:33
btman_cc_0 2026174464 21472 1211418626 49 1#ca4871e9dd0346102584cb4372d8fb45 2023-05-23 14:03
ezman_cc_0 2014036997 19456 2153597954 5 1#e5647b24ac1d8a379a24767c270a2c09 2023-11-06 10:33
service_mgr_fp_0 2025639936 16960 2153597952 101 1#c109fc93e18612c62d3da78de8980b10 2023-11-06 10:33
cpp_ha_top_leve_fp_0 2025639936 16960 2026051621 13 1#e47ad3a674df1d339ea73c60d25c901b 2023-07-18 09:48
keyman_rp_0 2025639936 16960 2153597952 101 1#e9f59b1057a599543d8a70e47827c8b5 2023-11-06 10:33
install_mgr_rp_0 2153597966 16564 2153597952 101 1#d35dac159a8f0f83d7ed6e49dd890764 2023-11-06 10:33
fman_rp_rp_0 2081352713 16396 2153597952 101 1#1172d9bb9551115d0ad12c27521d7e50 2023-11-06 10:33
rif_mgr_rp_0 2081352713 16396 2153597952 101 1#afa6853f53f0d24a2b5c768d55647ece 2023-11-06 10:33
service_mgr_rp_0 2081352713 16396 2153597952 101 1#c109fc93e18612c62d3da78de8980b10 2023-11-06 10:33
hman_cc_0 2081352713 16396 2018520068 65 1#06355345e426d7cf03a7311e90fa5e27 2023-11-06 10:33
odm_proxy_rp_0 2081352713 16396 2153597952 101 1#d0e10ab0a2c19fab4ef58807d0c8dd5d 2023-11-06 10:33
plogd_rp_0 2081352713 16396 2153597952 101 1#b0ba702a78022e17699424d1e7b0c445 2023-11-06 10:33
stack_mgr_rp_0 2081352713 16396 2153597952 101 1#b8b00469cc3e27e96b098f0374e465ba 2023-11-06 10:33
smand_rp_0 2081352713 16396 2153597952 101 1#c703559d949c27e7d381f59e3c562210 2023-11-06 10:33
cmcc_cc_0 2081352713 16396 2153597954 4 1#1f115f5d3d87a4d57bef167a46ea142a 2023-11-06 10:33
dmiauthd_rp_0 2081352713 16396 2153597952 101 1#32e59ac12674c351f3afd4235ab46174 2023-11-06 10:33
odm_1_rp_0 2081352713 16396 2153597952 101 1#89ec41610389477b89398473c3f67ed4 2023-11-06 10:33
ncsshd_bp_rp_0 2081352713 16396 2153597952 101 1#ff5c906f79060a6db57fc9182f1ca43c 2023-11-06 10:33
emd_rp_0 2081352713 16396 2153597952 101 1#86e911700917169a275774ace3e59e9b 2023-11-06 10:33
cpp_sp_svr_fp_0 2025690117 8212 2153597952 101 1#139d78ae5f43ed2856b5ac62b30ea6e9 2023-11-06 10:33
rotee_FRU_SLOT_NUM 2026051619 4097 2026051619 1 1#fbfe31a726ca44d0a8b3cc5765fa0581 2023-01-24 14:54
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051621 13 1#08a71073a3b6f7ec5616797ed9256c5a 2024-01-22 05:36
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-11-06 10:33
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-11-07 09:43
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
emd_cc_0 2147738628 4096 2153597954 4 1#86e911700917169a275774ace3e59e9b 2023-03-20 15:19
tams_proc_rp_0 2153597954 4032 2153597954 5 1#30a3d48a62d16c8848c3ea4a37d48d57 2023-11-06 10:36
tamd_proc_rp_0 2153597954 3053 2153597954 5 1#3c74606697d83a1e464aca7f25d38b49 2023-11-06 10:36
pttcd_rp_0 2282963968 4 2282963968 1 1#eb434979804a1bce4143423d0e1cd917 2023-11-06 10:33

Monthly Stats

process callsite_ID(bytes) max_diff_bytes callsite_ID(calls) max_diff_calls tracekey timestamp(UTC)
------------------------------------------------------------------------------------------------------------------------------------------------------------
wncd_0_rp_0 1953030147 56696832 2153597966 1160 1#f18a39cfccd9b076be3b963f85167e15 2024-04-02 05:47
nmspd_rp_0 1955606529 36001152 2153322500 8554 1#a5973a198fd3338c85bcb95fbb9dff9b 2023-12-11 08:46
cpp_cp_svr_fp_0 2025690117 34139688 2025690117 25017 1#a30850b92b696e212eb4615752cd7364 2024-03-18 10:01
pubd_rp_0 2286216194 32351552 2153597954 268 1#a735f78af58c341fae6b3cf3f5d5ae78 2023-12-12 09:10
ndbmand_rp_0 2085982212 29976584 2283581440 8623 1#be022bb6d9ba61a71406762d45d28abe 2023-12-26 02:56
repm_rp_0 2490305541 24116424 2153597954 10 1#1534491d9bd6c5b18e0627a0c413a5a7 2024-04-02 05:47
linux_iosd-imag_rp_0 2081352713 17166612 2153597954 7283 1#b88ebfb996f901dda822c19877714d2e 2024-03-26 20:51
cli_agent_rp_0 2085982212 15080192 2283371523 58931 1#325c629edb100b9348865ffca2e6f45a 2023-12-20 19:01
rogued_rp_0 605867012 12320768 1953874944 38 1#3373369a1e18f23c0e769c33d5a7d094 2024-02-09 11:17
rrm_rp_0 1956510722 7566000 1956494340 3779 1#7637befe94e68380fae119331b433306 2024-02-18 08:22
fman_fp_image_fp_0 2153597954 4536328 2085976066 60213 1#35e857bb22e19507655106ec06107735 2024-02-28 16:51
wncmgrd_rp_0 2153597954 3577703 2153597954 305 1#ef821435b7539ec489df6793139165c4 2024-02-02 12:37
odm_0_rp_0 2283987972 2924880 2153588737 6 1#89ec41610389477b89398473c3f67ed4 2024-04-02 05:47
sessmgrd_rp_0 2083471363 1320397 2023785472 20906 1#1ec2548a0ca3f038f69cbaff5dfe427c 2023-08-29 11:46
dbm_rp_0 2153597954 1077013 2153597954 5531 1#ecb815e2dc3c971a523d4580b3a37617 2024-03-11 22:23
btman_rp_0 2026174464 797392 1211418626 1719 1#ca4871e9dd0346102584cb4372d8fb45 2024-02-20 08:08
wncd_1_rp_0 1953030147 479232 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-08 11:21
wncd_4_rp_0 1953030147 479232 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-14 13:31
wncd_3_rp_0 1953030147 479232 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-06 19:49
wncd_2_rp_0 1953030147 479232 2023785472 8649 1#f18a39cfccd9b076be3b963f85167e15 2023-11-13 23:12
mobilityd_rp_0 1953725443 286000 1953725441 651 1#2a10a7aa288884e6b8ac30245134d460 2024-03-18 09:42
psd_rp_0 2083471363 262144 2153597952 28 1#ac1d69af3bab39e83ca082147a7f0de7 2023-07-18 09:48
hman_rp_0 2025647104 172080 2018572295 166 1#06355345e426d7cf03a7311e90fa5e27 2024-04-14 10:02
wstatsd_rp_0 1951458306 73834 2082392065 1 1#9d6d8c5477b54b4f17afef7ff40a8f4a 2023-11-30 15:58
btman_fp_0 2083813386 57384 1211418626 103 1#ca4871e9dd0346102584cb4372d8fb45 2023-11-06 10:33
cman_fp_fp_0 2083813386 57384 2153597952 101 1#7a929da5718168124a37ad6bdfb2bd7e 2023-11-06 10:33
lman_rp_0 2083813386 57384 2153597952 101 1#c8658e8c4509fac7f0665c8e62f41647 2023-11-06 10:33
cpp_driver_fp_0 2083813386 57384 2153597952 101 1#bbb78d9eaf52281e2b584e950a1d2e2b 2023-11-06 10:33
vman_rp_0 2083813386 57384 2153597952 101 1#3bc6ead2eb5a025990d1eef49bf36aa2 2023-11-06 10:33
cmand_rp_0 2025647104 57360 2153597954 4 1#1dffe7863aa5ee117130a010849b2e8b 2023-07-18 09:48
mcpcc-lc-ms_cc_0 2025647104 57360 2153597954 4 1#7ce339e7fa1999085b4ef805040b1dfa 2023-11-06 10:33
btman_cc_0 2026174464 21472 1211418626 49 1#ca4871e9dd0346102584cb4372d8fb45 2023-05-23 14:03
ezman_cc_0 2014036997 19456 2153597954 5 1#e5647b24ac1d8a379a24767c270a2c09 2023-11-06 10:33
service_mgr_fp_0 2025639936 16960 2153597952 101 1#c109fc93e18612c62d3da78de8980b10 2023-11-06 10:33
cpp_ha_top_leve_fp_0 2025639936 16960 2026051621 13 1#e47ad3a674df1d339ea73c60d25c901b 2023-07-18 09:48
keyman_rp_0 2025639936 16960 2153597952 101 1#e9f59b1057a599543d8a70e47827c8b5 2023-11-06 10:33
install_mgr_rp_0 2153597966 16564 2153597952 101 1#d35dac159a8f0f83d7ed6e49dd890764 2023-11-06 10:33
fman_rp_rp_0 2081352713 16396 2153597952 101 1#1172d9bb9551115d0ad12c27521d7e50 2023-11-06 10:33
rif_mgr_rp_0 2081352713 16396 2153597952 101 1#afa6853f53f0d24a2b5c768d55647ece 2023-11-06 10:33
service_mgr_rp_0 2081352713 16396 2153597952 101 1#c109fc93e18612c62d3da78de8980b10 2023-11-06 10:33
hman_cc_0 2081352713 16396 2018520068 65 1#06355345e426d7cf03a7311e90fa5e27 2023-11-06 10:33
odm_proxy_rp_0 2081352713 16396 2153597952 101 1#d0e10ab0a2c19fab4ef58807d0c8dd5d 2023-11-06 10:33
plogd_rp_0 2081352713 16396 2153597952 101 1#b0ba702a78022e17699424d1e7b0c445 2023-11-06 10:33
stack_mgr_rp_0 2081352713 16396 2153597952 101 1#b8b00469cc3e27e96b098f0374e465ba 2023-11-06 10:33
smand_rp_0 2081352713 16396 2153597952 101 1#c703559d949c27e7d381f59e3c562210 2023-11-06 10:33
cmcc_cc_0 2081352713 16396 2153597954 4 1#1f115f5d3d87a4d57bef167a46ea142a 2023-11-06 10:33
dmiauthd_rp_0 2081352713 16396 2153597952 101 1#32e59ac12674c351f3afd4235ab46174 2023-11-06 10:33
odm_1_rp_0 2081352713 16396 2153597952 101 1#89ec41610389477b89398473c3f67ed4 2023-11-06 10:33
ncsshd_bp_rp_0 2081352713 16396 2153597952 101 1#ff5c906f79060a6db57fc9182f1ca43c 2023-11-06 10:33
emd_rp_0 2081352713 16396 2153597952 101 1#86e911700917169a275774ace3e59e9b 2023-11-06 10:33
cpp_sp_svr_fp_0 2025690117 8212 2153597952 101 1#139d78ae5f43ed2856b5ac62b30ea6e9 2023-11-06 10:33
rotee_FRU_SLOT_NUM 2026051619 4097 2026051619 1 1#fbfe31a726ca44d0a8b3cc5765fa0581 2023-01-24 14:54
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051621 13 1#08a71073a3b6f7ec5616797ed9256c5a 2024-01-22 05:36
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-11-06 10:33
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-11-07 09:43
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
emd_cc_0 2147738628 4096 2153597954 4 1#86e911700917169a275774ace3e59e9b 2023-03-20 15:19
tams_proc_rp_0 2153597954 4032 2153597954 5 1#30a3d48a62d16c8848c3ea4a37d48d57 2023-11-06 10:36
tamd_proc_rp_0 2153597954 3053 2153597954 5 1#3c74606697d83a1e464aca7f25d38b49 2023-11-06 10:36
pttcd_rp_0 2282963968 4 2282963968 1 1#eb434979804a1bce4143423d0e1cd917 2023-11-06 10:33

Yearly Stats

process callsite_ID(bytes) max_diff_bytes callsite_ID(calls) max_diff_calls tracekey timestamp(UTC)
------------------------------------------------------------------------------------------------------------------------------------------------------------
wncd_0_rp_0 1953030147 56659968 2153597966 1158 1#f18a39cfccd9b076be3b963f85167e15 2024-02-09 15:58
cpp_cp_svr_fp_0 2025690117 34139688 2025690117 24924 1#a30850b92b696e212eb4615752cd7364 2024-02-14 09:25
repm_rp_0 2490305541 24116424 2153597954 10 1#1534491d9bd6c5b18e0627a0c413a5a7 2024-04-02 05:47
linux_iosd-imag_rp_0 2081352713 17166612 2153597954 7283 1#b88ebfb996f901dda822c19877714d2e 2024-02-09 21:01
rogued_rp_0 605867012 12320768 1953874944 38 1#3373369a1e18f23c0e769c33d5a7d094 2024-02-09 11:17
rrm_rp_0 1956510722 7566000 1956494340 3779 1#7637befe94e68380fae119331b433306 2024-02-18 08:22
fman_fp_image_fp_0 2153597954 4536328 2085976066 60213 1#35e857bb22e19507655106ec06107735 2024-02-28 16:51
wncmgrd_rp_0 2153597954 3577703 2153597954 305 1#ef821435b7539ec489df6793139165c4 2024-02-02 12:37
odm_0_rp_0 2283987972 2917320 2153588737 6 1#89ec41610389477b89398473c3f67ed4 2024-02-05 09:41
dbm_rp_0 2153597954 1077013 2153597954 5531 1#ecb815e2dc3c971a523d4580b3a37617 2024-03-11 22:23
btman_rp_0 2026174464 797392 1211418626 1719 1#ca4871e9dd0346102584cb4372d8fb45 2024-02-20 08:08
mobilityd_rp_0 1953725443 286000 1953725441 651 1#2a10a7aa288884e6b8ac30245134d460 2024-03-18 09:42
hman_rp_0 2025647104 172080 2018572295 166 1#06355345e426d7cf03a7311e90fa5e27 2024-04-14 10:02
wncd_2_rp_0 2153597966 16396 2153597966 1 1#f18a39cfccd9b076be3b963f85167e15 2023-01-24 14:54
install_mgr_rp_0 2081352713 16396 2081352713 1 1#d35dac159a8f0f83d7ed6e49dd890764 2023-01-24 14:54
wncd_4_rp_0 2153597966 16396 2153597966 1 1#f18a39cfccd9b076be3b963f85167e15 2023-01-24 14:54
wncd_1_rp_0 2153597966 16396 2153597966 1 1#f18a39cfccd9b076be3b963f85167e15 2023-01-24 14:54
wncd_3_rp_0 2153597966 16396 2153597966 1 1#f18a39cfccd9b076be3b963f85167e15 2023-01-24 14:54
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-11-06 10:33
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-12-15 19:25
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-11-07 09:43
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_fp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
pman_rp_0 2026051619 4097 2026051619 1 1#08a71073a3b6f7ec5616797ed9256c5a 2023-07-18 09:48
rotee_FRU_SLOT_NUM 2026051619 4097 2026051619 1 1#fbfe31a726ca44d0a8b3cc5765fa0581 2023-01-24 14:54
btman_fp_0 2026054657 4097 2026054657 1 1#ca4871e9dd0346102584cb4372d8fb45 2023-01-24 14:54
tams_proc_rp_0 2148712448 1024 2148712448 1 1#30a3d48a62d16c8848c3ea4a37d48d57 2023-01-24 14:53
cpp_driver_fp_0 2025639937 104 2025639937 1 1#bbb78d9eaf52281e2b584e950a1d2e2b 2023-01-24 14:54
cpp_sp_svr_fp_0 2025639937 104 2025639937 1 1#139d78ae5f43ed2856b5ac62b30ea6e9 2023-01-24 14:54
vman_rp_0 2154009600 48 2154009600 1 1#3bc6ead2eb5a025990d1eef49bf36aa2 2023-01-24 14:54
smand_rp_0 2153597954 48 2153597954 1 1#c703559d949c27e7d381f59e3c562210 2023-01-24 14:55
service_mgr_rp_0 2154009600 48 2154009600 1 1#c109fc93e18612c62d3da78de8980b10 2023-01-24 14:54
pubd_rp_0 2154009600 48 2154009600 1 1#a735f78af58c341fae6b3cf3f5d5ae78 2023-01-24 14:54
stack_mgr_rp_0 2550458368 48 2550458368 1 1#b8b00469cc3e27e96b098f0374e465ba 2023-01-24 14:53
rif_mgr_rp_0 2550403075 48 2550403075 1 1#afa6853f53f0d24a2b5c768d55647ece 2023-01-24 14:53
service_mgr_fp_0 2154009600 48 2154009600 1 1#c109fc93e18612c62d3da78de8980b10 2023-01-24 14:54
psd_rp_0 2154009600 48 2154009600 1 1#ac1d69af3bab39e83ca082147a7f0de7 2023-01-24 14:54
btman_cc_0 2154009600 48 2154009600 1 1#ca4871e9dd0346102584cb4372d8fb45 2023-01-24 14:54
odm_proxy_rp_0 2154009600 48 2154009600 1 1#d0e10ab0a2c19fab4ef58807d0c8dd5d 2023-01-24 14:54
emd_cc_0 2154009600 48 2154009600 1 1#86e911700917169a275774ace3e59e9b 2023-01-24 14:54
emd_rp_0 2154009600 48 2154009600 1 1#86e911700917169a275774ace3e59e9b 2023-01-24 14:53
plogd_rp_0 2154009600 48 2154009600 1 1#b0ba702a78022e17699424d1e7b0c445 2023-01-24 14:54
fman_rp_rp_0 2154009600 48 2154009600 1 1#1172d9bb9551115d0ad12c27521d7e50 2023-01-24 14:54
dmiauthd_rp_0 2154009600 48 2154009600 1 1#32e59ac12674c351f3afd4235ab46174 2023-01-24 14:55
cman_fp_fp_0 2154009600 48 2154009600 1 1#7a929da5718168124a37ad6bdfb2bd7e 2023-01-24 14:54
cpp_ha_top_leve_fp_0 2154009600 48 2154009600 1 1#e47ad3a674df1d339ea73c60d25c901b 2023-01-24 14:54
cli_agent_rp_0 2154009600 48 2154009600 1 1#325c629edb100b9348865ffca2e6f45a 2023-01-24 14:54
hman_cc_0 2154009600 48 2154009600 1 1#06355345e426d7cf03a7311e90fa5e27 2023-01-24 14:54
wstatsd_rp_0 2154009600 48 2154009600 1 1#9d6d8c5477b54b4f17afef7ff40a8f4a 2023-01-24 14:54
lman_rp_0 2154009600 48 2154009600 1 1#c8658e8c4509fac7f0665c8e62f41647 2023-01-24 14:54
ndbmand_rp_0 2154009600 48 2154009600 1 1#be022bb6d9ba61a71406762d45d28abe 2023-01-24 14:55
keyman_rp_0 2154009600 48 2154009600 1 1#e9f59b1057a599543d8a70e47827c8b5 2023-01-24 14:53
odm_1_rp_0 2154009600 48 2154009600 1 1#89ec41610389477b89398473c3f67ed4 2023-01-24 14:54
ncsshd_bp_rp_0 2154009600 48 2154009600 1 1#ff5c906f79060a6db57fc9182f1ca43c 2023-01-24 14:55
nmspd_rp_0 2154009600 48 2154009600 1 1#a5973a198fd3338c85bcb95fbb9dff9b 2023-01-24 14:54
ezman_cc_0 2014139404 40 2014139404 1 1#e5647b24ac1d8a379a24767c270a2c09 2023-01-24 14:54
cmcc_cc_0 2153597954 40 2153597954 1 1#1f115f5d3d87a4d57bef167a46ea142a 2023-01-24 14:54
tamd_proc_rp_0 2153597954 40 2153597954 1 1#3c74606697d83a1e464aca7f25d38b49 2023-01-24 14:53
cmand_rp_0 566739968 32 566739968 1 1#1dffe7863aa5ee117130a010849b2e8b 2023-01-24 14:53
mcpcc-lc-ms_cc_0 2153597954 28 2153597954 1 1#7ce339e7fa1999085b4ef805040b1dfa 2023-01-24 14:54
sessmgrd_rp_0 2018635781 7 2018635781 1 1#1ec2548a0ca3f038f69cbaff5dfe427c 2023-01-24 14:44
pttcd_rp_0 2282963968 4 2282963968 1 1#eb434979804a1bce4143423d0e1cd917 2023-11-06 10:33

Backtrace

rrm_rp_0 callsite 1956510722 alloc 963 free 6 1#7637befe94e68380fae119331b433306 maroon:7F7B599D1000+5304 maroon:7F7B599D1000+657C ewlc_rrm_mgr:7F7B944F1000+53F76 ewlc_rrm_mgr:7F7B944F1000+7BC8A ewlc_rrm_mgr:7F7B944F1000+7D2C8 ewlc_rrm_mgr:7F7B944F1000+8904D ewlc_rrm_mgr:7F7B944F1000+9AC0F

show platform software process memory chassis active r0 all sorted
Pid RSS PSS Heap Shared Private Name
--------------------------------------------------------------------------
21780 1794280 1367966 1221336 527360 1266920 pubd
3416 1742112 1488251 480 331400 1410712 linux_iosd-imag
17605 723024 367274 126756 434164 288860 wncd_0
17459 703024 220594 7280 593492 109532 wncmgrd
20857 617284 157775 7724 561316 55968 dbm
17719 473616 137228 13364 403532 70084 wncd_1
17834 462224 124126 13240 404684 57540 wncd_2
18060 444060 120132 12368 385348 58712 wncd_4
18467 441836 95534 14756 404328 37508 nmspd
17947 439152 124410 13380 376400 62752 wncd_3
19229 390532 122744 35820 338120 52412 repm
18324 345396 98285 18348 290152 55244 rogued
19578 337552 93694 10200 314796 22756 odm_0
21688 268144 182898 3260 120128 148016 fman_fp_image
21465 251256 209583 1440 48916 202340 cpp_cp_svr
29644 249364 93595 388 185856 63508 ndbmand
17315 227112 54015 2472 196976 30136 wstatsd
18613 217764 58162 4128 181860 35904 mobilityd
18177 196800 53567 11260 163108 33692 rrm
21093 183976 76886 108 120672 63304 cli_agent
31518 177532 175191 83084 2396 175136 confd
18951 174040 45120 6944 141184 32856 sessmgrd
20425 154320 76073 4440 109152 45168 fman_rp
24728 135964 132677 248 3408 132556 mcpcc-lc-ms
22781 118428 93646 4772 28072 90356 ezman
959 115876 77171 98484 42424 73452 smand
18779 113820 29130 2836 91336 22484 psd
21268 105516 74528 2984 34508 71008 cpp_sp_svr
19693 90948 17949 2540 79160 11788 odm_1
21071 69100 41541 5520 30144 38956 cpp_driver
20860 62316 31592 4488 34440 27876 cpp_ha_top_leve
29894 57128 26855 316 33992 23136 dmiauthd
21893 52388 22368 2332 36560 15828 cman_fp
3604 48832 17232 2992 37048 11784 cmand
12585 45024 13121 1752 36212 8812 install_mgr
20665 39400 17065 1228 24380 15020 cpp_cdm_svr
23356 37360 10751 2000 29700 7660 cmcc
3493 35900 10198 2040 27592 8308 stack_mgr
4543 35380 9740 2040 27324 8056 rif_mgr
4168 35100 15831 1808 20236 14864 emd
5026 34892 25897 2916 10940 23952 nginx
10354 34352 10812 1960 25828 8524 vman
19458 34172 6155 1952 29084 5088 odm_proxy
19092 33580 8722 1592 28524 5056 service_mgr
23464 31556 12936 1572 19608 11948 emd
4924 27752 16815 1780 14736 13016 libvirtd
20102 27600 9185 2716 19860 7740 hman
4429 27176 8125 3744 19836 7340 btman
20288 26564 6348 1736 21464 5100 service_mgr
11046 25492 6018 1960 20528 4964 lman
23572 23704 6059 1484 18224 5480 btman
22058 23696 5507 1724 18780 4916 btman
4309 23680 6634 2528 17552 6128 keyman
22670 20780 5045 1256 16708 4072 hman
19343 18520 3972 2060 14820 3700 plogd
30202 18024 3600 1264 14644 3380 ncsshd_bp
9918 17640 2327 400 17252 388 ncsshd
30499 17064 3509 400 14316 2748 ncsshd
5115 13976 11035 10836 3036 10940 chasync.sh
3822 13752 4159 1116 9780 3972 tamd_proc
5025 13436 3378 2916 12184 1252 nginx
3935 12960 3711 1648 9388 3572 tams_proc
4903 12296 4356 396 10708 1588 virtlogd
4048 11736 2507 804 9384 2352 tam_svcs_esg_cf
1 11608 6869 2660 5888 5720 systemd
10749 11516 9179 8712 2400 9116 ncd.sh
13323 11488 9017 8528 2536 8952 auto_upgrade_cl
11624 11328 3606 8400 10440 888 issu_stack.sh
12484 10336 3361 8252 9772 564 issu_stack.sh
9477 10324 7553 7008 2852 7472 rollback_timer.
12477 10272 3366 8252 9696 576 issu_stack.sh
22035 9772 2105 400 7820 1952 pttcd
6809 9344 6867 132 2936 6408 dhcpd
14035 8608 6272 5716 2400 6208 periodic.sh
2928 7916 5527 5004 2452 5464 psvp.sh
3063 7872 5519 4940 2416 5456 pvp.sh
22317 7628 5078 4536 2620 5008 pvp.sh
199 7448 3130 2704 5716 1732 systemd-journal
19702 7388 5059 4528 2392 4996 pvp.sh
4898 7216 4263 3668 3048 4168 droputil.sh
5498 7160 4263 3628 2988 4172 reflector.sh
5027 6776 2037 2916 6172 604 nginx
19375 6760 3179 2296 4252 2508 journalctl
29480 6384 1946 268 4628 1756 pman
252 6372 3064 924 3748 2624 systemd-udevd
6030 6328 3553 2892 2856 3472 iptbl.sh
9922 6072 1832 400 5700 372 ncsshd
21768 5676 1016 268 4688 988 pman
20392 5652 950 268 4732 920 pman
19449 5648 946 268 4732 916 pman
10696 5644 1169 268 4664 980 pman
23564 5636 932 268 4732 904 pman
22773 5636 932 268 4732 904 pman
4040 5636 934 268 4732 904 pman
3927 5636 934 268 4732 904 pman
19084 5620 949 268 4700 920 pman
18771 5620 949 268 4700 920 pman
29636 5616 949 268 4696 920 pman
17711 5616 949 268 4696 920 pman
17595 5616 949 268 4696 920 pman
19335 5608 948 268 4688 920 pman
11607 5604 1106 268 4688 916 pman
18314 5596 948 268 4676 920 pman
22018 5592 932 268 4688 904 pman
24719 5580 1082 268 4688 892 pman
20273 5580 948 268 4660 920 pman
18941 5576 945 268 4660 916 pman
3483 5576 948 268 4656 920 pman
20840 5568 1010 268 4584 984 pman
13831 5568 1128 268 4628 940 pman
29878 5552 951 268 4628 924 pman
23348 5552 932 268 4648 904 pman
18169 5552 947 268 4632 920 pman
17825 5548 954 268 4620 928 pman
4301 5544 944 268 4628 916 pman
3343 5544 951 268 4620 924 pman
20854 5540 946 268 4620 920 pman
23456 5536 931 268 4632 904 pman
17939 5528 947 268 4608 920 pman
3596 5528 946 268 4608 920 pman
20655 5524 934 268 4616 908 pman
17305 5524 946 268 4604 920 pman
21674 5516 948 268 4596 920 pman
21079 5516 947 268 4596 920 pman
19681 5516 948 268 4596 920 pman
14027 5516 1094 268 4616 900 pman
13313 5516 1103 268 4608 908 pman
4535 5516 948 268 4596 920 pman
21049 5512 945 268 4592 920 pman
20084 5512 946 268 4592 920 pman
19568 5512 946 268 4592 920 pman
11029 5512 950 268 4588 924 pman
4160 5512 946 268 4592 920 pman
951 5512 946 268 4592 920 pman
4421 5508 950 268 4584 924 pman
21254 5504 947 268 4584 920 pman
18459 5504 946 268 4584 920 pman
21453 5492 943 268 4576 916 pman
12569 5492 946 268 4572 920 pman
30187 5484 946 268 4564 920 pman
22662 5484 926 268 4584 900 pman
21876 5480 942 268 4564 916 pman
18606 5480 946 268 4560 920 pman
19221 5472 946 268 4552 920 pman
22051 5464 946 268 4544 920 pman
18053 5456 945 268 4536 920 pman
30485 5448 930 268 4544 904 pman
17450 5448 942 268 4532 916 pman
10344 5448 942 268 4532 916 pman
29488 5444 1818 2296 4732 712 confd-startup.s
3814 5444 926 268 4544 900 pman
5016 5436 946 268 4516 920 pman
9923 4948 1199 400 3976 972 netconf-subsys
31625 4396 1786 2296 3684 712 confd-startup.s
4930 4084 2097 1300 2056 2028 rpc.mountd
4900 3952 1014 792 3032 920 oom.sh
3135 3880 789 268 3176 704 rotee
19937 3828 726 268 3184 644 rotee
5563 3816 727 268 3176 640 rotee
3053 3792 701 268 3176 616 rotee
6192 3732 693 268 3120 612 rotee
5024 3732 693 268 3120 612 rotee
22392 3708 707 268 3076 632 rotee
5442 3696 721 268 3052 644 rotee
6267 3680 690 268 3064 616 rotee
9744 3644 688 268 3032 612 rotee
9474 3096 398 132 2776 320 auxinit.sh
413 3060 1880 132 1300 1760 nfsdcld
13839 2812 377 132 2508 304 sort_files_by_i
389 2796 580 132 2304 492 auditd
31768 2660 342 132 2380 280 stack_sntp.sh
411 2600 713 132 2040 560 rpc.idmapd
9482 2524 297 132 2316 208 xinetd
9479 2500 320 132 2268 232 xinetd
4946 2300 285 132 2092 208 xinetd
4935 2300 777 132 1572 728 rpc.statd
8101 2232 305 132 2000 232 xinetd
4905 2204 680 132 1576 628 rpcbind
399 2016 349 132 1716 300 audispd
31773 1996 221 132 1824 172 sntp
5114 1892 222 132 1756 136 inet_gethost
12475 1808 218 132 1612 196 inotifywait
5113 1744 126 132 1680 64 inet_gethost
5585 1740 180 132 1584 156 inotifywait
10005 1732 271 132 1480 252 inotifywait
13809 1720 174 132 1568 152 inotifywait
3058 1696 168 132 1548 148 inotifywait
5462 1644 179 132 1484 160 inotifywait
12492 1636 171 132 1484 152 inotifywait
6360 1628 163 132 1484 144 inotifywait
12482 1620 174 132 1464 156 inotifywait
31624 1568 162 132 1416 152 inotifywait
11210 1564 139 132 1464 100 sleep
22445 1560 165 132 1412 148 inotifywait
10847 1560 155 132 1424 136 sleep
9803 1556 158 132 1408 148 inotifywait
9806 1540 157 132 1400 140 inotifywait
20100 1508 165 132 1360 148 inotifywait
11477 1508 169 132 1356 152 inotifywait
31552 1392 128 132 1272 120 erl_child_setup
5107 1392 124 132 1304 88 sleep

show platform software process memory chassis standby r0 all sorted
Pid RSS PSS Heap Shared Private Name
--------------------------------------------------------------------------
3408 4500304 4275776 480 287724 4212580 linux_iosd-imag
17896 421512 204491 17248 251732 169780 wncd_0
17750 322820 106848 4648 254052 68768 wncmgrd
18237 308536 95383 10356 244576 63960 wncd_3
18008 295976 84222 10344 240444 55532 wncd_1
18122 290968 79836 10428 239488 51480 wncd_2
18352 289068 79762 10348 237544 51524 wncd_4
21605 260868 177681 3260 117924 142944 fman_fp_image
15887 249060 96925 36356 189308 59752 repm
17063 248964 81852 5956 197048 51916 dbm
16344 221128 69071 10376 199800 21328 odm_0
21350 203924 165010 1440 45732 158192 cpp_cp_svr
18902 198080 50780 3448 165004 33076 mobilityd
30138 182740 57079 388 143092 39648 ndbmand
19245 169584 42740 6748 138336 31248 sessmgrd
23062 166940 44350 1588 138296 28644 pubd
18470 163352 35366 3192 139360 23992 rrm
18612 153408 33647 2344 129184 24224 rogued
16865 149860 74203 4440 105028 44832 fman_rp
18757 149736 30946 2432 127424 22312 nmspd
32086 146076 143934 72904 2160 143916 confd
17605 143836 35906 2324 129580 14256 wstatsd
28418 135684 132408 248 3408 132276 mcpcc-lc-ms
17175 129792 40937 108 97164 32628 cli_agent
21136 122336 93352 2720 32508 89828 cpp_sp_svr
24704 118588 93907 4756 28072 90516 ezman
19075 113116 29565 2696 90376 22740 psd
1557 99148 61719 17532 40820 58328 smand
16456 85316 15626 2428 73700 11616 odm_1
20931 67456 41551 5520 28480 38976 cpp_driver
20720 58976 30245 4212 32228 26748 cpp_ha_top_leve
21806 50552 22256 2088 34752 15800 cman_fp
3596 46736 16204 2836 35852 10884 cmand
12239 44452 13055 1660 36224 8228 install_mgr
20509 39252 16977 1296 24288 14964 cpp_cdm_svr
25783 37676 10989 2000 29940 7736 cmcc
3483 35316 10194 2088 27032 8284 stack_mgr
4537 34088 9669 1876 26064 8024 rif_mgr
4161 33312 15834 1632 18488 14824 emd
30400 33192 8737 316 26280 6912 dmiauthd
19389 32244 8196 1468 27808 4436 service_mgr
10351 32112 10511 1788 23896 8216 vman
16226 32096 6000 1784 27112 4984 odm_proxy
25991 31996 12933 1572 20088 11908 emd
4928 27940 17000 1780 14696 13244 libvirtd
20128 24664 6031 1476 19864 4800 service_mgr
16725 24536 7374 2384 18448 6088 hman
11047 23188 5802 1796 18384 4804 lman
26169 22804 5265 1440 18164 4640 btman
4421 22616 6922 2436 16284 6332 btman
22001 21476 5274 1452 16760 4716 btman
24474 20868 5281 1256 16576 4292 hman
4301 20788 5645 2192 15648 5140 keyman
16092 16328 3716 1856 12860 3468 plogd
30709 14944 3171 1100 11944 3000 ncsshd_bp
3814 13624 4041 1116 9764 3860 tamd_proc
9473 13620 10618 10392 3172 10448 chasync.sh
5670 13608 3399 2916 12428 1180 nginx
3927 12912 3681 1648 9380 3532 tams_proc
12565 12412 10746 264 1796 10616 chasync.sh
31012 12064 2609 268 9720 2344 ncsshd
4900 11976 4165 396 10464 1512 virtlogd
4040 11812 2525 804 9456 2356 tam_svcs_esg_cf
10754 11624 9181 8712 2504 9120 ncd.sh
12840 11444 9017 8528 2492 8952 auto_upgrade_cl
1 11384 6869 2664 5660 5724 systemd
11563 11252 3509 8400 10480 772 issu_stack.sh
9474 11180 8324 7696 2936 8244 issu_switchover
9475 10424 7560 7008 2944 7480 rollback_timer.
12187 10348 3342 8252 9788 560 issu_stack.sh
12182 10284 3351 8252 9704 580 issu_stack.sh
23183 9680 2085 400 7736 1944 pttcd
6807 9496 7002 132 2968 6528 dhcpd
14005 8824 6268 5716 2620 6204 periodic.sh
3055 8084 5523 4976 2628 5456 pvp.sh
2921 8068 5526 5004 2604 5464 psvp.sh
19538 7524 5068 4528 2528 4996 pvp.sh
23578 7484 5085 4540 2472 5012 pvp.sh
5671 7484 2598 2916 6792 692 nginx
5495 7184 4255 3628 3008 4176 reflector.sh
4895 7144 4245 3668 2976 4168 droputil.sh
5672 6828 2047 2916 6220 608 nginx
6027 6460 3557 2892 2984 3476 iptbl.sh
252 6452 3076 924 3824 2628 systemd-udevd
199 6408 2338 2464 5232 1176 systemd-journal
16136 6396 2744 1240 4108 2288 journalctl
10692 5672 1144 268 4732 940 pman
11028 5640 941 268 4728 912 pman
19236 5636 933 268 4732 904 pman
4032 5636 933 268 4732 904 pman
1549 5636 951 268 4728 908 pman
24461 5604 932 268 4700 904 pman
18895 5600 929 268 4700 900 pman
17055 5600 929 268 4700 900 pman
4293 5600 929 268 4700 900 pman
19065 5596 929 268 4696 900 pman
28400 5592 1098 268 4688 904 pman
17741 5592 932 268 4688 904 pman
16083 5592 933 268 4688 904 pman
12231 5592 932 268 4688 904 pman
10342 5592 933 268 4688 904 pman
4152 5592 933 268 4688 904 pman
21591 5588 929 268 4688 900 pman
16716 5588 928 268 4688 900 pman
13988 5584 1093 268 4688 896 pman
13696 5584 1105 268 4676 908 pman
23176 5580 933 268 4676 904 pman
25767 5564 928 268 4664 900 pman
29978 5560 1103 268 4656 904 pman
3588 5556 928 268 4656 900 pman
18605 5552 929 268 4652 900 pman
12822 5552 1095 268 4656 896 pman
11552 5548 1097 268 4648 900 pman
17596 5544 932 268 4640 904 pman
30382 5540 928 268 4640 900 pman
26153 5536 931 268 4632 904 pman
3335 5536 931 268 4632 904 pman
20915 5532 931 268 4628 904 pman
18750 5532 927 268 4632 900 pman
15876 5532 935 268 4624 908 pman
5663 5532 932 268 4628 904 pman
4413 5532 931 268 4628 904 pman
16844 5528 927 268 4628 900 pman
25975 5520 927 268 4620 900 pman
23054 5520 927 268 4620 900 pman
21119 5520 930 268 4616 904 pman
18230 5520 927 268 4620 900 pman
18114 5520 927 268 4620 900 pman
18344 5516 935 268 4608 908 pman
20700 5512 931 268 4608 904 pman
17167 5512 931 268 4608 904 pman
3806 5512 931 268 4608 904 pman
20114 5508 927 268 4608 900 pman
16448 5508 927 268 4608 900 pman
24688 5496 930 268 4592 904 pman
18460 5496 931 268 4592 904 pman
30997 5492 935 268 4584 908 pman
16335 5484 927 268 4584 900 pman
18000 5480 934 268 4572 908 pman
16218 5472 926 268 4572 900 pman
4529 5472 926 268 4572 900 pman
30692 5468 930 268 4564 904 pman
30130 5468 929 268 4564 904 pman
21330 5464 926 268 4564 900 pman
20493 5464 926 268 4564 900 pman
3919 5464 926 268 4564 900 pman
17886 5452 930 268 4548 904 pman
21793 5448 931 268 4544 904 pman
19379 5448 931 268 4544 904 pman
21985 5436 925 268 4536 900 pman
3475 5428 931 268 4524 904 pman
29986 5344 1792 2296 4648 696 confd-startup.s
2544 4328 1770 2296 3632 696 confd-startup.s
4934 4072 2032 1300 2104 1968 rpc.mountd
9767 3816 705 268 3200 616 rotee
5560 3808 712 268 3180 628 rotee
5439 3796 720 268 3156 640 rotee
4897 3764 989 792 2848 916 oom.sh
3127 3764 774 268 3064 700 rotee
19754 3712 717 268 3068 644 rotee
5011 3700 692 268 3084 616 rotee
3045 3696 684 268 3088 608 rotee
6185 3660 688 268 3052 608 rotee
9742 3644 688 268 3032 612 rotee
6265 3644 688 268 3032 612 rotee
23861 3620 706 268 2988 632 rotee
418 3372 2032 132 1468 1904 nfsdcld
9472 3232 394 132 2916 316 auxinit.sh
394 2728 564 132 2248 480 auditd
13711 2700 365 132 2396 304 sort_files_by_i
32365 2568 331 132 2292 276 stack_sntp.sh
417 2488 683 132 1956 532 rpc.idmapd
9482 2484 293 132 2276 208 xinetd
4937 2468 787 132 1736 732 rpc.statd
9477 2456 310 132 2228 228 xinetd
4944 2296 278 132 2092 204 xinetd
8089 2264 301 132 2036 228 xinetd
4901 2152 675 132 1528 624 rpcbind
403 2024 344 132 1724 300 audispd
32376 1968 222 132 1792 176 sntp
14176 1868 278 132 1612 256 inotifywait
2557 1808 198 132 1632 176 inotifywait
5582 1784 182 132 1624 160 inotifywait
6357 1756 170 132 1608 148 inotifywait
3050 1696 169 132 1548 148 inotifywait
12191 1664 172 132 1512 152 inotifywait
2543 1640 167 132 1484 156 inotifywait
12576 1636 166 132 1488 148 inotifywait
12186 1636 171 132 1484 152 inotifywait
12180 1624 177 132 1464 160 inotifywait
5459 1584 181 132 1420 164 inotifywait
24048 1572 170 132 1420 152 inotifywait
19923 1560 160 132 1416 144 inotifywait
9801 1548 164 132 1400 148 inotifywait
9805 1544 158 132 1396 148 inotifywait
32119 1532 130 132 1412 120 erl_child_setup
13656 1508 168 132 1356 152 inotifywait
5730 1492 148 132 1360 132 inotifywait
23695 1448 132 132 1352 96 sleep
23420 1416 151 132 1280 136 sleep
5094 1396 127 132 1304 92 sleep

show int po1 | i line protocol|put rate|drops|broadcast
Port-channel1 is up, line protocol is up
Input queue: 0/375/0/0 (size/max/drops/flushes); Total output drops: 0
5 minute input rate 18688000 bits/sec, 4211 packets/sec
5 minute output rate 36086000 bits/sec, 13948 packets/sec
Received 2012371334 broadcasts (3419436413 multicasts)
Output 271606683 broadcasts (849886412 multicasts)
149248298 unknown protocol drops

show platform hardware chassis active qfp statistics drop
Last clearing of QFP drops statistics : never

-------------------------------------------------------------------------
Global Drop Stats Packets Octets
-------------------------------------------------------------------------
Disabled 390910755 24281680930
IpFormatErr 4292 283272
Ipv4NoAdj 1779 247281
Ipv6NoRoute 20724 1160544
L2mcInvalidReplicaRecord 85 12614
PuntPerCausePolicerDrops 36545646 6870380510
SWPortMacConflict 113 14056
SWPortStby 4173783683 1263366781518
SWPortStbyTXDrop 40938053 7430528242
TailDrop 1477979447 218724479325
UnconfiguredIpv4Fia 654957088 634516130062
UnconfiguredIpv6Fia 116973300 15712169083
WlsCapwapError 1727505 427249961
WlsCapwapReassFragConsume 7801589 521594277
WlsClientError 5195752 479170969

show platform hardware chassis active qfp feature wireless punt statistics
CPP Wireless Punt stats:

App Tag Packet Count
------- ------------
CAPWAP_PKT_TYPE_DOT11_PROBE_REQ 786840378
CAPWAP_PKT_TYPE_DOT11_MGMT 120429475
CAPWAP_PKT_TYPE_DOT11_IAPP 3947197078
CAPWAP_PKT_TYPE_DOT11_RFID 148511353
CAPWAP_PKT_TYPE_DOT11_RRM 0
CAPWAP_PKT_TYPE_DOT11_DOT1X 168675970
CAPWAP_PKT_TYPE_CAPWAP_KEEPALIVE 235153842
CAPWAP_PKT_TYPE_MOBILITY_KEEPALIVE 0
CAPWAP_PKT_TYPE_CAPWAP_CNTRL 1482422254
CAPWAP_PKT_TYPE_CAPWAP_DATA 0
CAPWAP_PKT_TYPE_CAPWAP_DATA_PAT 65018
CAPWAP_PKT_TYPE_MOBILITY_CNTRL 0
WLS_SMD_WEBAUTH 0
SISF_PKT_TYPE_ARP 167664252
SISF_PKT_TYPE_DHCP 15941063
SISF_PKT_TYPE_DHCP6 17167719
SISF_PKT_TYPE_IPV6_ND 27204683
SISF_PKT_TYPE_DATA_GLEAN 418127
SISF_PKT_TYPE_DATA_GLEAN_V6 38193
SISF_PKT_TYPE_DHCP_RELAY 0
WLCLIENT_PKT_TYPE_MDNS 0
CAPWAP_PKT_TYPE_CAPWAP_RESERVED 0

show buffers | i buffers|failures
Small buffers, 104 bytes (total 1200, permanent 1200, peak 1250 @ 11w0d):
0 failures (0 no memory)
Middle buffers, 600 bytes (total 900, permanent 900, peak 909 @ 1y11w):
0 failures (0 no memory)
Big buffers, 1536 bytes (total 900, permanent 900, peak 901 @ 1y11w):
0 failures (0 no memory)
VeryBig buffers, 4520 bytes (total 100, permanent 100, peak 101 @ 1y11w):
0 failures (0 no memory)
Large buffers, 5024 bytes (total 100, permanent 100, peak 101 @ 1y11w):
0 failures (0 no memory)
VeryLarge buffers, 8304 bytes (total 100, permanent 100, peak 106 @ 15w1d):
0 failures (0 no memory)
Huge buffers, 18024 bytes (total 20, permanent 20, peak 21 @ 1y11w):
0 failures (0 no memory)
CF Small buffers, 104 bytes (total 101, permanent 100, peak 119 @ 1y11w):
0 failures (0 no memory)
Generic ED Pool buffers, 512 bytes (total 101, permanent 100, peak 101 @ 1y11w):
CF Middle buffers, 600 bytes (total 101, permanent 100, peak 140 @ 1y11w):
0 failures (0 no memory)
Syslog ED Pool buffers, 600 bytes (total 1057, permanent 1056, peak 1057 @ 1y11w):
EOBC0 buffers, 1524 bytes (total 256, permanent 256):
CF Big buffers, 1536 bytes (total 26, permanent 25, peak 26 @ 1y11w):
0 failures (0 no memory)
IPC buffers, 4096 bytes (total 2604, permanent 2604):
0 failures (0 no memory)
CF VeryBig buffers, 4520 bytes (total 3, permanent 2, peak 3 @ 1y11w):
0 failures (0 no memory)
CF Large buffers, 5024 bytes (total 2, permanent 1, peak 2 @ 1y11w):
0 failures (0 no memory)
IPC Medium buffers, 16384 bytes (total 2, permanent 2, peak 4 @ 1y11w):
2 failures (0 no memory)
Private Huge IPC buffers, 18024 bytes (total 1, permanent 0, peak 1 @ 1y11w):
0 failures (0 no memory)
Private Huge buffers, 65280 bytes (total 1, permanent 0, peak 1 @ 1y11w):
0 failures (0 no memory)
IPC Large buffers, 65535 bytes (total 17, permanent 16, peak 17 @ 1y11w):
0 failures (0 no memory)
Header buffers, 0 bytes (total 266, permanent 256, peak 266 @ 22w6d):
0 failures (0 no memory)
F/S buffers, 256 bytes (total 384, permanent 384):
0 failures (0 no memory)
Normal buffers, 512 bytes (total 512, permanent 512):
0 failures (0 no memory)
lsmpi_rx buffers, 416 bytes (total 8194, permanent 8194):
lsmpi_tx buffers, 416 bytes (total 4098, permanent 4098):

Leo Laohoo · ‎04-14-2024

21780 87 1794252 136 1221304 1794252 pubd

That's too high. Is there a DNAC appliance?

RoeyF · ‎04-14-2024

yes, we have.

Leo Laohoo · ‎04-15-2024

There is a very long list of memory leak bugs attributed to DNAC. For obvious reasons, the bugs themselves will not use the words "Catalyst Center" or "DNAC". Instead, "Catalyst Center" and/or "DNAC" is substituted with "pubd" and/or "telemetry" as not to "upset" some customers.

Remove DNAC from monitoring this controller (for two weeks) and see if the errors go away.

RoeyF · ‎04-15-2024

hi,

it was exist before connecting DNAC,

i'm planning upgrade the WLC software to the last suggest version

marce1000 · ‎04-15-2024

>...i'm planning upgrade the WLC software to the last suggested version
- Good plan!

M.

-- Each morning when I wake up and look into the mirror I always say ' Why am I so brilliant ? '
When the mirror will then always repond to me with ' The only thing that exceeds your brilliance is your beauty! '

Leo Laohoo · ‎04-15-2024

@RoeyF wrote:
i'm planning upgrade the WLC software to the last suggest version

It better not be, 17.9.4/17.9.4a or 17.9.5!

marce1000 · ‎04-15-2024

@Leo Laohoo ; Please Leo , again explain why ; for customer my viewpoint currently remains go for :
https://software.cisco.com/download/home/286316412/type/282046477/release/Cupertino-17.9.5

M.

-- Each morning when I wake up and look into the mirror I always say ' Why am I so brilliant ? '
When the mirror will then always repond to me with ' The only thing that exceeds your brilliance is your beauty! '

Leo Laohoo · ‎04-15-2024

@RoeyF,

Anyone planning to use 17.9.4/17.9.4a or 17.9.5 with 1800/2800/3800/4800/1560 and all Catalyst 9k APs must provisions the APs to reboot daily. And no exception.

There are several known bugs which causes the abovementioned APs to randomly drop random packets at random times. Daily reboot will help alleviate the issue until the buffer gets filled up and the problem returns. How fast does this buffer gets filled up is highly dependent on how "busy" the individual AP is.

Currently have a pair of HA SSO controllers on 17.9.5 and I have to fail-over every three weeks because the controller will stop processing anything like random wireless clients are stuck at "Authenticating" state and without an IP address.

I have a 9800-L, 2 week uptime, which suddenly "stopped". As in, no console, all ports stopped. Just stopped. We had to cold-reboot the controller. No crash logs. Nothing.

And with 17.9.5 given the "star" blessing, we will see just how buggy, unreliable and unstable 17.9.5 is!

marce1000 · ‎04-14-2024

- What outputs do you have from :
show platform resources
show platform hardware chassis active qfp datapath utilization | i Load

M.

-- Each morning when I wake up and look into the mirror I always say ' Why am I so brilliant ? '
When the mirror will then always repond to me with ' The only thing that exceeds your brilliance is your beauty! '

RoeyF · ‎04-15-2024

show platform resources
**State Acronym: H - Healthy, W - Warning, C - Critical
Resource Usage Max Warning Critical State
----------------------------------------------------------------------------------------------------
RP0 (ok, active) H
Control Processor 13.75% 100% 80% 90% H
DRAM 8495MB(26%) 31625MB 88% 93% H
harddisk 0MB(0%) 0MB 80% 85% H
ESP0(ok, active) H
QFP H
TCAM 60cells(0%) 1048576cells 65% 85% H
DRAM 533279KB(25%) 2097152KB 85% 95% H
IRAM 14762KB(11%) 131072KB 85% 95% H
CPU Utilization 1.00% 100% 90% 95% H

show platform hardware chassis active qfp datapath utilization | i Load
Processing: Load (pct) 1 1 1 1