Re: memory high

k.adath2015 · ‎07-01-2020

Hi ,

router showing high memory usage (qos_mon_periodic)

Cisco IOS Software, C3900 Software (C3900-UNIVERSALK9-M), Version 15.5(1)T, RELEASE SOFTWARE (fc2)

is there a workaround to free up memory

If needed to upgrade what is the recommeded ios

processes memory sorted
Processor Pool Total: 749956420 Used: 640726060 Free: 109230360
I/O Pool Total: 71303168 Used: 38883200 Free: 32419968

PID TTY Allocated Freed Holding Getbufs Retbufs Process
403 0 502952496 0 502959792 0 0 qos_mon_periodic
0 0 204131728 105940144 91863904 0 0 *Init*
1 0 1671072180 1631910068 40289136 0 0 Chunk Manager
138 0 17957192 11660 17952912 0 0 ISM-VPN init
218 0 43663276 30547208 14006360 0 0 STILE PERIODIC T
372 0 1384728 20524 1371500 0 0 EEM Server
0 0 4288137060 2987437848 957556 58304751 2268 *Dead*
0 0 0 0 722844 0 0 *MallocLite*
436 0 614388 8568 494920 0 0 BGP Router
171 0 2405357660 835497304 343916 0 0 CDP Protocol
316 0 294864 588 303572 0 0 Crypto WUI
355 0 287068 4988 292376 100548 0 EEM ED Syslog
368 0 285148 3908 266896 0 0 VLAN Manager
186 0 211540 0 224836 0 0 IP ARP Adjacency
356 0 212004 4988 217312 67468 0 EEM ED Generic
298 0 218600 556 216044 0 0 Crypto HW Proc
7 0 1163761560 1434026820 205572 4010418669 4088817257 Pool Manager
263 645 155907448 155731016 188988 4536 0 SSH Process
428 0 168040 816 178336 0 0 BGP Task
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
330 0 5413188 66012 150504 1787364 0 Crypto IKEv2
139 0 366728 211960 148268 0 0 mDNS
373 0 133924 97616 121908 0 0 Call Home proces
128 0 170856 25504 102056 0 0 USB Startup
4 0 65588 0 90884 0 0 EDDRI_MAIN
188 0 1865539084 2265371668 82936 1779724 126252 IP Input
245 0 66496 856 75936 0 0 IP Connected Rou
70 0 66304 0 73600 0 0 IF-MGR control p
295 0 66412 240 73468 0 0 HTTP Process
324 0 1038580 913840 73204 0 0 Crypto CA
14 0 56668 17008 63340 0 0 XDMDispatchLoop
184 0 49412 0 62708 0 0 IPAM Manager
260 0 944 0 62240 0 0 COPS
143 0 54596 416 61476 0 0 VRRS Main thread
169 0 49408 0 56704 0 0 ACCT Periodic Pr
187 0 49384 0 56680 0 0 IP ARP Retry Age
319 0 49624 240 56680 0 0 Timer Library
433 0 30700 748 55860 0 0 LICENSE AGENT
422 0 85228 29008 55228 0 0 DHCPD Receive
119 0 48620 1569561604 53512 0 0 EEM ED ND
335 0 2765844 2728036 51744 0 0 Crypto IKMP
337 0 322040 12224 50472 2268 0 IPSEC key engine
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
426 0 687096 1060 47804 108420 0 HSRP Common
96 0 1853573700 1853500776 45632 18276 0 Per-Second Jobs
262 0 2715538464 2636872096 42024 12853100 0 ADJ resolve proc
37 0 2636914736 2636861940 40956 3120 0 ARP Background
66 644 79756 55420 37256 0 0 SSH Process
248 0 34908 5088 37116 0 0 SR CapMan Proces
253 0 16672 7196 34588 0 0 HTTP CORE
61 0 413132 3688 32268 53820 0 Net Background
293 0 16824 240 29880 0 0 IPS Auto Update
157 0 3168 0 28464 0 0 SMI Director DB
427 0 2732 240 27248 0 0 HSRP IPv4
208 0 1840 240 26896 0 0 Ethernet CFM
250 0 85324 240 26624 0 0 SCTP Main Proces
243 0 15728 2740 26284 0 0 IP RIB Update
318 0 944 0 26240 0 0 FW_TEST_TRP
144 0 1152 240 26208 0 0 raw tcp monitori
159 0 704 0 26000 0 0 SMI Backup Proce
418 0 3467889936 2760562644 25876 0 0 SNMP ENGINE
408 0 240 0 25536 0 0 tHUB
339 0 0 0 25296 0 0 Crypto ACL
33 0 0 0 25296 0 0 Crash writer
209 0 240 240 25296 0 0 Ethernet CFM PAL
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
407 0 0 0 25296 0 0 fnvRootHubPortSt
117 0 0 0 25296 0 0 RF_INTERDEV_SCTP
129 0 0 0 25296 0 0 CF_INTERDEV_SCTP
36 0 51536 34704 24128 0 0 ARP Input
167 0 16832 240 23888 0 0 AAA Server
252 0 2160840028 1739342860 23220 0 0 TCP Protocols
69 0 23604 16164 23068 0 0 RF Slave Main Th
380 0 13052 1208 22140 0 0 EEM Policy Direc
397 0 16816 4988 22124 0 0 EEM ED CRASH
396 0 16816 4988 22124 0 0 EEM ED DS
353 0 20320 5704 22088 0 0 DCM Core Thread
399 0 16672 4988 21980 0 0 EEM ED Nf
395 0 16244 4988 21552 0 0 EEM ED Env
393 0 16244 4988 21552 0 0 EEM ED Test
216 0 6732 120 20028 0 0 CEF background p
227 0 12928 3096 19864 0 0 CEF: IPv4 proces
297 0 12580 240 19636 0 0 CIFS Proxy Proce
359 0 13412 4988 18720 0 0 EEM ED Resource
432 0 88152 59076 18148 0 0 NTP
384 0 12000 4988 17308 0 0 EEM ED Interface
354 0 11972 5156 17280 0 0 EEM ED Routing
388 0 12216 4988 17068 0 0 EEM ED RF
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
57 0 997720 970916 17028 0 0 crypto sw pk pro
358 0 11628 4988 16936 0 0 EEM ED Track
357 0 11620 4988 16928 0 0 EEM ED NHRP
391 0 11620 4988 16928 0 0 EEM ED SNMP Noti
392 0 11608 4988 16916 0 0 EEM ED Timer
382 0 11560 4988 16868 0 0 EEM ED CLI
383 0 11516 4988 16824 0 0 EEM ED Counter
394 0 11516 4988 16824 0 0 EEM ED Config
389 0 11516 4988 16824 0 0 EEM ED SNMP
385 0 11516 4988 16824 0 0 EEM ED IOSWD
118 0 11516 4988 16824 0 0 EEM ED Identity
386 0 11516 4988 16824 0 0 EEM ED None
387 0 11516 4988 16824 0 0 EEM ED OIR
390 0 11516 4988 16824 0 0 EEM ED SNMP Obje
405 0 11516 4988 16824 0 0 EEM ED Ipsla
404 0 11516 4988 16824 0 0 EEM ED RPC
402 0 3304 0 16600 0 0 udp_transport Se
44 0 8412 80 15628 0 0 Entity MIB API
197 0 8424 0 15548 0 0 SSH Event handle
370 0 2468 480 15284 0 0 RBM CORE
376 0 10096 1964 15052 0 0 DCM snmp dp Thre
280 0 4728 0 15024 0 0 IPv6 Static Hand
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
400 0 1232507488 1210971444 14824 7779240 0 Syslog
410 0 1728 240 14784 0 0 MRIB Process
351 0 7456 104 14752 0 0 dcm_cli_engine
381 0 3490539892 3452511060 14420 0 0 IP SNMP
417 0 7500 33888 14380 0 0 EEM Helper Threa
419 0 1260 240 14348 0 0 IP SNMPV6
67 0 66872 0 14340 0 0 CTS CORE
327 0 944 0 14240 0 0 PKI OCSP
378 0 9908 14608 14116 0 0 Bulkstat-Client
68 0 1044 83868 14100 0 0 SXP CORE
315 0 1032 240 14088 0 0 LDAP process
398 0 3557024556 241568 14064 0 0 PDU DISPATCHER
219 0 1584869656 1584870212 13976 0 0 Flow Exporter Ti
320 0 6852 240 13908 0 0 Crypto Support
203 0 480 240 13536 0 0 Spanning Tree
217 0 224 0 13520 0 0 fib_fib_bfd_sb e
177 0 224 0 13520 0 0 CEF switching ba
229 0 224 0 13520 0 0 Collection proce
265 0 224 0 13520 0 0 MFIB Master back
228 0 224 0 13520 0 0 ADJ background
409 0 3755628144 3755628060 13380 0 0 mdns Timer Proce
421 0 7522796 14634212 13328 18144 0 SNMP Traps
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
420 0 0 0 13328 0 0 SNMP ConfCopyPro
313 0 4508 480 13324 0 0 EST Client
329 0 0 0 13308 0 0 encrypt proc
278 0 0 0 13296 0 0 VPDN call manage
284 0 0 0 13296 0 0 Ethernet PM Moni
276 0 240 240 13296 0 0 X.25 Background
292 0 0 0 13296 0 0 IPS Process
42 0 0 0 13296 0 0 Policy Manager
308 0 0 0 13296 0 0 Opaque Database
323 0 0 0 13296 0 0 RSA background p
264 0 240 240 13296 0 0 Tunnel
47 0 0 0 13296 0 0 License IPC stat
106 0 0 0 13296 0 0 sal_dpc_process
325 0 240 240 13296 0 0 Crypto PKI-CRL
326 0 0 0 13296 0 0 Crypto PKI-Rev-P
103 0 240 240 13296 0 0 SM Installer
328 0 0 0 13296 0 0 PKI Revocation
48 0 0 0 13296 0 0 License IPC serv
333 0 0 0 13296 0 0 Crypto INT
334 0 6516 1660 13296 2268 0 Crypto IKE Dispa
146 0 240 240 13296 0 0 Auth Manager
251 0 3105568 1551964260 13296 624016 642744 TCP Timer
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
54 0 240 240 13296 0 0 Dialer event
341 0 0 0 13296 0 0 IPSec background
350 0 0 0 13296 0 0 Test AAA Client
423 0 0 0 13296 0 0 CFT Timer Proces
16 0 0 0 13296 0 0 OIR Handler
242 0 0 0 13296 0 0 Routing Topology
241 0 0 0 13296 0 0 RG If-Mgr Timer
240 0 240 240 13296 0 0 RG Media Timer
87 0 0 0 13296 0 0 Crypto PKI-HA
424 0 0 0 13296 0 0 FNF Cache Ager P
56 0 240 240 13296 0 0 XML Proxy Client
425 0 93620 0 13296 52452 0 FNF Cache Ager P
160 0 240 240 13296 0 0 RG Faults Timer
161 0 240 240 13296 0 0 RG Protocol Time
162 0 240 240 13296 0 0 RG Transport Tim
365 0 0 0 13296 0 0 IKEv2 FlexVPN Pr
62 0 1928 1928 13296 0 0 IDB Work
63 0 139160 240 13296 77832 0 Logger
301 0 240 240 13296 0 0 VO IM DP
195 0 240 240 13296 0 0 PPP IP Route
220 0 240 240 13296 0 0 Flow Exporter Pa
181 0 240 240 13296 0 0 ATM OAM Input
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
182 0 240 240 13296 0 0 ATM OAM TIMER
199 0 0 0 13296 0 0 SSS Manager
185 0 240 240 13296 0 0 IPAM Events
204 0 240 240 13296 0 0 SSM connection m
214 0 240 240 13296 0 0 KRB5 AAA
175 0 240 240 13296 0 0 Ethernet LMI
200 0 0 0 13296 0 0 SSS Policy Manag
205 0 0 0 13296 0 0 WAAS Process
0 0 12712 907928692 12712 0 0 *Sched*
352 0 5592 264 12700 0 0 dcm_cli_provider
158 0 4728 0 12024 0 0 SMI CDP Update H
94 0 4968 240 12024 0 0 Compute load avg
91 0 19000 10876 11296 0 0 RF Master Main T
266 0 996 240 11052 0 0 MVPN Mgr Process
133 0 5868 2180 10884 0 0 crypto engine pr
244 0 3852 6464 10828 0 0 IP Background
379 0 3780 264 10728 0 0 dcm_expression_p
267 0 480 240 10536 0 0 Multicast Offloa
377 0 3584 264 10536 0 0 snmp dcm ma shim
221 0 224 0 10520 0 0 Tunnel FIB
6 0 3364 1368 10420 0 0 Check heaps
130 0 0 0 10296 0 0 Crypto Device Up
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
166 0 240 240 10296 0 0 IP Host Track Pr
137 0 0 0 10296 0 0 PSE2 UART period
176 0 240 240 10296 0 0 Ethernet OAM Pro
213 0 240 240 10296 0 0 EAPoUDP Process
196 0 0 0 10296 0 0 HQF TARGET DYNAM
344 0 0 0 10296 0 0 Licensing MIB pr
336 0 0 0 10296 0 0 IPSEC manual key
283 0 240 240 10296 0 0 Ethernet PM Soft
282 0 0 0 10296 0 0 Ethernet PM Proc
281 0 0 0 10296 0 0 Ethernet Datapla
277 0 625379692 625379692 10296 0 0 QoS stats proces
273 0 0 0 10296 0 0 IP IRDP
272 0 0 0 10296 0 0 IPv6 RIB Event H
271 0 0 0 10296 0 0 IPv6 RIB Cleanup
270 0 240 240 10296 0 0 App Route Proces
269 0 240 240 10296 0 0 static
156 0 3208 240 10264 0 0 call_home_les_oi
140 0 0 0 10232 0 0 BGP Consistency
3 0 816 0 10216 0 0 BGP Scheduler
17 0 0 0 10216 0 0 BGP I/O
122 0 0 0 10216 0 0 BGP Scanner
172 0 0 0 10160 0 0 BGP Event
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
371 0 3264 480 10080 0 0 CTS credentials
374 0 10952 756 9532 0 0 Call Home DS
26 0 2104 0 9400 0 0 IPC Seat Manager
411 0 0 0 9296 0 0 Key Proc
141 0 1920 0 9216 0 0 FHRP Main thread
179 0 1884 0 9180 0 0 TRACK Main threa
180 0 2020 196 9148 0 0 TRACK Client thr
142 0 1816 0 9112 0 0 VRRP Main thread
296 0 2032 240 9088 0 0 CIFS API Process
51 0 1688 0 8984 0 0 CHKPT RG SCTPthr
375 0 1688 0 8984 0 0 Call Home DSfile
92 0 1688 0 8984 0 0 RF Master Status
50 0 1688 0 8984 0 0 RF SCTPthread
173 0 58636 0 8944 0 0 Call Home Timer
314 0 486815500 486809192 8848 780 0 NIST rng proc
95 0 72072 6116 8556 23980 0 Per-minute Jobs
211 0 944 0 8240 0 0 Auth-proxy HTTP
291 0 1184 240 8240 0 0 URL filter proc
364 0 944 0 8240 0 0 IKEv2 Cluster Lo
152 0 1152 240 8208 0 0 DTP Protocol
302 0 1084 240 8140 0 0 CRM_CALL_UPDATE_
235 0 836 160 8132 0 0 L2MM
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
312 0 1044 240 8100 0 0 TPLUS
34 0 380 0 7676 0 0 Exception contro
247 0 336 0 7632 0 0 Service Routing
233 0 480 240 7536 0 0 Dot1x Supplicant
343 0 228 0 7524 0 0 GKM KS PROCESS
234 0 464 240 7520 0 0 Dot1x Supplicant
232 0 464 240 7520 0 0 Dot1x Supplicant
286 0 376 240 7432 0 0 SDEE Management
435 0 240 0 7400 0 0 DHCPD Database
151 0 240 240 7296 0 0 CMD HANDLER
150 0 0 0 7296 0 0 EAP Framework
154 0 240 240 7296 0 0 PI MATM Aging Pr
246 0 0 0 7296 0 0 IP Traceroute
249 0 0 0 7296 0 0 SNMP Timers
149 0 0 0 7296 0 0 802.1x Webauth F
147 0 0 0 7296 0 0 AUTH POLICY Fram
145 0 240 240 7296 0 0 IP NAT HA BGND P
148 0 240 240 7296 0 0 Dot1x Mgr Proces
254 0 0 0 7296 0 0 IUA Main Process
255 0 240 240 7296 0 0 RUDPV1 Main Proc
256 0 0 0 7296 0 0 bsm_timers
257 0 0 0 7296 0 0 bsm_xmt_proc
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
230 0 0 0 7296 0 0 Socket Timers
259 0 240 240 7296 0 0 PPP Compress Res
210 0 0 0 7296 0 0 Auth-proxy AAA B
261 0 240 240 7296 0 0 Dialer Forwarder
163 0 0 0 7296 0 0 RG VP
5 0 0 0 7296 0 0 RO Notify Timers
258 0 240 240 7296 0 0 PPP Compress Inp
135 0 240 240 7296 0 0 SEC BATCH
134 0 0 0 7296 0 0 crypto raw delet
132 0 0 0 7296 0 0 Multi-ISA Cleanu
268 0 0 0 7296 0 0 RARP Input
183 0 240 240 7296 0 0 IPAM/ODAP Events
207 0 0 0 7296 0 0 IPv6 ping proces
206 0 0 0 7296 0 0 X.25 Encaps Mana
189 0 0 0 7296 0 0 ICMP event handl
190 0 240 240 7296 0 0 PIM register asy
136 0 240 240 7296 0 0 BPSM stat Proces
275 0 0 0 7296 0 0 PAD InCall
131 0 0 0 7296 0 0 Multi-ISA Event
191 0 240 240 7296 0 0 NAT64 Bgnd Proce
127 0 240 240 7296 0 0 Call Management
126 0 0 0 7296 0 0 IGMP Snooping Re
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
202 0 0 0 7296 0 0 SSS Feature Time
201 0 0 0 7296 0 0 SSS Feature Mana
192 0 69312 240 7296 24948 0 MOP Protocols
125 0 0 0 7296 0 0 IGMP Snooping Pr
285 0 240 240 7296 0 0 PPP NBF
153 0 0 0 7296 0 0 SFF8472
287 0 240 240 7296 0 0 Inspect process
164 0 240 240 7296 0 0 RG AR
289 0 240 240 7296 0 0 FW DP Inspect pr
290 0 240 240 7296 0 0 CCE DP URLF cach
226 0 0 0 7296 0 0 IPC UDP Input
124 0 240 240 7296 0 0 rawsocket async
123 0 0 0 7296 0 0 Platform Compact
294 0 0 0 7296 0 0 Select Timers
225 0 240 240 7296 0 0 IPMUXv6
224 0 240 240 7296 0 0 IPMUXv4
121 0 240 240 7296 0 0 Ether-Switch RBC
120 0 240 240 7296 0 0 UCSE Monitor
299 0 0 0 7296 0 0 IPv6 Inspect Tim
300 0 0 0 7296 0 0 IPSECv6 PS Proc
116 0 0 0 7296 0 0 RF_INTERDEV_DELA
155 0 240 240 7296 0 0 EtherChnl
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
304 0 240 240 7296 0 0 AAA Cached Serve
305 0 240 240 7296 0 0 ENABLE AAA
306 0 0 0 7296 0 0 EM Background Pr
274 0 0 0 7296 0 0 LAPB Process
307 0 0 0 7296 0 0 IDMGR CORE
309 0 0 0 7296 0 0 Key chain liveke
310 0 240 240 7296 0 0 LINE AAA
311 0 147158044 147158044 7296 0 0 LOCAL AAA
239 0 0 0 7296 0 0 MAB Framework
114 0 240 240 7296 0 0 ehwic_eswge Proc
223 0 0 0 7296 0 0 HQF Input Shaper
193 0 240 240 7296 0 0 PPP SIP
112 0 240 240 7296 0 0 DXMRVL
317 0 0 0 7296 0 0 EAP Process
222 0 0 0 7296 0 0 HQF Output Shape
110 0 240 240 7296 0 0 ESWILPPM
109 0 240 240 7296 0 0 Eswilp Storm Con
321 0 0 0 7296 0 0 EPM MAIN PROCESS
231 0 0 0 7296 0 0 Critical Auth
108 0 240 240 7296 0 0 ESWPPM
107 0 0 0 7296 0 0 ARL Table Manage
165 0 0 0 7296 0 0 DHCP Snooping
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
168 0 0 0 7296 0 0 AAA ACCT Proc
102 0 240 240 7296 0 0 Bryce I2C CMD Qu
101 0 240 240 7296 0 0 SM Monitor
100 0 0 0 7296 0 0 POS APS Event Pr
99 0 0 5181636 7296 0 0 Transport Port A
331 0 0 0 7296 0 0 IKEv2 AAA handle
332 0 240 584 7296 0 0 CRYPTO MAP FREE
98 0 0 0 7296 0 0 Token Daemon
97 0 0 0 7296 0 0 AggMgr Process
170 0 0 0 7296 0 0 AAA System Acct
198 0 0 0 7296 0 0 RIB LM VALIDATE
93 0 0 0 7296 0 0 Net Input
338 0 0 0 7296 0 0 CRYPTO QoS proce
174 0 240 240 7296 0 0 AAA Dictionary R
340 0 0 0 7296 0 0 Crypto PAS Proc
90 0 240 240 7296 0 0 TDM Management
342 0 240 240 7296 0 0 GKM GM Process
237 0 0 0 7296 0 0 IGMPSN
194 0 240 240 7296 0 0 PPP Bind
345 0 240 240 7296 0 0 Control-plane ho
346 0 0 0 7296 0 0 PM Callback
347 0 240 240 7296 0 0 dhcp snooping sw
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
349 0 618942684 3202498748 7296 0 0 AAA SEND STOP EV
89 0 0 0 7296 0 0 IPSEC HA Mgr
88 0 0 0 7296 0 0 IKE HA Mgr
86 0 0 0 7296 0 0 CHKPT Test clien
85 0 0 0 7296 0 0 CHKPT Test clien
84 0 0 0 7296 0 0 CHKPT Test clien
83 0 0 0 7296 0 0 CHKPT Test clien
82 0 0 0 7296 0 0 CHKPT Test clien
81 0 0 0 7296 0 0 CHKPT Test clien
80 0 0 0 7296 0 0 CHKPT Test clien
79 0 0 0 7296 0 0 CHKPT Test clien
360 0 240 240 7296 0 0 RMON Recycle Pro
361 0 240 240 7296 0 0 RMON Deferred Se
362 0 14729976 14679732 7296 18144 0 Syslog Traps
363 0 0 0 7296 0 0 WAN Optimization
236 0 0 0 7296 0 0 MRD
78 0 0 0 7296 0 0 CHKPT Test clien
366 0 0 0 7296 0 0 Crypto cTCP proc
77 0 0 0 7296 0 0 CHKPT Test clien
215 0 0 0 7296 0 0 FRR Background P
76 0 0 0 7296 0 0 CHKPT Test clien
115 0 240 240 7296 0 0 Netclock Backgro
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
212 0 0 0 7296 0 0 IP Admin SM Proc
75 0 0 0 7296 0 0 cpf_process_tpQ
322 0 240 240 7296 0 0 CSDB Timer proce
28 0 0 0 7296 0 0 IPC Seat RX Cont
74 0 0 0 7296 0 0 cpf_msg_rcvq_pro
73 0 0 0 7296 0 0 cpf_msg_holdq_pr
406 0 0 0 7296 0 0 IP SLAs Ethernet
71 0 720 0 7296 0 0 IF-MGR event pro
65 0 240 240 7296 0 0 Platform Periodi
64 0 51672 168404 7296 0 0 TTY Background
60 0 0 0 7296 0 0 Critical Bkgnd
59 0 0 0 7296 0 0 ISM-VPN Cleanup
58 0 240 407129184 7296 0 0 ISM-VPN main
55 0 0 0 7296 0 0 SERIAL A'detect
53 0 240 240 7296 0 0 GraphIt
52 0 0 0 7296 0 0 ARP Snoop
27 0 0 0 7296 0 0 IPC Check Queue
113 0 0 0 7296 0 0 esw_mrvl mat que
49 0 240 240 7296 0 0 SMART
46 0 240 240 7296 0 0 Serial Backgroun
45 0 996 996 7296 0 0 PrstVbl
43 0 240 240 7296 0 0 DDR Timers
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
41 0 0 0 7296 0 0 AAA_SERVER_DEADT
40 0 0 0 7296 0 0 CEF MIB API
39 0 0 0 7296 0 0 ATM ASYNC PROC
38 0 240 240 7296 0 0 ATM Idle Timer
35 0 0 0 7296 0 0 IFS Agent Manage
430 0 0 0 7296 0 0 TCP Listener
32 0 0 0 7296 0 0 IPC Session Deta
31 0 0 0 7296 0 0 IPC Loadometer
30 0 0 0 7296 0 0 IPC Keep Alive M
29 0 0 0 7296 0 0 IPC Seat TX Cont
8 0 0 0 7296 0 0 DiscardQ Backgro
9 0 240 240 7296 0 0 Timers
11 0 0 0 7296 0 0 License Client N
12 0 0 0 7296 0 0 Image License br
25 0 0 0 7296 0 0 IPC Process leve
24 0 0 0 7296 0 0 IPC Deferred Por
23 0 0 0 7296 0 0 IPC Periodic Tim
22 0 0 0 7296 0 0 IPC Zone Manager
13 0 921890968 921892736 7296 0 0 Licensing Auto U
18 0 240 240 7296 0 0 Environmental mo
19 0 0 0 7296 0 0 IPC Event Notifi
20 0 0 0 7296 0 0 IPC Dynamic Cach
--More-- PID TTY Allocated Freed Holding Getbufs Retbufs Process
21 0 0 0 7296 0 0 IPC Session Serv
369 0 0 0 7212 0 0 NBAR LLT timer s
288 0 0 0 7160 0 0 BGP VA
434 0 0 0 7160 0 0 DHCPD Timer
415 0 240 0 4536 0 0 Async write proc
414 0 240 0 4536 0 0 Async write proc
413 0 240 0 4536 0 0 Async write proc
412 0 240 0 4536 0 0 Async write proc
178 0 224 0 4520 0 0 ADJ NSF process
238 0 240 240 4296 0 0 L2X Switching Ev
15 0 0 0 4296 0 0 RMI RM Notify Wa
10 0 0 0 4296 0 0 WATCH_AFS
416 0 0 0 4296 0 0 DFS flush period
111 0 240 240 4296 0 0 Eswilp Storm Con
2 0 240 240 4296 0 0 Load Meter
105 0 0 0 4296 0 0 dev_device_remov
72 0 0 0 4296 0 0 Inode Table Dest
104 0 0 0 4296 0 0 dev_device_inser
679214460 Total

Thanks

Leo Laohoo · ‎07-01-2020

Look at the IOS version. Not only is it a "T" train but it is a version "0".
I wouldn't even bother troubleshooting any further because I'd be recommending upgrading the firmware to something more recent and NOT a "T" train. Look for an IOS version in the "M" train.

k.adath2015 · ‎07-02-2020

Hi @Leo Laohoo

" Look at the IOS version. Not only is it a "T" train but it is a version "0". " , What you mean by version "0"

It is 15.5(1)T .

What is T train and M train

Thanks

Leo Laohoo · ‎07-02-2020

Cisco calls "T" train as the "technology" train. Experienced users call it the "terrible" train. If you want to find bugs, guaranteed the worst ones are found in the "T" train.
"M" train is the long-term "maintenance" train. All the bugs are fixed in the "M" train.
If you want something stable, go for an "M" train. If you are adventurous, go with the "T" train.

Joseph W. Doherty · ‎07-02-2020

"What you mean by version "0""

More or less Leo is telling you this is the first public release (which indeed makes many of us a bit nervous using such).

"T" trains contain features that are "brand new". Generally we normally only use them, in production environments, when you really, really (really) believe you need the feature(s).

In this situation, you're facing the double risk of using an IOS with "brand new" features and being at the beginning of its release history. Running into bugs, for such, shouldn't be unexpected. As Leo suggests, even without checking you've stumbled into a known bug, upgrading such an IOS and/or moving into a non-T train, is often a very good idea. As Georg posting shows, in may in fact be a known bug that has been fixed in later releases.

BTW, in ye olde days, software releases would eventually be tagged with "GD" (generally deployment) which meant Cisco thought starting with that release, that IOS release was more or less stable. What was interesting was how long it took some IOS software to hit this milestone. In the current situation, Cisco will tag some releases being recommended as being stable. The big difference in the new system, later releases, in the same train, aren't always given the same recommentation.

Georg Pauwen · ‎07-01-2020

Hello,

on a side note, and in addition to Leo's post, the bug below applies to the 3900:

qos_mon_periodic processes getting spawned without any configs
CSCur90546
Description
Symptom:
Memory leak in QoS process: qos_mon_periodic

It will consistently increase "Holding" value exhausting available memory for other processes:

------------------ show process memory ------------------

Processor Pool Total: 219882976 Used: 219747748 Free: 135228
I/O Pool Total: 134217728 Used: 101889348 Free: 32328380

PID TTY Allocated Freed Holding Getbufs Retbufs Process
365 0 190997108 0 191004404 0 0 qos_mon_periodic

Conditions:
No specific conditions need to be met.

Workaround:
None

Known Affected Releases: (5)
15.5(1)T
15.5(1)T0.2
15.5(1)T1.2
15.5(2)S
15.5(2)T

Known Fixed Releases: (96)
15.5(2)T1
15.5(2)S1
15.5(1)T3
15.5(1)S2
16.11.1
16.11.1a
16.10.1b
16.10.1c
16.10.1d
16.10.1e
16.10.1i
16.10.1s
16.10.1
16.10.1a
16.9.3
16.9.3h
16.9.2s
16.9.2
16.9.2a
16.9.1s
16.9.1
16.9.1a
16.9.1b
16.9.1c
16.9.1d
16.8.3
16.8.2
16.8.1s
16.8.1
16.8.1a
16.8.1b
16.8.1c
16.8.1d
16.8.1e
16.7.3
16.7.2
16.7.1a
16.7.1b
16.7.1
16.6.5a
16.6.5b
16.6.5
16.6.4a
16.6.4s
16.6.4
16.6.3
16.6.2
16.6.2s
16.6.1
16.6.1a
16.5.3
16.5.2
16.5.1b
16.5.1
16.5.1a
16.4.3
16.4.2
16.4.1
16.3.8
16.3.7
16.3.6
16.3.5c
16.3.5
16.3.5a
16.3.5b
16.3.4
16.3.3
16.3.3a
16.3.2
16.3.1a
16.3.1
16.2.2
16.2.1
16.1.3
16.1.2
16.1.1
16.1(0.198)
16.1.0
15.6(1)SN
15.6(1.9)T0.2
15.6(1.9)T0.1
15.5(2)T0.1
15.5(2)SN
15.5(2)S0.9
15.5(2.20)S
15.5(2.16.5)PIH28
15.5(2.14.1)PIH28
15.5(2.11)T
15.5(1)T2.1
15.5(1)SN1
15.5(1)S4.21
15.5(1)S2.15
15.5(1)S2.1
15.5(1)S1.1