cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
21298
Views
1
Helpful
17
Replies

3650 High Memory Used

Questions
Level 1
Level 1

A warning log of  "%PLATFORM-3-ELEMENT_CRITICAL:Switch 1 R0/0: smand:  1/RP/0: Used Memory value 98% exceeds critical level 95%" appears.

 

show processes memory 

This is the suspicious process.

 

3650#show processes memory
Processor Pool Total: 885692992 Used: 313796992 Free: 571896000

「lsmpi_io Pool Total:    6295128 Used:    6294295 Free:        833」

 

Does it have anything to do with the log?

So, what's the solution?

 

 

i have SW version 16.3.5b 

 

 

1 Accepted Solution

Accepted Solutions

Deepak Kumar
VIP Alumni
VIP Alumni

Hi,

This looks like a software bug. Advise updating the IOS.

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvd45973/?rfs=iqvred

 

 

Regards,

Deepak Kumar

 

Regards,
Deepak Kumar,
Don't forget to vote and accept the solution if this comment will help you!

View solution in original post

17 Replies 17

Deepak Kumar
VIP Alumni
VIP Alumni

Hi,

This looks like a software bug. Advise updating the IOS.

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvd45973/?rfs=iqvred

 

 

Regards,

Deepak Kumar

 

Regards,
Deepak Kumar,
Don't forget to vote and accept the solution if this comment will help you!

Is it fatal when I left it unattended??

Its known bug so upgrade the IOS.

 

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvd45973/?rfs=iqvred

 

BR

Tayyab

*** Please rate all helpful responses and mark solutions***

Is it fatal when I left it unattended?

if you leave as it is, it might downgrade the service, However, you have two options,

 

1) Reload the switch (Workaround not a solution)

or 

2) Upgrade the OS.

 

BR

Tayyab

*** Please rate all helpful responses and mark solutions***

Hi,

according to https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvd45973/?rfs=iqvred, this bug should be fixed with release

16.3.3b - but the originial poster an I use 16.3.5b. So is this bug open again?
 
Regards,
Wolfgang

We are on 16.3.5b and have the bug too.

We will upgrade the next days.

I have also this bug on 16.6.3 .

Any new?

shallugarg6343
Level 1
Level 1

I am using ISR4331 with isr4300-universalk9.16.06.03.SPA.bin" and effected by this


@shallugarg6343 wrote:
I am using ISR4331 with isr4300-universalk9.16.06.03.SPA.bin" and effected by this

@shallugarg6343

Post the complete output to the following commands: 

sh version
sh platform resources
sh platform software status con brief

MAAU1-PR-FLEX01#sh ver
Cisco IOS XE Software, Version 16.06.03
Cisco IOS Software [Everest], ISR Software (X86_64_LINUX_IOSD-UNIVERSALK9-M), Version 16.6.3, RELEASE SOFTWARE (fc8)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2018 by Cisco Systems, Inc.
Compiled Wed 28-Feb-18 23:54 by mcpre


Cisco IOS-XE software, Copyright (c) 2005-2018 by cisco Systems, Inc.
All rights reserved. Certain components of Cisco IOS-XE software are
licensed under the GNU General Public License ("GPL") Version 2.0. The
software code licensed under GPL Version 2.0 is free software that comes
with ABSOLUTELY NO WARRANTY. You can redistribute and/or modify such
GPL code under the terms of GPL Version 2.0. For more details, see the
documentation or "License Notice" file accompanying the IOS-XE software,
or the applicable URL provided on the flyer accompanying the IOS-XE
software.


ROM: IOS-XE ROMMON

MAAU1-PR-FLEX01 uptime is 3 years, 42 weeks, 6 days, 18 hours, 8 minutes
Uptime for this control processor is 3 years, 42 weeks, 6 days, 18 hours, 10 minutes
System returned to ROM by PowerOn at 10:47:29 EDT Thu Jun 6 2019
System restarted at 12:24:56 EDT Fri Dec 18 2020
System image file is "bootflash:isr4300-universalk9.16.06.03.SPA.bin"
Last reload reason: PowerOn

 

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

 

Suite License Information for Module:'esg'

--------------------------------------------------------------------------------
Suite Suite Current Type Suite Next reboot
--------------------------------------------------------------------------------
FoundationSuiteK9 None None None
securityk9
appxk9

AdvUCSuiteK9 None None None
uck9
cme-srst
cube


Technology Package License Information:

-----------------------------------------------------------------
Technology Technology-package Technology-package
Current Type Next reboot
------------------------------------------------------------------
appxk9 None None None
uck9 None None None
securityk9 securityk9 Permanent securityk9
ipbase ipbasek9 Permanent ipbasek9

cisco ISR4331/K9 (1RU) processor with 1796073K/6147K bytes of memory.
Processor board ID FLM2123Y02Q
3 Gigabit Ethernet interfaces
32768K bytes of non-volatile configuration memory.
4194304K bytes of physical memory.
3207167K bytes of flash memory at bootflash:.
0K bytes of WebUI ODM Files at webui:.

Configuration register is 0x2102

MAAU1-PR-FLEX01#

MAAU1-PR-FLEX01#show platform resources
**State Acronym: H - Healthy, W - Warning, C - Critical
Resource Usage Max Warning Critical State
----------------------------------------------------------------------------------------------------
RP0 (ok, active) C
Control Processor 3.70% 100% 90% 95% H
DRAM 3724MB(98%) 3790MB 90% 95% C
ESP0(ok, active) H
QFP H
DRAM 128780KB(49%) 262144KB 80% 90% H
IRAM 213KB(10%) 2048KB 80% 90% H
CPU Utilization 1.00% 100% 90% 95% H

MAAU1-PR-FLEX01#

MAAU1-PR-FLEX01#sh platform software status con brief
Load Average
Slot Status 1-Min 5-Min 15-Min
RP0 Healthy 1.80 1.59 1.50

Memory (kB)
Slot Status Total Used (Pct) Free (Pct) Committed (Pct)
RP0 Critical 3881160 3813800 (98%) 67360 ( 2%) 3934680 (101%)

CPU Utilization
Slot CPU User System Nice Idle IRQ SIRQ IOwait
RP0 0 1.90 0.60 0.00 97.50 0.00 0.00 0.00
1 2.10 0.60 0.00 97.29 0.00 0.00 0.00
2 4.90 1.80 0.00 93.30 0.00 0.00 0.00
3 1.29 0.59 0.00 98.00 0.00 0.09 0.00
4 1.90 1.90 0.00 96.19 0.00 0.00 0.00
5 73.70 3.20 0.00 23.10 0.00 0.00 0.00
6 66.30 15.90 0.00 17.80 0.00 0.00 0.00
7 0.00 0.00 0.00 100.00 0.00 0.00 0.00

MAAU1-PR-FLEX01


@shallugarg6343 wrote:

DRAM 3724MB(98%) 3790MB 90% 95% C​

Confirm a memory leak:  Memory utilization is at 98%.  

Kindly post the "first page" to the following command:

sh processes memory platform sorted location switch active r0

Do not post the entire output -- I just want to see the "first page" of the output.  

MAAU1-PR-FLEX01#show processes memory platform sorted location R0
System memory: 3881160K total, 3811808K used, 69352K free,
Lowest: 69352K
Pid Text Data Stack Dynamic RSS Total Name
--------------------------------------------------------------------------------
3158 251690 721452 136 124 721452 3430036 linux_iosd-imag
8485 89 1079580 132 894900 1079580 2647504 cpp_cp_svr
12200 11937 208544 136 47788 208544 2273416 fman_fp_image
30372 7080 63072 136 2264 63072 1282036 fman_rp
9888 18117 673420 136 428 673420 1158188 qfp-ucode-utah
5728 68 137676 132 6832 137676 1137332 cpp_sp_svr
3572 151 107760 132 3020 107760 1120920 cpp_driver
4511 363 90580 136 3664 90580 1110724 cpp_ha_top_leve
26381 230 54608 136 3348 54608 1036804 bsm
2216 266 21652 132 3612 21652 848876 cman_fp
27838 202 34756 136 7056 34756 807880 cli_agent
18321 472 32064 136 4252 32064 768300 iomd
5817 151 55692 136 268 55692 630796 smd
28289 97 34772 136 3556 34772 619388 dbm
4282 460 51108 136 25480 51108 489932 smand
27616 1080 28732 136 4356 28732 405688 cmand
11143 624 12828 136 1416 12828 347028 cmcc
10060 624 13548 136 1416 13548 347028 cmcc
8947 498 5048 132 132 5048 270964 libvirtd
1306 36 11864 136 1424 11864 264964 psd
30025 326 13680 136 2084 13680 251444 hman
31285 113 11192 136 1664 11192 247444 lman
11438 326 10172 136 1148 10172 240000 hman
10629 326 10036 136 1148 10036 240000 hman
7362 326 10256 132 1148 10256 239996 hman
841 39 10148 136 2160 10148 199852 plogd
14867 39 9736 136 1668 9736 199360 plogd
14170 39 9460 136 1668 9460 199360 plogd
8474 39 9552 132 1668 9552 199356 plogd
18362 52 8032 136 596 8032 195772 ngiolite
11091 26 8060 136 1464 8060 176396 tams_proc
10048 72 7604 136 836 7604 171552 tamd_proc
9141 16 6624 136 688 6624 164968 tam_svcs_esg_cf


@shallugarg6343 wrote:
3158 251690 721452 136 124 721452 3430036 linux_iosd-imag

Potentially, this could be CSCvh31431. 

Options are: 

1.  Reboot the entire stack; or

2.  Upgrade to 16.6.10

 

Review Cisco Networking for a $25 gift card