Committed Memory value %

[ip_guy]

Hello colleagues,

How's going work?

Recently my ISR4331/K9 started to be a little bit buggy. It uses IOS XE version 03.15.00.S. and IOS Software Version 15.5(2)S. It so much slow that I am unable to type commands. I have all logs from device but I am unable to attach from some reason.

These are few log messages I am getting:
CET: %IOSXE-3-PLATFORM: SIP1: cpp_cp: QFP:0.0 Thread:000 TS:00077010033211266112 %STILE-3-VM_ERRORS: STILE VM traceback with cause: *VM Stuck Thread*, please see FP log for more informationsho mod
CET: %PLATFORM-3-ELEMENT_CRITICAL: SIP1: smand: RP/0: Committed Memory value 99% exceeds critical level 95%

CET: %PLATFORM_INFRA-5-IOS_INTR_OVER_LIMIT: IOS thread disabled interrupt for 14 msec
-Traceback= 1#6dda34ccc6725609124b8addabdf2f71 :7FFE5EA65000+A97D552 :7FFE5EA65000+1125AB2B :7FFE5EA65000+1126CE27 :7FFE5EA65000+1126CB54 :7FFE5EA65000+112B5F9F :7FFE5EA65000+A1D0A57 :7FFE5EA65000+A1D0849 :7FFE5EA65000+A1D05D8 :7FFE5EA65000+A1D039A

I all ready found here at Community similar discussion but the issue was for ASR router. I have two options to do. I can  upgrade IOS (but I am not sure what version should I install) or to reload device since it works 2 and a half year.

I would appreciate any help/idea.

Thank you in advance.

Milos

[Leo Laohoo]

The router is running 3.15.0. Look at the last "digit" -- it ends with a "0".
Upgrade the firmware to something more recent (and something that doesn't end with "0", "1", "2" or "3").

[ip_guy]

Hi Leo,

Thank you for quick response. Can you suggest me what software version of XE should i upgrade/download?

IOS 15.5.(2)S seems okay??

Regards,

Milos

[Leo Laohoo]

---

@ip_guy wrote:

IOS 15.5.(2)S seems okay??

---

Milos, 

15.5(2)S is still a "version 0".  See the "S"?  No number ends after it.  This means "0".

Upgrade the firmware to something more recent (and something that doesn't end with "0", "1", "2" or "3").

[Georg Pauwen]

Hello,

on a side note, you might be hitting the bug below:

IOS-XE router memory leak in cpp_sp_svr
CSCva63723
Description
Symptom:
1) Getting logs about committed memory exceeding warning or critical level, for example:

- on modular IOS-XE routers the ESP/0 is mentioned:
%PLATFORM-4-ELEMENT_WARNING: R0/0: smand: ESP/0: Committed Memory value 95% exceeds warning level 90%

- on the integrated IOS-XE routers RP/0 is mentioned:
%PLATFORM-3-ELEMENT_CRITICAL: SIP0: smand: RP/0: Committed Memory value 114% exceeds critical level 100%

2) We see that cpp_sp_svr uses more and more memory:

- on the modular platforms check: show platform software process list F0 sort memory
- on the fixed platforms check: show platform software process list R0 sort memory

3) In the "show platform software memory qfp-service-process qfp active" two components: Simple Classification Engine and TCAM Classification Engine get more allocations than frees and the overhead counter is increasing.

Conditions:
IOS-XE router acts as an LNS.
Radius is used to apply a policy-map to sessions.
The leak occurs when sessions are being torn down and detach operations take place.

Workaround:
unknown at this time

Known Fixed Releases: (12)
Everest-16.4.1
Denali-16.3.3
Denali-11.3.3
16.4.1
16.4(0.174)
16.3.3
16.3(2.4)
15.5(3)S4g
15.5(3)S4e
15.5(3)S4d
15.5(3)S4c
11.3(3)

[ip_guy]

Thank you guys.

I found IOS XE Software - Fuji (16.9.4 MD), Everest (16.6.7 MD), Gibraltar (16.12.2 ED) and Amsterdam (17.1.1 ED). What are differences of this versions? Is there some special that I should download?

Thanks in advance.

Regards,

Milos

[balaji.bandi]

As you see the version number increasing like below

Everest (16.6.7 MD),

 Fuji (16.9.4 MD),

 Gibraltar (16.12.2 ED)

 Amsterdam (17.1.1 ED)

Ever version have new features added for improvement and security bug fixes.

Latest one is the bottom with new features added, i always recomend to read the release notes and understand your device support features and upgrade respective version IOS for better performance.

[ip_guy]

Thanks Bandi,

If I do upgrade does license will be deleted?

[balaji.bandi]

Technically License should remain same for the device.

Depends on what version to what version you jumping.

New world all going smart Licenses, so look the version you try to upgrade. read the realse notes very carefully.

[Leo Laohoo]

Avoid 16.12.2 and 17.1.1.
Choose from 16.6.7 or 16.9.4. Read the Release Notes of the version you pick very carefully. You cannot upgrade from 3.X.X, for example, to 16.X.X (or 17.X.X) without upgrading the ROMMON.

[ip_guy]

Hi Leo,

Thank you for info. So I need first to download IOS XE ROMMON (16.X) and then I can upgrade IOS XE Software 16.6.7 or 16.9.4?

Regarding Release Notes I found on this site:

https://software.cisco.com/research/home?pid=285018115&sid=282046477&cr=

[Leo Laohoo · Accepted solution]

16.6.7 or 16.9.4 are fine.  

Read the Release Notes very carefully.  16.6.X has been announced with EoS.  So final software so this means one last final release before 31 July 2020. 

16.9.X means Smart Licensing.  

Did anyone take the time and effort to read the Release Notes?