Cisco 1812 Possible memory leak

DanielKerman · ‎11-27-2013

Hello everyone!

One of our end clients Cisco 1812 running IOS version 12.4(20)T.

is experiencing high memory utilization. We dont have any reports of any network performance issues other than the fact that the routers memory utilization is aroung 85%.

Here is the output of "show proccess memory sorted":

Processor Pool Total: 36644112 Used: 31336588 Free: 5307524

I/O Pool Total: 33554432 Used: 5765120 Free: 27789312

PID TTY Allocated Freed Holding Getbufs Retbufs Process

0 0 63857000 35282860 25820484 0 0 *Init*

1 0 5235924 2352808 2890360 0 0 Chunk Manager

0 0 0 0 1643852 0 0 *MallocLite*

0 0 982745744 474472844 1286988 2084576 0 *Dead*

237 0 27803724 2499519412 883724 0 0 IP-EIGRP: PDM

193 0 598020 18864 565020 0 0 VLAN Manager

102 0 832288 333937300 545012 0 0 IP RIB Update

24 0 239088 0 249332 99792 0 EEM ED Syslog

44 0 195912 252 177604 0 0 USB Startup

197 0 152920 0 160164 0 0 EEM Server

158 0 107324 532 116036 0 0 Crypto WUI

136 6 823484020 806925084 83860 20412 0 Virtual Exec

144 0 76520 252 83512 0 0 HTTP Process

169 0 66852 0 80096 0 0 Crypto IKEv2

115 0 940 0 62184 0 0 COPS

70 0 49384 0 56628 0 0 ACCT Periodic Pr

76 0 49384 0 56628 0 0 IP ARP Retry Age

230 0 40036 916 38044 0 0 DHCPD Receive

171 0 547232 519776 35128 0 0 IPSEC key engine

133 0 16812 252 29804 0 0 IPS Auto Update

12 0 3514652 4906488 29424 0 0 ARP Background

11 0 22056 1848 27452 0 0 ARP Input

130 0 19508 252 26500 0 0 SCTP Main Proces

173 0 43548 48988 25908 0 0 Crypto ACL

222 0 252 0 25552 0 0 tHUB

161 0 284 0 25528 0 0 RPMS_PROC_MAIN

53 0 252 252 25244 0 0 ISDN Timer

8 0 0 0 25244 0 0 Crash writer

148 7 625944 613384 24308 0 0 Virtual Exec

52 0 459884 433532 23864 0 0 crypto engine pr

168 0 6968 252 19960 0 0 Crypto IKMP

146 0 12592 252 19584 0 0 CIFS Proxy Proce

117 0 11364 0 19192 0 0 CEF: IPv4 proces

5 0 241292 2124404 18236 122720 811288 Pool Manager

236 0 0 0 18232 0 0 IP-EIGRP Router

226 0 299617080 598402212 17256 0 0 SNMP ENGINE

77 0 34748 6352 16420 6768 0 IP Input

198 0 9764 912 16096 0 0 EEM Policy Direc

190 0 5540 0 15784 0 0 EEM ED Resource

47 0 21892 0 15440 13536 0 IGMP Snooping Pr

162 0 2356 832 14768 0 0 Crypto CA

195 0 18224 16836 14632 0 0 Syslog

31 0 105492 640 14608 4536 0 Net Background

229 0 43588780 49091604 14440 11340 0 SNMP Traps

227 0 1252 304 14260 0 0 IP SNMPV6

224 0 46988560 46987612 14260 0 0 IP SNMP

212 0 3732 0 13976 0 0 EEM ED Env

211 0 3732 0 13976 0 0 EEM ED Config

PID TTY Allocated Freed Holding Getbufs Retbufs Process

210 0 3732 0 13976 0 0 EEM ED Test

209 0 3732 0 13976 0 0 EEM ED Timer

213 0 3732 0 13976 0 0 EEM ED RPC

208 0 3732 0 13976 0 0 EEM ED Snmp_Prox

207 0 3732 0 13976 0 0 EEM ED SNMP

205 0 3732 0 13976 0 0 EEM ED OIR

204 0 3732 0 13976 0 0 EEM ED None

203 0 3732 0 13976 0 0 EEM ED IOSWD

202 0 3732 0 13976 0 0 EEM ED Interface

201 0 3732 0 13976 0 0 EM ED GOLD

200 0 3732 0 13976 0 0 EEM ED Counter

199 0 3732 0 13976 0 0 EEM ED CLI

191 0 3732 0 13976 0 0 EEM ED Track

32 0 4316 4000 13560 0 0 IDB Work

87 0 12104 252 13468 2340 0 Spanning Tree

103 0 224 0 13468 0 0 CEF background p

74 0 4892732 3192140 13468 61880 0 ADJ resolve proc

73 0 224 0 13468 0 0 CEF switching ba

3 0 224 0 13332 0 0 Collection proce

225 0 298792940 0 13312 0 0 PDU DISPATCHER

228 0 0 0 13312 0 0 SNMP ConfCopyPro

29 0 252 252 13244 0 0 XML Proxy Client

27 0 252 252 13244 0 0 Dialer event

165 0 0 0 13244 0 0 encrypt proc

141 0 0 0 13244 0 0 XSM_ENQUEUER

132 0 0 0 13244 0 0 IPS Process

131 0 0 0 13244 0 0 VPDN call manage

232 0 190228 190228 13244 0 0 NTP

167 0 252 724 13244 0 0 Crypto IKE Dispa

142 0 0 0 13244 0 0 XSM Historian

33 0 252 252 13244 0 0 Logger

17 0 0 0 13244 0 0 Policy Manager

124 0 252 252 13244 0 0 X.25 Background

112 0 562472 0 13244 0 0 TCP Protocols

95 0 252 252 13244 0 0 KRB5 AAA

84 0 0 0 13244 0 0 SSS Manager

96 0 252 252 13244 0 0 PPP IP Route

82 0 504 504 13244 0 0 PPP Hooks

97 0 252 252 13244 0 0 PPP IPCP

89 0 252 82788 13244 0 0 SSM connection m

111 0 0 20512196 13244 0 0 TCP Timer

110 0 0 0 13244 0 0 L2X Data Daemon

192 0 5052 0 12296 0 0 Crypto cTCP proc

0 0 12132 764080 12132 0 0 *Sched*

75 0 5992 1400 11836 0 0 IP ARP Adjacency

155 0 45156888 676908192 11708 0 0 TPLUS

19 0 3988 0 11232 0 0 Entity MIB API

113 0 940 0 11184 0 0 HTTP CORE

42 0 16884 3348 10772 0 0 ESWPPM

72 0 1195532 1192096 10680 0 0 CDP Protocol

4 0 3440 324 10420 0 0 Check heaps

101 0 329537616 0 10320 0 0 IP Background

I can see that "Chunk Manager" proccess is holding a lot of memory.

I have researched any known bugs about the subject of "Chunk Manager" possible memory leak that are covered here:

http://www.cisco.com/en/US/docs/ios/12_4t/release/notes/124TCAVS1.html

And found no match for the symptopms reported there.

If anyone can suggests what might be the root cause for this?

What does Chunk Manager proccess is responsible for?

Thanks in advance,

lmediavilla · ‎11-28-2013

Hi Daniel, did you check the new bug toolkit?

https://tools.cisco.com/bugsearch?referring_site=btk

Anyway 12.4(20)T for your 1812 is not too new, there are versions that you can upgrade.

Kind regards

Angus Bishop · ‎11-28-2013

Chunk manager is the process which manages a set of fixed-sized block subdivided within a large block that has been allocated from one of the standard memory pool .Chunk manager can be considered as a sub memory pool manager .

A process requests a allocation of large memory block from a memory pool . the process then calls chunk manager for sub divide the block into small fixed size chunk and uses the chunk manager to allocate and free the chunk . This is for helping to reduse the burden of the pool manager .

If chunk manager is consuming more process that means ,The switch tries to allocate memory for a particular process but could not find a enough blocks from free memory . This cnn be because the process holds memory even after running .

This can be because of IOS bugs .

Agnus .

DanielKerman · ‎11-28-2013

Hi Agnus and thank you for your reply.

As i said before i tried to research the issue in the forums and bug toolkit and didnt find any matches to any known bug symptoms.

Other than then contacting Cisco TAC, are there any other troubleshooting steps I can take?

I can provide you with output of any commands you need in order to examine the problem.

lmediavilla · ‎11-28-2013

Don't open a TAC case if your ios is too old, just update it

Kind regards