- Cisco Community
- Technology and Support
- Networking
- Switching
- DisclaimerThe Author of this
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Low Memory on router
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-01-2015 10:52 AM - edited 03-08-2019 12:17 AM
Hello All,
I am in a fix here. Just got to work and found most users cannot connect to the internet and on checking the router via Telnet it threw me pout with the error message connection failed . Port 23 cannot be accessed. I logged in via console and then got the low memory.
Users can hardly work and I want to get this fixed and everything seems not to work again.
I will appreciate any assistance to get out of this since there is no backup router to use at this time.
Thank you
Kechy4001.
- Labels:
-
Other Switching
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-01-2015 11:01 AM
Collect a "show proc mem sorted" and reload it to free the stuck memory.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-01-2015 12:36 PM
Thanks Norbert . Please the show "proc Mem sorted' is it a command I need to run on the router and then reload by typing reload ???.
I saw an article someone commented that we should use the default command below
config t
no ip route 0.0.0.0 0.0.0.0 FastEthernet0/1
ip route 0.0.0.0 0.0.0.0 1.1.1.2
end
Is it also correct to run this on my production router ? or just follow the instruction you have stated in your response
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-01-2015 01:29 PM
We need to investigate what is eating the memory. You can check what Joseph suggested.
You can run the commands "show proc mem sorted", "show arp", "show run" in the router grab the outputs and attach here. We will take a look before reloading it.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-02-2015 12:40 AM
please see report from show proc mem sorted. please router is cisco router 1800 series with 64MB flash on it.
GTBAsset#show proc mem sorted
*Jun 2 08:50:33.983: %SYS-2-CHUNKEXPANDFAIL: Could not expand chunk pool for ipnat node. No memory available -Process= "Chunk Manager", ipl= 4, pid= 1 -Traceback= 0x808FEC68 0x80375778 0x800C8384 0x800CBAD8
Processor Pool Total: 71999524 Used: 71914688 Free: 84836
I/O Pool Total: 12582912 Used: 12579416 Free: 3496
PID TTY Allocated Freed Holding Getbufs Retbufs Process
1 0 55157144 266500 54964312 0 0 Chunk Manager
0 0 50566980 23208504 23614932 0 0 *Init*
68 0 13957732 2272 2718244 0 0 IP Input
157 0 395144 12920 394936 0 0 IPSEC key engine
18 0 261628 0 271704 113400 0 EEM ED Syslog
0 0 189668 2109880 139600 655736 0 *Dead*
5 0 43226924 43100696 133304 31644 0 Pool Manager
94 0 103564 156 110640 0 0 L2MM
151 0 67340 3700 89080 0 0 Crypto ACL
156 0 66852 0 79928 0 0 Crypto IKEv2
93 0 73404 0 73404 0 0 CEF process
129 0 65660 252 72484 0 0 HTTP Process
97 0 38464 252 37136 0 0 DHCPD Receive
146 0 284 0 25360 0 0 RPMS_PROC_MAIN
192 0 252 0 25328 0 0 tHUB
104 0 0 0 25076 0 0 COPS
8 0 0 0 25076 0 0 Crash writer
116 0 16844 252 23668 0 0 SCTP Main Proces
91 0 22172 10128 22120 0 0 IP Background
--More--
*Jun 2 08:50:37.383: %SYS-2-MALLOCFAIL: Memory allocation of 65536 bytes failed from 0x80376A00, alignment 8
Pool: Processor Free: 77984 Cause: Memory fragmentation
Alternate Pool: I/O Free: 3496 Cause: Not enough free memory
-Process= "IP Input", ipl= 0, pid= 68 -Traceback= 0x808FEC68 0x80350FEC 0x80356E28 0x80376A04 0x80375A98 0x803783E0 0x803758E8 0x80E2E104 0x80E2F924 0x80E30500 0x80E3289C 0x80E2D764 0x80CCA324 0x80CC8828 0x80CC8B44 28 0 8368 664 20844 0 0 Exec
131 0 12592 252 19416 0 0 CIFS Proxy Proce
184 0 10012 252 19176 0 0 EEM Policy Direc
200 0 14624 0 18664 0 0 RIP Router
155 0 4824 252 17648 0 0 Crypto IKMP
178 0 13408 3684 17460 0 0 EEM Server
197 0 10268 252 17092 2080 0 VRRP
107 0 5992 0 16068 0 0 HTTP CORE
31 0 22360 0 14208 0 0 Net Background
182 0 76540 69812 13648 0 0 VLAN Manager
32 0 3784 3528 13332 0 0 IDB Work
193 0 504 252 13328 0 0 tENM
112 0 252 252 13076 0 0 X.25 Background
125 0 0 0 13076 0 0 XSM_ENQUEUER
15 0 0 0 13076 0 0 Policy Manager
25 0 252 252 13076 0 0 Dialer event
33 0 252 252 13076 0 0 Logger
103 0 0 9548 13076 0 0 TCP Protocols
102 0 0 0 13076 0 0 TCP Timer
--More--
*Jun 2 08:50:43.987: %SYS-2-CHUNKEXPANDFAIL: Could not expand chunk pool for ipnat node. No memory available -Process= "Chunk Manager", ipl= 4, pid= 1 -Traceback= 0x808FEC68 0x80375778 0x800C8384 154 0 252 492 13076 0 0 Crypto IKE Dispa
126 0 0 0 13076 0 0 XSM Historian
27 0 252 252 13076 0 0 XML Proxy Client
81 0 252 252 13076 0 0 L2TP mgmt daemon
86 0 252 252 13076 0 0 PPP IP Route
85 0 252 252 13076 0 0 KRB5 AAA
72 0 504 504 13076 0 0 PPP Hooks
75 0 0 0 13076 0 0 SSS Test Client
185 0 127540 127540 13076 0 0 Syslog
87 0 252 252 13076 0 0 PPP IPCP
74 0 0 0 13076 0 0 SSS Manager
78 0 0 0 13076 0 0 VPDN call manage
80 0 0 0 13076 0 0 L2X SSS manager
79 0 0 0 13076 0 0 L2X Socket proce
188 0 5304 252 12128 0 0 Compute load avg
0 0 12128 195512 12128 0 0 *Sched*
11 0 4248 0 11324 780 0 ARP Input
40 0 13176 956 11188 0 0 ESWPPM
67 0 3764 412 10588 0 0 CDP Protocol
17 0 3244 0 10320 0 0 Entity MIB API
4 0 3372 252 10256 0 0 Check heaps
92 0 164 0 10240 0 0 IP RIB Update
174 0 76 0 10152 0 0 EEM ED Resource
61 0 252 252 10076 0 0 Dot11 auth Dot1x
177 0 0 0 10076 0 0 EEM ED Track
176 0 0 0 10076 0 0 EEM ED Timer
175 0 0 0 10076 0 0 EEM ED SNMP
60 0 252 252 10076 0 0 Dot11 aaa proces
173 0 0 0 10076 0 0 EEM ED OIR
172 0 0 0 10076 0 0 EEM ED None
171 0 0 0 10076 0 0 EEM ED Memory-th
170 0 0 0 10076 0 0 EEM ED IOSWD
169 0 0 0 10076 0 0 EEM ED Interface
168 0 0 0 10076 0 0 EEM ED Counter
167 0 0 0 10076 0 0 EEM ED CLI
46 0 0 0 10076 0 0 Crypto Device Up
83 0 252 252 10076 0 0 EAPoUDP Process
106 0 252 252 10076 0 0 Adj Manager
35 0 0 0 10076 0 0 Per-Second Jobs
147 0 1428 652 9852 0 0 Crypto CA
53 0 2500 252 9324 0 0 DTP Protocol
143 0 416 252 9240 0 0 Crypto WUI
148 0 0 0 9076 0 0 Crypto PKI-CRL
149 0 0 0 9076 0 0 Crypto SSL
160 0 0 0 9076 0 0 Key Proc
191 0 36888 37256 9076 0 0 crypto sw pk pro
132 0 1192 252 8016 0 0 URL filter proc
141 0 1068 252 7892 0 0 TPLUS
127 0 1020 252 7844 0 0 SSLVPN_PROCESS
49 0 11556 1772 7416 0 0 crypto engine pr
183 0 220 0 7296 0 0 DHCPD Database
89 0 468 252 7292 0 0 Dot1x Supplicant
122 0 424 252 7248 0 0 SDEE Management
90 0 416 252 7240 0 0 Dot1x Supplicant
190 0 164 0 7240 0 0 CEF Scanner
88 0 416 252 7240 0 0 Dot1x Supplicant
164 0 164 0 7240 0 0 DATA Transfer Pr
3 0 164 0 7240 0 0 Spanning Tree
165 0 164 0 7240 0 0 DATA Collector
34 0 168988 252 7180 0 0 TTY Background
99 0 0 0 7076 0 0 Socket Timers
98 0 0 0 7076 0 0 IP Traceroute
37 0 0 0 7076 0 0 Token Daemon
47 0 0 0 7076 0 0 Multi-ISA Event
100 0 252 252 7076 0 0 RLM groups Proce
36 0 0 0 7076 0 0 AggMgr Process
105 0 252 252 7076 0 0 Dialer Forwarder
30 0 0 0 7076 0 0 Critical Bkgnd
26 0 0 0 7076 0 0 SERIAL A'detect
108 0 0 11174152 7076 0 0 IP Cache Ager
109 0 0 0 7076 0 0 RARP Input
110 0 0 0 7076 0 0 Transport Port A
111 0 0 0 7076 0 0 PAD InCall
96 0 0
*Jun 2 08:50:53.987: %SYS-2-CHUNKEXPANDFAIL: Could not expand chunk pool for ipnat node. No memory available -Process= "Chunk Manager", ipl= 4, pid= 1 -Traceback= 0x808FEC68 0x80375778 0x800C8384 0x800CBAD8 0 7076 0 0 IGMPSN
113 0 252 252 7076 0 0 PPP Bind
114 0 252 252 7076 0 0 PPP SSS
115 0 252 252 7076 0 0 RBSCP Background
48 0 0 0 7076 0 0 Multi-ISA Cleanu
24 0 252 252 7076 0 0 GraphIt
118 0 0 0 7076 0 0 DHCPD Timer
119 0 0 0 7076 0 0 Authentication P
120 0 0 0 7076 0 0 Auth-proxy AAA B
121 0 0 0 7076 0 0 IPS Timer
84 0 0 0 7076 0 0 IPv6 RIB Redistr
123 0 0 0 7076 0 0 IPv6 Inspect Tim
124 0 0 0 7076 0 0 XSM_EVENT_ENGINE
21 0 0 0 7076 0 0 RO Notify Timers
20 0 252 252 7076 0 0 Serial Backgroun
82 0 0 0 7076 0 0 X.25 Encaps Mana
128 0 0 0 7076 0 0 Select Timers
23 0 252 252 7076 0 0 SMART
130 0 252 252 7076 0 0 CIFS API Process
16 0 252 252 7076 0 0 DDR Timers
50 0 704 704 7076 0 0 Switch Link Moni
133 0 504 504 7076 0 0 Crypto HW Proc
135 0 252 252 7076 0 0 AAA Cached Serve
136 0 252 252 7076 0 0 ENABLE AAA
43 0 0 0 7076 0 0 Platform Compact
117 0 252 252 7076 0 0 Inspect process
95 0 0 0 7076 0 0 MRD
140 0 252 252 7076 0 0 LOCAL AAA
51 0 252 252 7076 0 0 COLLECT STAT COU
142 0 252 252 7076 0 0 VSP_MGR
52 0 252 252 7076 0 0 PI MATM Aging Pr
144 0 252 252 7076 0 0 Crypto Support
145 0 0 0 7076 0 0 EPM MAIN PROCESS
14 0 0 0 7076 0 0 AAA_SERVER_DEADT
77 0 0 0 7076 0 0 SSS Feature Time
76 0 0 0 7076 0 0 SSS Feature Mana
54 0 252 252 7076 0 0 dot1x
150 0 0 0 7076 0 0 encrypt proc
13 0 252 252 7076 0 0 AAA high-capacit
152 0 0 0 7076 0 0 CRYPTO QoS proce
153 0 0 0 7076 0 0 Crypto INT
12 0 252 252 7076 0 0 ATM Idle Timer
10 0 0 0 7076 0 0 Fan Fault Deboun
9 0 0 0 7076 0 0 Over Heat Deboun
7 0 252 252 7076 0 0 LED Timers
158 0 0 0 7076 0 0 IPSEC manual key
159 0 0 0 7076 0 0 Crypto PAS Proc
55 0 252 252 7076 0 0 Dot1x Mgr Proces
161 0 0 0 7076 0 0 GDOI GM Process
162 0 0 1032 7076 0 0 PM Callback
163 0 252 252 7076 0 0 Control-plane ho
19 0 0 0 7076 0 0 HC Counter Timer
138 0 0 0 7076 0 0 Key chain liveke
166 0 252 252 7076 0 0 AAA SEND STOP EV
56 0 0 0 7076 0 0 EAP Framework
71 0 252 252 7076 0 0 TurboACL chunk
70 0 252 252 7076 0 0 TurboACL
69 0 0 0 7076 0 0 ICMP event handl
57 0 0 0 7076 0 0 linktest
58 0 252 252 7076 0 0 Dot11 Mgmt & Ass
66 0 0 0 7076 0 0 ACCT Periodic Pr
65 0 0 0 7076 0 0 AAA ACCT Proc
64 0 252 252 7076 0 0 AAA Server
63 0 252 252 7076 0 0 AAA Dictionary R
62 0 0 0 7076 0 0 Dot11 Mac Auth
6 0 252 252 7076 0 0 Timers
179 0 252 252 7076 0 0 RMON Recycle Pro
180 0 252 252 7076 0 0 RMON Deferred Se
181 0 0 0 7076 0 0 Syslog Traps
139 0 252 252 7076 0 0 LINE AAA
137 0 0 0 7076 0 0 EM Background Pr
101 0 0 0 7076 0 0 SNMP Timers
202 0 82756 3728 7076 0 0 RIP Timers
186 0 0 0 7076 0
187 0 0 0 7076 0 0 Net Input
194 0 252 252 7076 0 0 IP NAT Ager
189 0 0 0 7076 0 0 Per-minute Jobs
195 0 0 0 7076 0 0 IP NAT WLAN
196 0 0 0 7076 0 0 IP VFR proc
201 0 0 79028 7076 0 0 RIP Send
198 0 252 252 7076 0 0 HSRP Common
45 0 0 0 4076 0 0 IGMP Snooping Re
44 0 0 0 4076 0 0 IGMP Snooping Pr
41 0 252 252 4076 0 0 Eswilp Storm Con
22 0 0 0 4076 0 0 RMI RM Notify Wa
38 0 0 0 4076 0 0 dev_device_inser
2 0 252 252 4076 0 0 Load Meter
39 0 0 0 4076 0 0 dev_device_remov
29 0 0 0 4076 0 0 Inode Table Dest
84447448 Total
Result from arp
GTBAsset#show arp
Protocol Address Age (min) Hardware Addr Type Interface
Internet 10.75.1.100 - 001e.f7d4.a33a ARPA Vlan1
Internet 10.35.202.162 - 001e.f7d4.a33a ARPA FastEthernet0
Internet 10.35.202.161 34 5057.a8c7.4a03 ARPA FastEthernet0
Internet 10.75.10.3 34 001f.caf0.0b21 ARPA Vlan2
Internet 10.75.10.2 - 001e.f7d4.a33a ARPA Vlan2
Internet 10.75.10.1 - 0000.5e00.0101 ARPA Vlan2
Internet 10.10.245.105 - 001e.f7d4.a33a ARPA Vlan20
Internet 10.10.200.1 - 001e.f7d4.a33a ARPA Vlan350
Internet 10.132.0.94 34 503d.e5af.8c00 ARPA Vlan30
Internet 10.132.0.95 - 001e.f7d4.a33a ARPA Vlan30
Internet 80.248.9.81 1 000f.3588.1bfc ARPA FastEthernet1
Internet 80.248.9.85 - 001e.f7d4.a33b ARPA FastEthernet1
Internet 80.248.9.87 - 001e.f7d4.a33b ARPA FastEthernet1
Internet 80.248.9.89 - 001e.f7d4.a33b ARPA FastEthernet1
Internet 80.248.9.88 - 001e.f7d4.a33b ARPA FastEthernet1
Internet 80.248.9.91 - 001e.f7d4.a33b ARPA FastEthernet1
Internet 80.248.9.90 - 001e.f7d4.a33b ARPA FastEthernet1
Internet 80.248.9.92 - 001e.f7d4.a33b ARPA FastEthernet1
Internet 80.248.9.94 - 001e.f7d4.a33b ARPA FastEthernet1
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-02-2015 12:50 AM
Please edit your post and remove the public IPs, from the show arp table.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-02-2015 01:47 AM
If you reload it the issue appears again immediately or take some time to reappear?
Can you send show ip nat statistics?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-01-2015 11:52 AM
Disclaimer
The Author of this posting offers the information contained within this posting without consideration and with the reader's understanding that there's no implied or expressed suitability or fitness for any purpose. Information provided is for informational purposes only and should not be construed as rendering professional advice of any kind. Usage of this posting's information is solely at reader's own risk.
Liability Disclaimer
In no event shall Author be liable for any damages whatsoever (including, without limitation, damages for loss of use, data or profit) arising out of the use or inability to use the posting's information even if Author has been advised of the possibility of such damage.
Posting
A common issue, when routing to the internet, is using a default route to the interface rather than a default route to the next hop (on that interface). The former will "eat" memory from its ARP table, the latter will not. Something you might want to check.
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide