Problem with DLSw

rpaolet · ‎09-17-2003

Hi,

i have 2 routers cisco 7206vxr(NPE400) with ios c7200-a3js-mz.121-5.T12.bin , and causally the routers doesn't work correctly.Before i thinked there was a problem with the buffers and i made tuning :

buffers small permanent 200

buffers small max-free 230

buffers small min-free 30

buffers middle permanent 180

buffers middle max-free 230

buffers middle min-free 50

buffers big permanent 75

buffers verybig permanent 15

buffers large permanent 10

buffers huge permanent 5

but i don't resolve the problem,and i attach the logs:

.Sep 17 13:37:04.349: %SYS-2-MALLOCFAIL: Memory allocation of 788 bytes failed f

rom 0x605E1730, pool I/O, alignment 32

-Process= "IP Input", ipl= 4, pid= 34

-Traceback= 60629D10 6062B1A0 605E1738 605E1A80 605E2000 6132B0E0 6132B1F4 6135E

B50 6135D838 6136D418 613746F0 613797E0 61375E9C 613586AC 61358B60 613403C8

%TCP-6-NOBUFF: TTY0, no buffer available

-Process= "TCP Driver", ipl= 0, pid= 103

-Traceback= 606FE99C 6070619C 6070653C 607D823C 607D8D6C 607D8FD4 60620664 60620

650

.Sep 17 13:37:05.661: %DLSWP-3-PNOMEM: DLSw: No memory to send start-up capabili

ties exchange

-Traceback= 613417F8 61343370 61342C70 61346C40 6185B4EC 61347B00 61336770 61340

294 6134888C 607D6F70 606FA918 606FC7A4 6073C0A4 607206E0 6071E598 6071E6C4

-------------------------------------------------

Sep 17 13:43:00 7200D 24: .Sep 17 13:38:46.778: %CLS-3-CLSFAIL: CLS: Assertion

failed: file "../cls/cls_entitymanager.c", line 3840

---------------------------------------------------

so i can't to go in console because the router are crashes

my questions is before to made upgrade ios to the release 12.2(17a) or 12.2(19), can i tuning in my configuration for buffer memory?

Thanks for collaboration

Regards

Roberto Paoletti

liviu.gheorghe · ‎09-17-2003

Your router has a memory allocation problem, which you can see in the loggs or on the console, %SYS-2-MALLOCFAIL: Memory allocation of 788 bytes failed.

This means that at some point in the normal functioning of the router, a process requests some bytes of memory or a certain task, and at the end of that task it doesn't free up the memory bytes requested.

You can see this with the command sho proc mem; look at the Holding column and see which process is pilling up memory. In the meantime you will see that the free memory is dropping until it reaches a few byes.

My advice is to upgrade to the latest available 12.1 or 12.2 IOS on CCO. Memory leaking problems are most often caused by a software defect.

Cheers

Regards, LG
*** Please Rate All Helpful Responses ***

dixho · ‎09-17-2003

I think that you are hitting CSCdt96984. The details of CSCdt96984 is as follows:

http://www.cisco.com/cgi-bin/Support/Bugtool/launch_bugtool.pl

and enter CSCdt96984.

rpaolet · ‎09-22-2003

Hi, i made to upgrade the release but i have again the problems, now ia analizing traffic on the lan, but i think there's a problem of memory,like to see in the log.I have 2 routers 7200 with snasw and dlsw, and now i stopped the snasw on a router because in the configuration i have this :

snasw cpname NETBAPV.C7200DS

snasw dlus NETBAPV.VTBAPV02 backup NETBAPV.VTBAPV06

snasw port ETHE0 FastEthernet0/1

snasw port VDLCA vdlc 100 mac 400c.7200.a002

snasw port VDLCB vdlc 100 mac 400c.7200.b002

snasw port VDLCATM vdlc 100 mac 400c.7200.0002

snasw link LSVI11 port ETHE0 rmac 0200.694e.7f80 rsap 0x08

snasw link LSVI12 port ETHE0 rmac 0200.694e.7f40

snasw link LSVI21 port ETHE0 rmac 0200.694e.7fc8 rsap 0x18

snasw link LSVI22 port ETHE0 rmac 0200.694e.7f28 rsap 0x18

this configuration is the same for the 2 routers.

i attach some logs, and can you help me to understand these?

-------------------------------------------------

Sep 19 10:06:06 7200D 96: .Sep 19 10:01:49.099: %SNASW-3-DLUR_LOG_2: PROBLEM - 4

73 - REQACTPU rejected

Sep 19 10:10:42 7200D 97: .Sep 19 10:06:25.191: %SYS-2-MALLOCFAIL: Memory alloca

tion of 788 bytes failed from 0x605649BC, alignment 32

Sep 19 10:10:42 7200D 98: Pool: I/O Free: 960568 Cause: Memory fragmentation

Sep 19 10:10:42 7200D 99: Alternate Pool: None Free: 0 Cause: No Alternate poo

l

Sep 19 10:10:42 7200D 100:

Sep 19 10:10:42 7200D 101: -Process= "DLSw msg proc", ipl= 0, pid= 90

Sep 19 10:10:42 7200D 102: -Traceback= 605B242C 605B37B0 605649C4 60564D2C 60565

6B0 60567CB0 612CD228 612CDBF0 612C1B50 612F6310 612EE40C 612EBD44 612EDEC4 612D

313C 612D07AC

Sep 19 10:11:03 7200D 103: .Sep 19 10:06:46.235: %SNASW-3-PC_LOG_11: PROBLEM - 4

84 - Unable to forward an HPR NLP - insufficient storage

Sep 19 10:11:04 7200D 104: .Sep 19 10:06:47.815: %SNASW-3-PC_LOG_11: PROBLEM - 4

85 - Unable to forward an HPR NLP - insufficient storage (Message suppressed 1 t

imes)

Sep 19 10:11:20 7200C 96: .Sep 19 10:07:02.596: %SYS-2-MALLOCFAIL: Memory alloca

tion of 788 bytes failed from 0x605649BC, alignment 32

Sep 19 10:11:20 7200C 97: Pool: I/O Free: 19832 Cause: Memory fragmentation

Sep 19 10:11:20 7200C 98: Alternate Pool: None Free: 0 Cause: No Alternate poo

l

Sep 19 10:14:15 7200D 134: .Sep 19 10:09:23.820: %DLSWP-3-PNOMEM: No memory to s

end start-up capabilities exchange

Sep 19 10:14:15 7200D 135: -Traceback= 612BD47C 612BEF2C 612BE87C 612C2584 617D1

BF0 612C3498 612B25A0 612BC07C 612C40DC 60776AB8 6068DAB8 6068FB38 606D0E2C 606B

3F9C 606B1ABC 606B1BA8

Sep 19 10:14:15 7200D 136: .Sep 19 10:09:27.044: %DLSWP-3-PNOMEM: No memory to s

end start-up capabilities exchange

Sep 19 10:14:15 7200D 137: -Traceback= 612BD47C 612BEF2C 612BE87C 612C2584 617D1

BF0 612C3498 612B25A0 612BC07C 612C40DC 60776AB8 6068DAB8 6068FB38 606D0E2C 606B

3F9C 606B1ABC 606B1BA8

Sep 19 10:14:15 7200D 138: .Sep 19 10:09:55.680: %SYS-2-MALLOCFAIL: Memory alloc

ation of 788 bytes failed from 0x605649BC, alignment 32

Sep 19 10:14:15 7200D 139: Pool: I/O Free: 289040 Cause: Memory fragmentation

Sep 19 10:14:15 7200D 140: Alternate Pool: None Free: 0 Cause: No Alternate po

ol

Sep 19 10:14:15 7200D 141:

Sep 19 10:14:15 7200D 142: -Process= "DLSw msg proc", ipl= 0, pid= 90

Sep 19 10:14:15 7200D 143: -Traceback= 605B242C 605B37B0 605649C4 60564D2C 60565

6B0 60567CB0 612CD228 612CDBF0 612C1B50 612F6310 612EE40C 612EBD44 612EDEC4 612D

313C 612D07AC

Sep 19 10:15:57 7200D 145: .Sep 19 10:11:40.160: %SYS-2-MALLOCFAIL: Memory alloc

ation of 788 bytes failed from 0x605649BC, alignment 32

Sep 19 10:15:57 7200D 146: Pool: I/O Free: 533792 Cause: Memory fragmentation

Sep 19 10:15:57 7200D 147: Alternate Pool: None Free: 0 Cause: No Alternate po

ol

Sep 19 10:15:57 7200D 148:

Sep 19 10:15:57 7200D 149: -Process= "DLSw msg proc", ipl= 0, pid= 90

Sep 19 10:15:57 7200D 150: -Traceback= 605B242C 605B37B0 605649C4 60564D2C 60565

6B0 60567CB0 612CD228 612CDBF0 612C1B50 612F6310 612EE40C 612EBD44 612EDEC4 612D

313C 612D07AC

----------------------------------------------------

thanks for your collaboration,

Regards

Roberto Paoletti

htranphu · ‎09-22-2003

Roberto,

Do you have the problem on both routers ? Does the problem go away when you stopped SNASw ?

It looks to be a memory shortage problem; we need to collect elaborate documentation (including core file) to see whether there is a memory leak.

I think the best way to handle this is to open a case with the Cisco IBM TAC which will help you collect the doc required. Please feel free to mention my name when talking to the TAC.

Thanks,

tran