CISCO 6500 VSS restarted.

sameermunj · ‎08-14-2013

hello guys,

i have a cisco 6500 switch in VSS and suddendly one of the switch in VSS got restarted... crach file got generated, please let me know if something you can find out, (software or hardware issue)

Software Version Running: ADVIPSERVICESK9-M, Version 15.1(1)SY

prinitng some chunks from the crash..

****************************************************************************************************************************************************************************

Chunk#1

%VSLP-SW2_SP-3-VSLP_LMP_FAIL_REASON: Te2/5/4: Disabled by Admin reload

%SYS-SW2_SP-3-INVMEMINT: Invalid memory action (malloc) at interrupt level

-Traceback= 40A25514z 41E259D0z 41563E5Cz 4156A740z 41629140z 4162A264z 40920404z 41618F44z 41C16058z 41675334z 41DE9A18z 40C914A4z 40C925BCz 40920404z 40C8DB1Cz 413EFD70z

*Aug 14 2013 15:45:55.575: %SYS-SW2_SP-2-MALLOCFAIL: Memory allocation of 8 bytes failed from 0x41567254, alignment 0

Pool: Processor Free: 702372632 Cause: Interrupt level allocation

Alternate Pool: None Free: 0 Cause: Interrupt level allocation

-Process= "<interrupt level>", ipl= 4

-Traceback= 40A10FB8z 40A25544z 41E259D0z 41563E5Cz 4156A740z 41629140z 4162A264z 40920404z 41618F44z 41C16058z 41675334z 41DE9A18z 40C914A4z 40C925BCz 40920404z 40C8DB1Cz

*Aug 14 10:15:55.575: SW2_SP: pf_ec_loadshare_set_port_load: calloc failed

Chunk#2

SYS-SW2_SP-3-INVMEMINT: Invalid memory action (malloc) at interrupt level

-Traceback= 40A24378z 41E25A48z 40C8DFD0z 40C925BCz 40920404z 40C8DB1Cz 413EFD70z 4159FB38z 415A96A8z 417408C8z 41129590z 4112A0D0z 4112A350z 412964F4z 4129388Cz 41293AC0z

*Aug 14 2013 15:45:55.599: %VSLP-SW2_SP-3-VSLP_LMP_FAIL_REASON: Te2/5/5: Disabled by Admin reload

*Aug 14 2013 15:45:55.599: %VSLP-SW2_SP-2-VSL_DOWN: Last VSL interface Te2/5/5 went down

Chunk#3

*Aug 14 2013 15:45:55.607: %SYS-SW2_SP-3-INVMEMINT: Invalid memory action (malloc) at interrupt level

-Traceback= 40A24378z 41E25A48z 40C8DFD0z 40C925BCz 40920404z 40C8DB1Cz 413EFD70z 4159FB38z 415A96A8z 417408C8z 41129590z 4112A0D0z 4112A350z 412964F4z 4129388Cz 41293AC0z

%Software-forced reload

15:46:10 UTC Wed Aug 14 2013: Breakpoint exception, CPU signal 23, PC = 0x41D24664

****************************************************************************************************************************************************************************

InayathUlla Sharieff · ‎08-14-2013

SAmeer,

Could you please provide me the following files;

show tech/show version

crash file completely.

sameermunj · ‎08-14-2013

Hi Inayat

Please find attached required details.

i am trying to get show tech from the device (sometimes it increses the cpu util so will not force actually)..please find below the show version output..

------------------ show version ------------------

Cisco IOS Software, s72033_rp Software (s72033_rp-ADVIPSERVICESK9-M), Version 15.1(1)SY, RELEASE SOFTWARE (fc2)

Technical Support: http://www.cisco.com/techsupport

Compiled Tue 09-Oct-12 15:13 by prod_rel_team

ROM: System Bootstrap, Version 12.2(17r)SX7, RELEASE SOFTWARE (fc1)

NDAINFA6509_SEZ-CORE uptime is 3 weeks, 2 days, 15 hours, 39 minutes

Uptime for this control processor is 2 days, 8 hours, 47 minutes

System returned to ROM by Stateful Switchover at 09:44:08 UTC Fri Apr 19 2013 (SP by reload)

System image file is "sup-bootdisk:s72033-advipservicesk9-mz.151-1.SY.bin"

Last reload reason: Admin CLI

This product contains cryptographic features and is subject to United

States and local country laws governing import, export, transfer and

use. Delivery of Cisco cryptographic products does not imply

third-party authority to import, export, distribute or use encryption.

Importers, exporters, distributors and users are responsible for

compliance with U.S. and local country laws. By using this product you

agree to comply with applicable laws and regulations. If you are unable

to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:

http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to

export@cisco.com.

cisco WS-C6509-E (R7000) processor (revision 1.5) with 983008K/65536K bytes of memory.

Processor board ID SMC1502000V

SR71000 CPU at 600Mhz, Implementation 0x504, Rev 1.2, 512KB L2 Cache

Last reset from s/w reset

72 Virtual Ethernet interfaces

486 Gigabit Ethernet interfaces

4 Ten Gigabit Ethernet interfaces

1917K bytes of non-volatile configuration memory.

65536K bytes of Flash internal SIMM (Sector size 512K).

Configuration register is 0x2102

sameermunj · ‎08-14-2013

Hi Inayat,

Please find the attached show tech, but this is two months old ( taken on 23^rd june 2013).

Hope this helps.

sameermunj · ‎08-14-2013

Hi Inayat

Please let su know if you get any clue out of it...

waiting for your input

thanks

Sameer

InayathUlla Sharieff · ‎08-15-2013

Sameer,

Can you also give me the ouput of show region please?

sameermunj · ‎08-15-2013

Hi Inayat

We opened TAC case with cisco and it tunrned out be CDP related Bug..

Thanks

Sameer

InayathUlla Sharieff · ‎08-15-2013

Sameer,

Can you send me the TAC case number pleaes? If possible send me the PM.

Regards

Inayath