Cisco 3750E - Debug Exception (Could be NULL pointer dereference

cwwong1973 · ‎05-04-2013

I am not able to find the exact bug for Cisco 3750E stack - Debug Exception (Could be NULL pointer dereference) Exception (0x2000) error.

Closest i can find is CSCsa72400 which only affects ver 12.2(20)SE4.

All the stacks (3 switches) are running 12.2(50)SE3

It appears that the switch 1 crashed and reloaded. My hunch is its software but i cant find any related bugs. It could be hardware issue as well?

Log

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: System previously crashed with the following message: (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 12.2(50)SE3, RELEASE SOFTWARE (fc1) (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: Technical Support: http://www.cisco.com/techsupport (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: Compiled Wed 22-Jul-09 05:35 by prod_rel_team (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: Debug Exception (Could be NULL pointer dereference) Exception (0x2000)! (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: SRR0 = 0x01A90BD0 SRR1 = 0x00029230 SRR2 = 0x0075DED4 SRR3 = 0x00021000 (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: ESR = 0x00000000 DEAR = 0x00000000 TSR = 0x8C000000 DBSR = 0x10000000 (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: CPU Register Context: (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: Vector = 0x00002000 PC = 0x00BBE6BC MSR = 0x00029230 CR = 0x20000002 (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: LR = 0x00BBE680 CTR = 0x01A85F3C XER = 0x6000007F (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: R0 = 0x00BBE680 R1 = 0x037B7B20 R2 = 0x00000000 R3 = 0x0552B024 (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: R4 = 0x00000000 R5 = 0x00000000 R6 = 0x00000000 R7 = 0x00000000 (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: R8 = 0x00007530 R9 = 0x00000000 R10 = 0x00000000 R11 = 0x00000005 (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: R12 = 0x62E847D3 R13 = 0x0F9817A8 R14 = 0x01A8433C R15 = 0x00000000 (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: R16 = 0x00000000 R17 = 0x00000000 R18 = 0x00000000 R19 = 0x00000000 (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: R20 = 0x00000000 R21 = 0x00000000 R22 = 0x00000000 R23 = 0x02D70000 (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: R24 = 0xAB1234AB R25 = 0x064FF624 R26 = 0x00000000 R27 = 0x02ECE084 (XXX-XX-L04-01-1)

May 3 15:55:58.317 AEST: %PLATFORM-1-CRASHED: R28 = 0x00000001 R29 = 0x025EB990 R30 = 0x064FF624 R31 = 0x00000000 (XXX-XX-L04-01-1)

May 3 15:55:58.325 AEST: %PLATFORM-1-CRASHED: (XXX-XX-L04-01-1)

May 3 15:55:58.325 AEST: %PLATFORM-1-CRASHED: Stack trace: (XXX-XX-L04-01-1)

May 3 15:55:58.325 AEST: %PLATFORM-1-CRASHED: PC = 0x00BBE6BC, SP = 0x037B7B20 (XXX-XX-L04-01-1)

May 3 15:55:58.325 AEST: %PLATFORM-1-CRASHED: Frame 00: SP = 0x037B7B30 PC = 0x00BBE680 (XXX-XX-L04-01-1)

May 3 15:55:58.325 AEST: %PLATFORM-1-CRASHED: Frame 01: SP = 0x037B7B60 PC = 0x01A81050 (XXX-XX-L04-01-1)

May 3 15:55:58.325 AEST: %PLATFORM-1-CRASHED: Frame 02: SP = 0x037B7B78 PC = 0x01A80C40 (XXX-XX-L04-01-1)

May 3 15:55:58.325 AEST: %PLATFORM-1-CRASHED: Frame 03: SP = 0x037B7BB0 PC = 0x01A81894 (XXX-XX-L04-01-1)

May 3 15:55:58.325 AEST: %PLATFORM-1-CRASHED: Frame 04: SP = 0x037B7BC8 PC = 0x01A841CC (XXX-XX-L04-01-1)

May 3 15:55:58.325 AEST: %PLATFORM-1-CRASHED: Frame 05: SP = 0x037B7BE0 PC = 0x01A843DC (XXX-XX-L04-01-1)

May 3 15:55:58.325 AEST: %PLATFORM-1-CRASHED: Frame 06: SP = 0x037B7BE8 PC = 0x00BC0648 (XXX-XX-L04-01-1)

May 3 15:55:58.325 AEST: %PLATFORM-1-CRASHED: Frame 07: SP = 0x00000000 PC = 0x00BB7118 (XXX-XX-L04-01-1)

May 3 15:55:58.325 AEST: %PLATFORM-1-CRASHED: (XXX-XX-L04-01-1)

The strange thing is there is a crashinfo folder but there is no files in there.

Directory of flash:/

2 -rwx 38808 Apr 25 2013 04:54:09 +10:00 config.text

3 -rwx 2204 Mar 1 1993 11:01:28 +11:00 vlan.dat

4 -rwx 3096 Apr 25 2013 04:54:09 +10:00 multiple-fs

5 -rwx 38789 Mar 15 2013 14:03:20 +11:00 config.text.backup

6 drwx 512 Mar 1 1993 11:34:31 +11:00 c3750e-universalk9-mz.122-50.SE3

429 drwx 512 May 3 2013 15:51:16 +10:00 crashinfo_ext <--new directory

430 -rwx 24 Mar 15 2013 14:03:20 +11:00 private-config.text.backup

431 -rwx 40015 Apr 22 2013 02:36:08 +10:00 SD194725

432 -rwx 24 Apr 25 2013 04:54:09 +10:00 private-config.text

433 drwx 512 Mar 1 1993 11:00:08 +11:00 crashinfo

57671680 bytes total (27945984 bytes free)

XXX-XX-L04-01-1#cd crashinfo_ext

XXX-XX-L04-01-1#dir

Directory of flash:/crashinfo_ext/

No files in directory

57671680 bytes total (27945984 bytes free)

----------------------------------------

Any suggestions would be very much appreciated.

Thanks

Wong

Leo Laohoo · ‎05-04-2013

Try not to use 12.2(50)SE IOS.

I've got good success with 12.2(55)SE7. Give that a try and observe.

Gabriel Hill · ‎05-04-2013

Hello cwwong,

I found the following:

CSCsz20865

IOS is pretty close to the same, and it is similar to your issue. Was the switch that restarted the master of the stack?

Thanks,
Gabriel

Bilal Nawaz · ‎05-04-2013

Can you try a

show flash1:

See if this displays anything.
The show flash command only shows flash content of the master.

I also couldn't find much on it

http://tools.cisco.com/Support/BugToolKit/search/getBugDetails.do?method=fetchBugDetails&bugId=CSCsa72400

Sent from Cisco Technical Support iPhone App

Please rate useful posts & remember to mark any solved questions as answered. Thank you.

cwwong1973 · ‎05-04-2013

Guys,

Thanks for your suggestions and replies. Really appreciate it.

Gab,

The master switch is switch 2. The switch 1 was the one crashed for no reason. Only happened once so i dont think its related to the bug you mentioned. No change to enviroment

Bilal,

My apologies...i obmitted some of the information.

The displays are from switch 1. I've sessioned to it.

The directory was created (at the same time of crash) - crashinfo_ext.

But there are no files in the directory.

leolaohoo,

Thanks...i'll keep a note of this.

Cheers

Wong

Cisco 3750E - Debug Exception (Could be NULL pointer dereference) Exception (0x2000) Error