WS-C3750X-24P %PLATFORM-1-CRASHED:

[NewComer]

Hello,

I have about 5 3750's that are crashing every 6hrs on the dot. Not sure if this is attributed to a configuration issue or a bug. The switches have been running for over a year with not issues. Crash dump below. Any help would be much appreciated.

Logs:

*Jan 1 16:02:22.136 Pacific: %PLATFORM-1-CRASHED: System previously crashed with the following message:
*Jan 1 16:02:22.136 Pacific: %PLATFORM-1-CRASHED: Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 15.2(4)E2, RELEASE SOFTWARE (fc2)
*Jan 1 16:02:22.136 Pacific: %PLATFORM-1-CRASHED: Technical Support: http://www.cisco.com/techsupport
*Jan 1 16:02:22.136 Pacific: %PLATFORM-1-CRASHED: Copyright (c) 1986-2016 by Cisco Systems, Inc.
*Jan 1 16:02:22.136 Pacific: %PLATFORM-1-CRASHED: Compiled Mon 27-Jun-16 08:25 by prod_rel_team
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED:
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED:
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: SRR0 = 0x02E0D2C8 SRR1 = 0x00029230 SRR2 = 0x032BF214 SRR3 = 0x00029230
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: ESR = 0x00000000 DEAR = 0x00000000 TSR = 0x84000000 DBSR = 0x10000000
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED:
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: CPU Register Context:
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: Vector = 0x00002000 PC = 0x032BF214 MSR = 0x00029230 CR = 0x35393053
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: LR = 0x032BF214 CTR = 0x0272FA44 XER = 0xC0000078
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: R0 = 0x032BF214 R1 = 0x097C3844 R2 = 0x00000000 R3 = 0x05ED48A0
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: R4 = 0x00000000 R5 = 0x097C351C R6 = 0x00000001 R7 = 0x052E0000
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: R8 = 0x00029230 R9 = 0x00000000 R10 = 0x052E0000 R11 = 0x052E0000
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: R12 = 0x35393055 R13 = 0x0D981A10 R14 = 0x00000001 R15 = 0x00000000
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: R16 = 0x00000000 R17 = 0xFFFFFFFF R18 = 0x097C3938 R19 = 0xFFFFFFFF
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: R20 = 0x00000000 R21 = 0x00000022 R22 = 0x00000000 R23 = 0x00000000
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: R24 = 0xFFFFFFFE R25 = 0x097C39E8 R26 = 0x7FFFFFDD R27 = 0x00000000
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: R28 = 0x03DA36AC R29 = 0x00000000 R30 = 0x04E400A0 R31 = 0x00000000
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED:
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: Stack trace:
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: PC = 0x032BF214, SP = 0x097C3844
*Jan 1 16:02:22.144 Pacific: %PLATFORM-1-CRASHED: Frame 00: SP = 0x097C3854 PC = 0x032BF214
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 01: SP = 0x097C3864 PC = 0x032B8288
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 02: SP = 0x097C387C PC = 0x032C1A10
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 03: SP = 0x097C38C8 PC = 0x032B4AAC
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 04: SP = 0x097C38D8 PC = 0x02E0C2F8
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 05: SP = 0x097C38E0 PC = 0x02E0CDF4
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 06: SP = 0x097C38F8 PC = 0x026BD200
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 07: SP = 0x097C39A8 PC = 0x026BE924
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 08: SP = 0x097C39E0 PC = 0x026BBD90
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 09: SP = 0x097C3D28 PC = 0x006F8EAC
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 10: SP = 0x097C3D90 PC = 0x00700094
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 11: SP = 0x097C3E18 PC = 0x006FDB88
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 12: SP = 0x097C3E58 PC = 0x006FDEF4
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 13: SP = 0x097C3E70 PC = 0x032BB408
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 14: SP = 0x097C3E90 PC = 0x0277A838
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED: Frame 15: SP = 0x097C3EC0 PC = 0x0026AC7C
*Jan 1 16:02:22.153 Pacific: %PLATFORM-1-CRASHED:

--------crash dump-----------

FL2#more flash:/crashinfo/crashinfo_1
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 15.2(4)E2, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2016 by Cisco Systems, Inc.
Compiled Mon 27-Jun-16 08:25 by prod_rel_team

Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!

SRR0 = 0x02E0D2C8 SRR1 = 0x00029230 SRR2 = 0x032BF214 SRR3 = 0x00029230
ESR = 0x00000000 DEAR = 0x00000000 TSR = 0x84000000 DBSR = 0x10000000

CPU Register Context:
Vector = 0x00002000 PC = 0x032BF214 MSR = 0x00029230 CR = 0x35393053
LR = 0x032BF214 CTR = 0x0272FA44 XER = 0x80000008
R0 = 0x032BF214 R1 = 0x0982FF0C R2 = 0x00000000 R3 = 0x05ED54B8
R4 = 0x00000000 R5 = 0x0982FBE4 R6 = 0x00000001 R7 = 0x052E0000
R8 = 0x00029230 R9 = 0x00000000 R10 = 0x052E0000 R11 = 0x052E0000
R12 = 0x35393055 R13 = 0x0B98279C R14 = 0x00000001 R15 = 0x00000000
R16 = 0x00000000 R17 = 0xFFFFFFFF R18 = 0x09830000 R19 = 0xFFFFFFFF
R20 = 0x00000000 R21 = 0x0000002A R22 = 0x00000000 R23 = 0x00000000
R24 = 0xFFFFFFFE R25 = 0x098300B0 R26 = 0x7FFFFFD5 R27 = 0x00000000
R28 = 0x03DA36AC R29 = 0x00000000 R30 = 0x04E400A0 R31 = 0x00000000

Stack trace:
PC = 0x032BF214, SP = 0x0982FF0C
Frame 00: SP = 0x0982FF1C PC = 0x032BF214
Frame 01: SP = 0x0982FF2C PC = 0x032B8288
Frame 02: SP = 0x0982FF44 PC = 0x032C1A10
Frame 03: SP = 0x0982FF90 PC = 0x032B4AAC
Frame 04: SP = 0x0982FFA0 PC = 0x02E0C2F8
Frame 05: SP = 0x0982FFA8 PC = 0x02E0CDF4
Frame 06: SP = 0x0982FFC0 PC = 0x026BD200
Frame 07: SP = 0x09830070 PC = 0x026BE924
Frame 08: SP = 0x098300A8 PC = 0x026BBD90
Frame 09: SP = 0x098303F0 PC = 0x006F8EAC
Frame 10: SP = 0x09830458 PC = 0x00700094
Frame 11: SP = 0x098304E0 PC = 0x006FDB88
Frame 12: SP = 0x09830520 PC = 0x006FDEF4
Frame 13: SP = 0x09830538 PC = 0x032BB408
Frame 14: SP = 0x09830558 PC = 0x0277A838
Frame 15: SP = 0x09830588 PC = 0x0026AC7C

PrkGrnd-IDF-NE-FL2#more flash:/crashinfo/crashinfo_2
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 15.2(4)E2, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2016 by Cisco Systems, Inc.
Compiled Mon 27-Jun-16 08:25 by prod_rel_team

Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!

SRR0 = 0x02E0D2C8 SRR1 = 0x00029230 SRR2 = 0x032BF214 SRR3 = 0x00029230
ESR = 0x00000000 DEAR = 0x00000000 TSR = 0x84000000 DBSR = 0x10000000

CPU Register Context:
Vector = 0x00002000 PC = 0x032BF214 MSR = 0x00029230 CR = 0x35393053
LR = 0x032BF214 CTR = 0x0272FA44 XER = 0x80000008
R0 = 0x032BF214 R1 = 0x0971233C R2 = 0x00000000 R3 = 0x05E21894
R4 = 0x00000000 R5 = 0x09712014 R6 = 0x00000001 R7 = 0x052E0000
R8 = 0x00029230 R9 = 0x00000000 R10 = 0x052E0000 R11 = 0x052E0000
R12 = 0x35393055 R13 = 0x0D98279C R14 = 0x00000001 R15 = 0x00000000
R16 = 0x00000000 R17 = 0xFFFFFFFF R18 = 0x09712430 R19 = 0xFFFFFFFF
R20 = 0x00000000 R21 = 0x0000002C R22 = 0x00000000 R23 = 0x00000000
R24 = 0xFFFFFFFE R25 = 0x097124E0 R26 = 0x7FFFFFD3 R27 = 0x00000000
R28 = 0x03DA36AC R29 = 0x00000000 R30 = 0x04E400A0 R31 = 0x00000000

Stack trace:
PC = 0x032BF214, SP = 0x0971233C
Frame 00: SP = 0x0971234C PC = 0x032BF214
Frame 01: SP = 0x0971235C PC = 0x032B8288
Frame 02: SP = 0x09712374 PC = 0x032C1A10
Frame 03: SP = 0x097123C0 PC = 0x032B4AAC
Frame 04: SP = 0x097123D0 PC = 0x02E0C2F8
Frame 05: SP = 0x097123D8 PC = 0x02E0CDF4
Frame 06: SP = 0x097123F0 PC = 0x026BD200
Frame 07: SP = 0x097124A0 PC = 0x026BE924
Frame 08: SP = 0x097124D8 PC = 0x026BBD90
Frame 09: SP = 0x09712820 PC = 0x006F8EAC
Frame 10: SP = 0x09712888 PC = 0x00700094
Frame 11: SP = 0x09712910 PC = 0x006FDB88
Frame 12: SP = 0x09712950 PC = 0x006FDEF4
Frame 13: SP = 0x09712968 PC = 0x032BB408
Frame 14: SP = 0x09712988 PC = 0x0277A838
Frame 15: SP = 0x097129B8 PC = 0x0026AC7C

PrkGrnd-IDF-NE-FL2#more flash:/crashinfo/crashinfo_3
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 15.2(4)E2, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2016 by Cisco Systems, Inc.
Compiled Mon 27-Jun-16 08:25 by prod_rel_team

Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!

SRR0 = 0x02E0D2C8 SRR1 = 0x00029230 SRR2 = 0x032BF214 SRR3 = 0x00029230
ESR = 0x00000000 DEAR = 0x00000000 TSR = 0xC4000000 DBSR = 0x10000000

CPU Register Context:
Vector = 0x00002000 PC = 0x032BF214 MSR = 0x00029230 CR = 0x35393053
LR = 0x032BF214 CTR = 0x0272FA44 XER = 0x80000008
R0 = 0x032BF214 R1 = 0x097CDE24 R2 = 0x00000000 R3 = 0x05EE0F1C
R4 = 0x00000000 R5 = 0x097CDAFC R6 = 0x00000001 R7 = 0x052E0000
R8 = 0x00029230 R9 = 0x00000000 R10 = 0x052E0000 R11 = 0x052E0000
R12 = 0x35393055 R13 = 0x0D98279C R14 = 0x00000001 R15 = 0x00000000
R16 = 0x00000000 R17 = 0xFFFFFFFF R18 = 0x097CDF18 R19 = 0xFFFFFFFF
R20 = 0x00000000 R21 = 0x00000021 R22 = 0x00000000 R23 = 0x00000000
R24 = 0xFFFFFFFE R25 = 0x097CDFC8 R26 = 0x7FFFFFDE R27 = 0x00000000
R28 = 0x03DA36AC R29 = 0x00000000 R30 = 0x04E400A0 R31 = 0x00000000

Stack trace:
PC = 0x032BF214, SP = 0x097CDE24
Frame 00: SP = 0x097CDE34 PC = 0x032BF214
Frame 01: SP = 0x097CDE44 PC = 0x032B8288
Frame 02: SP = 0x097CDE5C PC = 0x032C1A10
Frame 03: SP = 0x097CDEA8 PC = 0x032B4AAC
Frame 04: SP = 0x097CDEB8 PC = 0x02E0C2F8
Frame 05: SP = 0x097CDEC0 PC = 0x02E0CDF4
Frame 06: SP = 0x097CDED8 PC = 0x026BD200
Frame 07: SP = 0x097CDF88 PC = 0x026BE924
Frame 08: SP = 0x097CDFC0 PC = 0x026BBD90
Frame 09: SP = 0x097CE308 PC = 0x006F8EAC
Frame 10: SP = 0x097CE370 PC = 0x00700094
Frame 11: SP = 0x097CE3F8 PC = 0x006FDB88
Frame 12: SP = 0x097CE438 PC = 0x006FDEF4
Frame 13: SP = 0x097CE450 PC = 0x032BB408
Frame 14: SP = 0x097CE470 PC = 0x0277A838
Frame 15: SP = 0x097CE4A0 PC = 0x0026AC7C

PrkGrnd-IDF-NE-FL2#more flash:/crashinfo/crashinfo_4
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 15.2(4)E2, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2016 by Cisco Systems, Inc.
Compiled Mon 27-Jun-16 08:25 by prod_rel_team

Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!

SRR0 = 0x02E0D2C8 SRR1 = 0x00029230 SRR2 = 0x032BF214 SRR3 = 0x00029230
ESR = 0x00000000 DEAR = 0x00000000 TSR = 0x84000000 DBSR = 0x10000000

CPU Register Context:
Vector = 0x00002000 PC = 0x032BF214 MSR = 0x00029230 CR = 0x35393053
LR = 0x032BF214 CTR = 0x0272FA44 XER = 0x80000008
R0 = 0x032BF214 R1 = 0x096BF15C R2 = 0x00000000 R3 = 0x05DD0A90
R4 = 0x00000000 R5 = 0x096BEE34 R6 = 0x00000001 R7 = 0x052E0000
R8 = 0x00029230 R9 = 0x00000000 R10 = 0x052E0000 R11 = 0x052E0000
R12 = 0x35393055 R13 = 0x0D98279C R14 = 0x00000001 R15 = 0x00000000
R16 = 0x00000000 R17 = 0xFFFFFFFF R18 = 0x096BF250 R19 = 0xFFFFFFFF
R20 = 0x00000000 R21 = 0x0000002B R22 = 0x00000000 R23 = 0x00000000
R24 = 0xFFFFFFFE R25 = 0x096BF300 R26 = 0x7FFFFFD4 R27 = 0x00000000
R28 = 0x03DA36AC R29 = 0x00000000 R30 = 0x04E400A0 R31 = 0x00000000

Stack trace:
PC = 0x032BF214, SP = 0x096BF15C
Frame 00: SP = 0x096BF16C PC = 0x032BF214
Frame 01: SP = 0x096BF17C PC = 0x032B8288
Frame 02: SP = 0x096BF194 PC = 0x032C1A10
Frame 03: SP = 0x096BF1E0 PC = 0x032B4AAC
Frame 04: SP = 0x096BF1F0 PC = 0x02E0C2F8
Frame 05: SP = 0x096BF1F8 PC = 0x02E0CDF4
Frame 06: SP = 0x096BF210 PC = 0x026BD200
Frame 07: SP = 0x096BF2C0 PC = 0x026BE924
Frame 08: SP = 0x096BF2F8 PC = 0x026BBD90
Frame 09: SP = 0x096BF640 PC = 0x006F8EAC
Frame 10: SP = 0x096BF6A8 PC = 0x00700094
Frame 11: SP = 0x096BF730 PC = 0x006FDB88
Frame 12: SP = 0x096BF770 PC = 0x006FDEF4
Frame 13: SP = 0x096BF788 PC = 0x032BB408
Frame 14: SP = 0x096BF7A8 PC = 0x0277A838
Frame 15: SP = 0x096BF7D8 PC = 0x0026AC7C

PrkGrnd-IDF-NE-FL2#more flash:/crashinfo/crashinfo_5
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 15.2(4)E2, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2016 by Cisco Systems, Inc.
Compiled Mon 27-Jun-16 08:25 by prod_rel_team

Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!

SRR0 = 0x02E0D2C8 SRR1 = 0x00029230 SRR2 = 0x032BF214 SRR3 = 0x00029230
ESR = 0x00000000 DEAR = 0x00000000 TSR = 0x84000000 DBSR = 0x10000000

CPU Register Context:
Vector = 0x00002000 PC = 0x032BF214 MSR = 0x00029230 CR = 0x35393053
LR = 0x032BF214 CTR = 0x0272FA44 XER = 0x80000008
R0 = 0x032BF214 R1 = 0x097800B4 R2 = 0x00000000 R3 = 0x05E92EBC
R4 = 0x00000000 R5 = 0x0977FD8C R6 = 0x00000001 R7 = 0x052E0000
R8 = 0x00029230 R9 = 0x00000000 R10 = 0x052E0000 R11 = 0x052E0000
R12 = 0x35393055 R13 = 0x0D98279C R14 = 0x00000001 R15 = 0x00000000
R16 = 0x00000000 R17 = 0xFFFFFFFF R18 = 0x097801A8 R19 = 0xFFFFFFFF
R20 = 0x00000000 R21 = 0x00000020 R22 = 0x00000000 R23 = 0x00000000
R24 = 0xFFFFFFFE R25 = 0x09780258 R26 = 0x7FFFFFDF R27 = 0x00000000
R28 = 0x03DA36AC R29 = 0x00000000 R30 = 0x04E400A0 R31 = 0x00000000

Stack trace:
PC = 0x032BF214, SP = 0x097800B4
Frame 00: SP = 0x097800C4 PC = 0x032BF214
Frame 01: SP = 0x097800D4 PC = 0x032B8288
Frame 02: SP = 0x097800EC PC = 0x032C1A10
Frame 03: SP = 0x09780138 PC = 0x032B4AAC
Frame 04: SP = 0x09780148 PC = 0x02E0C2F8
Frame 05: SP = 0x09780150 PC = 0x02E0CDF4
Frame 06: SP = 0x09780168 PC = 0x026BD200
Frame 07: SP = 0x09780218 PC = 0x026BE924
Frame 08: SP = 0x09780250 PC = 0x026BBD90
Frame 09: SP = 0x09780598 PC = 0x006F8EAC
Frame 10: SP = 0x09780600 PC = 0x00700094
Frame 11: SP = 0x09780688 PC = 0x006FDB88
Frame 12: SP = 0x097806C8 PC = 0x006FDEF4
Frame 13: SP = 0x097806E0 PC = 0x032BB408
Frame 14: SP = 0x09780700 PC = 0x0277A838
Frame 15: SP = 0x09780730 PC = 0x0026AC7C

PrkGrnd-IDF-NE-FL2#more flash:/crashinfo/crashinfo_6
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 15.2(4)E2, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2016 by Cisco Systems, Inc.
Compiled Mon 27-Jun-16 08:25 by prod_rel_team

Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!

SRR0 = 0x02E0D2C8 SRR1 = 0x00029230 SRR2 = 0x032BF214 SRR3 = 0x00029230
ESR = 0x00000000 DEAR = 0x00000000 TSR = 0x84000000 DBSR = 0x10000000

CPU Register Context:
Vector = 0x00002000 PC = 0x032BF214 MSR = 0x00029230 CR = 0x35393053
LR = 0x032BF214 CTR = 0x0272FA44 XER = 0x80000008
R0 = 0x032BF214 R1 = 0x095DA434 R2 = 0x00000000 R3 = 0x05CF0050
R4 = 0x00000000 R5 = 0x095DA10C R6 = 0x00000001 R7 = 0x052E0000
R8 = 0x00029230 R9 = 0x00000000 R10 = 0x052E0000 R11 = 0x052E0000
R12 = 0x35393055 R13 = 0x0D98279C R14 = 0x00000001 R15 = 0x00000000
R16 = 0x00000000 R17 = 0xFFFFFFFF R18 = 0x095DA528 R19 = 0xFFFFFFFF
R20 = 0x00000000 R21 = 0x00000022 R22 = 0x00000000 R23 = 0x00000000
R24 = 0xFFFFFFFE R25 = 0x095DA5D8 R26 = 0x7FFFFFDD R27 = 0x00000000
R28 = 0x03DA36AC R29 = 0x00000000 R30 = 0x04E400A0 R31 = 0x00000000

Stack trace:
PC = 0x032BF214, SP = 0x095DA434
Frame 00: SP = 0x095DA444 PC = 0x032BF214
Frame 01: SP = 0x095DA454 PC = 0x032B8288
Frame 02: SP = 0x095DA46C PC = 0x032C1A10
Frame 03: SP = 0x095DA4B8 PC = 0x032B4AAC
Frame 04: SP = 0x095DA4C8 PC = 0x02E0C2F8
Frame 05: SP = 0x095DA4D0 PC = 0x02E0CDF4
Frame 06: SP = 0x095DA4E8 PC = 0x026BD200
Frame 07: SP = 0x095DA598 PC = 0x026BE924
Frame 08: SP = 0x095DA5D0 PC = 0x026BBD90
Frame 09: SP = 0x095DA918 PC = 0x006F8EAC
Frame 10: SP = 0x095DA980 PC = 0x00700094
Frame 11: SP = 0x095DAA08 PC = 0x006FDB88
Frame 12: SP = 0x095DAA48 PC = 0x006FDEF4
Frame 13: SP = 0x095DAA60 PC = 0x032BB408
Frame 14: SP = 0x095DAA80 PC = 0x0277A838
Frame 15: SP = 0x095DAAB0 PC = 0x0026AC7C

PrkGrnd-IDF-NE-FL2#more flash:/crashinfo/crashinfo_21
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 15.2(4)E2, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2016 by Cisco Systems, Inc.
Compiled Mon 27-Jun-16 08:25 by prod_rel_team

Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!

SRR0 = 0x02E0D2C8 SRR1 = 0x00029230 SRR2 = 0x032BF214 SRR3 = 0x00029230
ESR = 0x00000000 DEAR = 0x00000000 TSR = 0x84000000 DBSR = 0x10000000

CPU Register Context:
Vector = 0x00002000 PC = 0x032BF214 MSR = 0x00029230 CR = 0x35393053
LR = 0x032BF214 CTR = 0x0272FA44 XER = 0x80000008
R0 = 0x032BF214 R1 = 0x0990C724 R2 = 0x00000000 R3 = 0x0601A064
R4 = 0x00000000 R5 = 0x0990C3FC R6 = 0x00000001 R7 = 0x052E0000
R8 = 0x00029230 R9 = 0x00000000 R10 = 0x052E0000 R11 = 0x052E0000
R12 = 0x35393055 R13 = 0x0D98279C R14 = 0x00000001 R15 = 0x00000000
R16 = 0x00000000 R17 = 0xFFFFFFFF R18 = 0x0990C818 R19 = 0xFFFFFFFF
R20 = 0x00000000 R21 = 0x00000025 R22 = 0x00000000 R23 = 0x00000000
R24 = 0xFFFFFFFE R25 = 0x0990C8C8 R26 = 0x7FFFFFDA R27 = 0x00000000
R28 = 0x03DA36AC R29 = 0x00000000 R30 = 0x04E400A0 R31 = 0x00000000

Stack trace:
PC = 0x032BF214, SP = 0x0990C724
Frame 00: SP = 0x0990C734 PC = 0x032BF214
Frame 01: SP = 0x0990C744 PC = 0x032B8288
Frame 02: SP = 0x0990C75C PC = 0x032C1A10
Frame 03: SP = 0x0990C7A8 PC = 0x032B4AAC
Frame 04: SP = 0x0990C7B8 PC = 0x02E0C2F8
Frame 05: SP = 0x0990C7C0 PC = 0x02E0CDF4
Frame 06: SP = 0x0990C7D8 PC = 0x026BD200
Frame 07: SP = 0x0990C888 PC = 0x026BE924
Frame 08: SP = 0x0990C8C0 PC = 0x026BBD90
Frame 09: SP = 0x0990CC08 PC = 0x006F8EAC
Frame 10: SP = 0x0990CC70 PC = 0x00700094
Frame 11: SP = 0x0990CCF8 PC = 0x006FDB88
Frame 12: SP = 0x0990CD38 PC = 0x006FDEF4
Frame 13: SP = 0x0990CD50 PC = 0x032BB408
Frame 14: SP = 0x0990CD70 PC = 0x0277A838
Frame 15: SP = 0x0990CDA0 PC = 0x0026AC7C

PrkGrnd-IDF-NE-FL2#more flash:/crashinfo/crashinfo_24
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 15.2(4)E2, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2016 by Cisco Systems, Inc.
Compiled Mon 27-Jun-16 08:25 by prod_rel_team

Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!

SRR0 = 0x02E0D2C8 SRR1 = 0x00029230 SRR2 = 0x032BF214 SRR3 = 0x00029230
ESR = 0x00000000 DEAR = 0x00000000 TSR = 0x84000000 DBSR = 0x10000000

CPU Register Context:
Vector = 0x00002000 PC = 0x032BF214 MSR = 0x00029230 CR = 0x35393053
LR = 0x032BF214 CTR = 0x0272FA44 XER = 0x80000008
R0 = 0x032BF214 R1 = 0x098E9044 R2 = 0x00000000 R3 = 0x05FFAA40
R4 = 0x00000000 R5 = 0x098E8D1C R6 = 0x00000001 R7 = 0x052E0000
R8 = 0x00029230 R9 = 0x00000000 R10 = 0x052E0000 R11 = 0x052E0000
R12 = 0x35393055 R13 = 0x0B98279C R14 = 0x00000001 R15 = 0x00000000
R16 = 0x00000000 R17 = 0xFFFFFFFF R18 = 0x098E9138 R19 = 0xFFFFFFFF
R20 = 0x00000000 R21 = 0x00000024 R22 = 0x00000000 R23 = 0x00000000
R24 = 0xFFFFFFFE R25 = 0x098E91E8 R26 = 0x7FFFFFDB R27 = 0x00000000
R28 = 0x03DA36AC R29 = 0x00000000 R30 = 0x04E400A0 R31 = 0x00000000

Stack trace:
PC = 0x032BF214, SP = 0x098E9044
Frame 00: SP = 0x098E9054 PC = 0x032BF214
Frame 01: SP = 0x098E9064 PC = 0x032B8288
Frame 02: SP = 0x098E907C PC = 0x032C1A10
Frame 03: SP = 0x098E90C8 PC = 0x032B4AAC
Frame 04: SP = 0x098E90D8 PC = 0x02E0C2F8
Frame 05: SP = 0x098E90E0 PC = 0x02E0CDF4
Frame 06: SP = 0x098E90F8 PC = 0x026BD200
Frame 07: SP = 0x098E91A8 PC = 0x026BE924
Frame 08: SP = 0x098E91E0 PC = 0x026BBD90
Frame 09: SP = 0x098E9528 PC = 0x006F8EAC
Frame 10: SP = 0x098E9590 PC = 0x00700094
Frame 11: SP = 0x098E9618 PC = 0x006FDB88
Frame 12: SP = 0x098E9658 PC = 0x006FDEF4
Frame 13: SP = 0x098E9670 PC = 0x032BB408
Frame 14: SP = 0x098E9690 PC = 0x0277A838

[ysotocob · Accepted solution]

I worked on the crash 24 of the post.

I was able to identify the following software defect in the IOS you are currently running 15.2(4)E2:

CSCva45165 Crash with Cisco BFD MIB / ciscoBfdSessEntry

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCva45165/?reffering_site=dumpcr

Please confirm if you has the conditions in the bug and update the post. If so apply the workaround or upgrade to version 15.2(4)E3 or higher.

Unfortunally I was not able to get further details about it, if you consider that this bug might not be the rootcause please attach the show tech output on this thread and if possible the last 3 extended crashfiles on the device.

T

[NewComer]

Thanks for looking into this. I believe this is the case for me. Most of my devices are running on an older code version and I did started having issues after I turned up my NMS. I will upgrade as recommended.  

[Holmesz]

Sorry, I had this problem too.

Is upgrading can solved this issue?

If it worked , please tell me which IOS is suggest.

Thanks

[ysotocob]

If have the exact Stack trace and same IOS code then upgrade is needed

[NewComer]

Holmesz,

I upgraded to the latest code 15.2(4)E6. My issue was introduced by deploying an NMS and all my devices were running really old code. The devices were crashing every 6 hours. Someone suggested upgrading the code and it fixed my problem.