WS-C3850-12S-E address failling error, Switch unable to boot

[vedanth@tglobalin.com]

Hello All,

WS-C3850-12S-E switch is not able to boot its system image ,When powered on the it shows the below message 

"Booting...(use DDR clock 667 MHz)
*** TLB (Load/Fetch) Exception ***
PC = 0x00000000 00000000
SP = 0xffffffff 80096894
Cause Reg = 0x00000000 40008008, Status Reg = 0x00000000 504000e7"

From here i am unable to go to ROMMON mode ..The switch mode button is perfectly fine, Also after multiple hard reset the switch will push the booting image, but no luck, 

Please Help me out here , I am unable to determine what is exactly causing the issue and what is the solution :

please find the log below ...apart this the switch wont boot completely 

LMC0 ECC: Failing bank: 7
LMC0 ECC: Failing row: 0x5c2
LMC0 ECC: Failing column: 0xacc
LMC0 ECC: syndrome: 0xed
Failing Address: 0x0000000005c2b3e0, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:0 ded_err:3
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 7
LMC0 ECC: Failing row: 0x5c2
LMC0 ECC: Failing column: 0xacc
LMC0 ECC: syndrome: 0xed
Failing Address: 0x0000000005c2b3e0, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 0
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2530
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005694c00, Data: 0x7830303030303030
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 3
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2530
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005694d80, Data: 0x4330204543433a09
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 4
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2540
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005695200, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 1
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2540
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005695080, Data: 0x64726f6d653a2030
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 3
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2540
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005695180, Data: 0x3a094661696c696e
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 5
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2550
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005695680, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 0
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2550
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005695400, Data: 0x3a20307864630a3c
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 0
LMC0 ECC: Failing row: 0x433
LMC0 ECC: Failing column: 0xec0
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x000000000433b000, Data: 0x09003b5567bd0010
ERROR LMC0 ECC: sec_err:3 ded_err:3
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 2
LMC0 ECC: Failing row: 0x5c2
LMC0 ECC: Failing column: 0xacc
LMC0 ECC: syndrome: 0xed
Failing Address: 0x0000000005c2b160, Data: 0xffffffff856a1f10
ERROR LMC0 ECC: sec_err:0 ded_err:3
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 2
LMC0 ECC: Failing row: 0x5c2
LMC0 ECC: Failing column: 0xacc
LMC0 ECC: syndrome: 0xed
Failing Address: 0x0000000005c2b160, Data: 0xffffffff856a1f10
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 1
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2560
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005695880, Data: 0x6f6c756d6e3a2030
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 3
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2560
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005695980, Data: 0x696e6720726f773a
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 5
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2570
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005695e80, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 0
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2570
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005695c00, Data: 0x3078323536300a3c
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 3
LMC0 ECC: Failing row: 0x5e9
LMC0 ECC: Failing column: 0x2460
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005e91980, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 2
LMC0 ECC: Failing row: 0x5e9
LMC0 ECC: Failing column: 0x2460
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005e91900, Data: 0xa800000005e91900
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 4
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2580
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005696200, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 2
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2580
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005696100, Data: 0x3035653931393030
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 0
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2580
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005696000, Data: 0x5f6572723a300a3c
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 7
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2590
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005696780, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 1
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2590
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005696480, Data: 0x6133630a3c333e45
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 3
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x2590
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005696580, Data: 0x3078303030303030
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 7
LMC0 ECC: Failing row: 0x435
LMC0 ECC: Failing column: 0x1610
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000004358780, Data: 0xfc830008dc670000
ERROR LMC0 ECC: sec_err:3 ded_err:3
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 3
LMC0 ECC: Failing row: 0x5c2
LMC0 ECC: Failing column: 0xacc
LMC0 ECC: syndrome: 0xed
Failing Address: 0x0000000005c2b1e0, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:0 ded_err:3
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 3
LMC0 ECC: Failing row: 0x5c2
LMC0 ECC: Failing column: 0xacc
LMC0 ECC: syndrome: 0xed
Failing Address: 0x0000000005c2b1e0, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 0
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x25a0
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005696800, Data: 0x333e4552524f5220
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 7
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x25b0
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005696f80, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 1
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x25b0
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005696c80, Data: 0x3639363830302c20
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 3
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x25b0
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005696d80, Data: 0x653a20307864630a
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 7
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x25c0
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005697380, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 0
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x25c0
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005697000, Data: 0x302c20446174613a
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 3
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x25c0
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005697180, Data: 0x2064696d6d3a2020
ERROR LMC0 ECC: sec_err:2 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 7
LMC0 ECC: Failing row: 0x4e7
LMC0 ECC: Failing column: 0x1d80
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000004e76388, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 1
LMC0 ECC: Failing row: 0x4e7
LMC0 ECC: Failing column: 0x1d80
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000004e76080, Data: 0xffffffff844e73d0
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 4
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x25d0
LMC0 ECC: syndrome: 0xdc
Failing Address: 0x0000000005697600, Data: 0x0000000000000000
ERROR LMC0 ECC: sec_err:3 ded_err:0
LMC0 ECC: Failing dimm: 0
LMC0 ECC: Failing rank: 0
LMC0 ECC: Failing bank: 3
LMC0 ECC: Failing row: 0x569
LMC0 ECC: Failing column: 0x25d0
LMC0 ECC: syndrome: 0xdc

[Seb Rupik]

I've not seen that error before, but the fact it mentions ECC suggest that it is RAM and probably more specifically it is generating an ECC read error due to memory corruption.

Probably a faulty DIMM. Since these are soldered onto the board this would likely be a RMA.

cheers,

Seb.

[Richard Burts]

From what you have posted it appears that your switch is completely not able to read its disk. Is this new equipment or is it a switch that you have had for a while. If it is not new then has something happened to it recently?

If this switch is covered by a maintenance agreement then I would suggest that you open a case with Cisco TAC.

HTH

Rick

[vedanth@tglobalin.com]

hey Richard,

Thanks for reverting...appreciate your help...Yes this  has been with me from an year and yes it was normal before....few days it  was not in use... and now the issue started..

[Richard Burts · Accepted solution]

Thanks for clarifying that this is a switch that you have been using successfully for a while and recently the problem started. I agree with Leo that the best alternative is to contact Cisco TAC and ask their assistance in arranging an RMA. It does sound like a hardware problem.

HTH

Rick

[vedanth@tglobalin.com]

alright ...thanks a lot for clarifying the issue @Richard Burts... @Leo Laohoo... 

[Richard Burts]

You are welcome. I am glad that our suggestions have been helpful. Thank you for marking this question as solved. This will allow other participants in the communities to identify discussions which have helpful information. These communities are excellent places to ask questions and to learn about networking. I hope to see you continue to be active in the communities.

HTH

Rick

[Chidojohnkingsley92]

The problem is the main microcontroller processor, is not making full contact with the board, has loose contact. To know more on Cisco switches hardware issues , go to this YouTube channel https://youtube.com/channel/UCSlFIDtpsncR9J45kjGwN1Q

[James Wingnut]

I had the same error and WS-C3850-48XS switch would not boot. 

Booting...(use DDR clock 667 MHz)
*** Address Error (Load/Fetch) Exception ***
PC = 0x00000000 00000000
SP = 0xffffffff 800594e4
Cause Reg = 0x00000000 40008010, Status Reg = 0x00000000 504000e7

Followed this YouTube video posted by Chidojohnkingsley92:  https://www.youtube.com/watch?v=amQB2Y2bIz8

This legitimately worked - remove the two spacers under the heatsink for the processor and replace heatsink. Torque down just a bit, not too hard. Switch now boots.

[Leo Laohoo]

Contact Cisco TAC and organize for RMA.
3650/3850 is covered under Cisco's Enhanced Limited Lifetime Hardware Warranty.