Troubles with Cisco 3750

Riccardo Veraldi · ‎03-07-2013

Hello,

after some time of inactivity today I turned on my cisco 3750 24-TS and it has some problems.

do you think it is an hardware problem ?

any hints ?

log follows

POST: PortASIC RingLoopback Tests : Begin

POST: PortASIC RingLoopback Tests : End, Status Passed

Waiting for Stack Master Election...

POST: PortASIC CAM Subsystem Tests : Begin

TCAM (asic:2) walking-one test failed

Write: 80_00000000_01000000-00_00000000_00000000

Read: FF_00000000_01000000-00_00000000_00000000

POST: POST Failed

POST: PortASIC CAM Subsystem Tests : End, Status Failed

POST: CAM test failed

POST Failed: disabling stack links and shutting down SDP

driver class subsystem initialization failed

*Mar 1 00:00:44.652: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console d

ebugging output.

*Mar 1 00:00:44.535: HOST MULT: cannot allocate TCAM entry for

*Mar 1 00:00:44.644: %SYS-2-ASSERTION_FAILED: Assertion failed: "reg_used_xdr_p

ortid_to_lc_logical_slot()" -Process= "Init", ipl= 0, pid= 3

-Traceback= CE7CC4 CE83D8 C64638 1A0D30 1A0EE8 14B2788 14B2828 CF37E0 CF3A10 943

290 939F58

%Software-forced reload

00:00:45 UTC Mon Mar 1 1993: Unexpected exception to CPUvector 2000, PC = 9412B

4

-Traceback= 9412B4 941254 1A0D30 1A0EE8 14B2788 14B2828 CF37E0 CF3A10 943290 939

F58

=== Flushing messages (00:00:45 UTC Mon Mar 1 1993) ===

Buffered messages:

Queued messages:

*Mar 1 00:00:46.028: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console d

ebugging output.

*Mar 1 00:00:45.642: %SYS-3-LOGGER_FLUSHED: System was paused for 00:00:00 to e

nsure console debugging output.

*Mar 1 00:00:45.902: %Insufficient flash filespace for extended crashinfo.

Cisco IOS Software, C3750 Software (C3750-ADVIPSERVICESK9-M), Version 12.2(44)SE

2, RELEASE SOFTWARE (fc2)

Compiled Thu 01-May-08 15:42 by antonino

Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!

SRR0 = 0x005E5CA4 SRR1 = 0x00029230 SRR2 = 0x005E4E74 SRR3 = 0x00021000

ESR = 0x00000000 DEAR = 0x00000000 TSR = 0x8C000000 DBSR = 0x10000000

CPU Register Context:

Vector = 0x00002000 PC = 0x009412B4 MSR = 0x00029230 CR = 0x33000035

LR = 0x00941254 CTR = 0x00CDAF5C XER = 0xC0000000

R0 = 0x00941254 R1 = 0x02914010 R2 = 0x00000000 R3 = 0x00000000

R4 = 0xFFFFFFFE R5 = 0x00000000 R6 = 0x02913FE8 R7 = 0x00029230

R8 = 0x00000000 R9 = 0x02230000 R10 = 0x025C19C0 R11 = 0x00000000

R12 = 0x0000B24A R13 = 0x00010000 R14 = 0x00CF39B0 R15 = 0x00000000

R16 = 0x00000000 R17 = 0x00000000 R18 = 0x00000000 R19 = 0x00000000

R20 = 0x00000000 R21 = 0x00000000 R22 = 0x00000000 R23 = 0x00000000

R24 = 0x00000000 R25 = 0x00000000 R26 = 0x00000000 R27 = 0x00000001

R28 = 0x018C1618 R29 = 0x00000481 R30 = 0x018C1608 R31 = 0x00000000

Stack trace:

PC = 0x009412B4, SP = 0x02914010

Frame 00: SP = 0x02914020 PC = 0x00941254

Frame 01: SP = 0x029142E0 PC = 0x00C64710

Frame 02: SP = 0x029142F8 PC = 0x001A0D30

Frame 03: SP = 0x02914330 PC = 0x001A0EE8

Frame 04: SP = 0x02914338 PC = 0x014B2788

Frame 05: SP = 0x02914350 PC = 0x014B2828

Frame 06: SP = 0x02914370 PC = 0x00CF37E0

Frame 07: SP = 0x02914468 PC = 0x00CF3A10

Frame 08: SP = 0x02914470 PC = 0x00943290

Frame 09: SP = 0x00000000 PC = 0x00939F58

Andras Dosztal · ‎03-07-2013

From the "POST: PortASIC CAM Subsystem Tests : End, Status Failed" message, it seems to be a HW problem, you should open a TAC case.

The %SYS-2-ASSERTION_FAILED means an internal state consistency check failed. Correct operation cannot be guaranteed, and the system has been halted.

angelvar · ‎03-07-2016

Hello All,

It appears to be a bug CSCth04987:

Symptom: After reload, a switch crashes in loop with following messages :

POST: POST Failed
POST: PortASIC CAM Subsystem Tests : End, Status Failed

POST: CAM test failed
POST Failed: disabling stack links and shutting down SDP

and

%SYS-2-ASSERTION_FAILED: Assertion failed: "reg_used_xdr_portid_to_lc_logical_slot()" -Process= "Init", ipl= 0, pid= 3

Conditions:

The switch has been configured with SDM template IPe, which is unsupported although configurable.

Workaround:

Enter RomMon by pressing the MODE button, reconfigure the SDM variable and manually boot.
The example below shows a reconfiguration to desktop default (template# 0).

switch: set SDM_TEMPLATE_ID 0
switch: set
SDM_TEMPLATE_ID=0 <<< THIS IS IMPOTANT one.

switch: flash_init
switch: boot

mablake1841 · ‎06-01-2020

I know this is an old thread but this did resolve my issue.

Device: WS-C3750G-24TS

OS: 12.2(46)SE

Kishore Chennupati · ‎03-07-2013

Open a TAC case

Riccardo Veraldi · ‎03-07-2013

I do not have a smartent or maintenance contract for this switch.

is it possible to force ignoring the consisntecy check ?

Gregory Snipes · ‎03-07-2013

That would be extremely inadvisable. The test is failing for a reason related to the health of your ASICs. The ASICs are arguably the most important part of the switch, they do most of the heavy lifting. Running a switch with bad ASICs is asking for problems.

Riccardo Veraldi · ‎03-07-2013

hello,

yes I know what you say is really true... but I use this switch as desktop switch

thank you

Riccardo Veraldi · ‎03-07-2013

I fixed the problem for now.

I booted in rommon

formatted the whole flash

rebooted and went again in rommon by itself of course.

at this point I uploaded a newer IOS image via XMODEM

took several hours...

at the end I rebooted te system and.... it works!!

no more TCAM errors!!

Joe_Satriani · ‎03-08-2013

Hi Riccardo,

Your switch will fail again when warm or under heavy load.

I'm a Electronics engineer and I specialize in repairing all Cisco products. Asic 2(Sasquatch) needs to be changed or the fault could even be it's external memory. My bet is the Internal memory on the Asic. The next question would be which Asic is number 2......

Like i said before I fix these things for a living so I know the Asic maps for Cisco Switches.

If you need any help just PM me.

Joe

glen.grant · ‎03-08-2013

Get ahold of Cisco , the 3750 is supposed to have a limited "lifetime" warranty on it so they should replace even without a smartnet contract. Supposed to be like 10 business day turnaround.

Leo Laohoo · ‎03-08-2013

 the 3750 is supposed to have a limited "lifetime" warranty on it

Only the "E" and "X" have LLW, Glen. Legacy stuff are not included.