Troubles with Cisco 3750

[Riccardo Veraldi]

Hello,

after some time of inactivity today I turned on my cisco 3750 24-TS and it has some problems.

do you think it is an hardware problem ?

any hints ?

log follows

POST: PortASIC RingLoopback Tests : Begin

POST: PortASIC RingLoopback Tests : End, Status Passed

Waiting for Stack Master Election...

POST: PortASIC CAM Subsystem Tests : Begin

TCAM (asic:2) walking-one test failed

  Write: 80_00000000_01000000-00_00000000_00000000

  Read:  FF_00000000_01000000-00_00000000_00000000

POST: POST Failed

POST: PortASIC CAM Subsystem Tests : End, Status Failed

POST: CAM test failed

POST Failed: disabling stack links and shutting down SDP

driver class subsystem initialization failed

*Mar  1 00:00:44.652: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console d

ebugging output.

*Mar  1 00:00:44.535: HOST MULT: cannot allocate TCAM entry for

*Mar  1 00:00:44.535: HOST MULT: cannot allocate TCAM entry for

*Mar  1 00:00:44.535: HOST MULT: cannot allocate TCAM entry for

*Mar  1 00:00:44.535: HOST MULT: cannot allocate TCAM entry for

*Mar  1 00:00:44.535: HOST MULT: cannot allocate TCAM entry for

*Mar  1 00:00:44.535: HOST MULT: cannot allocate TCAM entry for

*Mar  1 00:00:44.535: HOST MULT: cannot allocate TCAM entry for

*Mar  1 00:00:44.644: %SYS-2-ASSERTION_FAILED: Assertion failed: "reg_used_xdr_p

ortid_to_lc_logical_slot()" -Process= "Init", ipl= 0, pid= 3

-Traceback= CE7CC4 CE83D8 C64638 1A0D30 1A0EE8 14B2788 14B2828 CF37E0 CF3A10 943

290 939F58

%Software-forced reload

00:00:45 UTC Mon Mar 1 1993: Unexpected exception to CPUvector 2000, PC = 9412B

4

-Traceback= 9412B4 941254 1A0D30 1A0EE8 14B2788 14B2828 CF37E0 CF3A10 943290 939

F58

=== Flushing messages (00:00:45 UTC Mon Mar 1 1993) ===

Buffered messages:

Queued messages:

*Mar  1 00:00:46.028: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console d

ebugging output.

*Mar  1 00:00:45.642: %SYS-3-LOGGER_FLUSHED: System was paused for 00:00:00 to e

nsure console debugging output.

*Mar  1 00:00:45.902: %Insufficient flash filespace for extended crashinfo.

Cisco IOS Software, C3750 Software (C3750-ADVIPSERVICESK9-M), Version 12.2(44)SE

2, RELEASE SOFTWARE (fc2)

Copyright (c) 1986-2008 by Cisco Systems, Inc.

Compiled Thu 01-May-08 15:42 by antonino

Debug Exception (Could be NULL pointer dereference) Exception (0x2000)!

SRR0 = 0x005E5CA4  SRR1 = 0x00029230  SRR2 = 0x005E4E74  SRR3 = 0x00021000

ESR = 0x00000000  DEAR = 0x00000000  TSR = 0x8C000000  DBSR = 0x10000000

CPU Register Context:

Vector = 0x00002000  PC = 0x009412B4  MSR = 0x00029230  CR = 0x33000035

LR = 0x00941254  CTR = 0x00CDAF5C  XER = 0xC0000000

R0 = 0x00941254  R1 = 0x02914010  R2 = 0x00000000  R3 = 0x00000000

R4 = 0xFFFFFFFE  R5 = 0x00000000  R6 = 0x02913FE8  R7 = 0x00029230

R8 = 0x00000000  R9 = 0x02230000  R10 = 0x025C19C0  R11 = 0x00000000

R12 = 0x0000B24A  R13 = 0x00010000  R14 = 0x00CF39B0  R15 = 0x00000000

R16 = 0x00000000  R17 = 0x00000000  R18 = 0x00000000  R19 = 0x00000000

R20 = 0x00000000  R21 = 0x00000000  R22 = 0x00000000  R23 = 0x00000000

R24 = 0x00000000  R25 = 0x00000000  R26 = 0x00000000  R27 = 0x00000001

R28 = 0x018C1618  R29 = 0x00000481  R30 = 0x018C1608  R31 = 0x00000000

Stack trace:

PC = 0x009412B4, SP = 0x02914010

Frame 00: SP = 0x02914020    PC = 0x00941254

Frame 01: SP = 0x029142E0    PC = 0x00C64710

Frame 02: SP = 0x029142F8    PC = 0x001A0D30

Frame 03: SP = 0x02914330    PC = 0x001A0EE8

Frame 04: SP = 0x02914338    PC = 0x014B2788

Frame 05: SP = 0x02914350    PC = 0x014B2828

Frame 06: SP = 0x02914370    PC = 0x00CF37E0

Frame 07: SP = 0x02914468    PC = 0x00CF3A10

Frame 08: SP = 0x02914470    PC = 0x00943290

Frame 09: SP = 0x00000000    PC = 0x00939F58

[Andras Dosztal]

From the "POST: PortASIC CAM Subsystem Tests : End, Status Failed" message, it seems to be a HW problem, you should open a TAC case.

The %SYS-2-ASSERTION_FAILED means an internal state consistency check failed. Correct operation cannot be guaranteed, and the system has been halted.

[angelvar]

Hello All,

It appears to be a bug CSCth04987:

Symptom: After reload, a switch crashes in loop with following messages :

POST: POST Failed
POST: PortASIC CAM Subsystem Tests : End, Status Failed

POST: CAM test failed
POST Failed: disabling stack links and shutting down SDP

and

%SYS-2-ASSERTION_FAILED: Assertion failed: "reg_used_xdr_portid_to_lc_logical_slot()" -Process= "Init", ipl= 0, pid= 3

Conditions:

The switch has been configured with SDM template IPe, which is unsupported although configurable.

Workaround:

Enter RomMon by pressing the MODE button, reconfigure the SDM variable and manually boot.
The example below shows a reconfiguration to desktop default (template# 0).

switch: set SDM_TEMPLATE_ID 0
switch: set
SDM_TEMPLATE_ID=0 <<< THIS IS IMPOTANT one.

switch: flash_init
switch: boot

[mablake1841]

I know this is an old thread but this did resolve my issue.

Device: WS-C3750G-24TS 

OS: 12.2(46)SE

[Kishore Chennupati]

Open a TAC case

[Riccardo Veraldi]

I do not have a smartent or maintenance contract for this switch.

is it possible to force ignoring the consisntecy check ?

[Gregory Snipes]

That would be extremely inadvisable. The test is failing for a reason related to the health of your ASICs. The ASICs are arguably the most important part of the switch, they do most of the heavy lifting. Running a switch with bad ASICs is asking for problems.

[Riccardo Veraldi]

hello,

yes I know what you say is really true... but I use this switch as desktop switch

thank you

[Riccardo Veraldi]

I fixed the problem for now.

I booted in rommon

formatted the whole flash

rebooted and went again in rommon by itself of course.

at this point I uploaded a newer IOS image via XMODEM

took several hours...

at the end I rebooted te system and.... it works!!

no more TCAM errors!!

[Joe_Satriani]

Hi Riccardo,

Your switch will fail again when warm or under heavy load.

I'm a Electronics engineer and I specialize in repairing all Cisco products.  Asic 2(Sasquatch) needs to be changed or the fault could even be it's external memory. My bet is the Internal memory on the Asic. The next  question would be which Asic is number 2......

Like i said before I fix these things for a living so I know the Asic maps for Cisco Switches.

If you need any help just PM me.

Joe

[glen.grant]

  Get ahold of Cisco , the 3750 is supposed to have a limited "lifetime" warranty on it  so they should replace even without a smartnet contract.  Supposed to be like 10 business day turnaround.

[Leo Laohoo]

 the 3750 is supposed to have a limited "lifetime" warranty on it

Only the "E" and "X" have LLW, Glen.  Legacy stuff are not included.