Re: Problem with VSS 6500

Christian Overrein · ‎08-26-2013

Hi,

I get this message on my Cisco 6500 VSS.

I cannot find what this message is about.

This message come every 10-15 minuttes in my log.

%EARL_L2_ASIC-SW2_SPSTBY-4-DBUS_HDR_ERR: EARL L2 ASIC #0: Dbus Hdr. Error occurred. Ctrl1 0xB08D0E3D

This is my hardware:

VSS1#sh module switch 1

Load for five secs: 4%/0%; one minute: 4%; five minutes: 4%

Time source is hardware calendar, *14:39:20.134 DST Thu Aug 22 2013

Switch Number: 1 Role: Virtual Switch Active

---------------------- -----------------------------

Mod Ports Card Type Model Serial No.

--- ----- -------------------------------------- ------------------ -----------

1 5 Supervisor Engine 720 10GE (Active) VS-S720-10G SAL1618BRHA

2 24 CEF720 24 port 1000mb SFP WS-X6724-SFP SAL1622DTWH

3 4 WiSM 2 WLAN Service Module WS-SVC-WISM2-K9 SAL1622DMTC

4 6 Firewall Module WS-SVC-FWM-1 SAL1620CYE5

Mod MAC addresses Hw Fw Sw Status

--- ---------------------------------- ------ ------------ ------------ -------

1 70ca.9bf1.6f9c to 70ca.9bf1.6fa3 4.1 8.5(4) 12.2(33)SXJ3 Ok

2 2c54.2d82.dbf0 to 2c54.2d82.dc07 5.1 12.2(18r)S1 12.2(33)SXJ3 Ok

3 0007.7d8c.8d78 to 0007.7d8c.8d87 1.1 12.2(18r)S1 12.2(33)SXJ3 Ok

4 0007.7d8c.8a80 to 0007.7d8c.8a87 4.5 7.2(1) 3.1(10) Ok

Mod Sub-Module Model Serial Hw Status

---- --------------------------- ------------------ ----------- ------- -------

1 Policy Feature Card 3 VS-F6K-PFC3C SAL1616ALTN 1.1 Ok

1 MSFC3 Daughterboard VS-F6K-MSFC3 SAL161065G1 5.1 Ok

2 Centralized Forwarding Card WS-F6700-CFC SAL16138AMD 4.1 Ok

Mod Online Diag Status

---- -------------------

1 Pass

2 Pass

3 Pass

4 Pass

VSS1#sh module switch 2

Load for five secs: 3%/1%; one minute: 4%; five minutes: 4%

Time source is hardware calendar, *14:39:50.526 DST Thu Aug 22 2013

Switch Number: 2 Role: Virtual Switch Standby

---------------------- -----------------------------

Mod Ports Card Type Model Serial No.

--- ----- -------------------------------------- ------------------ -----------

1 5 Supervisor Engine 720 10GE (Hot) VS-S720-10G SAL1516BV5K

2 24 CEF720 24 port 1000mb SFP WS-X6724-SFP SAL1622DTW4

3 4 WiSM 2 WLAN Service Module WS-SVC-WISM2-K9 SAL1601ZXTX

4 6 Firewall Module WS-SVC-FWM-1 SAL1622DRDK

Mod MAC addresses Hw Fw Sw Status

--- ---------------------------------- ------ ------------ ------------ -------

1 8843.e18a.1ca8 to 8843.e18a.1caf 4.0 8.5(4) 12.2(33)SXJ3 Ok

2 5057.a8a1.ece0 to 5057.a8a1.ecf7 5.1 12.2(18r)S1 12.2(33)SXJ3 Ok

3 e05f.b994.d5bc to e05f.b994.d5cb 1.1 12.2(18r)S1 12.2(33)SXJ3 Ok

4 0007.7d8c.9090 to 0007.7d8c.9097 4.5 7.2(1) 3.1(10) Ok

Mod Sub-Module Model Serial Hw Status

---- --------------------------- ------------------ ----------- ------- -------

1 Policy Feature Card 3 VS-F6K-PFC3C SAL16095PZE 1.1 Ok

1 MSFC3 Daughterboard VS-F6K-MSFC3 SAL16106QM0 5.1 Ok

2 Centralized Forwarding Card WS-F6700-CFC SAL1620CSZN 4.1 Ok

Mod Online Diag Status

---- -------------------

1 Pass

2 Pass

3 Pass

4 Pass

IOS version: s72033-adventerprisek9_wan-mz.122-33.SXJ3.bin

I hope somebody can help my to figure out of this.

Regard,

Christian

Simon Leigh · ‎08-26-2013

This message indicates that the EARL L2 ASIC detected an invalid header in the DBUS . This error is due to hardware that has failed, a misconfiguration of the module software, or invalid packets that were dropped because of an OIR operation.

Chances are this is caused by a hardware problem and advised that Module 5, VS-S720-10G, need to be replaced.
Log a TAC case with Cisco.

Sent from Cisco Technical Support iPad App

Sent from Cisco Technical Support iPad App

InayathUlla Sharieff · ‎08-26-2013

EARL_L2_ASIC-SW1_SPSTBY-4-DBUS_HDR_ERR EARL L2 ASIC #0: Dbus Hdr. Error occurred. Ctrl1 0xB08D0E3D

 

Explanation :

--------------- 

The message indicates there was an error detected by the L2 forwardingengine. This is most commonly either a poorly seated supervisor module or the supervisor could be failing. There is also a chance that one of the line cards is triggering the maligned packets on the Dbus but it's not as common as the supervisor being the issue. This is considers a low level hardware or connection issue and the troubleshooting should start with reseating the modules and supervisor.

 


If this does not resolve the log errors supervisor replacement will be the next step.

HTH

Regards

Inayath

****Plz rate if this info is helpfull******

Christian Overrein · ‎08-26-2013

Hi,

I have tried to reload the chassis. Tat give me no impact on the fail message.

// Christian

InayathUlla Sharieff · ‎08-26-2013

1- Have you tried Re-seating the module? (I.e Removing the module and inserting it back ?)

2- If yes then go ahead and create the RMA with cisco.

Regards

Inayath

**** Plz rate all usefull posts****************

Christian Overrein · ‎08-27-2013

Hi,

Yes, have tried to replace all the modules int he Chassis. Same problem. Ofcourse, All power off.

I am going with RMA and Cisco TAC

Thanks for answering.

Aninda Chatterjee · ‎08-27-2013

Hi Christian,

Just to give you a heads up, replacement of a module may not necessarily solve the problem. You can think of these packets as bad packets that could be because of a bad card or a bad packet that was generated from somewhere within the network. I am not even sure of what module are you planning to replace - this is being detected by the supervisor of the standby chassis.

I would suggest that you open a TAC case not for the RMA but for troubleshooting. There is a way to capture these bad packets using the 6500s inbuilt ELAM capture tool. However, there are some changes that need to be done on a specific register before we can attempt to capture these packets and these changes should only be done by a TAC engineer.

With this capture, you can find out the origin of the packet, which card/port it came in from, what type of packet it is, the source/destination IP and mac, etc. Again, I would suggest that you have Cisco TAC troubleshoot this before asking for a replacement.

Regards,

Aninda

Message was edited by: Aninda Chatterjee

Christian Overrein · ‎08-27-2013

Thanks alot for some good information here, Aninda.

Now I am going for Cisco TAC to get some troubleshooting.

Regards,

Christian