fail module after update ROMMON

Breszko Daniel · ‎02-06-2019

Hello,

I have problem with my WS-C4500X-32.

After update ROMMON to firmwareupgradeallK10-150_1r_SG15.SPA my module is Fail.

Supervisor don't see any Gbic inserted inplug in interfaces (No XCVR).

Some one have any ideas to fix it ?

Switch#sh module
Chassis Type : WS-C4500X-32

Power consumed by backplane : 0 Watts

Mod Ports Card Type Model Serial No.
---+-----+--------------------------------------+------------------+-----------
1 32 4500X-32 10GE (SFP+) WS-C4500X-32 JAEXXXXXXX

M MAC addresses Hw Fw Sw Status
--+--------------------------------+---+------------+----------------+---------
1 e4aa.5dab.6240 to e4aa.5dab.625f 2.0 15.0(1r)SG15 03.09.02.E Ok

Switch#show diagnostic result module 1

Current bootup diagnostic level: minimal

module 1: SerialNo : JAE1938075E

Overall Diagnostic Result for module 1 : MINOR ERROR
Diagnostic level at card bootup: minimal

Test results: (. = Pass, F = Fail, U = Untested)

1) supervisor-bootup ---------------> .
2) linecard-online-diag ------------> F
3) stub-rx-errors ------------------> .
4) supervisor-rx-errors ------------> .

Switch#show diagnostic result module 1 detail

Current bootup diagnostic level: minimal

module 1: SerialNo : JAEXXXXX

Overall Diagnostic Result for module 1 : MINOR ERROR
Diagnostic level at card bootup: minimal

Test results: (. = Pass, F = Fail, U = Untested)

___________________________________________________________________________

1) supervisor-bootup ---------------> .

Error code ------------------> 0 (DIAG_SUCCESS)
Total run count -------------> 1
Last test testing type ------> n/a
Last test execution time ----> Feb 06 2019 11:54:44
First test failure time -----> n/a
Last test failure time ------> n/a
Last test pass time ---------> Feb 06 2019 11:54:44
Total failure count ---------> 0
Consecutive failure count ---> 0

Power-On-Self-Test Results for ACTIVE Supervisor

prod: WS-C4500X-32 part: 73-14959-07 serial: JAEXXXXX

Power-on-self-test for Module 1: WS-C4500X-32

CPU Subsystem Tests ...
seeprom: Pass

Traffic: L3 Loopback ...
Test Results: Pass

Traffic: L2 Loopback ...
Test Results: Pass

Module 1 Passed

___________________________________________________________________________

2) linecard-online-diag ------------> F

Error code ------------------> 1 (DIAG_FAILURE)
Total run count -------------> 1
Last test testing type ------> n/a
Last test execution time ----> Feb 06 2019 11:54:44
First test failure time -----> Feb 06 2019 11:54:44
Last test failure time ------> Feb 06 2019 11:54:44
Last test pass time ---------> n/a
Total failure count ---------> 1
Consecutive failure count ---> 1

Slot Ports Card Type Diag Status Diag Details
---- ----- -------------------------------------- ---------------- ------------
1 32 4500X-32 10GE (SFP+) Skipped Packet memory
Total Failure Component

Detailed Status
---------------
. = Pass U = Unknown
L = Loopback failure S = Stub failure
P = Port failure
E = SEEPROM failure G = GBIC integrity check failure

Ports 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
. . . . . . . . . . . . . . . .

Ports 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32
. . . . . . . . . . . . . . . .

___________________________________________________________________________

3) stub-rx-errors ------------------> .

Error code ------------------> 0 (DIAG_SUCCESS)
Total run count -------------> 20
Last test testing type ------> Health Monitoring
Last test execution time ----> Feb 06 2019 12:13:45
First test failure time -----> n/a
Last test failure time ------> n/a
Last test pass time ---------> Feb 06 2019 12:13:45
Total failure count ---------> 0
Consecutive failure count ---> 0
___________________________________________________________________________

4) supervisor-rx-errors ------------> .

Error code ------------------> 0 (DIAG_SUCCESS)
Total run count -------------> 20
Last test testing type ------> Health Monitoring
Last test execution time ----> Feb 06 2019 12:13:45
First test failure time -----> n/a
Last test failure time ------> n/a
Last test pass time ---------> Feb 06 2019 12:13:45
Total failure count ---------> 0
Consecutive failure count ---> 0
___________________________________________________________________________

Mark Malone · ‎02-06-2019

Hi
so since upgarde no gbics are been seen by the switch is that correct ?

Are they seen in show inventory ?

Breszko Daniel · ‎02-06-2019

Yes, now i have inserted 20x Gbic 10GB/1GB and i dont see any.

In invertory i have only this:

Switch# sh inv
NAME: "Switch System", DESCR: "Cisco Systems, Inc. WS-C4500X-32 2 slot switch "
PID: , VID: , SN: JAXXXXX

NAME: "Supervisor(slot 1)", DESCR: "4500X-32 10GE (SFP+)"
PID: WS-C4500X-32 , VID: V05 , SN: JAEXXXXX

NAME: "Power Supply 1", DESCR: "Power Supply ( AC 750W )"
PID: C4KX-PWR-750AC-R , VID: V01 , SN: ART1852X1NJ

Mark Malone · ‎02-06-2019

Hi have you tried a fresh reboot since then ?

did you upgrade ROM for a particular reason can you roll back ?

Breszko Daniel · ‎02-06-2019

Thank you for your response,

I had to update Rommon to the latest available version (SG15), I downloaded the SG11 version and installed it, but the problem is still the same.

Leo Laohoo · ‎02-07-2019

Contact TAC and organize for an RMA.

Breszko Daniel · ‎02-08-2019

I checked the state of these ports and I am surprised that they are able to (RunModeFrozen), in good switch are (RunModeOperating).

Switch#sh platform chassis pluggable

GalChassisVp

slot 0: state=8,1,11 ElbCardType 402 GalModuleType 3

GalK5ModuleVpSlot : type( GalModuleVpTypeGlm )

GalK5DriverMan(0): runMode( 4 ) state( GalK5DriverManStateReady )

prevState( GalK5DriverManStateSuccess ) gldMinor( 49 ) Retries( 0 )

SR-Register( 0x00000101 ) gldMajorVersion( 0x01 ) cardRevision( 0x01 )

SR-RegisterValid( true ) driverType( Native ) SpiRomSize( 33554432 )

GalGlmLinecardVp(0:N) ElbCardType 402, GalModuleType 3,

Config RunModeOperating, Op RunModeOperating, uplinkMode SupervisorUplinkK2Like, redundantMode SupervisorLocalNonRedundant

System StatValue count 913

Bringup timeout: WaitAllOperating

Linecard 0 timeout: Complete

Linecard 1 timeout: WaitAllOtherOperating

Interrupts handled=0

Spurious linecard interrupts: total=0, consecutive=0, max consecutive=0

EpmPluggableGroup(0:N) managing 32 pluggables, RunModeFrozen

received changed notifies=0, rxLoss notifies=0

ReviewRunTimeMax=6000, ReviewRunTimeExpected=1000

ReviewPeriod=1000000 MaxSubReviews=0 DOM interval=30000000

Review pluggables last 5 seconds last minute last hour

Events per second 0 0 0

Total : 0

Te1/1 RunModeFrozen State=EmptyHole Changed=False

Te1/2 RunModeFrozen State=EmptyHole Changed=False

Te1/3 RunModeFrozen State=EmptyHole Changed=False

Te1/4 RunModeFrozen State=EmptyHole Changed=False

Te1/5 RunModeFrozen State=EmptyHole Changed=False

Te1/6 RunModeFrozen State=EmptyHole Changed=False

Te1/7 RunModeFrozen State=EmptyHole Changed=False

Te1/8 RunModeFrozen State=EmptyHole Changed=False

Te1/9 RunModeFrozen State=EmptyHole Changed=False

Te1/10 RunModeFrozen State=EmptyHole Changed=False

Te1/11 RunModeFrozen State=EmptyHole Changed=False

Te1/12 RunModeFrozen State=EmptyHole Changed=False

Te1/13 RunModeFrozen State=EmptyHole Changed=False

Te1/14 RunModeFrozen State=EmptyHole Changed=False

Te1/15 RunModeFrozen State=EmptyHole Changed=False

Te1/16 RunModeFrozen State=EmptyHole Changed=False

Te1/17 RunModeFrozen State=EmptyHole Changed=False

Te1/18 RunModeFrozen State=EmptyHole Changed=False

Te1/19 RunModeFrozen State=EmptyHole Changed=False

Te1/20 RunModeFrozen State=EmptyHole Changed=False

Te1/21 RunModeFrozen State=EmptyHole Changed=False

Te1/22 RunModeFrozen State=EmptyHole Changed=False

Te1/23 RunModeFrozen State=EmptyHole Changed=False

Te1/24 RunModeFrozen State=EmptyHole Changed=False

Te1/25 RunModeFrozen State=EmptyHole Changed=False

Te1/26 RunModeFrozen State=EmptyHole Changed=False

Te1/27 RunModeFrozen State=EmptyHole Changed=False

Te1/28 RunModeFrozen State=EmptyHole Changed=False

Te1/29 RunModeFrozen State=EmptyHole Changed=False

Te1/30 RunModeFrozen State=EmptyHole Changed=False

Te1/31 RunModeFrozen State=EmptyHole Changed=False

Te1/32 RunModeFrozen State=EmptyHole Changed=False

GalGlmLinecardMan(0:N/0) : ElbCardType 402 Config RunModeOperating, Op RunModeOperating, Status Ok

GalGlmLinecardMan(0:N/1) : ElbCardType 403 Config RunModeOperating, Op RunModeOperating, Status Ok

GalGlmLoopbackDiagMan(1)

GalGlmStubDiagMan(1/1) PPPP

GalGlmStubDiagMan(1/2) PPPP

GalGlmStubDiagMan(1/3) PPPP

GalGlmStubDiagMan(1/4) PPPP

PluggableLinecard(0:N), Config RunModeOperating, Op RunModeOperating

GlmEdcControllerMan(0) managing 32 Edcs, speaking S2w100KHzSingleMaster

RunMode=RunModeOperating, opRunMode=RunModeOperating

Edc Config Reg Status Reg

0 0x00000000 0x0000000A

1 0x00000000 0x0000000A

2 0x00000000 0x0000000A

3 0x00000000 0x0000000A

4 0x00000000 0x0000000A

5 0x00000000 0x0000000A

6 0x00000000 0x0000000A

7 0x00000000 0x0000000A

8 0x00000000 0x0000000A

9 0x00000000 0x0000000A

10 0x00000000 0x0000000A

11 0x00000000 0x0000000A

12 0x00000000 0x0000000A

13 0x00000000 0x0000000A

14 0x00000000 0x0000000A

15 0x00000000 0x0000000A

16 0x00000000 0x0000000A

17 0x00000000 0x0000000A

18 0x00000000 0x0000000A

19 0x00000000 0x0000000A

20 0x00000000 0x0000000A

21 0x00000000 0x0000000A

22 0x00000000 0x0000000A

23 0x00000000 0x0000000A

24 0x00000000 0x0000000A

25 0x00000000 0x0000000A

26 0x00000000 0x0000000A

27 0x00000000 0x0000000A

28 0x00000000 0x0000000A

29 0x00000000 0x0000000A

30 0x00000000 0x0000000A

31 0x00000000 0x0000000A

Lasi interrupts received=0, handlingInterrupt=False

Vsi errors: total=0, last=Null

Vsi failures: consecutive=0, max consecutive=0

Vsi successes: consecutive=318, max consecutive=318

EDC PHY ID Model ( 15 ) Version ( 4 )

edcControllerMan_(0:N), numEdcGroups( 8 ), numEdcPorts ( 32 ), RunMode( RunModeOperating ), OpRunMode( RunModeOperating )

ConfigEdcType( 3 ), OpEdcType( 3 )

edcControllerMan_(0:N) EthEdcBcm84754Man( 0 ), RunMode( RunModeOperating ), OpRunMode( RunModeOperating )

EdcInitState: 42 EdcUcodeChecksum: ( 0x600D ) General2Reg: ( 0x12C )

EdcBcm(edcControllerMan_(0:N) EthEdcBcm84754Man( 0 )) in 10GModeComplete

Ucode version Reg ( 0x00 )

General 2 Reg(1.CA1A)=0x00

EDC chip revision Reg : 0x0

edcControllerMan_(0:N) EthEdcBcm84754Man( 0 ) LinkControllerMan, RunMode( 4 )

PreviousReviewLinkState( Null ), CurrentReviewLinkState( Null )

NegotiationStatus( 1 )

Reg(7.FFE0)=0x00 Reg(7.FFE4)=0x00

Reg(7.FFE5)=0x00, Cached Reg(7.FFE5)=0x00

LinkStatusReg=000

Pmd10GStatus2Reg_(1.000a)=0x00 Pcs10GStatusReg(3.0020)=0x00

Pmd10GOpticsDigitalControlReg_(1.cd09)=0x00

Pmd10GStatus1Reg_(1.01)=0x00 Pmd10GStatus2Reg_(1.08)=0x00

Pcs10GStatus1Reg_(3.01)=0x00 Pcs10GStatus2Reg_(3.08)=0x00

Configuration Params:

Config: ConfigurationModeDisabled FlowControlModes[] LineSpeeds[]

DuplexModes[] ClockModeNull Unknown

LoopbackOff FaultIndicationNone 0 Debounce0ms Efficient Energy Ethernet N/A

Link Downshift Feature(for Mgig ports) Enabled

Operational Params:

Ops: LinkDown FlowControlModeNull LineSpeedNull DuplexNull

ClockModeNull FaultIndicationNone NegotiationErrorNone EfficientEthernet: N/A

Link Downshift Feature(for Mgig ports) Enabled

#link downs: 0

OpConfigMode: ConfigurationModeDisabled

Debounce:

Triggered: 0 Debounced: 0

edcControllerMan_(0:N) EthEdcSfpCtrlMan( 0 ) managing 1 sfps, speaking Mdio1MHz

RunMode=RunModeOperating, opRunMode=RunModeOperating

State(StateWaitForNextReview), SubState(SubStateMonitor)

InterruptState(InterruptStateNull), TotalInt( 0 ) InitRetry( 1 )

TwoWireDmaSelRegRead (1.8800) = 0x00

PmaPmdControlReg (1.0000) = 0x00

Rx Alarm Control Reg(1.9000) = 0x24

Tx Alarm Control Reg(1.9001) = 0x00

Lasi Control Reg (1.9002) = 0x04

Rx Alarm Status Reg (1.9003) = 0x401C

Lasi Status Reg (1.9005) = 0x0C

Pmd Control Reg (1.C800) = 0x3F80

Pmd Status Reg (1.C804) = 0x8008

Optical Config Reg (1.C8E4) = 0x3F

General2 Reg (1.CA1A) = 0x00

Mii Control Reg (7.FFE0) = 0x00

Misc2Reg (7.8309) = 0x00

changes detected=0, changes notified=0, rxLoss detected=0 lasi interrupt detected=0

read cache initialized(False), stale(True), dirty(True)

Vsi errors: total=0, last=Null

Vsi failures: consecutive=0, max consecutive=0

Vsi successes: consecutive=28, max consecutive=28

edcControllerMan_(0:N) EthEdcBcm84754Man( 1 ), RunMode( RunModeOperating ), OpRunMode( RunModeOperating )

EdcInitState: 42 EdcUcodeChecksum: ( 0x600D ) General2Reg: ( 0x12C )

EdcBcm(edcControllerMan_(0:N) EthEdcBcm84754Man( 1 )) in 10GModeComplete

Ucode version Reg ( 0x00 )

General 2 Reg(1.CA1A)=0x00

EDC chip revision Reg : 0x0

Breszko Daniel · ‎02-08-2019