6509 - lcp failed to go online issue....

[jimmysands73_2]

Got call saying some users were down, found root cause, card dead on a 6509.

*Nov 9 20:52:41.310: SP: oir_disable_notice: slot6: lcp failed to go online

*Nov 9 20:52:41.310: %C6KPWR-SP-4-DISABLED: power to module in slot 6 set off (Reset)

*Nov 9 20:52:41.310: SP: oir_disable_notice: slot6: lcp failed to go online

from line card in module 6 on our 6509.  Status light is not lit up.  Tried

0564-RTR-01#hw-module module 6 reset

Proceed with reload of module? [confirm]

Didnt help. 

Tried reseeating the card, didnt help.

I moved module 6 (model WS-X6348) to open bay 9, same issue.

Nov 9 14:36:04.114: %OIR-SP-6-REMCARD: Card removed from slot 6, interfaces disabled

Nov 9 14:40:06.303: %OIR-SP-6-PWRFAILURE: Module 9 is being disabled due to power convertor failure

Nov 9 14:40:06.303: SP: oir_disable_notice: slot9: lcp failed to go online

Nov 9 14:40:06.303: SP: oir_disable_notice: slot9: lcp failed to go online

Nov 9 14:40:31.983: %OIR-SP-6-REMCARD: Card removed from slot 9, interfaces disabled

Back in slot 6:

0564-RTR-01#show diagnostic module 6

Current Online Diagnostic Level = Minimal

Online Diagnostic[Module 6]: Card is not detected.

0564-RTR-01#show diagnostic content module 6

Online Diagnostic[Module 6]: Card is not detected.

Card is kaput?  A router reload was already performed, it has worked w/no issues the past few years.

[jimmysands73_2]

It also said in log regarding module 6:

Nov  9 12:52:39.632: %LINEPROTO-5-UPDOWN: Line protocol on Interface Vlan25, changed state to down
Nov  9 12:52:39.636: %LINEPROTO-5-UPDOWN: Line protocol on Interface Vlan26, changed state to down
Nov  9 20:52:41.310: %OIR-SP-6-PWRFAILURE: Module 6 is being disabled due to power convertor failure
Nov  9 20:52:41.310: SP: oir_disable_notice: slot6: lcp failed to go online
Nov  9 20:52:41.310: %C6KPWR-SP-4-DISABLED: power to module in slot 6 set off (Reset)
Nov  9 20:52:41.310: SP: oir_disable_notice: slot6: lcp failed to go online
Nov  9 12:52:51.692: %DIAG-SP-6-RUN_MINIMUM: Module 1: Running Minimum Online Diagnostics...

There is a module phuysical in 6 right now....

0564-RTR-01#sh power

system power redundancy mode = redundant

system power total =     1153.32 Watts (27.46 Amps @ 42V)

system power used =       653.52 Watts (15.56 Amps @ 42V)

system power available =  499.80 Watts (11.90 Amps @ 42V)

                        Power-Capacity PS-Fan Output Oper

PS   Type               Watts   A @42V Status Status State

---- ------------------ ------- ------ ------ ------ -----

1    WS-CAC-1300W       1153.32 27.46  OK     OK     on

2    WS-CAC-1300W       1153.32 27.46  OK     OK     on

                        Pwr-Requested  Pwr-Allocated  Admin Oper

Slot Card-Type          Watts   A @42V Watts   A @42V State State

---- ------------------ ------- ------ ------- ------ ----- -----

1    WS-X6K-SUP2-2GE     142.38  3.39   142.38  3.39  on    on

2    WS-X6408A-GBIC      142.38  3.39   142.38  3.39  on    on

3    WS-X6408A-GBIC       84.00  2.00    84.00  2.00  on    on

4    WS-X6408A-GBIC       84.00  2.00    84.00  2.00  on    on

5    WS-X6348-RJ-45      100.38  2.39   100.38  2.39  on    on

6    WS-X6348-RJ-45      100.38  2.39     -     -     on    off (Module Removed)

7    WS-X6348-RJ-45      100.38  2.39   100.38  2.39  on    on

0564-RTR-01#sh power

system power redundancy mode = redundant

system power total =     1153.32 Watts (27.46 Amps @ 42V)

system power used =       653.52 Watts (15.56 Amps @ 42V)

system power available =  499.80 Watts (11.90 Amps @ 42V)

                        Power-Capacity PS-Fan Output Oper

PS   Type               Watts   A @42V Status Status State

---- ------------------ ------- ------ ------ ------ -----

1    WS-CAC-1300W       1153.32 27.46  OK     OK     on

2    WS-CAC-1300W       1153.32 27.46  OK     OK     on

                        Pwr-Requested  Pwr-Allocated  Admin Oper

Slot Card-Type          Watts   A @42V Watts   A @42V State State

---- ------------------ ------- ------ ------- ------ ----- -----

1    WS-X6K-SUP2-2GE     142.38  3.39   142.38  3.39  on    on

2    WS-X6408A-GBIC      142.38  3.39   142.38  3.39  on    on

3    WS-X6408A-GBIC       84.00  2.00    84.00  2.00  on    on

4    WS-X6408A-GBIC       84.00  2.00    84.00  2.00  on    on

5    WS-X6348-RJ-45      100.38  2.39   100.38  2.39  on    on

6    WS-X6348-RJ-45      100.38  2.39     -     -     on    off (Module Removed)

7    WS-X6348-RJ-45      100.38  2.39   100.38  2.39  on    on

[johnlloyd_13 · Accepted solution]

seems like it's a faulty card. ask an RMA.

[jimmysands73_2]

Yup, changing it out as we speak.  I was shocked to find the startup config did not have a listing for port 6/1 - 48....if those ports are not on a operational line card does the 6500 series not show them in its config?  All I saw on the ints after I put the card in was:

interface FastEthernet6/1

no ip address

!

interface FastEthernet6/2

no ip address interface FastEthernet6/1
no ip address
!
interface FastEthernet6/2
no ip address

etc....looking for backup config now.

[johnlloyd_13 · Accepted solution]

Hi Jimmy,

I've replaced an RJ45 line card before (4507) but haven't encountered similar issue. Are you using the same card type? I hope you have a backup config.

Sent from Cisco Technical Support iPhone App

[jimmysands73_2]

Yeah, it was odd...in the config there was no mention of fa6/1 - 48....anyways, got the back from the depository and all is well again