IDSM-2 and NAM-2 modules inacessible after installing linecard

[kert_dezcom]

Hi,

I've installed second WS-X6748-SFP linecard on my catalyst 6509 with sup720-3b and after that NAM-2 and IDSM-2 module become inaccessible from management network. I can only login with session slot N proc 1.

When I execute #hw-module module 4 reset, modules become accessible.

#sh module from cat6509

Mod Ports Card Type                              Model              Serial No.

--- ----- -------------------------------------- ------------------ -----------

  2   48  CEF720 48 port 1000mb SFP              WS-X6748-SFP       SAL114670XW

  3   48  48-port 100FX SFP Ethernet Module      WS-X6148-FE-SFP    SAL1201BZKF

  4   48  CEF720 48 port 1000mb SFP              WS-X6748-SFP       SAL1625ETFJ

  5    2  Supervisor Engine 720 (Active)         WS-SUP720-3B       SAL1206FNGQ

  6    2  Supervisor Engine 720 (Hot)            WS-SUP720-3B       SAL1206FVFB

  8    8  Intrusion Detection System             WS-SVC-IDSM-2      SAD120502LR

  9    8  Network Analysis Module                WS-SVC-NAM-2       SAD120206LB

Mod MAC addresses                       Hw    Fw           Sw           Status

--- ---------------------------------- ------ ------------ ------------ -------

  2  001e.4a3e.3b30 to 001e.4a3e.3b5f   1.10  12.2(14r)S5  12.2(18)SXF1 Ok

  3  001e.4aea.e7b0 to 001e.4aea.e7df   3.3   8.4(1)       8.5(0.46)RFW Ok

  4  5057.a895.bb84 to 5057.a895.bbb3   2.4   12.2(18r)S1  12.2(18)SXF1 Ok

  5  001c.58d0.6dc4 to 001c.58d0.6dc7   5.6   8.5(2)       12.2(18)SXF1 Ok

  6  0016.c848.3698 to 0016.c848.369b   5.6   8.5(2)       12.2(18)SXF1 Ok

  8  001e.f7a1.54b0 to 001e.f7a1.54b7   6.3   7.2(1)       7.0(8)E4     Ok

  9  001e.f72a.ba62 to 001e.f72a.ba69   4.3   7.2(1)       5.1(2)       Ok

Mod  Sub-Module                  Model              Serial       Hw     Status

---- --------------------------- ------------------ ----------- ------- -------

  2  Centralized Forwarding Card WS-F6700-CFC       SAL114881B6  4.0    Ok

  4  Centralized Forwarding Card WS-F6700-CFC       SAL1624EGQS  4.1    Ok

  5  Policy Feature Card 3       WS-F6K-PFC3B       SAL1206FNZY  2.3    Ok

  5  MSFC3 Daughterboard         WS-SUP720          SAL1206FSFH  3.1    Ok

  6  Policy Feature Card 3       WS-F6K-PFC3B       SAL1206FP27  2.3    Ok

  6  MSFC3 Daughterboard         WS-SUP720          SAL1206FN26  3.1    Ok

  8  IDS 2 accelerator board     WS-SVC-IDSUPG      ADBG7270048  2.5    Ok

cat6500 running 12.2(18)SXF12a ios...

any suggestions?

[ralphcarter]

It may be a bug. What do your logs say? Have you tried to reset the IDSM and NAM, check your logs after you reboot them.

[kert_dezcom]

log says nothing. I tried reset both modules, but it didn't help.

Modules become accessible only until second linecard goes online...

[ralphcarter]

Check power?

show environment status

show power

[kert_dezcom]

#sh power

system power redundancy mode = redundant

system power redundancy operationally = non-redundant

system power total =     2771.16 Watts (65.98 Amps @ 42V)

system power used =      1612.38 Watts (38.39 Amps @ 42V)

system power available = 1158.78 Watts (27.59 Amps @ 42V)

                        Power-Capacity PS-Fan Output Oper

PS   Type               Watts   A @42V Status Status State

---- ------------------ ------- ------ ------ ------ -----

1    WS-CAC-3000W       1171.38 27.89  OK     OK     on

2    WS-CAC-3000W       2771.16 65.98  OK     OK     on

                        Pwr-Allocated  Oper

Fan  Type               Watts   A @42V State

---- ------------------ ------- ------ -----

1    WS-C6509-E-FAN      150.36  3.58  OK

                        Pwr-Requested  Pwr-Allocated  Admin Oper

Slot Card-Type          Watts   A @42V Watts   A @42V State State

---- ------------------ ------- ------ ------- ------ ----- -----

2    WS-X6748-SFP        254.94  6.07   254.94  6.07  on    on

3    WS-X6148-FE-SFP      96.60  2.30    96.60  2.30  on    on

4    WS-X6748-SFP        254.94  6.07   254.94  6.07  on    on

5    WS-SUP720-3B        282.24  6.72   282.24  6.72  on    on

6    WS-SUP720-3B        282.24  6.72   282.24  6.72  on    on

8    WS-SVC-IDSM-2       145.32  3.46   145.32  3.46  on    on

9    WS-SVC-NAM-2        145.74  3.47   145.74  3.47  on    on

#sh environment status

backplane:

  operating clock count: 2

  operating VTT count: 3

fan-tray 1:

  fan-tray 1 type: WS-C6509-E-FAN

  fan-tray 1 mode: Restricted-power

  fan-tray 1 fan-fail: OK

VTT 1:

  VTT 1 OK: OK

  VTT 1 outlet temperature: 26C

VTT 2:

  VTT 2 OK: OK

  VTT 2 outlet temperature: 30C

VTT 3:

  VTT 3 OK: OK

  VTT 3 outlet temperature: 35C

clock 1:

  clock 1 OK: OK, clock 1 clock-inuse: in-use

clock 2:

  clock 2 OK: OK, clock 2 clock-inuse: not-in-use

power-supply 1:

  power-supply 1 fan-fail: OK

  power-supply 1 power-input: AC high

  power-supply 1 power-output-mode: high

  power-supply 1 power-output-fail: OK

power-supply 2:

  power-supply 2 fan-fail: OK

  power-supply 2 power-input: AC high

  power-supply 2 power-output-mode: high

  power-supply 2 power-output-fail: OK

module 2:

  module 2 power-output-fail: OK

  module 2 outlet temperature: 46C

  module 2 inlet temperature: 22C

  module 2 device-1 temperature: 22C

  module 2 device-2 temperature: 41C

module 3:

  module 3 power-output-fail: OK

  module 3 outlet temperature: 22C

  module 3 inlet temperature: 22C

module 4:

  module 4 power-output-fail: OK

  module 4 outlet temperature: 32C

  module 4 inlet temperature: 20C

  module 4 device-1 temperature: 20C

  module 4 device-2 temperature: 30C

module 5:

  module 5 power-output-fail: OK

  module 5 outlet temperature: 23C

  module 5 inlet temperature: 18C

  module 5 device-1 temperature: 27C

  module 5 device-2 temperature: 27C

  module 5 asic-1 (SSO-1) temp: 18C

  module 5 asic-2 (SSO-2) temp: 18C

  module 5 asic-3 (SSO-3) temp: 18C

  module 5 asic-4 (SSO-4) temp: 18C

  module 5 asic-5 (SSA-1) temp: 18C

  module 5 asic-6 (HYPERION-1) temp: 18C

  module 5 RP outlet temperature: 21C

  module 5 RP inlet temperature: 21C

  module 5 EARL outlet temperature: 27C

  module 5 EARL inlet temperature: 19C

module 6:

  module 6 power-output-fail: OK

  module 6 outlet temperature: 23C

  module 6 inlet temperature: 18C

  module 6 device-1 temperature: 27C

  module 6 device-2 temperature: 28C

  module 6 asic-1 (SSO-1) temp: 18C

  module 6 asic-2 (SSO-2) temp: 18C

  module 6 asic-3 (SSO-3) temp: 18C

  module 6 asic-4 (SSO-4) temp: 18C

  module 6 asic-5 (SSA-1) temp: 18C

  module 6 asic-6 (HYPERION-1) temp: 18C

  module 6 RP outlet temperature: 21C

  module 6 RP inlet temperature: 22C

  module 6 EARL outlet temperature: 26C

  module 6 EARL inlet temperature: 19C

module 8:

  module 8 power-output-fail: OK

  module 8 outlet temperature: 28C

  module 8 inlet temperature: 24C

  module 8 device-1 temperature: 19C

  module 8 device-2 temperature: 25C

module 9:

  module 9 power-output-fail: OK

  module 9 outlet temperature: 28C

  module 9 inlet temperature: 23C

  module 9 device-1 temperature: 20C

  module 9 device-2 temperature: 25C

looks like everything is ok...

[kert_dezcom]

any ideas?

[ralphcarter · Accepted solution]

Try reboot switch?

Try updated IOS?

Update Bootrom?

Need to contact Cisco TAC and run diagnostics.

[kert_dezcom]

I've upgraded ios from 12.2(18)SXF12a to 12.2(33)SXI6. And everything goes fine.

Thanks for advice, ralphcarter

[ralphcarter]

Buggy IOS gets your everytime

I'm happy you found the issue, good luck!