IN cisco 7609 ROUTER show module major fail is coming for redundancy supervisory engine.what may be the problem.

[senthil2012]

Level1#sh module
Mod Ports Card Type                              Model              Serial No.
--- ----- -------------------------------------- ------------------ -----------
  1    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB0906026B
  2    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB084703ME
  3    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB084703UZ
  4    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB084703UM
  5    2  Supervisor Engine 720 (Hot)            WS-SUP720-BASE     SAD084600Z2
  6    2  Supervisor Engine 720 (Active)         WS-SUP720-BASE     SAD083003P3
  7   48  48 port 10/100/1000mb EtherModule      WS-X6148-GE-TX     SAD082605NY
  9    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB084703UY

Mod MAC addresses                       Hw    Fw           Sw           Status
--- ---------------------------------- ------ ------------ ------------ -------
  1  0011.9242.aa20 to 0011.9242.aa5f   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok
  2  0012.00dc.6780 to 0012.00dc.67bf   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok
  3  0011.93a2.f4c0 to 0011.93a2.f4ff   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok
  4  0012.00dc.8cf0 to 0012.00dc.8d2f   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok
  5  0011.21ba.7db0 to 0011.21ba.7db3   3.2   8.1(3)       12.2(18)SXF1 MajFail
  6  000f.f7be.ad40 to 000f.f7be.ad43   3.1   8.1(3)       12.2(18)SXF1 Ok
  7  0012.00ea.4f50 to 0012.00ea.4f7f   6.1   7.2(1)       8.5(0.46)RFW Ok
  9  0012.00dc.8d30 to 0012.00dc.8d6f   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok

Mod  Sub-Module                  Model              Serial       Hw     Status
---- --------------------------- ------------------ ----------- ------- -------
  5  Policy Feature Card 3       WS-F6K-PFC3A       SAD08380429  2.4    MajFail
  5  MSFC3 Daughterboard         WS-SUP720          SAD0844075N  2.4    MajFail
  6  Policy Feature Card 3       WS-F6K-PFC3A       SAD082905AL  2.4    Ok
  6  MSFC3 Daughterboard         WS-SUP720          SAD082806M5  2.3    Ok

Mod  Online Diag Status
---- -------------------
  1  Pass
  2  Pass
  3  Pass
  4  Pass
  5  Major Error
  6  Pass
  7  Minor Error
  9  Pass
Level1#

Level1#sh diagnostic result module 5

Current bootup diagnostic level: bypass

Module 5: Supervisor Engine 720 (Hot)  SerialNo : SAD084600Z2

  Overall Diagnostic Result for Module 5 : MAJOR ERROR
  Diagnostic level at card bootup: complete

  Test results: (. = Pass, F = Fail, U = Untested)

    1) TestScratchRegister -------------> .
    2) TestSPRPInbandPing --------------> .
    3) TestTransceiverIntegrity:

      Port  1  2
      ----------
            U  U

    4) TestActiveToStandbyLoopback:

      Port  1  2
      ----------
            .  .

    5) TestLoopback:

      Port  1  2
      ----------
            .  .

    6) TestNewIndexLearn ---------------> .
    7) TestDontConditionalLearn --------> .
    8) TestBadBpduTrap -----------------> .
    9) TestMatchCapture ----------------> .
   10) TestProtocolMatchChannel --------> .
   11) TestFibDevices ------------------> .
   12) TestIPv4FibShortcut -------------> .
   13) TestL3Capture2 ------------------> .
   14) TestIPv6FibShortcut -------------> .
   15) TestMPLSFibShortcut -------------> .
   16) TestNATFibShortcut --------------> .
   17) TestAclPermit -------------------> F
   18) TestAclDeny ---------------------> F
   19) TestQoSTcam ---------------------> F
   20) TestL3VlanMet -------------------> .
   21) TestIngressSpan -----------------> .
   22) TestEgressSpan ------------------> .
   23) TestNetflowInlineRewrite:

      Port  1  2
      ----------
            F  F

   24) TestFabricSnakeForward ----------> .
   25) TestFabricSnakeBackward ---------> .
   26) TestTrafficStress ---------------> U
   27) TestFibTcamSSRAM ----------------> U
   28) TestAsicMemory ------------------> U
   29) TestNetflowTcam -----------------> U
   30) ScheduleSwitchover --------------> U
   31) TestFirmwareDiagStatus ----------> U
   32) TestFabricFlowControlStatus -----> .

Level1#

please help to resolve the issue.

[amabdelh]

Have you tried reseat the card? Sometimes similar issues are solved after reseating the sup engines. If it is not cleared, the. It could be hw issue

Sent from Cisco Technical Support iPhone App

[senthil2012]

Thanks for your reply. i will check and revert back to you.

[senthil2012]

After reseating,redundant supervisor engine appear as bypass in show module command.

Level1>sh module
Mod Ports Card Type                              Model              Serial No.
--- ----- -------------------------------------- ------------------ -----------
  1    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB0906026B
  2    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB084703ME
  3    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB084703UZ
  4    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB084703UM
  5    2  Supervisor Engine 720 (Hot)            WS-SUP720-BASE     SAD084600Z2
  6    2  Supervisor Engine 720 (Active)         WS-SUP720-BASE     SAD083003P3
  7   48  48 port 10/100/1000mb EtherModule      WS-X6148-GE-TX     SAD082605NY
  9    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB084703UY

Mod MAC addresses                       Hw    Fw           Sw           Status
--- ---------------------------------- ------ ------------ ------------ -------
  1  0011.9242.aa20 to 0011.9242.aa5f   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok
  2  0012.00dc.6780 to 0012.00dc.67bf   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok
  3  0011.93a2.f4c0 to 0011.93a2.f4ff   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok
  4  0012.00dc.8cf0 to 0012.00dc.8d2f   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok
  5  0011.21ba.7db0 to 0011.21ba.7db3   3.2   8.1(3)       12.2(18)SXF1 Ok
  6  000f.f7be.ad40 to 000f.f7be.ad43   3.1   8.1(3)       12.2(18)SXF1 Ok
  7  0012.00ea.4f50 to 0012.00ea.4f7f   6.1   7.2(1)       8.5(0.46)RFW Ok
  9  0012.00dc.8d30 to 0012.00dc.8d6f   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok

Mod  Sub-Module                  Model              Serial       Hw     Status
---- --------------------------- ------------------ ----------- ------- -------
  5  Policy Feature Card 3       WS-F6K-PFC3A       SAD08380429  2.4    Ok
  5  MSFC3 Daughterboard         WS-SUP720          SAD0844075N  2.4    Ok
  6  Policy Feature Card 3       WS-F6K-PFC3A       SAD082905AL  2.4    Ok
  6  MSFC3 Daughterboard         WS-SUP720          SAD082806M5  2.3    Ok

Mod  Online Diag Status
---- -------------------
  1  Pass
  2  Pass
  3  Pass
  4  Pass
  5  Bypass
  6  Pass
  7  Minor Error
  9  Pass
Level1>

log messages:

Mar 25 11:26:08: %PFREDUN-SP-6-ACTIVE: Standby processor removed or reloaded, changing to Simplex mode
Mar 25 11:26:08: %OIR-SP-3-PWRCYCLE: Card in module 5, is being power-cycled (RF request)
Mar 25 11:26:08: %OIR-SP-3-PWRCYCLE: Card in module 5, is being power-cycled (OIR slot disable)
Mar 25 11:26:08: %OIR-SP-6-REMCARD: Card removed from slot 5, interfaces disabled
Mar 25 11:26:09: %OIR-SP-3-PWRCYCLE: Card in module 5, is being power-cycled (RF request)
Mar 25 11:35:14: %PFREDUN-SP-6-ACTIVE: Standby initializing for SSO mode
Mar 25 11:35:15: %SYS-SP-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.
Mar 25 11:35:18: %PFINIT-SP-5-CONFIG_SYNC: Sync'ing the startup configuration to the standby Router.
Mar 25 11:35:37: %FABRIC-SP-5-FABRIC_MODULE_BACKUP: The Switch Fabric Module in slot 5 became standby
Mar 25 11:35:38: %DIAG-SP-6-BYPASS: Module 5: Diagnostics is bypassed
Mar 25 11:35:38: %OIR-SP-6-INSCARD: Card inserted in slot 5, interfaces are now online
Mar 25 11:35:51: %SYS-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.

Firmware compiled 15-Jul-09 16:40 by integ Build [100]
Mar 25 11:35:51: %SYS-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.
Mar 25 11:35:51: %PFREDUN-SP-STDBY-6-STANDBY: Initializing for SSO mode
Mar 25 11:35:51: %SYS-SP-STDBY-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.
Mar 25 11:35:51: %SPANTREE-SP-STDBY-5-EXTENDED_SYSID: Extended SysId enabled for type vlan
00:01:17: SP-STDBY: SP: Currently running ROMMON from S (Gold) region
Mar 25 11:35:51: %DIAG-SP-STDBY-6-BYPASS: Module 5: Diagnostics is bypassed
Mar 25 11:35:51: %SYS-SP-STDBY-5-RESTART: System restarted --
Cisco Internetwork Operating System Software
IOS (tm) s72033_sp Software (s72033_sp-ADVIPSERVICESK9_WAN-M), Version 12.2(18)SXF17b, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2011 by cisco Systems, Inc.
Compiled Tue 15-Mar-11 21:11 by ccai
Mar 25 11:35:51: %PFREDUN-SP-STDBY-6-STANDBY: Ready for SSO mode
Mar 25 11:35:52: %SYS-SP-STDBY-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.

Please help to resolve the issue.

[senthil2012]

6 months ago,i upgraded the IOS from s72033-jk9o3sv-mz.122-18.SXD7b.bin to  s72033-advipservicesk9_wan-mz.122-18.SXF17b.bin.After upgrading it works fine for more than 5 months.

I loaded new IOS in 128 MB disk0:

old IOS is available in 64 MB sup-bootflash:

please help whether new IOS is creating any problem.

Help me.

[senthil2012]

please see the results after hw-module module 5 reset.

Level1>sh modu
Level1>sh module
Mod Ports Card Type                              Model              Serial No.
--- ----- -------------------------------------- ------------------ -----------
  1    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB0906026B
  2    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB084703ME
  3    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB084703UZ
  4    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB084703UM
  5    2  Supervisor Engine 720 (Hot)            WS-SUP720-BASE     SAD084600Z2
  6    2  Supervisor Engine 720 (Active)         WS-SUP720-BASE     SAD083003P3
  7   48  48 port 10/100/1000mb EtherModule      WS-X6148-GE-TX     SAD082605NY
  9    0  2 port adapter FlexWAN                 WS-X6182-2PA       JAB084703UY

Mod MAC addresses                       Hw    Fw           Sw           Status
--- ---------------------------------- ------ ------------ ------------ -------
  1  0011.9242.aa20 to 0011.9242.aa5f   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok
  2  0012.00dc.6780 to 0012.00dc.67bf   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok
  3  0011.93a2.f4c0 to 0011.93a2.f4ff   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok
  4  0012.00dc.8cf0 to 0012.00dc.8d2f   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok
  5  0011.21ba.7db0 to 0011.21ba.7db3   3.2   8.1(3)       12.2(18)SXF1 Ok
  6  000f.f7be.ad40 to 000f.f7be.ad43   3.1   8.1(3)       12.2(18)SXF1 Ok
  7  0012.00ea.4f50 to 0012.00ea.4f7f   6.1   7.2(1)       8.5(0.46)RFW Ok
  9  0012.00dc.8d30 to 0012.00dc.8d6f   1.6   12.2(18)SXF1 12.2(18)SXF1 Ok

Mod  Sub-Module                  Model              Serial       Hw     Status
---- --------------------------- ------------------ ----------- ------- -------
  5  Policy Feature Card 3       WS-F6K-PFC3A       SAD08380429  2.4    Ok
  5  MSFC3 Daughterboard         WS-SUP720          SAD0844075N  2.4    Ok
  6  Policy Feature Card 3       WS-F6K-PFC3A       SAD082905AL  2.4    Ok
  6  MSFC3 Daughterboard         WS-SUP720          SAD082806M5  2.3    Ok

Mod  Online Diag Status
---- -------------------
  1  Pass
  2  Pass
  3  Pass
  4  Pass
  5  Minor Error
  6  Pass
  7  Minor Error
  9  Pass
Level1>sh diagn
Level1>sh diagnostic re
Level1>sh diagnostic result mo
Level1>sh diagnostic result module 5

Current bootup diagnostic level: complete

Module 5: Supervisor Engine 720 (Hot)  SerialNo : SAD084600Z2

  Overall Diagnostic Result for Module 5 : MINOR ERROR
  Diagnostic level at card bootup: complete

  Test results: (. = Pass, F = Fail, U = Untested)

    1) TestScratchRegister -------------> .
    2) TestSPRPInbandPing --------------> .
    3) TestTransceiverIntegrity:

      Port  1  2
      ----------
            U  U

    4) TestActiveToStandbyLoopback:

      Port  1  2
      ----------
            .  .

    5) TestLoopback:

      Port  1  2
      ----------
            .  .

    6) TestNewIndexLearn ---------------> .
    7) TestDontConditionalLearn --------> .
    8) TestBadBpduTrap -----------------> .
    9) TestMatchCapture ----------------> .
   10) TestProtocolMatchChannel --------> .
   11) TestFibDevices ------------------> .
   12) TestIPv4FibShortcut -------------> .
   13) TestL3Capture2 ------------------> .
   14) TestIPv6FibShortcut -------------> .
   15) TestMPLSFibShortcut -------------> .
   16) TestNATFibShortcut --------------> .
   17) TestAclPermit -------------------> .
   18) TestAclDeny ---------------------> .
   19) TestQoSTcam ---------------------> F
   20) TestL3VlanMet -------------------> .
   21) TestIngressSpan -----------------> .
   22) TestEgressSpan ------------------> .
   23) TestNetflowInlineRewrite:

      Port  1  2
      ----------
            .  .

   24) TestFabricSnakeForward ----------> .
   25) TestFabricSnakeBackward ---------> .
   26) TestTrafficStress ---------------> U
   27) TestFibTcamSSRAM ----------------> U
   28) TestAsicMemory ------------------> U
   29) TestNetflowTcam -----------------> U
   30) ScheduleSwitchover --------------> U
   31) TestFirmwareDiagStatus ----------> U
   32) TestFabricFlowControlStatus -----> .

Level1>

what is the meaning of Minor error.Whether it will work fine.please help.

[amabdelh · Accepted solution]

To check if this is software bug or hardware issue, try to load the old ios and check. Also, if you can swap sup 5 and sup 6 and see if the issue follow the suspected sup, and same thing for the line card in slot 7, move it to a different sot and check.

[senthil2012]

Thank you very much.After interchanging slots working fine.