Problem on a supervisor WS-X45-SUP6L-E

Cristian Rimondi · ‎02-20-2013

Hi all,

on a WS-C4507R-E there is this configurations:

Cat4507#sh ver

Cisco IOS Software, Catalyst 4500 L3 Switch Software (cat4500e-IPBASEK9-M), Version 12.2(54)SG1, RELEASE SOFTWARE (fc1)

Image text-base: 0x10000000, data-base: 0x12C41C68

ROM: 12.2(44r)SG5

Darkside Revision 4, Nexu Revision 9, Fortooine Revision 1.22

...

System image file is "bootflash:cat4500e-ipbasek9-mz.122-54.SG1.bin"

.....

Cat4507#sh redundancy

Redundant System Information :

------------------------------

Available system uptime = 28 weeks, 4 days, 17 hours, 5 minutes

Switchovers system experienced = 3

Standby failures = 76

Last switchover reason = user forced

Hardware Mode = Duplex

Configured Redundancy Mode = Stateful Switchover

Operating Redundancy Mode = Stateful Switchover

Maintenance Mode = Disabled

Communications = Up

Current Processor Information :

-------------------------------

Active Location = slot 4

Current Software state = ACTIVE

Uptime in current state = 26 weeks, 19 hours, 56 minutes

Image Version = Cisco IOS Software, Catalyst 4500 L3 Switch Sof

tware (cat4500e-IPBASEK9-M), Version 12.2(54)SG1, RELEASE SOFTWARE (fc1)

Technical Support: http://www.cisco.com/techsupport

Compiled Thu 27-Jan-11 12:19 by prod_rel_team

BOOT = bootflash:cat4500e-ipbasek9-mz.122-54.SG1.bin,1

;

Configuration register = 0x2102

Peer Processor Information :

----------------------------

Standby Location = slot 3

Current Software state = STANDBY HOT

Uptime in current state = 1 day, 15 hours, 41 minutes

Image Version = Cisco IOS Software, Catalyst 4500 L3 Switch Sof

tware (cat4500e-IPBASEK9-M), Version 12.2(54)SG1, RELEASE SOFTWARE (fc1)

Technical Support: http://www.cisco.com/techsupport

Compiled Thu 27-Jan-11 12:19 by prod

BOOT = bootflash:cat4500e-ipbasek9-mz.122-54.SG1.bin,1

;

Configuration register = 0x2102

Cat4507#sh module 3

Mod Ports Card Type Model Serial No.

---+-----+--------------------------------------+------------------+-----------

3 6 Sup 6L-E 10GE (X2), 1000BaseX (SFP) WS-X45-SUP6L-E

M MAC addresses Hw Fw Sw Status

--+--------------------------------+---+------------+----------------+---------

3 68ef.bd3e.66c0 to 68ef.bd3e.66c5 1.1 12.2(44r)SG5 12.2(54)SG1 Ok

Mod Redundancy role Operating mode Redundancy status

----+-------------------+-------------------+----------------------------------

3 Standby Supervisor SSO Standby hot

Cat4507#sh module 4

Mod Ports Card Type Model Serial No.

---+-----+--------------------------------------+------------------+-----------

4 6 Sup 6L-E 10GE (X2), 1000BaseX (SFP) WS-X45-SUP6L-E

M MAC addresses Hw Fw Sw Status

--+--------------------------------+---+------------+----------------+---------

4 68ef.bd3e.66c6 to 68ef.bd3e.66cb 1.0 12.2(44r)SG5 12.2(54)SG1 Ok

Mod Redundancy role Operating mode Redundancy status

----+-------------------+-------------------+----------------------------------

4 Active Supervisor SSO Active

This is a problem :

Feb 16 00:09:33.137 MET: %C4K_REDUNDANCY-4-KEEPALIVE_WARNING: Keepalive messages from peer Supervisor are missing for 27 seconds

Feb 16 00:09:42.982 MET: %C4K_REDUNDANCY-3-COMMUNICATION: Communication with the peer Supervisor has been lost

Feb 16 00:09:42.990 MET: %C4K_REDUNDANCY-3-SIMPLEX_MODE: The peer Supervisor has been lost

Feb 16 00:12:08.000 MET: %C4K_REDUNDANCY-6-DUPLEX_MODE: The peer Supervisor has been detected

Feb 16 00:12:17.676 MET: %C4K_IOSMODPORTMAN-6-MODULEONLINE: Module 3 (WS-X45-SUP6L-E S/N: JAE1411042P Hw: 1.1) is online

Feb 16 00:12:17.680 MET: %C4K_REDUNDANCY-6-MODE: ACTIVE supervisor initializing for sso mode

Feb 16 00:12:18.000 MET: %C4K_REDUNDANCY-3-COMMUNICATION: Communication with the peer Supervisor has been established

Feb 16 00:12:24.648 MET: %C4K_REDUNDANCY-5-CONFIGSYNC: The bootvar has been successfully synchronized to the standby supervisor

Feb 16 00:12:24.648 MET: %C4K_REDUNDANCY-5-CONFIGSYNC: The config-reg has been successfully synchronized to the standby supervisor

Feb 16 00:12:24.648 MET: %C4K_REDUNDANCY-5-CONFIGSYNC: The startup-config has been successfully synchronized to the standby supervisor

Feb 16 00:12:25.484 MET: %C4K_REDUNDANCY-5-CONFIGSYNC: The private-config has been successfully synchronized to the standby supervisor

Feb 16 00:12:27.176 MET: %C4K_REDUNDANCY-5-CONFIGSYNC_RATELIMIT: The vlan database has been successfully synchronized to the standby supervisor

Feb 16 00:12:50.556 MET: %HA_CONFIG_SYNC-6-BULK_CFGSYNC_SUCCEED: Bulk Sync succeeded

Feb 16 00:12:51.276 MET: %RF-5-RF_TERMINAL_STATE: Terminal state reached for (SSO)

Feb 16 04:14:15.551 MET: %C4K_REDUNDANCY-4-KEEPALIVE_WARNING: Keepalive messages from peer Supervisor are missing for 27 seconds

Feb 16 04:14:30.955 MET: %C4K_REDUNDANCY-3-COMMUNICATION: Communication with the peer Supervisor has been lost

Feb 16 04:14:30.963 MET: %C4K_REDUNDANCY-3-SIMPLEX_MODE: The peer Supervisor has been lost

Feb 16 04:16:54.970 MET: %C4K_REDUNDANCY-6-DUPLEX_MODE: The peer Supervisor hasbeen detected

Feb 16 04:17:04.962 MET: %C4K_IOSMODPORTMAN-6-MODULEONLINE: Module 3 (WS-X45-SUP6L-E S/N: JAE1411042P Hw: 1.1) is online

Feb 16 04:17:04.962 MET: %C4K_REDUNDANCY-6-MODE: ACTIVE supervisor initializing for sso mode

Feb 16 04:17:04.970 MET: %C4K_REDUNDANCY-3-COMMUNICATION: Communication with the peer Supervisor has been established

Feb 16 04:17:11.766 MET: %C4K_REDUNDANCY-5-CONFIGSYNC: The bootvar has been successfully synchronized to the standby supervisor

Feb 16 04:17:11.766 MET: %C4K_REDUNDANCY-5-CONFIGSYNC: The config-reg has been successfully synchronized to the standby supervisor

Feb 16 04:17:11.770 MET: %C4K_REDUNDANCY-5-CONFIGSYNC: The startup-config has been successfully synchronized to the standby supervisor

Feb 16 04:17:12.590 MET: %C4K_REDUNDANCY-5-CONFIGSYNC: The private-config has been successfully synchronized to the standby supervisor

Feb 16 04:17:14.354 MET: %C4K_REDUNDANCY-5-CONFIGSYNC_RATELIMIT: The vlan database has been successfully synchronized to the standby supervisor

Feb 16 04:17:37.746 MET: %HA_CONFIG_SYNC-6-BULK_CFGSYNC_SUCCEED: Bulk Sync succeeded

Feb 16 04:17:38.446 MET: %RF-5-RF_TERMINAL_STATE: Terminal state reached for (SSO)

Feb 16 09:21:24.884 MET: %C4K_REDUNDANCY-5-CALENDAR_RATELIMIT: The calendar hasbeen successfully synchronized to the standby supervisor24 times since last calendar syslog

All the days I get always the same log message (see the bold character)

Is a hardware problem of WS-X45-SUP6L-E on module 3 ???

Can you help me ??

By

Crsitian

InayathUlla Sharieff · ‎02-20-2013

Hi Cristian,

From the logs seen on your device:

Feb 16 00:09:33.137 MET: %C4K_REDUNDANCY-4-KEEPALIVE_WARNING: Keepalive messages from peer Supervisor are missing for 27 seconds

Feb 16 00:09:42.982 MET: %C4K_REDUNDANCY-3-COMMUNICATION: Communication with the peer Supervisor has been lost

Feb 16 00:09:42.990 MET: %C4K_REDUNDANCY-3-SIMPLEX_MODE: The peer Supervisor has been lost

Feb 16 00:12:08.000 MET: %C4K_REDUNDANCY-6-DUPLEX_MODE: The peer Supervisor has been detected

The Default keep-alive timer value is nine seconds and Default keep-alive threshold value is 18 seconds. This means that keep-alive messages are sent every nine seconds and it is allowed to miss a total of 18 keep-alive messages before it declares that something is wrong. This gives a total of 162 seconds or 2.7 mins of keep-alive timeout. It is possible that the Supervisor is too busy to handle keepalive. In some scenarios, the logs says that the system returned to ROM by Stateful Switchover. In redundant systems, after 162 seconds the switch triggers a redundancy failover. In most of these cases, this is a transient issue which happens only once. As a workaround, you can reseat the Primary Supervisor module and then force it to become active and then monitor the switch for further error messages.

HTH

Regards

Inayath

*Plz rate the usefull posts.

Cristian Rimondi · ‎02-20-2013

??

look :

Cat4507#sh redundancy

Redundant System Information :

------------------------------

Available system uptime = 28 weeks, 4 days, 17 hours, 5 minutes

Switchovers system experienced = 3

Standby failures = 76

Last switchover reason = user forced

Hardware Mode = Duplex

Configured Redundancy Mode = Stateful Switchover

Operating Redundancy Mode = Stateful Switchover

Maintenance Mode = Disabled

Communications = Up

Current Processor Information :

-------------------------------

Active Location = slot 4

Current Software state = ACTIVE

Uptime in current state = 26 weeks, 19 hours, 56 minutes

Image Version = Cisco IOS Software, Catalyst 4500 L3 Switch Sof

tware (cat4500e-IPBASEK9-M), Version 12.2(54)SG1, RELEASE SOFTWARE (fc1)

Technical Support: http://www.cisco.com/techsupport

Compiled Thu 27-Jan-11 12:19 by prod_rel_team

BOOT = bootflash:cat4500e-ipbasek9-mz.122-54.SG1.bin,1

;

Configuration register = 0x2102

Peer Processor Information :

----------------------------

Standby Location = slot 3

Current Software state = STANDBY HOT

Uptime in current state = 1 day, 15 hours, 41 minutes

Image Version = Cisco IOS Software, Catalyst 4500 L3 Switch Sof

tware (cat4500e-IPBASEK9-M), Version 12.2(54)SG1, RELEASE SOFTWARE (fc1)

Technical Support: http://www.cisco.com/techsupport

Compiled Thu 27-Jan-11 12:19 by prod

BOOT = bootflash:cat4500e-ipbasek9-mz.122-54.SG1.bin,1

;

Configuration register = 0x2102

The supervisor in solt 3 restart alone see uptime.

I opend a case on TAC, and the response is that the module is faulty

InayathUlla Sharieff · ‎02-20-2013

Hi Cris,

I didnt had a look at the crash info of the module hence didnt suggest the module to be replaced.

REgard

Inayath