cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
853
Views
0
Helpful
5
Replies

MDS 9509 supervisor engine issue

Hi tem,

           MDS 9509 switch is having two sup. Engine accordingly 5th module is Active and 6th Module is standby and it's working fine but unfortunately sup. engine failover happened without any distribution and 5th Module is standby and 6th Module is active. After that we are getting we are getting following logs continuously. We need to know how sup.engine switchover happened automatically and  explanation of the logs

 

Error logs, show version and sow module out put mentioned for your reference

 

2021 Jul 5 19:54:17 PRIMARY-SWITCH %PLATFORM-2-MOD_REMOVE: Module 5 removed (Serial number JAE1244Z5QO)
2021 Jul 5 19:56:20 PRIMARY-SWITCH %SYSMGR-STANDBY-5-CFGWRITE_STARTED: Configuration copy started (PID 2437).
2021 Jul 5 19:56:50 PRIMARY-SWITCH %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
2021 Jul 5 19:56:55 PRIMARY-SWITCH %MODULE-5-STANDBY_SUP_OK: Supervisor 5 is standby
2021 Jul 5 19:56:55 PRIMARY-SWITCH %SYSMGR-STANDBY-5-MODULE_ONLINE: System Manager has received notification of local module becoming online.
2021 Jul 5 21:53:08 PRIMARY-SWITCH %PLATFORM-2-MOD_REMOVE: Module 5 removed (Serial number JAE1244Z5QO)
2021 Jul 5 22:00:01 PRIMARY-SWITCH %SYSMGR-2-STANDBY_BOOT_FAILED: Standby supervisor failed to boot up.
2021 Jul 5 22:02:34 PRIMARY-SWITCH %SYSMGR-STANDBY-5-CFGWRITE_STARTED: Configuration copy started (PID 2437).
2021 Jul 5 22:03:03 PRIMARY-SWITCH %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
2021 Jul 5 22:03:09 PRIMARY-SWITCH %MODULE-5-STANDBY_SUP_OK: Supervisor 5 is standby
2021 Jul 5 22:03:10 PRIMARY-SWITCH %SYSMGR-STANDBY-5-MODULE_ONLINE: System Manager has received notification of local module becoming online.
2021 Jul 6 01:29:38 PRIMARY-SWITCH %PLATFORM-2-MOD_REMOVE: Module 5 removed (Serial number JAE1244Z5QO)
2021 Jul 6 01:31:39 PRIMARY-SWITCH %SYSMGR-STANDBY-5-CFGWRITE_STARTED: Configuration copy started (PID 2437).
2021 Jul 6 01:32:09 PRIMARY-SWITCH %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
2021 Jul 6 01:32:15 PRIMARY-SWITCH %MODULE-5-STANDBY_SUP_OK: Supervisor 5 is standby
2021 Jul 6 01:32:15 PRIMARY-SWITCH %SYSMGR-STANDBY-5-MODULE_ONLINE: System Manager has received notification of local module becoming online.
2021 Jul 6 08:23:52 PRIMARY-SWITCH %PLATFORM-2-MOD_REMOVE: Module 5 removed (Serial number JAE1244Z5QO)
2021 Jul 6 08:25:54 PRIMARY-SWITCH %SYSMGR-STANDBY-5-CFGWRITE_STARTED: Configuration copy started (PID 2437).
2021 Jul 6 08:26:24 PRIMARY-SWITCH %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
2021 Jul 6 08:26:30 PRIMARY-SWITCH %MODULE-5-STANDBY_SUP_OK: Supervisor 5 is standby

 

`show version`
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Copyright (c) 2002-2009, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained herein are owned by
other third parties and are used and distributed under license.
Some parts of this software are covered under the GNU Public
License. A copy of the license is available at
http://www.gnu.org/licenses/gpl.html.

Software
BIOS: version 1.0.10
loader: version N/A
kickstart: version 4.2(3)
system: version 4.2(3)
BIOS compile time: 01/08/09
kickstart image file is: bootflash:/m9500-sf2ek9-kickstart-mz.4.2.3.bin
kickstart compile time: 10/26/2009 0:00:00 [12/05/2009 05:48:19]
system image file is: bootflash:/m9500-sf2ek9-mz.4.2.3.bin
system compile time: 10/26/2009 0:00:00 [12/05/2009 07:37:21]


Hardware
cisco MDS 9509 (9 Slot) Chassis ("Supervisor/Fabric-2")
Motorola, 7447A, altivec with 1033100 kB of memory.
Processor Board ID JAE1241WJS0

Device name: PRIMARY-SWITCH
bootflash: 1023120 kB
slot0: 0 kB (expansion flash)

Kernel uptime is 1514 day(s), 5 hour(s), 0 minute(s), 0 second(s)

Last reset
Reason: Unknown
System version: 4.2(3)
Service:
`show module`
Mod Ports Module-Type Model Status
--- ----- -------------------------------- ------------------ ------------
1 48 1/2/4 Gbps FC Module DS-X9148 ok
2 48 1/2/4 Gbps FC Module DS-X9148 ok
5 0 Supervisor/Fabric-2 DS-X9530-SF2-K9 ha-standby
6 0 Supervisor/Fabric-2 DS-X9530-SF2-K9 active *

Mod Sw Hw World-Wide-Name(s) (WWN)
--- -------------- ------ --------------------------------------------------
1 4.2(3) 1.8 20:01:00:0d:ec:c1:eb:00 to 20:30:00:0d:ec:c1:eb:00
2 4.2(3) 1.5 20:41:00:0d:ec:c1:eb:00 to 20:70:00:0d:ec:c1:eb:00
5 4.2(3) 1.6 --
6 4.2(3) 1.6 --


Mod MAC-Address(es) Serial-Num
--- -------------------------------------- ----------
1 00-1d-70-b2-9e-98 to 00-1d-70-b2-9e-9c JAE13198E2U
2 00-19-56-3e-89-40 to 00-19-56-3e-89-44 JAB105201K8
5 00-23-5e-99-a5-68 to 00-23-5e-99-a5-6c JAE1244Z5QO
6 00-23-5e-99-8e-14 to 00-23-5e-99-8e-18 JAE1241WJS0

* this terminal session
`show module internal exceptionlog`
********* Exception info for module 1 ********

5 Replies 5

marce1000
Hall of Fame
Hall of Fame

 

 - Compare  led-status indicator on both supervisors on the device (visually) , check if any is reporting a bad status.

 M.



-- Each morning when I wake up and look into the mirror I always say ' Why am I so brilliant ? '
    When the mirror will then always repond to me with ' The only thing that exceeds your brilliance is your beauty! '

Hi,

  LED status is ok and HA status also but found the logs everyday module 5 is removed. could you suggest on this?

2021 Jul 9 05:01:01 PRIMARY-SWITCH %PLATFORM-2-MOD_REMOVE: Module 5 removed (Serial number JAE1244Z5QO)
2021 Jul 9 05:03:03 PRIMARY-SWITCH %SYSMGR-STANDBY-5-CFGWRITE_STARTED: Configuration copy started (PID 2439).
2021 Jul 9 05:03:33 PRIMARY-SWITCH %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
2021 Jul 9 05:03:38 PRIMARY-SWITCH %MODULE-5-STANDBY_SUP_OK: Supervisor 5 is standby
2021 Jul 9 05:03:38 PRIMARY-SWITCH %SYSMGR-STANDBY-5-MODULE_ONLINE: System Manager has received notification of local module becoming online.
2021 Jul 9 10:44:10 PRIMARY-SWITCH %PLATFORM-2-MOD_REMOVE: Module 5 removed (Serial number JAE1244Z5QO)
2021 Jul 9 10:46:12 PRIMARY-SWITCH %SYSMGR-STANDBY-5-CFGWRITE_STARTED: Configuration copy started (PID 2439).
2021 Jul 9 10:46:37 PRIMARY-SWITCH %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
2021 Jul 9 10:46:42 PRIMARY-SWITCH %MODULE-5-STANDBY_SUP_OK: Supervisor 5 is standby
2021 Jul 9 10:46:42 PRIMARY-SWITCH %SYSMGR-STANDBY-5-MODULE_ONLINE: System Manager has received notification of local module becoming online.
2021 Jul 9 20:47:13 PRIMARY-SWITCH %PLATFORM-2-MOD_REMOVE: Module 5 removed (Serial number JAE1244Z5QO)
2021 Jul 9 20:49:15 PRIMARY-SWITCH %SYSMGR-STANDBY-5-CFGWRITE_STARTED: Configuration copy started (PID 2439).
2021 Jul 9 20:49:39 PRIMARY-SWITCH %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
2021 Jul 9 20:49:46 PRIMARY-SWITCH %MODULE-5-STANDBY_SUP_OK: Supervisor 5 is standby
2021 Jul 9 20:49:46 PRIMARY-SWITCH %SYSMGR-STANDBY-5-MODULE_ONLINE: System Manager has received notification of local module becoming online.
2021 Jul 9 21:45:40 PRIMARY-SWITCH %PLATFORM-2-MOD_REMOVE: Module 5 removed (Serial number JAE1244Z5QO)
2021 Jul 9 21:47:43 PRIMARY-SWITCH %SYSMGR-STANDBY-5-CFGWRITE_STARTED: Configuration copy started (PID 2439).
2021 Jul 9 21:48:13 PRIMARY-SWITCH %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
2021 Jul 9 21:48:18 PRIMARY-SWITCH %MODULE-5-STANDBY_SUP_OK: Supervisor 5 is standby
2021 Jul 9 21:48:18 PRIMARY-SWITCH %SYSMGR-STANDBY-5-MODULE_ONLINE: System Manager has received notification of local module becoming online.
2021 Jul 10 03:47:51 PRIMARY-SWITCH %PLATFORM-2-MOD_REMOVE: Module 5 removed (Serial number JAE1244Z5QO)
2021 Jul 10 03:49:52 PRIMARY-SWITCH %SYSMGR-STANDBY-5-CFGWRITE_STARTED: Configuration copy started (PID 2439).
2021 Jul 10 03:50:20 PRIMARY-SWITCH %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
2021 Jul 10 03:50:35 PRIMARY-SWITCH %SYSMGR-STANDBY-5-MODULE_ONLINE: System Manager has received notification of local module becoming online.
2021 Jul 10 03:50:35 PRIMARY-SWITCH %MODULE-5-STANDBY_SUP_OK: Supervisor 5 is standby
2021 Jul 10 06:07:34 PRIMARY-SWITCH %PLATFORM-2-MOD_REMOVE: Module 5 removed (Serial number JAE1244Z5QO)
2021 Jul 10 06:09:35 PRIMARY-SWITCH %SYSMGR-STANDBY-5-CFGWRITE_STARTED: Configuration copy started (PID 2439).
2021 Jul 10 06:10:05 PRIMARY-SWITCH %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
2021 Jul 10 06:10:11 PRIMARY-SWITCH %MODULE-5-STANDBY_SUP_OK: Supervisor 5 is standby
2021 Jul 10 06:10:11 PRIMARY-SWITCH %SYSMGR-STANDBY-5-MODULE_ONLINE: System Manager has received notification of local module becoming online.
2021 Jul 12 21:08:22 PRIMARY-SWITCH %PLATFORM-2-MOD_REMOVE: Module 5 removed (Serial number JAE1244Z5QO)
2021 Jul 12 21:15:15 PRIMARY-SWITCH %SYSMGR-2-STANDBY_BOOT_FAILED: Standby supervisor failed to boot up.
2021 Jul 12 21:17:46 PRIMARY-SWITCH %SYSMGR-STANDBY-5-CFGWRITE_STARTED: Configuration copy started (PID 2439).
2021 Jul 12 21:18:14 PRIMARY-SWITCH %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
2021 Jul 12 21:19:00 PRIMARY-SWITCH %SYSMGR-STANDBY-5-MODULE_ONLINE: System Manager has received notification of local module becoming online.
2021 Jul 12 21:19:00 PRIMARY-SWITCH %MODULE-5-STANDBY_SUP_OK: Supervisor 5 is standby
2021 Jul 13 03:11:53 PRIMARY-SWITCH %PLATFORM-2-MOD_REMOVE: Module 5 removed (Serial number JAE1244Z5QO)
2021 Jul 13 03:13:54 PRIMARY-SWITCH %SYSMGR-STANDBY-5-CFGWRITE_STARTED: Configuration copy started (PID 2439).
2021 Jul 13 03:14:22 PRIMARY-SWITCH %BOOTVAR-5-NEIGHBOR_UPDATE_AUTOCOPY: auto-copy supported by neighbor supervisor, starting...
2021 Jul 13 03:14:36 PRIMARY-SWITCH %MODULE-5-STANDBY_SUP_OK: Supervisor 5 is standby
2021 Jul 13 03:14:36 PRIMARY-SWITCH %SYSMGR-STANDBY-5-MODULE_ONLINE: System Manager has received notification of local module becoming online.
PRIMARY-SWITCH#

PRIMARY-SWITCH# sh system redundancy status
Redundancy mode
---------------
administrative: HA
operational: HA

This supervisor (sup-2)
-----------------------
Redundancy state: Active
Supervisor state: Active
Internal state: Active with HA standby

Other supervisor (sup-1)
------------------------
Redundancy state: Standby
Supervisor state: HA standby
Internal state: HA standby

 

 - Could be a bug , not sure, check software version , use an advisory release if applicable and or depending on problem-urgency.

 M.



-- Each morning when I wake up and look into the mirror I always say ' Why am I so brilliant ? '
    When the mirror will then always repond to me with ' The only thing that exceeds your brilliance is your beauty! '

Hi,

 This is End of support device/Sup engine so hope  not able to compare the .suggest version. Could you cross check asap?

 

 - Post output of show version

 M.



-- Each morning when I wake up and look into the mirror I always say ' Why am I so brilliant ? '
    When the mirror will then always repond to me with ' The only thing that exceeds your brilliance is your beauty! '
Review Cisco Networking for a $25 gift card