Recovering a Cisco 9600R

[carl_townshend]

Hi All

I am working on some DR documentation for the recovery of a cat 9606R switch with dual supervisors running in stackwise virtual, quad sup

I need to imagine a failure of one of the chassis for example where they wont boot and I have been delivered 2 new sups.

Am I right in saying first, it would be a good idea to disconnect the stackwise links, not to affect the other chassis?

Once recovered, would I need to covert to stackwise and then copy the config from the primary, how would we reintroduce back to the pair without downtime?

Has anyone got any info on this?

cheers

[balaji.bandi · Accepted solution]

Follow below guide replacement of failed one :

https://www.cisco.com/c/en/us/support/docs/interfaces-modules/catalyst-9600-series-supervisor-engine-1/216193-replace-a-supervisor-module-or-stack-mem.html

1. make sure you plan correctly write the steps.

2. make sure take the config backup out of the box.

3. new sup need to same version of code

[Leo Laohoo]

---

@carl_townshend wrote:

Am I right in saying first, it would be a good idea to disconnect the stackwise links, not to affect the other chassis?

---

IF the chassis dies then the StackWise links are dead anyway. 

Besides, dual-sup and each chassis has multiple power supplies.  The only thing that can fail is the backplane and I've only seen one Catalyst 6k with a faulty backplane.  

Make sure the power supplies are fed by a power rail which can be "controlled" via IP.  My worst case "nightmare" scenario is split brain to this kind of network equipment housed in a public DC which requires 48-hour notice just to gain access.   

[zeeshandeu85411]

@Leo LaohooI am working on C9606R (in Lab) and I am stuck into split brain and trying since 3 hours to get my switches back in SVL.

I have checked both the Switch configs, these are:

------------------

Switch_1#

en

switch renumber 1

switch priority 15

!

configure terminal

 boot system bootflash: xxxxxxxxxx.bin

!

stackwise-virtual

 domain 4      

 end

wr

---------------

Switch_2# same config with priority 14

Switch 1 rebooted first and after 5 to 10 seconds Switch 2 is rebooted

---------------

Port 1 and 25 on both are configured for SVL and Ports 4 and 28 are configured as is configard for DLD. Config is right.

During restart both the Switches Say:

"

Waiting for remote chassis to join
###############################################  but both come up as standalone.

"

I have restarted both for like multiple times and they are not joining the Stack. Its a Split Brain.

What can I do to get them back? The clock is ticking... and any help I can get will be a light in the darkness

Thanks in advance.

[balaji.bandi]

post show run from both the device removing confidential information to help. (if this is impacting contact tac is best to resolve)

Make sure check the Physical port come up and working ?

post below output also :

show stackwise-virtual
show stackwise-virtual link
show stackwise-virtual dual-active-detection

[zeeshandeu85411]

As I was working in Lab Environment so in my Case the solution was:

The config was removed on both the Switches and they were configured again.

Switch 1#

en
switch renumber 1
!
switch priority 15
!
configure terminal
boot system XXXXXX.bin
!
stackwise-virtual
domain 4
end
wr

!!! Same config on Switch2 only with lower Priority !!!

!!! After Reboot, Configration on Switch1 !!!

interface range TwentyFiveGig1/1/0/1, TwentyFiveGig1/1/0/25
description Stackwise-Virtual Link SW2
stackwise-virtual link 1

interface range TwentyFiveGig1/1/0/4, TwentyFiveGig1/1/0/28
description Dual-Active-Detection Link SW2
stackwise-virtual dual-active-detection

!!! After Reboot, Configuration on Switch2 !!!

interface range TwentyFiveGig2/2/0/1, TwentyFiveGig2/2/0/25
description Stackwise-Virtual Link SW1
stackwise-virtual link 1

interface range TwentyFiveGig2/2/0/4, TwentyFiveGig2/2/0/28
description Dual-Active-Detection Link SW1
stackwise-virtual dual-active-detection
!
wr

!------ Reboot Switch 1 and after a couple of seconds Reboot Switch 2 ----------!
!------ Don't Press Any Key, give them extra time to come back completely -----!

!!Now they should become a pair!!
!!You will not be able to logon to Switch 2, or if you can Login you will see this message:

"Standby console disabled"

Verify with show commands:

Switch1#

show switch

show stackwise-virtual
show stackwise-virtual link
show stackwise-virtual dual-active-detection