Solved: Trying to stack 2 c9300x-24Y with 2 c9300x-48TX switches. Same IOS.

rpanus · ‎12-22-2023

I am trying to stack 2 c9300x-24Y with 2 c9300x-48TX switches. All are running the same IOS. The 2 c9300x-24Y switches are switches 1 & 4 (top and bottom). The 2 c9300x-48TX switches are in positions 2 & 3.

When I run the show switch command on each switch, I only see like models of switches are stacked (1&4, 2&3). I have changed cables, reinstalled IOS, but to no affect. The stack originally started the same except for the 9300-tx switches were 9300-hx switches. Everything worked fine. The staging engineer realized the stack required 9300-tx's instead of the 9300-hx's. He powered down the stack and inserted the tx's where we realized the scenario described above. I have done a write erase on each switch, removed the priority commands, powered down, powered up, and so on. I had the staging guy replace all of the stack cables with brand new cables. We have configured hundreds of stacks over the past month or so without issue, but this is the first HX/Y attempt. Any ideas?

rpanus · ‎12-22-2023

This configuration command was the solution: "switch stack-speed high". Make sure that this configuration parameter is on all switch stack members. Thanks for everyone looking into this for me.

View solution in original post

balaji.bandi · ‎12-22-2023

looks good, can you post the configuration for the switch and also refer below troubleshooting guide :

Problem - C9300X Mixed Stack Splits into Sub-rings / Mismatched Stack Speeds

https://www.cisco.com/c/en/us/support/docs/switches/catalyst-9300-series-switches/217684-verify-and-troubleshoot-stackwise-on-cat.html

BB

***** Rate All Helpful Responses *****

How to Ask The Cisco Community for Help

View solution in original post

Leo Laohoo · ‎12-22-2023

All switch members (of the same stack) must be boot in Install Mode or Bundle Mode (and never a combination).

balaji.bandi · ‎12-22-2023

Provide some Logs while each switch booting time and joining stack

provide below output ;

show version

show switch

as asked home all installmode or bundle mode right ?

BB

***** Rate All Helpful Responses *****

How to Ask The Cisco Community for Help

rpanus · ‎12-22-2023

Below are show ver, show mod, sh switch stack-ports, and show version. Keep in mind that all 4 switches are properly connected to one another via data stack cables. IOS upgrades used install mode and have the same IOS version. You will see that there are 2 separate stacks even though they are all stacked together. The stack ports show that switch one stack port 1 (connected to switch 2) is down, while stack port 2 (connected to switch 4) is up. Same idea for switches 2 and 3. Makes no sense to me. As I stated before, this same scenario worked when there were 2 c9300x-hx switches in the place of the c9300x-tx switches.

SWITCHES 1 & 4

Switch#show mod

Switch Ports Model Serial No. MAC address Hw Ver. Sw Ver.

------ ----- --------- ----------- -------------- ------- --------

1 54 C9300X-24Y FJC27311JKW 8c94.6135.7180 V02 17.09.04a

2 54 C9300X-24Y FJC27311GWV 6879.095b.7780 V02 17.09.04a

Switch#

Switch#sh swi

Switch/Stack Mac Address : 8c94.6135.7180 - Local Mac Address

Mac persistency wait time: Indefinite

H/W Current

Switch# Role Mac Address Priority Version State

-------------------------------------------------------------------------------------

*1 Active 8c94.6135.7180 15 V02 Ready

2 Member 6879.095b.7780 12 V02 Ready

Switch#sh swi st

Switch#sh swi stack-p

Switch# Port1 Port2

----------------------------

1 DOWN OK

2 OK DOWN

Switch#

Switch#sh ver

Cisco IOS XE Software, Version 17.09.04a

Cisco IOS Software [Cupertino], Catalyst L3 Switch Software (CAT9K_IOSXE), Version 17.9.4a, RELEASE SOFTWARE (fc3)

Technical Support: http://www.cisco.com/techsupport

Compiled Fri 20-Oct-23 10:44 by mcpre

ROM: IOS-XE ROMMON

BOOTLDR: System Bootstrap, Version 17.9.1r, RELEASE SOFTWARE (P)

Switch uptime is 12 minutes

Uptime for this control processor is 16 minutes

System returned to ROM by Reload Command

System image file is "flash:packages.conf"

Last reload reason: Reload Command

Technology Package License Information:

------------------------------------------------------------------------------

Technology-package Technology-package

Current Type Next reboot

------------------------------------------------------------------------------

network-essentials Smart License network-essentials

dna-essentials Subscription Smart License dna-essentials

AIR License Level: AIR DNA Advantage

Next reload AIR license Level: AIR DNA Advantage

Smart Licensing Status: Smart Licensing Using Policy

cisco C9300X-24Y (X86) processor with 1310642K/6147K bytes of memory.

Processor board ID FJC27311JKW

1 Virtual Ethernet interface

16 Ten Gigabit Ethernet interfaces

80 TwentyFive Gigabit Ethernet interfaces

8 Hundred Gigabit Ethernet interfaces

2048K bytes of non-volatile configuration memory.

16777216K bytes of physical memory.

1638400K bytes of Crash Files at crashinfo:.

1638400K bytes of Crash Files at crashinfo-2:.

11264000K bytes of Flash at flash:.

11264000K bytes of Flash at flash-2:.

Base Ethernet MAC Address : 8c:94:61:35:71:80

Motherboard Assembly Number : 73-19730-06

Motherboard Serial Number : FJZ2731MVJV

Model Revision Number : D0

Motherboard Revision Number : B0

Model Number : C9300X-24Y

System Serial Number : FJC27311JKW

CLEI Code Number : INMGP00CRB

Switch Ports Model SW Version SW Image Mode

------ ----- ----- ---------- ---------- ----

* 1 54 C9300X-24Y 17.09.04a CAT9K_IOSXE INSTALL

2 54 C9300X-24Y 17.09.04a CAT9K_IOSXE INSTALL

Switch 02

---------

Switch uptime : 16 minutes

Base Ethernet MAC Address : 68:79:09:5b:77:80

Motherboard Assembly Number : 73-19730-06

Motherboard Serial Number : FJZ2731R535

Model Revision Number : D0

Motherboard Revision Number : B0

Model Number : C9300X-24Y

System Serial Number : FJC27311GWV

Last reload reason : Reload Command

CLEI Code Number : INMGP00CRB

END OF SWITCHES 1 & 4 OUTPUT

SWITCHES 2 & 3

Switch#show modu

Switch Ports Model Serial No. MAC address Hw Ver. Sw Ver.

------ ----- --------- ----------- -------------- ------- --------

1 78 C9300X-48TX FOC2713YFHJ 6c29.d253.c800 V02 17.09.04a

2 78 C9300X-48TX FOC2729Y23U 68e5.9e7c.f300 V02 17.09.04a

Switch#

Switch#sh sw

Switch/Stack Mac Address : 6c29.d253.c800 - Local Mac Address

Mac persistency wait time: Indefinite

H/W Current

Switch# Role Mac Address Priority Version State

-------------------------------------------------------------------------------------

*1 Active 6c29.d253.c800 14 V02 Ready

2 Member 68e5.9e7c.f300 13 V02 Ready

Switch#sh swi stack-p

Switch# Port1 Port2

----------------------------

1 OK DOWN

2 DOWN OK

Switch#

Switch#sh ver

Cisco IOS XE Software, Version 17.09.04a

Cisco IOS Software [Cupertino], Catalyst L3 Switch Software (CAT9K_IOSXE), Version 17.9.4a, RELEASE SOFTWARE (fc3)

Technical Support: http://www.cisco.com/techsupport

Compiled Fri 20-Oct-23 10:44 by mcpre

ROM: IOS-XE ROMMON

BOOTLDR: System Bootstrap, Version 17.9.1r, RELEASE SOFTWARE (P)

Switch uptime is 5 minutes

Uptime for this control processor is 9 minutes

System returned to ROM by Reload Command

System image file is "flash:packages.conf"

Last reload reason: Reload Command

Technology Package License Information:

------------------------------------------------------------------------------

Technology-package Technology-package

Current Type Next reboot

------------------------------------------------------------------------------

network-essentials Smart License network-essentials

dna-essentials Subscription Smart License dna-essentials

AIR License Level: AIR DNA Advantage

Next reload AIR license Level: AIR DNA Advantage

Smart Licensing Status: Smart Licensing Using Policy

cisco C9300X-48TX (X86) processor with 1310642K/6147K bytes of memory.

Processor board ID FOC2713YFHJ

1 Virtual Ethernet interface

112 Ten Gigabit Ethernet interfaces

32 TwentyFive Gigabit Ethernet interfaces

8 Hundred Gigabit Ethernet interfaces

2048K bytes of non-volatile configuration memory.

16777216K bytes of physical memory.

1638400K bytes of Crash Files at crashinfo:.

1638400K bytes of Crash Files at crashinfo-2:.

11264000K bytes of Flash at flash:.

11264000K bytes of Flash at flash-2:.

3887698K bytes of USB Flash at usbflash0:.

Base Ethernet MAC Address : 6c:29:d2:53:c8:00

Motherboard Assembly Number : 73-20261-04

Motherboard Serial Number : FOC27070Y1R

Model Revision Number : E0

Motherboard Revision Number : B0

Model Number : C9300X-48TX

System Serial Number : FOC2713YFHJ

CLEI Code Number : INMGG00CRB

Switch Ports Model SW Version SW Image Mode

------ ----- ----- ---------- ---------- ----

* 1 78 C9300X-48TX 17.09.04a CAT9K_IOSXE INSTALL

2 78 C9300X-48TX 17.09.04a CAT9K_IOSXE INSTALL

Switch 02

---------

Switch uptime : 9 minutes

Base Ethernet MAC Address : 68:e5:9e:7c:f3:00

Motherboard Assembly Number : 73-20261-04

Motherboard Serial Number : FOC272860SZ

Model Revision Number : E0

Motherboard Revision Number : B0

Model Number : C9300X-48TX

System Serial Number : FOC2729Y23U

Last reload reason : Reload Command

CLEI Code Number : INMGG00CRB

END OF SWITCHES 2 & 3 OUTPUT

balaji.bandi · ‎12-22-2023

looks good, can you post the configuration for the switch and also refer below troubleshooting guide :

Problem - C9300X Mixed Stack Splits into Sub-rings / Mismatched Stack Speeds

https://www.cisco.com/c/en/us/support/docs/switches/catalyst-9300-series-switches/217684-verify-and-troubleshoot-stackwise-on-cat.html

BB

***** Rate All Helpful Responses *****

How to Ask The Cisco Community for Help

rpanus · ‎12-22-2023

SWITCHES 1 & 4

Switch#show mod

Switch Ports Model Serial No. MAC address Hw Ver. Sw Ver.

------ ----- --------- ----------- -------------- ------- --------

1 54 C9300X-24Y FJC27311JKW 8c94.6135.7180 V02 17.09.04a

2 54 C9300X-24Y FJC27311GWV 6879.095b.7780 V02 17.09.04a

Switch#

Switch#sh swi

Switch/Stack Mac Address : 8c94.6135.7180 - Local Mac Address

Mac persistency wait time: Indefinite

H/W Current

Switch# Role Mac Address Priority Version State

-------------------------------------------------------------------------------------

*1 Active 8c94.6135.7180 15 V02 Ready

2 Member 6879.095b.7780 12 V02 Ready

Switch#sh swi st

Switch#sh swi stack-p

Switch# Port1 Port2

----------------------------

1 DOWN OK

2 OK DOWN

Switch#

Switch#sh ver

Cisco IOS XE Software, Version 17.09.04a

Cisco IOS Software [Cupertino], Catalyst L3 Switch Software (CAT9K_IOSXE), Version 17.9.4a, RELEASE SOFTWARE (fc3)

Technical Support: http://www.cisco.com/techsupport

Compiled Fri 20-Oct-23 10:44 by mcpre

ROM: IOS-XE ROMMON

BOOTLDR: System Bootstrap, Version 17.9.1r, RELEASE SOFTWARE (P)

Switch uptime is 12 minutes

Uptime for this control processor is 16 minutes

System returned to ROM by Reload Command

System image file is "flash:packages.conf"

Last reload reason: Reload Command

Technology Package License Information:

------------------------------------------------------------------------------

Technology-package Technology-package

Current Type Next reboot

------------------------------------------------------------------------------

network-essentials Smart License network-essentials

dna-essentials Subscription Smart License dna-essentials

AIR License Level: AIR DNA Advantage

Next reload AIR license Level: AIR DNA Advantage

Smart Licensing Status: Smart Licensing Using Policy

cisco C9300X-24Y (X86) processor with 1310642K/6147K bytes of memory.

Processor board ID FJC27311JKW

1 Virtual Ethernet interface

16 Ten Gigabit Ethernet interfaces

80 TwentyFive Gigabit Ethernet interfaces

8 Hundred Gigabit Ethernet interfaces

2048K bytes of non-volatile configuration memory.

16777216K bytes of physical memory.

1638400K bytes of Crash Files at crashinfo:.

1638400K bytes of Crash Files at crashinfo-2:.

11264000K bytes of Flash at flash:.

11264000K bytes of Flash at flash-2:.

Base Ethernet MAC Address : 8c:94:61:35:71:80

Motherboard Assembly Number : 73-19730-06

Motherboard Serial Number : FJZ2731MVJV

Model Revision Number : D0

Motherboard Revision Number : B0

Model Number : C9300X-24Y

System Serial Number : FJC27311JKW

CLEI Code Number : INMGP00CRB

Switch Ports Model SW Version SW Image Mode

------ ----- ----- ---------- ---------- ----

* 1 54 C9300X-24Y 17.09.04a CAT9K_IOSXE INSTALL

2 54 C9300X-24Y 17.09.04a CAT9K_IOSXE INSTALL

Switch 02

---------

Switch uptime : 16 minutes

Base Ethernet MAC Address : 68:79:09:5b:77:80

Motherboard Assembly Number : 73-19730-06

Motherboard Serial Number : FJZ2731R535

Model Revision Number : D0

Motherboard Revision Number : B0

Model Number : C9300X-24Y

System Serial Number : FJC27311GWV

Last reload reason : Reload Command

CLEI Code Number : INMGP00CRB

END OF SWITCHES 1 & 4 OUTPUT

SWITCHES 2 & 3

Switch#show modu

Switch Ports Model Serial No. MAC address Hw Ver. Sw Ver.

------ ----- --------- ----------- -------------- ------- --------

1 78 C9300X-48TX FOC2713YFHJ 6c29.d253.c800 V02 17.09.04a

2 78 C9300X-48TX FOC2729Y23U 68e5.9e7c.f300 V02 17.09.04a

Switch#

Switch#sh sw

Switch/Stack Mac Address : 6c29.d253.c800 - Local Mac Address

Mac persistency wait time: Indefinite

H/W Current

Switch# Role Mac Address Priority Version State

-------------------------------------------------------------------------------------

*1 Active 6c29.d253.c800 14 V02 Ready

2 Member 68e5.9e7c.f300 13 V02 Ready

Switch#sh swi stack-p

Switch# Port1 Port2

----------------------------

1 OK DOWN

2 DOWN OK

Switch#

Switch#sh ver

Cisco IOS XE Software, Version 17.09.04a

Cisco IOS Software [Cupertino], Catalyst L3 Switch Software (CAT9K_IOSXE), Version 17.9.4a, RELEASE SOFTWARE (fc3)

Technical Support: http://www.cisco.com/techsupport

Compiled Fri 20-Oct-23 10:44 by mcpre

ROM: IOS-XE ROMMON

BOOTLDR: System Bootstrap, Version 17.9.1r, RELEASE SOFTWARE (P)

Switch uptime is 5 minutes

Uptime for this control processor is 9 minutes

System returned to ROM by Reload Command

System image file is "flash:packages.conf"

Last reload reason: Reload Command

Technology Package License Information:

------------------------------------------------------------------------------

Technology-package Technology-package

Current Type Next reboot

------------------------------------------------------------------------------

network-essentials Smart License network-essentials

dna-essentials Subscription Smart License dna-essentials

AIR License Level: AIR DNA Advantage

Next reload AIR license Level: AIR DNA Advantage

Smart Licensing Status: Smart Licensing Using Policy

cisco C9300X-48TX (X86) processor with 1310642K/6147K bytes of memory.

Processor board ID FOC2713YFHJ

1 Virtual Ethernet interface

112 Ten Gigabit Ethernet interfaces

32 TwentyFive Gigabit Ethernet interfaces

8 Hundred Gigabit Ethernet interfaces

2048K bytes of non-volatile configuration memory.

16777216K bytes of physical memory.

1638400K bytes of Crash Files at crashinfo:.

1638400K bytes of Crash Files at crashinfo-2:.

11264000K bytes of Flash at flash:.

11264000K bytes of Flash at flash-2:.

3887698K bytes of USB Flash at usbflash0:.

Base Ethernet MAC Address : 6c:29:d2:53:c8:00

Motherboard Assembly Number : 73-20261-04

Motherboard Serial Number : FOC27070Y1R

Model Revision Number : E0

Motherboard Revision Number : B0

Model Number : C9300X-48TX

System Serial Number : FOC2713YFHJ

CLEI Code Number : INMGG00CRB

Switch Ports Model SW Version SW Image Mode

------ ----- ----- ---------- ---------- ----

* 1 78 C9300X-48TX 17.09.04a CAT9K_IOSXE INSTALL

2 78 C9300X-48TX 17.09.04a CAT9K_IOSXE INSTALL

Switch 02

---------

Switch uptime : 9 minutes

Base Ethernet MAC Address : 68:e5:9e:7c:f3:00

Motherboard Assembly Number : 73-20261-04

Motherboard Serial Number : FOC272860SZ

Model Revision Number : E0

Motherboard Revision Number : B0

Model Number : C9300X-48TX

System Serial Number : FOC2729Y23U

Last reload reason : Reload Command

CLEI Code Number : INMGG00CRB

END OF SWITCHES 2 & 3 OUTPUT

rpanus · ‎12-22-2023

This configuration command was the solution: "switch stack-speed high". Make sure that this configuration parameter is on all switch stack members. Thanks for everyone looking into this for me.