Added 3rd member to stack and 2nd switch reporting odd.

[brianw360]

Good day all.

Added a 3rd member to a stack (24 ports on each switch) and all the ports show up in SHO INT STATUS, but the second switch does not show in SHO VER.  And our LogicMonitor is showing  "Stack Port StackSub-St1-2 ON OR227-XAH1 is down."

The cabling is identical to the image below. We are waiting on a 48 port switch to consolidate two smaller switches.

Switch Ports Model SW Version SW Image Mode
------ ----- ----- ---------- ---------- ----
1 41 C9300-24P 16.12.4 CAT9K_IOSXE INSTALL
* 2 41 C9300-24P 16.12.4 CAT9K_IOSXE INSTALL
3 41 C9300-24P 16.12.4 CAT9K_IOSXE INSTALL

Switch 01
---------
Switch uptime : 46 weeks, 5 days, 16 hours, 30 minutes

Base Ethernet MAC Address : ac:3a:67:67:f9:00
Motherboard Assembly Number : 73-18271-04
Motherboard Serial Number : X.X.X
Model Revision Number : A0
Motherboard Revision Number : A0
Model Number : C9300-24P
System Serial Number : X.X.X
Last reload reason : PowerOn

Switch 03  <<<<<<<<<<<<<<<<<   Where's switch 02?
---------
Switch uptime : 2 hours, 10 minutes

Base Ethernet MAC Address : 44:ae:25:8a:17:00
Motherboard Assembly Number : 73-19912-03
Motherboard Serial Number : X.X.X
Model Revision Number : A0
Motherboard Revision Number : A0
Model Number : C9300-24P
System Serial Number : X.X.X
Last reload reason : PowerOn

Configuration register is 0x102

OR227-XAH1#

Any ideas?

TIA

[Reza Sharifi]

Hi,

In the image you posted, I don't see a cable between switc-2 and 3. Can you verify?

HTH

[brianw360]

Would that not be "2" in the picture??  That goes from the middle switch to the bottom switch.

[Reza Sharifi]

So, usually, you connect two stacking cables to each switch.

So,

sw1 to sw2

sw2 to sw3

sw3 to sw1

HTH

[brianw360]

OR227-XAH1#show switch stack-ring speed

Stack Ring Speed : 240G
Stack Ring Configuration: Half
Stack Ring Protocol : StackWise

[brianw360]

Usually, but the attached image is from a Cisco web site...and of course I cannot find the link because I took a screenshot.  But here's the other diagram.  

[william.cooper555]

Is switch 2 the active switch? That will show further up in the show version. 

Can you post the output off 'show switch detail'

[brianw360]

In the original post "* 2 41 C9300-24P 16.12.4 CAT9K_IOSXE INSTALL" show that switch 2 is the master indicated by the "*" to my knowledge.

I appreciate you chiming in!!!!

[brianw360]

OR227-XAH1#sho int status

Port Name Status Vlan Duplex Speed Type
Gi1/0/1 OR227-AP464 connected 901 a-full a-1000 10/100/1000BaseTX
Gi1/0/2 OR227-AP616 connected 901 a-full a-1000 10/100/1000BaseTX
Gi1/0/3 OR227-AP617 connected 901 a-full a-1000 10/100/1000BaseTX
Gi1/0/4 OR227-AP618 connected 901 a-full a-1000 10/100/1000BaseTX
Gi1/0/5 OR227-AP619 connected 901 a-full a-1000 10/100/1000BaseTX
Gi1/0/6 OR227-AP622 connected 901 a-full a-1000 10/100/1000BaseTX
Gi1/0/7 OR227-AP623 connected 901 a-full a-1000 10/100/1000BaseTX
Gi1/0/8 OR227-AP180 connected 901 a-full a-1000 10/100/1000BaseTX
Gi1/0/9 CAMERA - TT8 connected 700 a-full a-100 10/100/1000BaseTX
Gi1/0/10 CAMERA connected 700 a-full a-100 10/100/1000BaseTX
Gi1/0/11 CAMERA connected 700 a-full a-100 10/100/1000BaseTX
Gi1/0/12 SECURITY_CAMERA connected 701 a-full a-100 10/100/1000BaseTX
Gi1/0/13 CAMERA - TT8 connected 700 a-full a-100 10/100/1000BaseTX
Gi1/0/14 CAMERA - TT8 connected 700 a-full a-100 10/100/1000BaseTX
Gi1/0/15 ALERTUS connected 450 full 10 10/100/1000BaseTX
Gi1/0/16 LM: TEMP Switch RO connected trunk a-full a-1000 10/100/1000BaseTX
Gi1/0/17 OR227-CNVS187 connected 52 a-full a-1000 10/100/1000BaseTX
Gi1/0/18 DECODER - TT13 connected 700 a-full a-1000 10/100/1000BaseTX
Gi1/0/19 LM: TEMP Ro13 Wrpr connected trunk a-full a-1000 10/100/1000BaseTX
Gi1/0/20 OR227-CNVS205 & CI connected 201 a-full a-100 10/100/1000BaseTX
Gi1/0/21 OR227-CNVS114X & C connected 201 a-full a-1000 10/100/1000BaseTX
Gi1/0/22 connected 201 a-full a-1000 10/100/1000BaseTX
Gi1/0/23 CAMERA connected 700 a-full a-100 10/100/1000BaseTX
Gi1/0/24 OR227-UPSXAH1 connected 930 a-full a-100 10/100/1000BaseTX
Te1/1/1 LM: OR227-DXAC1 - connected trunk full 10G SFP-10GBase-LR
Te1/1/2 disabled 1 auto auto unknown
Te1/1/3 disabled 1 auto auto unknown
Te1/1/4 disabled 1 auto auto unknown
Te1/1/5 disabled 1 auto auto unknown
Te1/1/6 disabled 1 auto auto unknown
Te1/1/7 disabled 1 auto auto unknown
Te1/1/8 disabled 1 auto auto unknown
Ap1/0/1 disabled 1 auto auto App-hosting port
Gi2/0/1 CAMERA - TT8 notconnect 700 auto auto 10/100/1000BaseTX
Gi2/0/2 CAMERA - TT13 connected 700 a-full a-100 10/100/1000BaseTX
Gi2/0/3 CAMERA - TT13 connected 700 a-full a-100 10/100/1000BaseTX
Gi2/0/4 CAMERA - TT13 connected 700 a-full a-100 10/100/1000BaseTX
Gi2/0/5 CAMERA - TT13 connected 700 a-full a-100 10/100/1000BaseTX
Gi2/0/6 CAMERA - TT13 connected 700 a-full a-100 10/100/1000BaseTX
Gi2/0/7 CAMERA - TT13 connected 700 a-full a-100 10/100/1000BaseTX
Gi2/0/8 CAMERA - TT13 connected 700 a-full a-100 10/100/1000BaseTX
Gi2/0/9 CAMERA - TT13 connected 700 a-full a-100 10/100/1000BaseTX
Gi2/0/10 CAMERA notconnect 700 auto auto 10/100/1000BaseTX
Gi2/0/11 notconnect 201 auto auto 10/100/1000BaseTX
Gi2/0/12 notconnect 201 auto auto 10/100/1000BaseTX
Gi2/0/13 notconnect 201 auto auto 10/100/1000BaseTX
Gi2/0/14 notconnect 201 auto auto 10/100/1000BaseTX
Gi2/0/15 notconnect 201 auto auto 10/100/1000BaseTX
Gi2/0/16 notconnect 201 auto auto 10/100/1000BaseTX
Gi2/0/17 notconnect 201 auto auto 10/100/1000BaseTX
Gi2/0/18 notconnect 201 auto auto 10/100/1000BaseTX
Gi2/0/19 notconnect 201 auto auto 10/100/1000BaseTX
Gi2/0/20 notconnect 201 auto auto 10/100/1000BaseTX
Gi2/0/21 notconnect 201 auto auto 10/100/1000BaseTX

Port Name Status Vlan Duplex Speed Type
Gi2/0/22 notconnect 201 auto auto 10/100/1000BaseTX
Gi2/0/23 notconnect 201 auto auto 10/100/1000BaseTX
Gi2/0/24 notconnect 201 auto auto 10/100/1000BaseTX
Te2/1/1 LM: OR227-DXAC1 - connected trunk full 10G SFP-10GBase-LR
Te2/1/2 notconnect 1 auto auto unknown
Te2/1/3 notconnect 1 auto auto unknown
Te2/1/4 notconnect 1 auto auto unknown
Te2/1/5 notconnect 1 auto auto unknown
Te2/1/6 notconnect 1 auto auto unknown
Te2/1/7 notconnect 1 auto auto unknown
Te2/1/8 notconnect 1 auto auto unknown
Ap2/0/1 connected 1 a-full a-1000 App-hosting port
Gi3/0/1 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/2 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/3 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/4 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/5 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/6 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/7 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/8 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/9 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/10 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/11 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/12 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/13 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/14 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/15 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/16 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/17 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/18 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/19 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/20 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/21 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/22 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/23 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/0/24 notconnect 1 auto auto 10/100/1000BaseTX
Gi3/1/1 notconnect 1 auto auto unknown
Gi3/1/2 notconnect 1 auto auto unknown
Te3/1/3 notconnect 1 auto auto unknown
Te3/1/4 notconnect 1 full 10G SFP-10GBase-LR
Ap3/0/1 connected 1 a-full a-1000 App-hosting port
Po1 OR227-DXAC1 connected trunk a-full a-10G N/A

[william.cooper555]

You just need to post the output from

Show switch detail

[Leo Laohoo]

Look at the uptime of switch 1.  It is >4 months. 

Next, look at the firmware.  16.12.4.  

Yeah, add those two together and that is the answer to the problem. 

The stack is operating in a dangerous situation where switch 2 thinks it is all alone (aka "split brain") because the firmware used is the very buggy 16.12.4. 

[brianw360]

Leo!  My mentor...you just don't know it!

The original post Switch 01
---------
Switch uptime : 46 weeks, 5 days, 16 hours, 30 minutes

There's 52 weeks in a year correct?  This is 6 weeks shy.  A month a half at least.

Switch Ports Model SW Version SW Image Mode
------ ----- ----- ---------- ---------- ----
1 41 C9300-24P 16.12.4 CAT9K_IOSXE INSTALL
* 2 41 C9300-24P 16.12.4 CAT9K_IOSXE INSTALL
3 41 C9300-24P 16.12.4 CAT9K_IOSXE INSTALL

All switches have the same IOS version. Unless I'm missing something.  Okay...so the 16.12.4 version is buggy and I need the reference to influence a major corporation to change. (Georgia-Pacific who is owned by Koch Inc.) 

Leo you're a huge influencer in this community.  I follow you with out any reservation. 

Thank you for your insight.

[Leo Laohoo]

Do not use 16.10.X, 16.11.X nor 16.12.X. 

If you need to upgrade, go straight to the latest 17.9.X.