Cisco 3850 stack member 1 current state stuck on syncing and stack member 2 stuck at sync not started.

[VK20]

Its a ws-c3850-48t

My member 4 and 3 are stuck at syncing after power outage. 

Why is the config not syncing?

Tried reloading and unplugging the cables.

Should I remove the stack member ? Then plug the cable back in?

Something like: https://vmguru.com/2010/03/hot-adding-or-removing-a-cisco-3750-from-a-stack/

I am sorry I am new to this.

Switch/Stack Mac Address : 0XXX.0XXX.0X80 - Local Mac Address
Mac persistency wait time: Indefinite
H/W Current
Switch# Role Mac Address Priority Version State
------------------------------------------------------------
*1 Active 5006.ab36.XXXX 1 V06 Ready
2 Standby 9c57.add0.XXXX 1 V06 Ready
3 Member 5006.ab18.XXXX 1 0 Syncing
4 Member 5006.ab50.XXXX 1 0 Sync not started

#show switch stack-ports

Switch# Port1 Port2
----------------------------
1 OK OK
2 OK OK
3 OK OK
4 OK OK

#show switch neighbors
Switch # Port 1 Port 2
-------- ------ ------
1 2 4
2 3 1
3 4 2
4 1 3

[Martin L]

looks like 3 is stuck on something.  How did u turn 3 and 4 on? both at the same time or 3 then 4?  try power on 3 only, 4 is off. to see what happens. if not good, turn 4 while 3 is off.

right now u can console to 3 only to see what;s going on.  if u cannot , see sw 1 loggs ( i think show log | in STACK  would help u limit output).  either switch should give u some log error/message. 

if sw 3 is in switch mode (rommon mode), then type boot to start booting

connections look good, cables should be ok unless u think some1 damaged them.

Regards, ML
**Please Rate All Helpful Responses **

[VK20]

Thank you for the response.

I don't see much info related to stack manager.

I see the switch getting removed and getting back online and shows as ready in the logs.

Because I reloaded the members one by one.

* 16:23:55.688: %STACKMGR-1-SWITCH_ADDED: 1 stack-mgr: Switch 3 has been added to the stack.
* 16:23:55.690: %STACKMGR-1-SWITCH_ADDED: MEMBER: 4 stack-mgr: Switch 3 has been added to the stack.
* 16:23:55.680: %STACKMGR-1-SWITCH_ADDED: STANDBY:2 stack-mgr: Switch 3 has been added to the stack. (stack-XXXX-2)
* 16:24:05.533: %STACKMGR-1-SWITCH_READY: MEMBER: 4 stack-mgr: Switch 3 is ready.
* 16:24:06.755: %STACKMGR-1-SWITCH_READY: STANDBY:2 stack-mgr: Switch 3 is ready. (stack-XXXX-2)
* 16:24:17.808: %STACKMGR-1-SWITCH_READY: 1 stack-mgr: Switch 3 is ready.* 15:45:46.834: %STACKMGR-1-SWITCH_REMOVED: MEMBER: 3 stack-mgr: Switch 4 has been removed from the stack.
* 15:51:13.539: %STACKMGR-1-STACK_LINK_CHANGE: 1 stack-mgr: Stack port 2 on switch 1 is up
* 15:51:13.567: %STACKMGR-1-STACK_LINK_CHANGE: MEMBER: 3 stack-mgr: Stack port 1 on switch 3 is up
* 15:51:18.168: %STACKMGR-1-SWITCH_ADDED: 1 stack-mgr: Switch 4 has been added to the stack.
* 15:51:18.195: %STACKMGR-1-SWITCH_ADDED: MEMBER: 3 stack-mgr: Switch 4 has been added to the stack.
* 15:51:18.166: %STACKMGR-1-SWITCH_ADDED: STANDBY:2 stack-mgr: Switch 4 has been added to the stack. (stack-XXXX-2)
* 15:51:28.002: %STACKMGR-1-SWITCH_READY: STANDBY:2 stack-mgr: Switch 4 is ready. (stack-XXXX-2)
* 15:51:29.257: %STACKMGR-1-SWITCH_READY: MEMBER: 3 stack-mgr: Switch 4 is ready.
* 15:51:40.197: %STACKMGR-1-SWITCH_READY: 1 stack-mgr: Switch 4 is ready.
* 16:18:21.763: %STACKMGR-1-RELOAD_REQUEST: 1 stack-mgr: Received reload request for switch 3, reason Reload Slot Command
* 16:18:21.794: %STACKMGR-1-RELOAD: MEMBER: 3 stack-mgr: Reloading due to reason Reload Slot Command
* 16:18:22.022: %STACKMGR-1-STACK_LINK_CHANGE: MEMBER: 4 stack-mgr: Stack port 2 on switch 4 is down
* 16:18:22.023: %STACKMGR-1-SWITCH_REMOVED: 1 stack-mgr: Switch 3 has been removed from the stack.
* 16:18:22.021: %STACKMGR-1-STACK_LINK_CHANGE: STANDBY:2 stack-mgr: Stack port 1 on switch 2 is down (stack-XXXX-2)
* 16:18:22.021: %STACKMGR-1-SWITCH_REMOVED: STANDBY:2 stack-mgr: Switch 3 has been removed from the stack. (stack-XXXX-2)
* 16:18:22.025: %STACKMGR-1-SWITCH_REMOVED: MEMBER: 4 stack-mgr: Switch 3 has been removed from the stack.
* 16:23:51.117: %STACKMGR-1-STACK_LINK_CHANGE: MEMBER: 4 stack-mgr: Stack port 2 on switch 4 is up
* 16:23:51.107: %STACKMGR-1-STACK_LINK_CHANGE: STANDBY:2 stack-mgr: Stack port 1 on switch 2 is up (stack-XXXX-2)
* 16:23:55.688: %STACKMGR-1-SWITCH_ADDED: 1 stack-mgr: Switch 3 has been added to the stack.
* 16:23:55.690: %STACKMGR-1-SWITCH_ADDED: MEMBER: 4 stack-mgr: Switch 3 has been added to the stack.
* 16:23:55.680: %STACKMGR-1-SWITCH_ADDED: STANDBY:2 stack-mgr: Switch 3 has been added to the stack. (stack-XXXX-2)
* 16:24:05.533: %STACKMGR-1-SWITCH_READY: MEMBER: 4 stack-mgr: Switch 3 is ready.
* 16:24:06.755: %STACKMGR-1-SWITCH_READY: STANDBY:2 stack-mgr: Switch 3 is ready. (stack-XXXX-2)
* 16:24:17.808: %STACKMGR-1-SWITCH_READY: 1 stack-mgr: Switch 3 is ready.

[Leo Laohoo]

---

@VK20 wrote:

03.02.03

---

Most likely to be a firmware bug.  I'd upgrade the stack to a more recent version.  

[balaji.bandi]

I have seen this kind of issue. 

you have priority set all to 1, so whoever comes first the elect as master

if downtime is acceptable, i will pull all the device power, and start bringing up one by one from master/standby / member /member

once stack boots up correctly and working, when you get another chance, change the priory of the switch

master 10

standby 9

member 1

member 1

[Leo Laohoo]

What firmware is the stack running on?

[VK20]

Cisco IOS Software, IOS-XE Software, Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 03.02.03.SE RELEASE SOFTWARE (fc2)

[Martin L]

is this still an issue? if not, what was happening? and how u solved it?

[VK20]

Not yet resolved.

[balaji.bandi]

have you followed the step i have posted, and what is the outcome of the test

can you post complete logs connecting console cable if not resolved yet?

[VK20 · Accepted solution]

This has been resolved.

Finally we rebooted the entire stack. 

And it fixed the issue.

I tried bring the members online one by one but that didn't help, I started seeing switch3 error in the logs.

Finally after reload of entire stack fixed the issues.

I really feel awesome about this community that will come together to help a newbie.

Thank you everyone.

[Martin L]

Good to know; you still need to fix priority #s or this may happen next time; I would go by MACs and make Top switch #1 as Master, 2nd from the top "backup"
I think commands are sw 1 priority 15, sw 2 priority 10 , then your output should look like:
*1 Active 5006.ab36.XXXX 15 V06 Ready
2 Standby 9c57.add0.XXXX 10 V06 Ready