Re: 9200L Stack ring splits

jasonmeyer · ‎08-05-2022

I have a stack of 6 switches that on occasion the stack ring will split into 1 and 5. Running show switch gave me one member as ready and the others as removed. When I would try to console into one of the others, it was unresponsive or was in straggler mode. They are running 17.03.03. Is there a recommended version I should upgrade them to?

Reza Sharifi · ‎08-05-2022

Hi,

I recommend that you open a ticket with Cisco, as this issue possibly is a bug in the OS you are running. Cisco will provide a version you should upgrade to.

HTH

marce1000 · ‎08-05-2022

- Configure a syslog-server , then look at the logging received when all of that weird stuff starts happening.

M.

-- Each morning when I wake up and look into the mirror I always say ' Why am I so brilliant ? '
When the mirror will then always repond to me with ' The only thing that exceeds your brilliance is your beauty! '

jasonmeyer · ‎08-05-2022

have any recommendations for an open source syslog server?

marce1000 · ‎08-05-2022

- FYI : https://www.ittsystems.com/best-free-syslog-server-windows/

M.

-- Each morning when I wake up and look into the mirror I always say ' Why am I so brilliant ? '
When the mirror will then always repond to me with ' The only thing that exceeds your brilliance is your beauty! '

jasonmeyer · ‎08-05-2022

nvm, kiwi seems to be pretty highly regarded.

Reza Sharifi · ‎08-05-2022

Splunk is very good, and I think you can use a trial version for free.

https://www.splunk.com/en_us/download/splunk-enterprise.html?utm_campaign=google_amer_en_search_generic_devops&utm_source=google&utm_medium=cpc&utm_content=Splunk_Enterprise_Demo&utm_term=syslog&_bk=syslog&_bt=447289786777&_bm=p&_bn=g&_bg=10316322307...

HTH

jasonmeyer · ‎08-05-2022

OK I have Kiwi syslog setup and configured on the stack to send to it. Thanks for the suggestions.

N-Chan · ‎08-05-2022

Hello Jason,

These might be silly questions but how are your Stacking cables wired? Are they tightly secured in the back?

Are there any errors messages when you have your console cable in the other stack?

See if you can diagnose with "show switch stack-ports" (optional: summary; detail)

jasonmeyer · ‎08-05-2022

They are tightly-secured and all ports are active.

Leo Laohoo · ‎08-05-2022

Please post the complete output to the following commands (especially from the straggler):

sh version
dir flash:
dir flash:core
dir crashinfo:

Remember, I want to see the above output from the stack and from the straggler unit.

jasonmeyer · ‎08-05-2022

Thats the thing, 5 out of the 6 switches in the stack go to straggler mode. Got the stack sending logs to a syslog server now, so hopefully I will catch it next time it happens.

Leo Laohoo · ‎08-05-2022

@jasonmeyer wrote:
Got the stack sending logs to a syslog server now, so hopefully I will catch it next time it happens.

Look for the outputs I have requested. Those file(s) are all stored in each member of the stack.

jasonmeyer · ‎09-12-2022

Well happened again. In my syslogs I found this.

2022-09-11 07:57:08 Local7.Info 10.248.254.34 33: Sep 11 12:57:04.889: %PLATFORM-6-HASTATUS: RP switchover, received chassis event to become active
2022-09-11 07:57:08 Local7.Error 10.248.254.34 34: Sep 11 12:57:04.891: %REDUNDANCY-3-SWITCHOVER: RP switchover (PEER_NOT_PRESENT)
2022-09-11 07:57:08 Local7.Error 10.248.254.34 35: Sep 11 12:57:04.915: %REDUNDANCY-3-SWITCHOVER: RP switchover (PEER_DOWN)
2022-09-11 07:57:08 Local7.Error 10.248.254.34 36: Sep 11 12:57:04.915: %REDUNDANCY-3-SWITCHOVER: RP switchover (PEER_REDUNDANCY_STATE_CHANGE)
2022-09-11 07:57:08 Local7.Info 10.248.254.34 37: Sep 11 12:57:05.394: %PLATFORM-6-HASTATUS: RP switchover, sent message became active. IOS is ready to switch to primary after chassis confirmation
2022-09-11 07:57:08 Local7.Warning 10.248.254.34 38: Sep 11 12:57:04.262: %STACKMGR-4-SWITCH_REMOVED: Switch 1 R0/0: stack_mgr: Switch 2 has been removed from the stack.
2022-09-11 07:57:08 Local7.Info 10.248.254.34 39: Sep 11 12:57:05.849: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
2022-09-11 07:57:08 Local7.Info 10.248.254.34 40: Sep 11 12:57:05.939: %PLATFORM-6-HASTATUS: RP switchover, received chassis event became active
2022-09-11 07:57:08 Local7.Alert 10.248.254.34 41: Sep 11 12:57:05.973: %PLATFORM_FEP-1-FRU_PS_SIGNAL_OK: Switch 1: signal on power supply A is restored
2022-09-11 07:57:08 Local7.Info 10.248.254.34 42: Sep 11 12:57:06.050: %PLATFORM-6-HASTATUS_DETAIL: RP switchover, received chassis event became active. Switch to primary (count 2)
2022-09-11 07:57:08 Local7.Info 10.248.254.34 43: Sep 11 12:57:06.055: %HA-6-SWITCHOVER: Route Processor switched from standby to being active
2022-09-11 07:57:08 Local7.Info 10.248.254.34 44: Sep 11 12:57:05.485: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 1 on Switch 1 is down
2022-09-11 07:57:08 Local7.Info 10.248.254.34 45: Sep 11 12:57:05.486: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is down
2022-09-11 07:57:08 Local7.Notice 10.248.254.34 46: Sep 11 12:57:07.224: %HMANRP-5-CHASSIS_DOWN_EVENT: Chassis 2 gone DOWN!

In Show Ver I see this for switch 2.

Last reload reason : stack merge due to incompatiblity

Which brought me to https://bst.cisco.com/bugsearch/bug/CSCvq56135

In looking at the affected/fixed, the ver I am running is in the fixed, but its not the newest.Running 17.03.05.