Re: supervisor engine reload in 4500x series!!

yangtao · ‎12-03-2021

In our infrastructure we are using 4500x series switch, its configured with VSS Cluster.

Since last mouth standby supervisor engine got rebooted many times.

Can some one help me to fix this issue ?

marce1000 · ‎12-03-2021

- Check current software version on the 4500 models, use an advisory release (upgrade) , if applicable , check if that can help.

M.

-- Each morning when I wake up and look into the mirror I always say ' Why am I so brilliant ? '
When the mirror will then always repond to me with ' The only thing that exceeds your brilliance is your beauty! '

yangtao · ‎12-05-2021

I already update software version to cat4500e-universalk9.SPA.03.11.05.E.152-7.E5.bin(the newest version from Cisco), but the Standby switch still reboot by itself!

Leo Laohoo · ‎12-04-2021

@yangtao wrote:

44357  -rwx     2715397   Dec 3 2021 19:10:32 +00:00  crashinfo_iosd_20211203-190857-UTC
44362  -rwx    76704569   Dec 3 2021 19:10:34 +00:00  fullcore_iosd_20211203-190857-UTC
44359  -rwx     2720136   Dec 3 2021 06:25:59 +00:00  crashinfo_iosd_20211203-062425-UTC
44363  -rwx    76575238   Dec 3 2021 06:26:01 +00:00  fullcore_iosd_20211203-062425-UTC
44360  -rwx     2720470   Dec 3 2021 15:11:10 +00:00  crashinfo_iosd_20211203-150934-UTC
44361  -rwx    76619376   Dec 3 2021 15:11:12 +00:00  fullcore_iosd_20211203-150934-UTC

I want to see those crashinfo and fullcore files.

yangtao · ‎12-05-2021

yangtao · ‎12-05-2021

Leo Laohoo · ‎12-05-2021

@yangtao wrote:

===================== Exception Data ====================
Exception in 'iosd' with Signal=SIGABRT(6)
Frame Pointer=0x4AB507D0, Program Counter=0x1B954ECC
Thread ID=5126: -Traceback= 1#cf8400dfe0489ab9c1678e3d6ee6474e :100000+350 :100000+350 iosd_unix:1BD03000+23830 iosd_unix:1BD03000+23FA8 :100000+350 debugflag:1C2E6000+1A600 :1F758000+166B900 :1F758000+7845008 :1F758000+7845320 :1F758000+784572C :1F758000+7882814 :1F758000+6DBD7DC :1F758000+6DBA6D0 :1F758000+6DB2808 :1F758000+16563A0 :1F758000+1657E8C :1F758000+165A408 :1F758000+165DE68 :1F758000+6168FC0 :1F758000+6169644 :1F758000+151BFFC :1F758000+151C3E4 :1F758000+151CC58 :1F758000+151CB30
Execution time: sec=0 usec=11394
===================== log file: /mnt/pss/sup_sysmgr_reset.log =====================
<Sat Dec 4 00:05:33 2021> hap_sup_reset: Reason Code:[2] Reset Reason:Service [iosd] pid:[5126] terminated abnormally [6].

Raise a TAC Case and get them to verify if this is CSCuc71332.

yangtao · ‎12-05-2021

I already update software version to cat4500e-universalk9.SPA.03.11.05.E.152-7.E5.bin,but the Standby switch still reboot by itself!

yangtao · ‎12-05-2021

sh ver

ROM: 15.0(1r)SG12
JinQiao_IDC_4500X uptime is 4 weeks, 5 days, 19 hours, 14 minutes
Uptime for this control processor is 6 minutes
System returned to ROM by reload
System image file is "bootflash:cat4500e-universalk9.SPA.03.11.05.E.152-7.E5.bin"
Jawa Revision 3, Winter Revision 0x0.0x41

Last reload reason: Critical software exception

sh log

Dec 5 22:24:29.884: %C4K_REDUNDANCY-4-KEEPALIVE_WARNING: Keepalive messages from peer Supervisor are missing for 27 seconds
*Dec 5 22:24:33.208: %VSLP-3-VSLP_LMP_FAIL_REASON: Te1/1/31: Timeout (30000msec) waiting for Hello packet from peer
*Dec 5 22:24:33.208: %EC-5-UNBUNDLE: Interface TenGigabitEthernet1/1/31 left the port-channel Port-channel1
*Dec 5 22:24:33.210: %EC-5-UNBUNDLE: Interface TenGigabitEthernet2/1/31 left the port-channel Port-channel2
*Dec 5 22:24:33.239: %VSLP-3-VSLP_LMP_FAIL_REASON: Te1/1/32: Timeout (30000msec) waiting for Hello packet from peer
*Dec 5 22:24:33.239: %VSLP-2-VSL_DOWN: All VSL links went down while switch is in ACTIVE role

*Dec 5 22:24:33.240: %EC-5-UNBUNDLE: Interface TenGigabitEthernet1/1/32 left the port-channel Port-channel1
*Dec 5 22:24:33.248: %EC-5-UNBUNDLE: Interface TenGigabitEthernet2/1/32 left the port-channel Port-channel2
*Dec 5 22:24:34.118: %C4K_REDUNDANCY-3-COMMUNICATION: Communication with the peer Supervisor has been lost
*Dec 5 22:24:34.174: %EC-5-UNBUNDLE: Interface TenGigabitEthernet2/1/29 left the port-channel Port-channel5
*Dec 5 22:24:34.175: %FASTHELLO-2-FH_DOWN: Fast-Hello interface Te2/1/30 lost dual-active detection capability

*Dec 5 22:24:34.178: %EC-5-UNBUNDLE: Interface TenGigabitEthernet2/2/8 left the port-channel Port-channel3
*Dec 5 22:24:34.209: %C4K_REDUNDANCY-3-SIMPLEX_MODE: The peer Supervisor has been lost
*Dec 5 22:29:15.965: %C4K_IOSINTF-5-LMPHWSESSIONSTATE: Lmp HW session DOWN on slot 1 port 31.
*Dec 5 22:29:15.966: %C4K_IOSINTF-5-LMPHWSESSIONSTATE: Lmp HW session DOWN on slot 1 port 30.
*Dec 5 22:29:16.018: %C4K_IOSINTF-5-LMPHWSESSIONSTATE: Lmp HW session DOWN on slot 1 port 32.
*Dec 5 22:29:32.280: %FASTHELLO-2-FH_DOWN: Fast-Hello interface Te1/1/30 lost dual-active detection capability

*Dec 5 22:34:54.199: %C4K_IOSINTF-5-LMPHWSESSIONSTATE: Lmp HW session UP on slot 1 port 31.
*Dec 5 22:34:56.423: %C4K_IOSINTF-5-LMPHWSESSIONSTATE: Lmp HW session UP on slot 1 port 32.
*Dec 5 22:35:10.205: %VSLP-5-VSL_UP: Ready for control traffic

*Dec 5 22:35:13.239: %VSLP-5-RRP_ROLE_RESOLVED: Role resolved as ACTIVE by VSLP
*Dec 5 22:35:13.239: %EC-5-BUNDLE: Interface TenGigabitEthernet1/1/31 joined port-channel Port-channel1
*Dec 5 22:35:13.249: %EC-5-BUNDLE: Interface TenGigabitEthernet1/1/32 joined port-channel Port-channel1
*Dec 5 22:35:14.154: %C4K_REDUNDANCY-6-DUPLEX_MODE: The peer Supervisor has been detected
*Dec 5 22:35:54.696: %C4K_REDUNDANCY-6-MODE: ACTIVE supervisor initializing for sso mode
*Dec 5 22:35:55.177: %C4K_REDUNDANCY-3-COMMUNICATION: Communication with the peer Supervisor has been established
*Dec 5 22:35:55.231: %BUFCAP-6-SERVER_INIT: EPC SPI server init SUCCESSFUL
*Dec 5 22:35:55.231: %BUFCAP-6-CLIENT: EPC SPI client is BORN
*Dec 5 22:36:07.327: %C4K_REDUNDANCY-5-CONFIGSYNC: The config-reg has been successfully synchronized to the standby supervisor
*Dec 5 22:36:07.328: %C4K_REDUNDANCY-5-CONFIGSYNC: The startup-config has been successfully synchronized to the standby supervisor
*Dec 5 22:36:07.866: %C4K_REDUNDANCY-5-CONFIGSYNC: The private-config has been successfully synchronized to the standby supervisor
*Dec 5 22:36:08.672: %C4K_REDUNDANCY-5-CONFIGSYNC_RATELIMIT: The vlan database has been successfully synchronized to the standby supervisor
*Dec 5 22:36:47.407: %EC-5-BUNDLE: Interface TenGigabitEthernet2/1/31 joined port-channel Port-channel2
*Dec 5 22:36:47.433: %EC-5-BUNDLE: Interface TenGigabitEthernet2/1/32 joined port-channel Port-channel2
*Dec 5 22:36:51.836: %HA_CONFIG_SYNC-6-BULK_CFGSYNC_SUCCEED: Bulk Sync succeeded
*Dec 5 22:36:52.829: %RF-5-RF_TERMINAL_STATE: 1 ha_mgr: Terminal state reached for (SSO)
*Dec 5 22:36:52.075: %C4K_IOSMODPORTMAN-6-MODULEONLINE: STANDBY:Module 1 (WS-C4500X-32 S/N: JAE223601K8 Hw: 2.0) is online
*Dec 5 22:36:52.075: %C4K_IOSMODPORTMAN-6-MODULEONLINE: STANDBY:Module 2 (C4KX-NM-8 S/N: JAE22410QST Hw: 1.0) is online
*Dec 5 22:36:52.075: %C4K_IOSMODPORTMAN-6-MODULEONLINE: STANDBY:Module 11 (WS-C4500X-32 S/N: JAE22440F53 Hw: 2.0) is online
*Dec 5 22:36:52.075: %C4K_IOSMODPORTMAN-6-MODULEONLINE: STANDBY:Module 12 (C4KX-NM-8 S/N: JAE220106HY Hw: 1.0) is online
*Dec 5 22:37:00.410: %FASTHELLO-5-FH_UP: Fast-Hello interface Te1/1/30 status changed to link up

*Dec 5 22:37:00.414: %FASTHELLO-5-FH_UP: Fast-Hello interface Te2/1/30 status changed to link up

*Dec 5 22:37:00.508: %FASTHELLO-5-FH_DUAL_ACTIVE_CAP: Fast-Hello interface Te1/1/30 became dual-active detection capable

*Dec 5 22:37:00.249: %FASTHELLO-5-FH_UP: STANDBY: Fast-Hello interface Te2/1/30 status changed to link up

*Dec 5 22:37:00.418: %FASTHELLO-5-FH_UP: STANDBY: Fast-Hello interface Te1/1/30 status changed to link up

*Dec 5 22:37:00.419: %FASTHELLO-5-FH_DUAL_ACTIVE_CAP: STANDBY: Fast-Hello interface Te2/1/30 became dual-active detection capable
*Dec 5 22:37:01.417: %EC-5-BUNDLE: Interface TenGigabitEthernet2/2/8 joined port-channel Port-channel3
*Dec 5 22:37:01.435: %EC-5-BUNDLE: STANDBY:Interface TenGigabitEthernet2/2/8 joined port-channel Port-channel3
*Dec 5 22:37:03.415: %EC-5-BUNDLE: Interface TenGigabitEthernet2/1/29 joined port-channel Port-channel5
*Dec 5 22:37:03.515: %EC-5-BUNDLE: STANDBY:Interface TenGigabitEthernet2/1/29 joined port-channel Port-channel5