9800-40 stby reboot

richard.greene1 · ‎03-22-2021

active stays up, stby keeps rebooting

Initializing Hardware ...

System integrity status: 90170200 12030107

Current image running: Boot ROM0
Last reset cause: LocalSoft

C9800-40-K9 platform with 33554432 Kbytes of main memory

File size is 0x000015ef
Located packages.conf
Image size 5615 inode num 1286146, bks cnt 2 blk size 8*512
#
File size is 0x01faf507
Located C9800-rpboot.17.03.03.SPA.pkg
Image size 33223943 inode num 1286148, bks cnt 8112 blk size 8*512
####################################################################################################################################################################################################################################################################################################################################
Boot image size = 33223943 (0x1faf507) bytes

ROM:RSA Self Test Passed
ROM:Sha512 Self Test Passed

Package header rev 3 structure detected
Calculating SHA-1 hash...done
validate_package_cs: SHA-1 hash:
calculated b0287c0d:b3e6fde8:c7918b3b:d813115c:9cae11d2
expected b0287c0d:b3e6fde8:c7918b3b:d813115c:9cae11d2
Validating main package signatures

RSA Signed RELEASE Image Signature Verification Successful.
Image validated

Waiting for remote chassis to join

Chassis number is 2
All chassis in the stack have been discovered. Accelerating discovery
Mar 22 19:38:16.337: %PMAN-3-PROC_EMPTY_EXEC_FILE: R0/0: pvp: Empty executable used for process bt_logger
Mar 22 19:38:18.023: %PMAN-3-PROC_EMPTY_EXEC_FILE: R0/0: pvp: Empty executable used for process bt_logger
Mar 22 19:38:18.754: %PMAN-3-PROC_EMPTY_EXEC_FILE: R0/0: pvp: Empty executable used for process bt_logger
Mar 22 19:38:20.333: %PMAN-3-PROC_EMPTY_EXEC_FILE: R0/0: pvp: Empty executable used for process bt_logger
Mar 22 19:38:29.106: %PMAN-3-PROC_EMPTY_EXEC_FILE: R0/0: pvp: Empty executable used for process bt_logger
Mar 22 19:38:51.180: %PMAN-3-PROC_EMPTY_EXEC_FILE: R0/0: pvp: Empty executable used for process bt_logger

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

Cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software [Amsterdam], C9800 Software (C9800_IOSXE-K9), Version 17.3.3, RELEASE SOFTWARE (fc7)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2021 by Cisco Systems, Inc.
Compiled Thu 04-Mar-21 12:37 by mcpre

This software version supports only Smart Licensing as the software licensing mechanism.

PLEASE READ THE FOLLOWING TERMS CAREFULLY. INSTALLING THE LICENSE OR
LICENSE KEY PROVIDED FOR ANY CISCO SOFTWARE PRODUCT, PRODUCT FEATURE,
AND/OR SUBSEQUENTLY PROVIDED SOFTWARE FEATURES (COLLECTIVELY, THE
"SOFTWARE"), AND/OR USING SUCH SOFTWARE CONSTITUTES YOUR FULL
ACCEPTANCE OF THE FOLLOWING TERMS. YOU MUST NOT PROCEED FURTHER IF YOU
ARE NOT WILLING TO BE BOUND BY ALL THE TERMS SET FORTH HEREIN.

Your use of the Software is subject to the Cisco End User License Agreement
(EULA) and any relevant supplemental terms (SEULA) found at
http://www.cisco.com/c/en/us/about/legal/cloud-and-software/software-terms.html.

You hereby acknowledge and agree that certain Software and/or features are
licensed for a particular term, that the license to such Software and/or
features is valid only for the applicable term and that such Software and/or
features may be shut down or otherwise terminated by Cisco after expiration
of the applicable license term (e.g., 90-day trial period). Cisco reserves
the right to terminate any such Software feature electronically or by any
other means available. While Cisco may provide alerts, it is your sole
responsibility to monitor your usage of any such term Software feature to
ensure that your systems and networks are prepared for a shutdown of the
Software feature.

The default license boot level has been set to none

All TCP AO KDF Tests Pass
cisco C9800-40-K9 (1GL) processor (revision 1GL) with 3750951K/6147K bytes of memory.
Processor board ID TTM244406L4
Router operating mode: Autonomous
1 Virtual Ethernet interface
4 Ten Gigabit Ethernet interfaces
32768K bytes of non-volatile configuration memory.
33554432K bytes of physical memory.
24616959K bytes of eUSB flash at bootflash:.
24616959K bytes of eUSB flash at bootflash-1:.
234365527K bytes of SATA hard disk at harddisk:.
234365527K bytes of SATA hard disk at harddisk-1:.

Base Ethernet MAC Address : EC:CE:13:90:81:60

Installation mode is INSTALL

Press RETURN to get started!

Adding registry invocations for the WLC platform

*Mar 22 19:38:57.231: %SMART_LIC-6-AGENT_ENABLED: Smart Agent for Licensing is enabled
*Mar 22 19:38:57.295: %REDUNDANCY-3-PEER_MONITOR: PEER_FOUND event on standby
*Mar 22 19:39:12.570: mcp_pm_subsys_init : Init done sucessfullyRA Tracing tool registry return: 0
*Mar 22 19:39:12.838: BFD: brace register success
*Mar 22 19:39:13.739: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled for type vlan
*Mar 22 19:39:15.505: %CUBE-3-LICENSING: SIP trunking (CUBE) licensing is now based on dynamic sessions counting, static license capacity configuration through 'mode border-e lement license capacity' would be ignored.
*Mar 22 19:39:15.518: %SIP-1-LICENSING: CUBE license reporting period has been set to the minimum value of 8 hours.
*Mar 22 19:39:15.566: %CRYPTO_ENGINE-4-CSDL_COMPLIANCE_DISABLED: Cisco PSB security compliance has been disabled
*Mar 22 19:39:15.645: %VOICE_HA-7-STATUS: CUBE HA-supported platform detected.
*Mar 22 19:39:15.854: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to down
*Mar 22 19:39:15.956: mcp_pm_init_done : Called
*Mar 22 19:39:17.021: %ONEP_BASE-6-SS_ENABLED: ONEP: Service set Base was enabled by Default
Mar 22 19:39:21.751: cwan_pseudo_oir_insert_one: [0/0] ctrlr[16506] already analyzed
Mar 22 19:39:50.468: %SYS-7-NVRAM_INIT_WAIT_TIME: Waited 0 seconds for NVRAM to be available
Mar 22 19:39:50.623: %CRYPTO_ENGINE-5-KEY_ADDITION: A key named SLA-KeyPair has been generated or imported by crypto config
Mar 22 19:39:50.628: %CRYPTO_ENGINE-5-KEY_ADDITION: A key named TP-self-signed-565514959 has been generated or imported by crypto config
Mar 22 19:39:50.631: %CRYPTO_ENGINE-5-KEY_ADDITION: A key named XXXXXXXXXXXXXX has been generated or imported by crypto config
Mar 22 19:39:50.634: %CRYPTO_ENGINE-5-KEY_ADDITION: A key named SLA-KeyPair2 has been generated or imported by crypto config
Mar 22 19:39:51.154: %PKI-6-TRUSTPOINT_CREATE: Trustpoint: SLA-TrustPoint created succesfully
Mar 22 19:39:51.189: %PKI-6-TRUSTPOINT_CREATE: Trustpoint: TP-self-signed-565514959 created succesfully
Mar 22 19:39:51.216: %PKI-6-TRUSTPOINT_CREATE: Trustpoint: XXXXXXXXXXXX created succesfully
Mar 22 19:39:51.218: %PKI-6-TRUSTPOINT_CREATE: Trustpoint: XXXXXXXXXXXX created succesfully
Mar 22 19:39:51.312: %AAAA-4-CLI_DEPRECATED: WARNING: Command has been added to the configuration using a type 0 password. However, type 0 passwords will soon be deprecated. M igrate to a supported password type
Mar 22 19:39:51.334: %AAAA-4-CLI_DEPRECATED: WARNING: Command has been added to the configuration using a type 0 password. However, type 0 passwords will soon be deprecated. M igrate to a supported password type
Mar 22 19:39:51.513: %AAAA-4-CLI_DEPRECATED: WARNING: Command has been added to the configuration using a type 0 password. However, type 0 passwords will soon be deprecated. M igrate to a supported password type
Mar 22 19:39:51.513: %AAAA-4-CLI_DEPRECATED: WARNING: Command has been added to the configuration using a type 0 password. However, type 0 passwords will soon be deprecated. M igrate to a supported password type
Mar 22 19:39:51.514: %AAAA-4-CLI_DEPRECATED: WARNING: Command has been added to the configuration using a type 0 password. However, type 0 passwords will soon be deprecated. M igrate to a supported password type
Mar 22 19:39:51.514: %AAAA-4-CLI_DEPRECATED: WARNING: Command has been added to the configuration using a type 0 password. However, type 0 passwords will soon be deprecated. M igrate to a supported password type
Mar 22 19:39:51.521: %AAAA-4-CLI_DEPRECATED: WARNING: Command has been added to the configuration using a type 0 password. However, type 0 passwords will soon be deprecated. M igrate to a supported password type
Mar 22 19:39:51.522: %AAAA-4-CLI_DEPRECATED: WARNING: Command has been added to the configuration using a type 7 password. However, type 7 passwords will soon be deprecated. M igrate to a supported password type

Mar 22 19:39:51.643: %CRYPTO_ENGINE-5-KEY_REPLACE: A key named SLA-KeyPair has been replaced by crypto config with new key data
Mar 22 19:39:51.644: %SSH-5-DISABLED: SSH 1.99 has been disabled
Mar 22 19:39:51.653: %CRYPTO_ENGINE-5-KEY_REPLACE: A key named TP-self-signed-565514959 has been replaced by crypto config with new key data
Mar 22 19:39:51.662: %CRYPTO_ENGINE-5-KEY_REPLACE: A key named XXXXXXXXXXXX has been replaced by crypto config with new key data
Mar 22 19:39:51.672: %CRYPTO_ENGINE-5-KEY_REPLACE: A key named SLA-KeyPair2 has been replaced by crypto config with new key data
Mar 22 19:40:31.686: %SPA_OIR-6-OFFLINECARD: SPA (BUILT-IN-4X10G/1G) offline in subslot 0/0
Mar 22 19:40:31.690: %IOSXE_OIR-6-INSCARD: Card (fp) inserted in slot F0
Mar 22 19:40:31.690: %IOSXE_OIR-6-ONLINECARD: Card (fp) online in slot F0
Mar 22 19:40:31.732: %IOSXE_OIR-6-INSCARD: Card (cc) inserted in slot 0
Mar 22 19:40:31.732: %IOSXE_OIR-6-ONLINECARD: Card (cc) online in slot 0
Mar 22 19:40:32.002: %IOSXE_OIR-6-INSSPA: SPA inserted in subslot 0/0TSM Hook for PRE PLUGIN ANALYZE failed for slot/bay (00), status = 17
Mar 22 19:40:32.135: %IOSXE_OIR-3-SPA_INTF_ID_ALLOC_FAILED: Failed to allocate interface identifiers forSPA(BUILT-IN-4X10G/1G) in slot/bay: 0/0
Mar 22 19:40:34.461: %SSH-5-ENABLED: SSH 1.99 has been enabled
Mar 22 19:40:34.541: %SYS-5-RESTART: System restarted --
Cisco IOS Software [Amsterdam], C9800 Software (C9800_IOSXE-K9), Version 17.3.3, RELEASE SOFTWARE (fc7)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2021 by Cisco Systems, Inc.
Compiled Thu 04-Mar-21 12:37 by mcpre
Mar 22 19:40:37.604: %CRYPTO_ENGINE-5-KEY_ADDITION: A key named SLA-KeyPair.server has been generated or imported by crypto-engine
Mar 22 19:40:38.937: %SPA_OIR-6-ONLINECARD: SPA (BUILT-IN-4X10G/1G) online in subslot 0/0
Mar 22 19:40:39.009: %IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/0/1, link down due to remote fault
Mar 22 19:40:40.994: %LINK-3-UPDOWN: SIP0/0: Interface TenGigabitEthernet0/0/1, changed state to down
Mar 22 19:40:48.066: %PKI-4-NOAUTOSAVE: Configuration was modified. Issue "write memory" to save new certificate
ARNORTHWLC9800-stby>% Error in generating keys: could not generate test signature

Mar 22 19:41:02.887: %CRYPTO_ENGINE-3-CSDL_COMPLIANCE_FAIL_RSA: Cisco PSB security compliance violation is detected. Use of weak (1024 bit) key is denied
ARNORTHWLC9800-stby>
Chassis 2 reloading, reason - SESA: SESA AER Request not received, Err: 31
Mar 22 19:43:16.082: %PMAN-5-EXITACTION: F0/0: pvp: Process manager is exiting:
Mar 22 19:43:16.107: %PMAN-5-EXITACTION: C0/0: pvp: Process manager is exiting:
Mar 22 19:43:17.219: %PMAN-5-EXITvp: Process manager is exiting: process exit with reload fru code

then it repeats

pieterh · ‎03-24-2021

Mar 22 19:40:39.009: %IOSXE_SPA-6-UPDOWN: Interface TenGigabitEthernet0/0/1, link down due to remote fault
Mar 22 19:40:40.994: %LINK-3-UPDOWN: SIP0/0: Interface TenGigabitEthernet0/0/1, changed state to down

how are BOTH controllers connected to the neighboring switch ?

check the logs on these switches
and check/match the configuration on the controllers with this/these switches
looks there is something wrong here