C3650 won't boot (smart license manager)

259147 · ‎03-03-2025

The WS-C3650-24PD-S switch keeps restarting itself repeatedly with action: rp processes exit with reload switch code
I've tried booting from USB flash drive with all of the old and new ISO versions for this model however the error codes are similar to the ones in the logs below:

logs1:

Booting...
Interface GE 0 link down***ERROR: PHY link is down

Getting rest of image
Reading full image into memory...Check base package header ...: done = 16384
Getting rest of image
Reading full image into memory....done
Reading full base package into memory...: done = 34844799
Bundle Image
--------------------------------------
Kernel Address : 0x537793c4
Kernel Size : 0x43880f/4425743
Initramfs Address : 0x53bb1bd3
Initramfs Size : 0x1ca9cac/30055596
Compression Format: mzip

Bootable image at @ ram:0x537793c4
Bootable image segment 0 address range [0x81100000, 0x81da6400] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 623
Loading Linux kernel with entry point 0x818968e0 ...
Bootloader: Done loading app on core_mask: 0xf

### Launching Linux Kernel (flags = 0x5)

Linux version 4.9.187 (deeratho@sjc-ads-3552) (gcc version 5.3.0 (GCC) ) #1 SMP Mon Dec 12 22:44:31 PST 2022
CVMSEG size: 2 cache lines (256 bytes)
Cavium Inc. SDK-5.1.0
bootconsole [early0] enabled
CPU0 revision is: 000d900a (Cavium Octeon II)
Checking for the multiply/shift bug... no.
Checking for the daddiu bug... no.
%IOSXEBOOT-b333d3ffa0ce8dc4cdd788ea6034645c-new_cksum: (rp/0): 4
%IOSXEBOOT-b333d3ffa0ce8dc4cdd788ea6034645c-saved_cksum: (rp/0): 4

Final tar file: mcu_ucode_bundle_8_1_0.tar
MM [0] MCU version 24 sw ver 0

Front-end Microcode IMG MGR: found 1 microcode images for 1 device.
Image for front-end 0: /tmp/microcode_update/front_end/fe_type_8_1 update needed: yes

Front-end Microcode IMG MGR: Preparing to program device microcode...
Front-end Microcode IMG MGR: Preparing to program device[0], index=0 ...88616 bytes.
Front-end Microcode IMG MGR: Programming device 0...
% Front-end Microcode IMG MGR: address 0, Could not enable sys_poll

% Front-end Microcode IMG MGR: unable to program device: 0
% Front-end Microcode IMG MGR: malformed microcode cache
Both links down, not waiting for other switches
Switch number is 1

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

Cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software [Gibraltar], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.12.9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2023 by Cisco Systems, Inc.
Compiled Mon 20-Mar-23 03:14 by mcpre

This software version supports only Smart Licensing as the software licensing mechanism.

PLEASE READ THE FOLLOWING TERMS CAREFULLY. INSTALLING THE LICENSE OR
LICENSE KEY PROVIDED FOR ANY CISCO SOFTWARE PRODUCT, PRODUCT FEATURE,
AND/OR SUBSEQUENTLY PROVIDED SOFTWARE FEATURES (COLLECTIVELY, THE
"SOFTWARE"), AND/OR USING SUCH SOFTWARE CONSTITUTES YOUR FULL
ACCEPTANCE OF THE FOLLOWING TERMS. YOU MUST NOT PROCEED FURTHER IF YOU
ARE NOT WILLING TO BE BOUND BY ALL THE TERMS SET FORTH HEREIN.

Your use of the Software is subject to the Cisco End User License Agreement
(EULA) and any relevant supplemental terms (SEULA) found at
http://www.cisco.com/c/en/us/about/legal/cloud-and-software/software-terms.html.

You hereby acknowledge and agree that certain Software and/or features are
licensed for a particular term, that the license to such Software and/or
features is valid only for the applicable term and that such Software and/or
features may be shut down or otherwise terminated by Cisco after expiration
of the applicable license term (e.g., 90-day trial period). Cisco reserves
the right to terminate any such Software feature electronically or by any
other means available. While Cisco may provide alerts, it is your sole
responsibility to monitor your usage of any such term Software feature to
ensure that your systems and networks are prepared for a shutdown of the
Software feature.

Feb 27 12:51:29.776: %PMAN-3-PROCHOLDDOWN: R0/0: The process platform_mgr has been helddown (rc 134)

FIPS: Flash Key Check : Begin
FIPS: Flash Key Check : End, Not Found, FIPS Mode Not Enabled

All TCP AO KDF Tests Pass
cisco WS-C3650-24PD (MIPS) processor (revision W0) with 794816K/6147K bytes of memory.
Processor board ID FDO2332M0DT
2048K bytes of non-volatile configuration memory.
4194304K bytes of physical memory.
252000K bytes of Crash Files at crashinfo:.
1611414K bytes of Flash at flash:.
491392K bytes of USB Flash at usbflash0:.
0K bytes of WebUI ODM Files at webui:.

Base Ethernet MAC Address : 2c:f8:9b:3e:0e:80
Motherboard Assembly Number : 73-15894-07
Motherboard Serial Number : FDO233115JU
Model Revision Number : W0
Motherboard Revision Number : A0
Model Number : WS-C3650-24PD
System Serial Number : FDO2332M0DT

Chassis 1 reloading, reason - Critical process crash
reload fp action requested

Press RETURN to get started!

*Feb 27 12:51:30.339: Rommon debug: debugFlagsStr[1], flags[0x1]
*Feb 27 12:51:32.762: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Feb 27 12:51:34.212: %IOSD_INFRA-6-IFS_DEVICE_OIR: Device usbflash0 added
*Feb 27 12:51:35.498: %SMART_LIC-6-AGENT_READY: Smart Agent for Licensing is initialized
*Feb 27 12:51:35.499: %SMART_LIC-6-AGENT_ENABLED: Smart Agent for Licensing is enabled
*Feb 27 12:51:35.501: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Feb 27 12:51:38.398: %SMART_LIC-6-HA_ROLE_CHANGED: Smart Agent HA role changed to Active.RA Tracing tool registry return: 0
*Feb 27 12:51:48.604: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled for type vlan
*Feb 27 12:51:50.251: %LINK-3-UPDOWN: Interface Lsmpi18/3, changed state to up
*Feb 27 12:51:50.253: %LINK-3-UPDOWN: Interface EOBC18/1, changed state to up
*Feb 27 12:51:50.255: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to down
*Feb 27 12:51:50.255: %LINK-3-UPDOWN: Interface LIIN18/2, changed state to up
*Feb 27 12:51:50.611: %HMANRP-6-HMAN_IOS_CHANNEL_INFO: HMAN-IOS channel event for switch 1: EMP_RELAY: Channel UP!
*Feb 27 12:51:50.616: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
*Feb 27 12:51:10.281: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 1 on Switch 1 is nocable
*Feb 27 12:51:10.281: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is down
*Feb 27 12:51:10.282: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is nocable
*Feb 27 12:51:10.282: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 27 12:51:14.514: %PLATFORM_MGR-1-PLATMGR_INIT_FAIL: Switch 1 R0/0: platform_mgr: Platform Manager: MCU application initialization failed.
*Feb 27 12:51:15.596: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 27 12:51:17.599: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 27 12:51:17.600: %STACKMGR-6-ACTIVE_ELECTED: Switch 1 R0/0: stack_mgr: Switch 1 has been elected ACTIVE.
*Feb 27 12:51:29.662: %PMAN-3-PROCHOLDDOWN: Switch 1 R0/0: root: The process platform_mgr has been helddown (rc 134)
*Feb 27 12:51:50.626: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
*Feb 27 12:51:51.312: %LINEPROTO-5-UPDOWN: Line protocol on Interface Lsmpi18/3, changed state to up
*Feb 27 12:51:51.312: %LINEPROTO-5-UPDOWN: Line protocol on Interface EOBC18/1, changed state to up
*Feb 27 12:51:51.313: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0, changed state to up
*Feb 27 12:51:51.313: %LINEPROTO-5-UPDOWN: Line protocol on Interface LIIN18/2, changed state to up
*Feb 27 12:51:52.508: %LINEPROTO-5-UPDOWN: Line protocol on Interface Vlan1, changed state to down
*Feb 27 12:51:54.875: %SYS-6-STARTUP_CONFIG_IGNORED: System startup configuration is ignored based on the configuration register setting.
*Feb 27 12:51:55.512: %SYS-5-CONFIG_P: Configured programmatically by process CPP MQC QoS Policy manager from console as vty2
*Feb 27 12:51:55.698: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to up
*Feb 27 12:51:55.764: %IOSXE_MGMTVRF-3-AFI_ATTACH_FAIL: Management VRF AFI ipv6 attach failed
*Feb 27 12:51:55.839: %SYS-5-CONFIG_P: Configured programmatically by process MGMT VRF Process from console as vty0
*Feb 27 12:51:55.851: %IOSXE_MGMTVRF-6-CREATE_SUCCESS_INFO: Management vrf Mgmt-vrf created with ID 1, ipv4 table-id 0x1, ipv6 table-id 0x1E000001
*Feb 27 12:51:55.854: %SYS-5-CONFIG_P: Configured programmatically by process MGMT VRF Process from console as vty0
*Feb 27 12:51:56.810: %PMAN-0-PROCFAILCRIT: Switch 1 R0/0: pvp: A critical process platform_mgr has failed (rc 134)
*Feb 27 12:51:57.681: %EVENT_TRACE-6-ENABLE: Trace already enabled.
*Feb 27 12:51:57.681: %EVENT_TRACE-6-ENABLE: Trace already enabled.
*Feb 27 12:51:57.682: %EVENT_TRACE-6-ENABLE: Trace already enabled.
*Feb 27 12:51:57.683: %EVENT_TRACE-6-ENABLE: Trace already enabled.
*Feb 27 12:51:57.600: %PMAN-3-RELOAD_SYSTEM: Switch 1 R0/0: pvp: Reloading: Peer switch is not standby ready. System will be reloaded
*Feb 27 12:51:57.813: %STACKMGR-1-RELOAD: Switch 1 R0/0: stack_mgr: Reloading due to reason Critical process crash
*Feb 27 12:51:58.402: %SYS-5-RESTART: System restarted --
Cisco IOS Software [Gibraltar], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.12.9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2023 by Cisco Systems, Inc.
Compiled Mon 20-Mar-23 03:14 by mcpre
*Feb 27 12:51:59.894: %LINK-3-UPDOWN: Interface Vlan1, changed state to up
*Feb 27 12:52:01.720: %SERVICES-3-INVALID_CHASFS: Switch 1 R0/0: btman_rotate_immediate: Thread 0xffe9f0d000 has no global chasfs context
*Feb 27 12:52:01.721: %SERVICES-2-NORESOLVE_ACTIVE: Switch 1 R0/0: btman_rotate_immediate: Error resolving active FRU: BINOS_FRU_RP
*Feb 27 12:52:02.265: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to down
*Feb 27 12:52:03.265: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0, changed state to down
*Feb 27 12:52:03.617: %ONEP_BASE-6-SS_ENABLED: ONEP: Service set Base was enabled by Default
*Feb 27 12:52:03.886: %PNP-6-PNP_DISCOVERY_STOPPED: PnP Discovery stopped (Startup Config Present)
*Feb 27 12:52:05.660: %SYS-5-CONFIG_P: Configured programmatically by process EPM CREATE DEFAULT CWA URL ACL from console as consolerp processes exit with reload switch code
Feb 27 12:52:19.616: %PMAN-3-PROCESS_NOTIFICATION: R0/0: pvp: System report /crashinfo/system-report_1_20250227-125215-Universal.tar.gz (size: 3415 KB) generated

% FACTORYRESET - Exiting without calling factory_reset
watchdog: watchdog0: watchdog did not stop!
reboot: Restarting system

logs2:

switch: dir usbflash0:
Directory of usbflash0:/

4 -rw- 482619172 cat3k_caa-universalk9.16.12.09.SPA.bin

20275200 bytes available (482648064 bytes used)

switch: boot usbflash0:cat3k_caa-universalk9.16.12.09.SPA.bin
Reading full image into memory................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done
Bundle Image
--------------------------------------
Kernel Address : 0x537966e8
Kernel Size : 0x43880f/4425743
Initramfs Address : 0x53bceef7
Initramfs Size : 0x1ca9cac/30055596
Compression Format: mzip

Bootable image at @ ram:0x537966e8
Bootable image segment 0 address range [0x81100000, 0x81da6400] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
File "usbflash0:cat3k_caa-universalk9.16.12.09.SPA.bin" uncompressed and installed, entry point: 0x818968e0
Loading Linux kernel with entry point 0x818968e0 ...
Bootloader: Done loading app on core_mask: 0xf

### Launching Linux Kernel (flags = 0x5)

Linux version 4.9.187 (deeratho@sjc-ads-3552) (gcc version 5.3.0 (GCC) ) #1 SMP Mon Dec 12 22:44:31 PST 2022
CVMSEG size: 2 cache lines (256 bytes)
Cavium Inc. SDK-5.1.0
bootconsole [early0] enabled
CPU0 revision is: 000d900a (Cavium Octeon II)
Checking for the multiply/shift bug... no.
Checking for the daddiu bug... no.
%IOSXEBOOT-b333d3ffa0ce8dc4cdd788ea6034645c-new_cksum: (rp/0): 4
%IOSXEBOOT-b333d3ffa0ce8dc4cdd788ea6034645c-saved_cksum: (rp/0): 4

Final tar file: mcu_ucode_bundle_8_1_0.tar
MM [0] MCU version 24 sw ver 0

Front-end Microcode IMG MGR: found 1 microcode images for 1 device.
Image for front-end 0: /tmp/microcode_update/front_end/fe_type_8_1 update needed: yes

Front-end Microcode IMG MGR: Preparing to program device microcode...
Front-end Microcode IMG MGR: Preparing to program device[0], index=0 ...88616 bytes.
Front-end Microcode IMG MGR: Programming device 0...
% Front-end Microcode IMG MGR: address 0, Could not enable sys_poll

% Front-end Microcode IMG MGR: unable to program device: 0
% Front-end Microcode IMG MGR: malformed microcode cache
Waiting for 120 seconds for other switches to boot

Both links down, accelerating discovery and not waiting for other switches
Switch number is 1

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

Cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software [Gibraltar], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.12.9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2023 by Cisco Systems, Inc.
Compiled Mon 20-Mar-23 03:14 by mcpre

This software version supports only Smart Licensing as the software licensing mechanism.

PLEASE READ THE FOLLOWING TERMS CAREFULLY. INSTALLING THE LICENSE OR
LICENSE KEY PROVIDED FOR ANY CISCO SOFTWARE PRODUCT, PRODUCT FEATURE,
AND/OR SUBSEQUENTLY PROVIDED SOFTWARE FEATURES (COLLECTIVELY, THE
"SOFTWARE"), AND/OR USING SUCH SOFTWARE CONSTITUTES YOUR FULL
ACCEPTANCE OF THE FOLLOWING TERMS. YOU MUST NOT PROCEED FURTHER IF YOU
ARE NOT WILLING TO BE BOUND BY ALL THE TERMS SET FORTH HEREIN.

Your use of the Software is subject to the Cisco End User License Agreement
(EULA) and any relevant supplemental terms (SEULA) found at
http://www.cisco.com/c/en/us/about/legal/cloud-and-software/software-terms.html.

You hereby acknowledge and agree that certain Software and/or features are
licensed for a particular term, that the license to such Software and/or
features is valid only for the applicable term and that such Software and/or
features may be shut down or otherwise terminated by Cisco after expiration
of the applicable license term (e.g., 90-day trial period). Cisco reserves
the right to terminate any such Software feature electronically or by any
other means available. While Cisco may provide alerts, it is your sole
responsibility to monitor your usage of any such term Software feature to
ensure that your systems and networks are prepared for a shutdown of the
Software feature.

Feb 28 12:15:19.628: %PMAN-3-PROCHOLDDOWN: R0/0: The process platform_mgr has been helddown (rc 134)

FIPS: Flash Key Check : Begin
FIPS: Flash Key Check : End, Not Found, FIPS Mode Not Enabled

All TCP AO KDF Tests Pass
cisco WS-C3650-24PD (MIPS) processor (revision W0) with 794816K/6147K bytes of memory.
Processor board ID FDO2332M0DT
2048K bytes of non-volatile configuration memory.
4194304K bytes of physical memory.
252000K bytes of Crash Files at crashinfo:.
1611414K bytes of Flash at flash:.
491392K bytes of USB Flash at usbflash0:.
0K bytes of WebUI ODM Files at webui:.

Base Ethernet MAC Address : 2c:f8:9b:3e:0e:80
Motherboard Assembly Number : 73-15894-07
Motherboard Serial Number : FDO233115JU
Model Revision Number : W0
Motherboard Revision Number : A0
Model Number : WS-C3650-24PD
System Serial Number : FDO2332M0DT

Chassis 1 reloading, reason - Critical process crash
reload fp action requested

Press RETURN to get started!

*Feb 28 12:15:23.666: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Feb 28 12:15:25.131: %IOSD_INFRA-6-IFS_DEVICE_OIR: Device usbflash0 added
*Feb 28 12:15:26.480: %SMART_LIC-6-AGENT_READY: Smart Agent for Licensing is initialized
*Feb 28 12:15:26.481: %SMART_LIC-6-AGENT_ENABLED: Smart Agent for Licensing is enabled
*Feb 28 12:15:26.485: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Feb 28 12:15:29.359: %SMART_LIC-6-HA_ROLE_CHANGED: Smart Agent HA role changed to Active.RA Tracing tool registry return: 0
*Feb 28 12:15:39.620: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled for type vlan
*Feb 28 12:15:41.310: %LINK-3-UPDOWN: Interface Lsmpi18/3, changed state to up
*Feb 28 12:15:41.312: %LINK-3-UPDOWN: Interface EOBC18/1, changed state to up
*Feb 28 12:15:41.313: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to down
*Feb 28 12:15:41.314: %LINK-3-UPDOWN: Interface LIIN18/2, changed state to up
*Feb 28 12:15:41.710: %HMANRP-6-HMAN_IOS_CHANNEL_INFO: HMAN-IOS channel event for switch 1: EMP_RELAY: Channel UP!
*Feb 28 12:15:41.715: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
*Feb 28 12:15:00.221: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 1 on Switch 1 is nocable
*Feb 28 12:15:00.221: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is down
*Feb 28 12:15:00.222: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is nocable
*Feb 28 12:15:00.222: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:15:04.448: %PLATFORM_MGR-1-PLATMGR_INIT_FAIL: Switch 1 R0/0: platform_mgr: Platform Manager: MCU application initialization failed.
*Feb 28 12:15:05.644: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:15:07.647: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:15:07.648: %STACKMGR-6-ACTIVE_ELECTED: Switch 1 R0/0: stack_mgr: Switch 1 has been elected ACTIVE.
*Feb 28 12:15:19.458: %PMAN-3-PROCHOLDDOWN: Switch 1 R0/0: root: The process platform_mgr has been helddown (rc 134)
*Feb 28 12:15:41.733: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
*Feb 28 12:15:42.436: %LINEPROTO-5-UPDOWN: Line protocol on Interface Lsmpi18/3, changed state to up
*Feb 28 12:15:42.437: %LINEPROTO-5-UPDOWN: Line protocol on Interface EOBC18/1, changed state to up
*Feb 28 12:15:42.437: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0, changed state to up
*Feb 28 12:15:42.438: %LINEPROTO-5-UPDOWN: Line protocol on Interface LIIN18/2, changed state to up
*Feb 28 12:15:44.170: %LINEPROTO-5-UPDOWN: Line protocol on Interface Vlan1, changed state to down
*Feb 28 12:15:45.864: %SYS-7-NVRAM_INIT_WAIT_TIME: Waited 0 seconds for NVRAM to be available
*Feb 28 12:15:46.406: %SYS-5-CONFIG_P: Configured programmatically by process MGMT VRF Process from console as vty0
*Feb 28 12:15:46.420: %IOSXE_MGMTVRF-6-CREATE_SUCCESS_INFO: Management vrf Mgmt-vrf created with ID 1, ipv4 table-id 0x1, ipv6 table-id 0x1E000001
*Feb 28 12:15:46.426: %SYS-5-CONFIG_P: Configured programmatically by process MGMT VRF Process from console as vty0
*Feb 28 12:15:47.279: %SYS-5-CONFIG_I: Configured from memory by console
*Feb 28 12:15:47.783: %SYS-5-CONFIG_P: Configured programmatically by process CPP MQC QoS Policy manager from console as vty1
*Feb 28 12:15:47.889: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to up
*Feb 28 12:15:47.466: %PMAN-0-PROCFAILCRIT: Switch 1 R0/0: pvp: A critical process platform_mgr has failed (rc 134)
*Feb 28 12:15:48.111: %ONEP_BASE-6-SS_ENABLED: ONEP: Service set Base was enabled by Default
*Feb 28 12:15:48.180: %PMAN-3-RELOAD_SYSTEM: Switch 1 R0/0: pvp: Reloading: Peer switch is not standby ready. System will be reloaded
*Feb 28 12:15:48.340: %STACKMGR-1-RELOAD: Switch 1 R0/0: stack_mgr: Reloading due to reason Critical process crash
*Feb 28 12:15:49.856: %SYS-5-RESTART: System restarted --
Cisco IOS Software [Gibraltar], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.12.9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2023 by Cisco Systems, Inc.
Compiled Mon 20-Mar-23 03:14 by mcpre
*Feb 28 12:15:51.592: %LINK-3-UPDOWN: Interface Vlan1, changed state to up
*Feb 28 12:15:51.558: %SERVICES-3-INVALID_CHASFS: Switch 1 R0/0: btman_rotate_immediate: Thread 0xfff4647000 has no global chasfs context
*Feb 28 12:15:51.558: %SERVICES-2-NORESOLVE_ACTIVE: Switch 1 R0/0: btman_rotate_immediate: Error resolving active FRU: BINOS_FRU_RP
*Feb 28 12:15:53.316: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to down
*Feb 28 12:15:54.316: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0, changed state to down
Switch>
Switch>
Switch>
Switch>
Switch>c
% Ambiguous command: "c"
Switch>
Switch>
Switch>
Switch>
Switch>
*Feb 28 12:15:55.059: %PNP-6-PNP_DISCOVERY_STOPPED: PnP Discovery stopped (Startup Config Present)
Switch>
Switch>c
% Ambiguous command: "c"
Switch>
Switch>
Switch>
Switch>c
% Ambiguous command: "c"
Switch>
Switch>c
% Ambiguous command: "c"
Switch>
Switch>
Switch>c
% Ambiguous command: "c"
Switch>
Switch>
*Feb 28 12:15:57.842: %SYS-5-CONFIG_P: Configured programmatically by process EPM CREATE DEFAULT CWA URL ACL from console as console
Switch>
Switch>
Switch>
Switch>rp processes exit with reload switch code
Feb 28 12:16:09.789: %PMAN-3-PROCESS_NOTIFICATION: R0/0: pvp: Deleting old files in /crashinfo ... System report /crashinfo/system-report_1_20250228-121606-Universal.tar.gz (size: 3415 KB) generated

% FACTORYRESET - Exiting without calling factory_reset
watchdog: watchdog0: watchdog did not stop!
reboot: Restarting system

Booting...
Interface GE 0 link down***ERROR: PHY link is down

Getting rest of image
Reading full image into memory...Check base package header ...: done = 16384
Getting rest of image
Reading full image into memory....done
Reading full base package into memory...: done = 34844799
Bundle Image
--------------------------------------
Kernel Address : 0x537793c4
Kernel Size : 0x43880f/4425743
Initramfs Address : 0x53bb1bd3
Initramfs Size : 0x1ca9cac/30055596
Compression Format: mzip

Bootable image at @ ram:0x537793c4
Bootable image segment 0 address range [0x81100000, 0x81da6400] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 623
Loading Linux kernel with entry point 0x818968e0 ...
Bootloader: Done loading app on core_mask: 0xf

### Launching Linux Kernel (flags = 0x5)

Linux version 4.9.187 (deeratho@sjc-ads-3552) (gcc version 5.3.0 (GCC) ) #1 SMP Mon Dec 12 22:44:31 PST 2022
CVMSEG size: 2 cache lines (256 bytes)
Cavium Inc. SDK-5.1.0
bootconsole [early0] enabled
CPU0 revision is: 000d900a (Cavium Octeon II)
Checking for the multiply/shift bug... no.
Checking for the daddiu bug... no.
%IOSXEBOOT-b333d3ffa0ce8dc4cdd788ea6034645c-new_cksum: (rp/0): 4
%IOSXEBOOT-b333d3ffa0ce8dc4cdd788ea6034645c-saved_cksum: (rp/0): 4
^V^V^V^M^M^V^M^V^V
^M^V^V^V^V^V^V^V^V
^M^M^M^C
^C
^C
^C
^M\^M/

^M^M\^M^M/

Final tar file: mcu_ucode_bundle_8_1_0.tar
MM [0] MCU version 24 sw ver 0

Front-end Microcode IMG MGR: found 1 microcode images for 1 device.
Image for front-end 0: /tmp/microcode_update/front_end/fe_type_8_1 update needed: yes

Front-end Microcode IMG MGR: Preparing to program device microcode...
Front-end Microcode IMG MGR: Preparing to program device[0], index=0 ...88616 bytes.
Front-end Microcode IMG MGR: Programming device 0...
^M

% Front-end Microcode IMG MGR: address 0, Could not enable sys_poll

% Front-end Microcode IMG MGR: unable to program device: 0
% Front-end Microcode IMG MGR: malformed microcode cache^M^M^C
^C
^M

^M^M^M^M^V
^V^V
^M^M^V
^M^V
^M^M^M^M^M^M^M^M^M

^V
^M^M^V
^M
Both links down, not waiting for other switches
Switch number is 1
^M
^C
^M
Initramfs Address : 0x53bb1bd3

Initramfs Address : 0x53bb1bd3

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

Cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software [Gibraltar], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.12.9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2023 by Cisco Systems, Inc.
Compiled Mon 20-Mar-23 03:14 by mcpre

This software version supports only Smart Licensing as the software licensing mechanism.

PLEASE READ THE FOLLOWING TERMS CAREFULLY. INSTALLING THE LICENSE OR
LICENSE KEY PROVIDED FOR ANY CISCO SOFTWARE PRODUCT, PRODUCT FEATURE,
AND/OR SUBSEQUENTLY PROVIDED SOFTWARE FEATURES (COLLECTIVELY, THE
"SOFTWARE"), AND/OR USING SUCH SOFTWARE CONSTITUTES YOUR FULL
ACCEPTANCE OF THE FOLLOWING TERMS. YOU MUST NOT PROCEED FURTHER IF YOU
ARE NOT WILLING TO BE BOUND BY ALL THE TERMS SET FORTH HEREIN.

Your use of the Software is subject to the Cisco End User License Agreement
(EULA) and any relevant supplemental terms (SEULA) found at
http://www.cisco.com/c/en/us/about/legal/cloud-and-software/software-terms.html.

You hereby acknowledge and agree that certain Software and/or features are
licensed for a particular term, that the license to such Software and/or
features is valid only for the applicable term and that such Software and/or
features may be shut down or otherwise terminated by Cisco after expiration
of the applicable license term (e.g., 90-day trial period). Cisco reserves
the right to terminate any such Software feature electronically or by any
other means available. While Cisco may provide alerts, it is your sole
responsibility to monitor your usage of any such term Software feature to
ensure that your systems and networks are prepared for a shutdown of the
Software feature.

Feb 28 12:20:08.593: %PMAN-3-PROCHOLDDOWN: R0/0: The process platform_mgr has been helddown (rc 134)

FIPS: Flash Key Check : Begin
FIPS: Flash Key Check : End, Not Found, FIPS Mode Not Enabled

All TCP AO KDF Tests Pass
cisco WS-C3650-24PD (MIPS) processor (revision W0) with 794816K/6147K bytes of memory.
Processor board ID FDO2332M0DT
2048K bytes of non-volatile configuration memory.
4194304K bytes of physical memory.
252000K bytes of Crash Files at crashinfo:.
1611414K bytes of Flash at flash:.
491392K bytes of USB Flash at usbflash0:.
0K bytes of WebUI ODM Files at webui:.

Base Ethernet MAC Address : 2c:f8:9b:3e:0e:80
Motherboard Assembly Number : 73-15894-07
Motherboard Serial Number : FDO233115JU
Model Revision Number : W0
Motherboard Revision Number : A0
Model Number : WS-C3650-24PD
System Serial Number : FDO2332M0DT

Chassis 1 reloading, reason - Critical process crash

Press RETURN to get started!

*Feb 28 12:20:12.668: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Feb 28 12:20:13.796: %IOSD_INFRA-6-IFS_DEVICE_OIR: Device usbflash0 added
*Feb 28 12:20:15.188: %SMART_LIC-6-AGENT_READY: Smart Agent for Licensing is initialized
*Feb 28 12:20:15.190: %SMART_LIC-6-AGENT_ENABLED: Smart Agent for Licensing is enabled
*Feb 28 12:20:15.193: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Feb 28 12:20:18.080: %SMART_LIC-6-HA_ROLE_CHANGED: Smart Agent HA role changed to Active.RA Tracing tool registry return: 0
*Feb 28 12:20:28.831: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled for type vlan
*Feb 28 12:20:30.558: %LINK-3-UPDOWN: Interface Lsmpi18/3, changed state to up
*Feb 28 12:20:30.561: %LINK-3-UPDOWN: Interface EOBC18/1, changed state to up
*Feb 28 12:20:30.563: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to down
*Feb 28 12:20:30.565: %LINK-3-UPDOWN: Interface LIIN18/2, changed state to up
*Feb 28 12:20:31.023: %HMANRP-6-HMAN_IOS_CHANNEL_INFO: HMAN-IOS channel event for switch 1: EMP_RELAY: Channel UP!
*Feb 28 12:20:31.041: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
*Feb 28 12:19:49.856: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 1 on Switch 1 is nocable
*Feb 28 12:19:49.856: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is down
*Feb 28 12:19:49.856: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is nocable
*Feb 28 12:19:49.856: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:19:54.033: %PLATFORM_MGR-1-PLATMGR_INIT_FAIL: Switch 1 R0/0: platform_mgr: Platform Manager: MCU application initialization failed.
*Feb 28 12:19:55.426: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:19:57.428: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:19:57.429: %STACKMGR-6-ACTIVE_ELECTED: Switch 1 R0/0: stack_mgr: Switch 1 has been elected ACTIVE.
*Feb 28 12:20:08.358: %PMAN-3-PROCHOLDDOWN: Switch 1 R0/0: root: The process platform_mgr has been helddown (rc 134)
*Feb 28 12:20:31.051: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
*Feb 28 12:20:31.711: %LINEPROTO-5-UPDOWN: Line protocol on Interface Lsmpi18/3, changed state to up
*Feb 28 12:20:31.712: %LINEPROTO-5-UPDOWN: Line protocol on Interface EOBC18/1, changed state to up
*Feb 28 12:20:31.712: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0, changed state to up
*Feb 28 12:20:31.713: %LINEPROTO-5-UPDOWN: Line protocol on Interface LIIN18/2, changed state to up
*Feb 28 12:20:31.841: %PMAN-0-PROCFAILCRIT: Switch 1 R0/0: pvp: A critical process platform_mgr has failed (rc 134)
*Feb 28 12:20:32.498: %PMAN-3-RELOAD_SYSTEM: Switch 1 R0/0: pvp: Reloading: Peer switch is not standby ready. System will be reloaded
*Feb 28 12:20:32.602: %STACKMGR-1-RELOAD: Switch 1 R0/0: stack_mgr: Reloading due to reason Critical process crash
*Feb 28 12:20:33.440: %LINEPROTO-5-UPDOWN: Line protocol on Interface Vlan1, changed state to down
*Feb 28 12:20:36.537: %SYS-7-NVRAM_INIT_WAIT_TIME: Waited 0 seconds for NVRAM to be available
*Feb 28 12:20:36.553: %SYS-5-CONFIG_P: Configured programmatically by process MGMT VRF Process from console as vty0
*Feb 28 12:20:36.575: %IOSXE_MGMTVRF-6-CREATE_SUCCESS_INFO: Management vrf Mgmt-vrf created with ID 1, ipv4 table-id 0x1, ipv6 table-id 0x1E000001
*Feb 28 12:20:36.581: %SYS-5-CONFIG_P: Configured programmatically by process MGMT VRF Process from console as vty0
*Feb 28 12:20:37.175: %SYS-5-CONFIG_I: Configured from memory by console
*Feb 28 12:20:37.456: %SYS-5-CONFIG_P: Configured programmatically by process CPP MQC QoS Policy manager from console as vty1
*Feb 28 12:20:37.541: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to up
*Feb 28 12:20:38.382: %SYS-5-RESTART: System restarted --
Cisco IOS Software [Gibraltar], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.12.9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2023 by Cisco Systems, Inc.
Compiled Mon 20-Mar-23 03:14 by mcpre
*Feb 28 12:20:40.374: %LINK-3-UPDOWN: Interface Vlan1, changed state to up
*Feb 28 12:20:42.566: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to down
*Feb 28 12:20:43.264: %ONEP_BASE-6-SS_ENABLED: ONEP: Service set Base was enabled by Defaultrp processes exit with reload switch code
Feb 28 12:21:57.449: %PMAN-3-PROCESS_NOTIFICATION: R0/0: pvp: System report /crashinfo/system-report_1_20250228-122153-Universal.tar.gz (size: 3407 KB) generated

% FACTORYRESET - Exiting without calling factory_reset
watchdog: watchdog0: watchdog did not stop!
reboot: Restarting system

Booting...
Interface GE 0 link down***ERROR: PHY link is down

Getting rest of image
Reading full image into memory...Check base package header ...: done = 16384
Getting rest of image
Reading full image into memory....done
Reading full base package into memory...: done = 34844799
Bundle Image
--------------------------------------
Kernel Address : 0x537793c4
Kernel Size : 0x43880f/4425743
Initramfs Address : 0x53bb1bd3
Initramfs Size : 0x1ca9cac/30055596
Compression Format: mzip

Bootable image at @ ram:0x537793c4
Bootable image segment 0 address range [0x81100000, 0x81da6400] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 623
Loading Linux kernel with entry point 0x818968e0 ...
Bootloader: Done loading app on core_mask: 0xf

### Launching Linux Kernel (flags = 0x5)

Linux version 4.9.187 (deeratho@sjc-ads-3552) (gcc version 5.3.0 (GCC) ) #1 SMP Mon Dec 12 22:44:31 PST 2022
CVMSEG size: 2 cache lines (256 bytes)
Cavium Inc. SDK-5.1.0
bootconsole [early0] enabled
CPU0 revision is: 000d900a (Cavium Octeon II)
Checking for the multiply/shift bug... no.
Checking for the daddiu bug... no.
%IOSXEBOOT-b333d3ffa0ce8dc4cdd788ea6034645c-new_cksum: (rp/0): 4
%IOSXEBOOT-b333d3ffa0ce8dc4cdd788ea6034645c-saved_cksum: (rp/0): 4

Final tar file: mcu_ucode_bundle_8_1_0.tar
MM [0] MCU version 24 sw ver 0

Front-end Microcode IMG MGR: found 1 microcode images for 1 device.
Image for front-end 0: /tmp/microcode_update/front_end/fe_type_8_1 update needed: yes

Front-end Microcode IMG MGR: Preparing to program device microcode...
Front-end Microcode IMG MGR: Preparing to program device[0], index=0 ...88616 bytes.
Front-end Microcode IMG MGR: Programming device 0...
% Front-end Microcode IMG MGR: address 0, Could not enable sys_poll

% Front-end Microcode IMG MGR: unable to program device: 0
% Front-end Microcode IMG MGR: malformed microcode cache
Both links down, not waiting for other switches
Switch number is 1

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

Cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software [Gibraltar], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.12.9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2023 by Cisco Systems, Inc.
Compiled Mon 20-Mar-23 03:14 by mcpre

This software version supports only Smart Licensing as the software licensing mechanism.

PLEASE READ THE FOLLOWING TERMS CAREFULLY. INSTALLING THE LICENSE OR
LICENSE KEY PROVIDED FOR ANY CISCO SOFTWARE PRODUCT, PRODUCT FEATURE,
AND/OR SUBSEQUENTLY PROVIDED SOFTWARE FEATURES (COLLECTIVELY, THE
"SOFTWARE"), AND/OR USING SUCH SOFTWARE CONSTITUTES YOUR FULL
ACCEPTANCE OF THE FOLLOWING TERMS. YOU MUST NOT PROCEED FURTHER IF YOU
ARE NOT WILLING TO BE BOUND BY ALL THE TERMS SET FORTH HEREIN.

Your use of the Software is subject to the Cisco End User License Agreement
(EULA) and any relevant supplemental terms (SEULA) found at
http://www.cisco.com/c/en/us/about/legal/cloud-and-software/software-terms.html.

You hereby acknowledge and agree that certain Software and/or features are
licensed for a particular term, that the license to such Software and/or
features is valid only for the applicable term and that such Software and/or
features may be shut down or otherwise terminated by Cisco after expiration
of the applicable license term (e.g., 90-day trial period). Cisco reserves
the right to terminate any such Software feature electronically or by any
other means available. While Cisco may provide alerts, it is your sole
responsibility to monitor your usage of any such term Software feature to
ensure that your systems and networks are prepared for a shutdown of the
Software feature.

Feb 28 12:25:56.598: %PMAN-3-PROCHOLDDOWN: R0/0: The process platform_mgr has been helddown (rc 134)

FIPS: Flash Key Check : Begin
FIPS: Flash Key Check : End, Not Found, FIPS Mode Not Enabled

All TCP AO KDF Tests Pass
cisco WS-C3650-24PD (MIPS) processor (revision W0) with 794816K/6147K bytes of memory.
Processor board ID FDO2332M0DT
2048K bytes of non-volatile configuration memory.
4194304K bytes of physical memory.
252000K bytes of Crash Files at crashinfo:.
1611414K bytes of Flash at flash:.
491392K bytes of USB Flash at usbflash0:.
0K bytes of WebUI ODM Files at webui:.

Base Ethernet MAC Address : 2c:f8:9b:3e:0e:80
Motherboard Assembly Number : 73-15894-07
Motherboard Serial Number : FDO233115JU
Model Revision Number : W0
Motherboard Revision Number : A0
Model Number : WS-C3650-24PD
System Serial Number : FDO2332M0DT

Chassis 1 reloading, reason - Critical process crash
reload fp action requested

Press RETURN to get started!

*Feb 28 12:26:00.615: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Feb 28 12:26:02.397: %IOSD_INFRA-6-IFS_DEVICE_OIR: Device usbflash0 added
*Feb 28 12:26:03.600: %SMART_LIC-6-AGENT_READY: Smart Agent for Licensing is initialized
*Feb 28 12:26:03.602: %SMART_LIC-6-AGENT_ENABLED: Smart Agent for Licensing is enabled
*Feb 28 12:26:03.605: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Feb 28 12:26:06.502: %SMART_LIC-6-HA_ROLE_CHANGED: Smart Agent HA role changed to Active.RA Tracing tool registry return: 0
*Feb 28 12:26:16.623: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled for type vlan
*Feb 28 12:26:18.321: %LINK-3-UPDOWN: Interface Lsmpi18/3, changed state to up
*Feb 28 12:26:18.323: %LINK-3-UPDOWN: Interface EOBC18/1, changed state to up
*Feb 28 12:26:18.325: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to down
*Feb 28 12:26:18.325: %LINK-3-UPDOWN: Interface LIIN18/2, changed state to up
*Feb 28 12:26:18.706: %HMANRP-6-HMAN_IOS_CHANNEL_INFO: HMAN-IOS channel event for switch 1: EMP_RELAY: Channel UP!
*Feb 28 12:26:18.709: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
*Feb 28 12:25:37.308: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 1 on Switch 1 is nocable
*Feb 28 12:25:37.308: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is down
*Feb 28 12:25:37.308: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is nocable
*Feb 28 12:25:37.308: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:25:41.553: %PLATFORM_MGR-1-PLATMGR_INIT_FAIL: Switch 1 R0/0: platform_mgr: Platform Manager: MCU application initialization failed.
*Feb 28 12:25:42.371: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:25:44.373: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:25:44.374: %STACKMGR-6-ACTIVE_ELECTED: Switch 1 R0/0: stack_mgr: Switch 1 has been elected ACTIVE.
*Feb 28 12:25:56.479: %PMAN-3-PROCHOLDDOWN: Switch 1 R0/0: root: The process platform_mgr has been helddown (rc 134)
*Feb 28 12:26:18.730: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
*Feb 28 12:26:19.343: %LINEPROTO-5-UPDOWN: Line protocol on Interface Lsmpi18/3, changed state to up
*Feb 28 12:26:19.343: %LINEPROTO-5-UPDOWN: Line protocol on Interface EOBC18/1, changed state to up
*Feb 28 12:26:19.344: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0, changed state to up
*Feb 28 12:26:19.344: %LINEPROTO-5-UPDOWN: Line protocol on Interface LIIN18/2, changed state to up
*Feb 28 12:26:20.914: %LINEPROTO-5-UPDOWN: Line protocol on Interface Vlan1, changed state to down
*Feb 28 12:26:23.405: %SYS-7-NVRAM_INIT_WAIT_TIME: Waited 0 seconds for NVRAM to be available
*Feb 28 12:26:23.504: %SYS-5-CONFIG_P: Configured programmatically by process MGMT VRF Process from console as vty0
*Feb 28 12:26:23.531: %IOSXE_MGMTVRF-6-CREATE_SUCCESS_INFO: Management vrf Mgmt-vrf created with ID 1, ipv4 table-id 0x1, ipv6 table-id 0x1E000001
*Feb 28 12:26:23.537: %SYS-5-CONFIG_P: Configured programmatically by process MGMT VRF Process from console as vty0
*Feb 28 12:26:23.441: %PMAN-0-PROCFAILCRIT: Switch 1 R0/0: pvp: A critical process platform_mgr has failed (rc 134)
*Feb 28 12:26:24.270: %SYS-5-CONFIG_I: Configured from memory by console
*Feb 28 12:26:24.848: %SYS-5-CONFIG_P: Configured programmatically by process CPP MQC QoS Policy manager from console as vty1
*Feb 28 12:26:24.117: %PMAN-3-RELOAD_SYSTEM: Switch 1 R0/0: pvp: Reloading: Peer switch is not standby ready. System will be reloaded
*Feb 28 12:26:24.259: %STACKMGR-1-RELOAD: Switch 1 R0/0: stack_mgr: Reloading due to reason Critical process crash
*Feb 28 12:26:25.029: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to up
*Feb 28 12:26:25.411: %ONEP_BASE-6-SS_ENABLED: ONEP: Service set Base was enabled by Default
*Feb 28 12:26:26.069: %SYS-5-RESTART: System restarted --
Cisco IOS Software [Gibraltar], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.12.9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2023 by Cisco Systems, Inc.
Compiled Mon 20-Mar-23 03:14 by mcpre
*Feb 28 12:26:27.327: %SERVICES-3-INVALID_CHASFS: Switch 1 R0/0: btman_rotate_immediate: Thread 0xfff61fa000 has no global chasfs context
*Feb 28 12:26:27.328: %SERVICES-2-NORESOLVE_ACTIVE: Switch 1 R0/0: btman_rotate_immediate: Error resolving active FRU: BINOS_FRU_RP
*Feb 28 12:26:28.062: %LINK-3-UPDOWN: Interface Vlan1, changed state to up
*Feb 28 12:26:30.328: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to down
*Feb 28 12:26:31.327: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0, changed state to down
*Feb 28 12:26:32.122: %PNP-6-PNP_DISCOVERY_STOPPED: PnP Discovery stopped (Startup Config Present)Switch rebooted continuously for atleast 5 times. Disabling autoreboot

*Feb 28 12:26:34.969: %SYS-5-CONFIG_P: Configured programmatically by process EPM CREATE DEFAULT CWA URL ACL from console as console
*Feb 28 12:26:36.837: %PKI-2-NON_AUTHORITATIVE_CLOCK: PKI functions can not be initialized until an authoritative time source, like NTP, can be obtained.
*Feb 28 12:26:37.136: %PKI-6-TRUSTPOINT_CREATE: Trustpoint: TP-self-signed-1326251070 created succesfullyrp processes exit with reload switch code
Feb 28 12:26:49.240: %PMAN-3-PROCESS_NOTIFICATION: R0/0: pvp: Deleting old files in /crashinfo ... System report /crashinfo/system-report_1_20250228-122645-Universal.tar.gz (size: 3414 KB) generated

% FACTORYRESET - Exiting without calling factory_reset
watchdog: watchdog0: watchdog did not stop!
reboot: Restarting system

Booting...
Interface GE 0 link down***ERROR: PHY link is down

The system is not configured to boot automatically. The
following command will finish loading the operating system
software:

boot

switch: boot flash:packages.conf

Getting rest of image
Reading full image into memory...Check base package header ...: done = 16384
Getting rest of image
Reading full image into memory....done
Reading full base package into memory...: done = 34844799
Bundle Image
--------------------------------------
Kernel Address : 0x5377b3c4
Kernel Size : 0x43880f/4425743
Initramfs Address : 0x53bb3bd3
Initramfs Size : 0x1ca9cac/30055596
Compression Format: mzip

Bootable image at @ ram:0x5377b3c4
Bootable image segment 0 address range [0x81100000, 0x81da6400] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 623
Loading Linux kernel with entry point 0x818968e0 ...
Bootloader: Done loading app on core_mask: 0xf

### Launching Linux Kernel (flags = 0x5)

Linux version 4.9.187 (deeratho@sjc-ads-3552) (gcc version 5.3.0 (GCC) ) #1 SMP Mon Dec 12 22:44:31 PST 2022
CVMSEG size: 2 cache lines (256 bytes)
Cavium Inc. SDK-5.1.0
bootconsole [early0] enabled
CPU0 revision is: 000d900a (Cavium Octeon II)
Checking for the multiply/shift bug... no.
Checking for the daddiu bug... no.
%IOSXEBOOT-b333d3ffa0ce8dc4cdd788ea6034645c-new_cksum: (rp/0): 4
%IOSXEBOOT-b333d3ffa0ce8dc4cdd788ea6034645c-saved_cksum: (rp/0): 4

Final tar file: mcu_ucode_bundle_8_1_0.tar
MM [0] MCU version 24 sw ver 0

Front-end Microcode IMG MGR: found 1 microcode images for 1 device.
Image for front-end 0: /tmp/microcode_update/front_end/fe_type_8_1 update needed: yes

Front-end Microcode IMG MGR: Preparing to program device microcode...
Front-end Microcode IMG MGR: Preparing to program device[0], index=0 ...88616 bytes.
Front-end Microcode IMG MGR: Programming device 0...
% Front-end Microcode IMG MGR: address 0, Could not enable sys_poll

% Front-end Microcode IMG MGR: unable to program device: 0
% Front-end Microcode IMG MGR: malformed microcode cache
Both links down, not waiting for other switches
Switch number is 1

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

Cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software [Gibraltar], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.12.9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2023 by Cisco Systems, Inc.
Compiled Mon 20-Mar-23 03:14 by mcpre

This software version supports only Smart Licensing as the software licensing mechanism.

PLEASE READ THE FOLLOWING TERMS CAREFULLY. INSTALLING THE LICENSE OR
LICENSE KEY PROVIDED FOR ANY CISCO SOFTWARE PRODUCT, PRODUCT FEATURE,
AND/OR SUBSEQUENTLY PROVIDED SOFTWARE FEATURES (COLLECTIVELY, THE
"SOFTWARE"), AND/OR USING SUCH SOFTWARE CONSTITUTES YOUR FULL
ACCEPTANCE OF THE FOLLOWING TERMS. YOU MUST NOT PROCEED FURTHER IF YOU
ARE NOT WILLING TO BE BOUND BY ALL THE TERMS SET FORTH HEREIN.

Your use of the Software is subject to the Cisco End User License Agreement
(EULA) and any relevant supplemental terms (SEULA) found at
http://www.cisco.com/c/en/us/about/legal/cloud-and-software/software-terms.html.

You hereby acknowledge and agree that certain Software and/or features are
licensed for a particular term, that the license to such Software and/or
features is valid only for the applicable term and that such Software and/or
features may be shut down or otherwise terminated by Cisco after expiration
of the applicable license term (e.g., 90-day trial period). Cisco reserves
the right to terminate any such Software feature electronically or by any
other means available. While Cisco may provide alerts, it is your sole
responsibility to monitor your usage of any such term Software feature to
ensure that your systems and networks are prepared for a shutdown of the
Software feature.

Feb 28 12:33:49.710: %PMAN-3-PROCHOLDDOWN: R0/0: The process platform_mgr has been helddown (rc 134)

FIPS: Flash Key Check : Begin
FIPS: Flash Key Check : End, Not Found, FIPS Mode Not Enabled

All TCP AO KDF Tests Pass
cisco WS-C3650-24PD (MIPS) processor (revision W0) with 794816K/6147K bytes of memory.
Chassis 1 reloading, reason - Critical process crash

Processor board ID FDO2332M0DT
2048K bytes of non-volatile configuration memory.
4194304K bytes of physical memory.
252000K bytes of Crash Files at crashinfo:.
1611414K bytes of Flash at flash:.
491392K bytes of USB Flash at usbflash0:.
0K bytes of WebUI ODM Files at webui:.

Base Ethernet MAC Address : 2c:f8:9b:3e:0e:80
Motherboard Assembly Number : 73-15894-07
Motherboard Serial Number : FDO233115JU
Model Revision Number : W0
Motherboard Revision Number : A0
Model Number : WS-C3650-24PD
System Serial Number : FDO2332M0DT

reload fp action requested

% There may not be enough space available to collect the complete crashinfo
% It would be advisable to have 283008 bytes free space on crashinfo:crashinfo_RP_00_00

Press RETURN to get started!

*Feb 28 12:33:53.749: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Feb 28 12:33:55.305: %IOSD_INFRA-6-IFS_DEVICE_OIR: Device usbflash0 added
*Feb 28 12:33:56.697: %SMART_LIC-6-AGENT_READY: Smart Agent for Licensing is initialized
*Feb 28 12:33:56.698: %SMART_LIC-6-AGENT_ENABLED: Smart Agent for Licensing is enabled
*Feb 28 12:33:56.700: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Feb 28 12:33:59.620: %SMART_LIC-6-HA_ROLE_CHANGED: Smart Agent HA role changed to Active.RA Tracing tool registry return: 0
*Feb 28 12:34:09.938: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled for type vlan
*Feb 28 12:34:11.807: %LINK-3-UPDOWN: Interface Lsmpi18/3, changed state to up
*Feb 28 12:34:11.812: %LINK-3-UPDOWN: Interface EOBC18/1, changed state to up
*Feb 28 12:34:11.813: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to down
*Feb 28 12:34:11.814: %LINK-3-UPDOWN: Interface LIIN18/2, changed state to up
*Feb 28 12:34:12.361: %HMANRP-6-HMAN_IOS_CHANNEL_INFO: HMAN-IOS channel event for switch 1: EMP_RELAY: Channel UP!
*Feb 28 12:34:12.369: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
*Feb 28 12:33:31.094: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 1 on Switch 1 is nocable
*Feb 28 12:33:31.094: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is down
*Feb 28 12:33:31.094: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is nocable
*Feb 28 12:33:31.095: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:33:35.324: %PLATFORM_MGR-1-PLATMGR_INIT_FAIL: Switch 1 R0/0: platform_mgr: Platform Manager: MCU application initialization failed.
*Feb 28 12:33:36.471: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:33:38.473: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:33:38.473: %STACKMGR-6-ACTIVE_ELECTED: Switch 1 R0/0: stack_mgr: Switch 1 has been elected ACTIVE.
*Feb 28 12:33:49.561: %PMAN-3-PROCHOLDDOWN: Switch 1 R0/0: root: The process platform_mgr has been helddown (rc 134)
*Feb 28 12:34:11.448: %PMAN-0-PROCFAILCRIT: Switch 1 R0/0: pvp: A critical process platform_mgr has failed (rc 134)
*Feb 28 12:34:12.058: %PMAN-3-RELOAD_SYSTEM: Switch 1 R0/0: pvp: Reloading: Peer switch is not standby ready. System will be reloaded
*Feb 28 12:34:12.182: %STACKMGR-1-RELOAD: Switch 1 R0/0: stack_mgr: Reloading due to reason Critical process crash
*Feb 28 12:34:12.391: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
*Feb 28 12:34:12.851: %LINEPROTO-5-UPDOWN: Line protocol on Interface Lsmpi18/3, changed state to up
*Feb 28 12:34:12.852: %LINEPROTO-5-UPDOWN: Line protocol on Interface EOBC18/1, changed state to up
*Feb 28 12:34:12.853: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0, changed state to up
*Feb 28 12:34:12.853: %LINEPROTO-5-UPDOWN: Line protocol on Interface LIIN18/2, changed state to up
*Feb 28 12:34:15.001: %LINEPROTO-5-UPDOWN: Line protocol on Interface Vlan1, changed state to down
*Feb 28 12:34:17.535: %SYS-7-NVRAM_INIT_WAIT_TIME: Waited 0 seconds for NVRAM to be available
*Feb 28 12:34:16.064: %SERVICES-3-INVALID_CHASFS: Switch 1 R0/0: btman_rotate_immediate: Thread 0xffebcff000 has no global chasfs context
*Feb 28 12:34:16.064: %SERVICES-2-NORESOLVE_ACTIVE: Switch 1 R0/0: btman_rotate_immediate: Error resolving active FRU: BINOS_FRU_RP
*Feb 28 12:34:17.771: %SYS-5-CONFIG_P: Configured programmatically by process MGMT VRF Process from console as vty0
*Feb 28 12:34:17.784: %IOSXE_MGMTVRF-6-CREATE_SUCCESS_INFO: Management vrf Mgmt-vrf created with ID 1, ipv4 table-id 0x1, ipv6 table-id 0x1E000001
*Feb 28 12:34:17.804: %SYS-5-CONFIG_P: Configured programmatically by process MGMT VRF Process from console as vty0
*Feb 28 12:34:18.337: %SYS-5-CONFIG_I: Configured from memory by console
*Feb 28 12:34:18.591: %SYS-5-CONFIG_P: Configured programmatically by process CPP MQC QoS Policy manager from console as vty1
*Feb 28 12:34:18.680: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to up
*Feb 28 12:34:19.528: %SYS-5-RESTART: System restarted --
Cisco IOS Software [Gibraltar], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.12.9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2023 by Cisco Systems, Inc.
Compiled Mon 20-Mar-23 03:14 by mcpre
*Feb 28 12:34:21.520: %LINK-3-UPDOWN: Interface Vlan1, changed state to up
*Feb 28 12:34:23.816: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to down
*Feb 28 12:34:24.000: %ONEP_BASE-6-SS_ENABLED: ONEP: Service set Base was enabled by Defaultrp processes exit with reload switch code
Feb 28 12:34:36.464: %PMAN-3-PROCESS_NOTIFICATION: R0/0: pvp: Deleting old files in /crashinfo ... System report /crashinfo/system-report_1_20250228-123432-Universal.tar.gz (size: 3409 KB) generated

% FACTORYRESET - Exiting without calling factory_reset
watchdog: watchdog0: watchdog did not stop!
reboot: Restarting system

Booting...
Interface GE 0 link down***ERROR: PHY link is down

Getting rest of image
Reading full image into memory...Check base package header ...: done = 16384
Getting rest of image
Reading full image into memory....done
Reading full base package into memory...: done = 34844799
Bundle Image
--------------------------------------
Kernel Address : 0x537793c4
Kernel Size : 0x43880f/4425743
Initramfs Address : 0x53bb1bd3
Initramfs Size : 0x1ca9cac/30055596
Compression Format: mzip

Bootable image at @ ram:0x537793c4
Bootable image segment 0 address range [0x81100000, 0x81da6400] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 623
Loading Linux kernel with entry point 0x818968e0 ...
Bootloader: Done loading app on core_mask: 0xf

### Launching Linux Kernel (flags = 0x5)

Linux version 4.9.187 (deeratho@sjc-ads-3552) (gcc version 5.3.0 (GCC) ) #1 SMP Mon Dec 12 22:44:31 PST 2022
CVMSEG size: 2 cache lines (256 bytes)
Cavium Inc. SDK-5.1.0
bootconsole [early0] enabled
CPU0 revision is: 000d900a (Cavium Octeon II)
Checking for the multiply/shift bug... no.
Checking for the daddiu bug... no.

%IOSXEBOOT-b333d3ffa0ce8dc4cdd788ea6034645c-new_cksum: (rp/0): 4
%IOSXEBOOT-b333d3ffa0ce8dc4cdd788ea6034645c-saved_cksum: (rp/0): 4

Final tar file: mcu_ucode_bundle_8_1_0.tar
MM [0] MCU version 24 sw ver 0

Front-end Microcode IMG MGR: found 1 microcode images for 1 device.
Image for front-end 0: /tmp/microcode_update/front_end/fe_type_8_1 update needed: yes

Front-end Microcode IMG MGR: Preparing to program device microcode...
Front-end Microcode IMG MGR: Preparing to program device[0], index=0 ...88616 bytes.
Front-end Microcode IMG MGR: Programming device 0...^C^C^C^C
% Front-end Microcode IMG MGR: address 0, Could not enable sys_poll

% Front-end Microcode IMG MGR: unable to program device: 0
% Front-end Microcode IMG MGR: malformed microcode cache^C
^C
^C
^C
^C
^Cen
conf t
no license smart enable
license smart transport off
no call-home
write memory
reloaden
conf t
no license smart enable
license smart transport off
no call-home
write memory
reloaden
conf t
no license smart enable
license smart transport off
no call-home
write memory
reloaden
conf t
no license smart enable
license smart transport off
no call-home
write memory
reload
en
conf t
no license smart enable
license smart transport off
no call-home
write memory
reload

Both links down, not waiting for other switches
Switch number is 1
^C

en
conf t
no license smart enable
license smart transport off
no call-home
write memory
reload

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

Cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software [Gibraltar], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.12.9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2023 by Cisco Systems, Inc.
Compiled Mon 20-Mar-23 03:14 by mcpre

This software version supports only Smart Licensing as the software licensing mechanism.

PLEASE READ THE FOLLOWING TERMS CAREFULLY. INSTALLING THE LICENSE OR
LICENSE KEY PROVIDED FOR ANY CISCO SOFTWARE PRODUCT, PRODUCT FEATURE,
AND/OR SUBSEQUENTLY PROVIDED SOFTWARE FEATURES (COLLECTIVELY, THE
"SOFTWARE"), AND/OR USING SUCH SOFTWARE CONSTITUTES YOUR FULL
ACCEPTANCE OF THE FOLLOWING TERMS. YOU MUST NOT PROCEED FURTHER IF YOU
ARE NOT WILLING TO BE BOUND BY ALL THE TERMS SET FORTH HEREIN.

Your use of the Software is subject to the Cisco End User License Agreement
(EULA) and any relevant supplemental terms (SEULA) found at
http://www.cisco.com/c/en/us/about/legal/cloud-and-software/software-terms.html.

You hereby acknowledge and agree that certain Software and/or features are
licensed for a particular term, that the license to such Software and/or
features is valid only for the applicable term and that such Software and/or
features may be shut down or otherwise terminated by Cisco after expiration
of the applicable license term (e.g., 90-day trial period). Cisco reserves
the right to terminate any such Software feature electronically or by any
other means available. While Cisco may provide alerts, it is your sole
responsibility to monitor your usage of any such term Software feature to
ensure that your systems and networks are prepared for a shutdown of the
Software feature.

Feb 28 12:38:35.874: %PMAN-3-PROCHOLDDOWN: R0/0: The process platform_mgr has been helddown (rc 134)

FIPS: Flash Key Check : Begin
FIPS: Flash Key Check : End, Not Found, FIPS Mode Not Enabled

All TCP AO KDF Tests Pass
cisco WS-C3650-24PD (MIPS) processor (revision W0) with 794816K/6147K bytes of memory.
Chassis 1 reloading, reason - Critical process crash

Processor board ID FDO2332M0DT
2048K bytes of non-volatile configuration memory.
4194304K bytes of physical memory.
252000K bytes of Crash Files at crashinfo:.
1611414K bytes of Flash at flash:.
491392K bytes of USB Flash at usbflash0:.
0K bytes of WebUI ODM Files at webui:.

Base Ethernet MAC Address : 2c:f8:9b:3e:0e:80
Motherboard Assembly Number : 73-15894-07
Motherboard Serial Number : FDO233115JU
Model Revision Number : W0
Motherboard Revision Number : A0
Model Number : WS-C3650-24PD
System Serial Number : FDO2332M0DT

reload fp action requested
BUG: Bad rss-counter state mm:80000000eb391680 idx:3 val:3

% There may not be enough space available to collect the complete crashinfo
% It would be advisable to have 283008 bytes free space on crashinfo:crashinfo_RP_00_00

Press RETURN to get started!

*Feb 28 12:38:38.043: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Feb 28 12:38:39.521: %IOSD_INFRA-6-IFS_DEVICE_OIR: Device usbflash0 added
*Feb 28 12:38:40.822: %SMART_LIC-6-AGENT_READY: Smart Agent for Licensing is initialized
*Feb 28 12:38:40.823: %SMART_LIC-6-AGENT_ENABLED: Smart Agent for Licensing is enabled
*Feb 28 12:38:40.827: %SMART_LIC-6-EXPORT_CONTROLLED: Usage of export controlled features is not allowed
*Feb 28 12:38:43.693: %SMART_LIC-6-HA_ROLE_CHANGED: Smart Agent HA role changed to Active.RA Tracing tool registry return: 0
*Feb 28 12:38:53.680: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled for type vlan
*Feb 28 12:38:55.313: %LINK-3-UPDOWN: Interface Lsmpi18/3, changed state to up
*Feb 28 12:38:55.315: %LINK-3-UPDOWN: Interface EOBC18/1, changed state to up
*Feb 28 12:38:55.317: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to down
*Feb 28 12:38:55.317: %LINK-3-UPDOWN: Interface LIIN18/2, changed state to up
*Feb 28 12:38:55.696: %HMANRP-6-HMAN_IOS_CHANNEL_INFO: HMAN-IOS channel event for switch 1: EMP_RELAY: Channel UP!
*Feb 28 12:38:55.699: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
*Feb 28 12:38:16.301: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 1 on Switch 1 is nocable
*Feb 28 12:38:16.301: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is down
*Feb 28 12:38:16.301: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr: Stack port 2 on Switch 1 is nocable
*Feb 28 12:38:16.302: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:38:20.577: %PLATFORM_MGR-1-PLATMGR_INIT_FAIL: Switch 1 R0/0: platform_mgr: Platform Manager: MCU application initialization failed.
*Feb 28 12:38:21.215: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:38:23.218: %STACKMGR-4-SWITCH_ADDED: Switch 1 R0/0: stack_mgr: Switch 1 has been added to the stack.
*Feb 28 12:38:23.218: %STACKMGR-6CPU 2 Unable to handle kernel paging request at virtual address 0000000000000001, epc == 80000000eb587ce0, ra == 80000000eb587ce0
-ACTIVE_ELECTED: Switch 1 R0/0: stack_mgr: Switch 1 has been eleOops[#1]:
cted ACTIVE.
*Feb 28 12:38:35.739: %PMAN-3-PROCHOLDDOWN: SwitchCPU: 2 PID: 25113 Comm: mv Tainted: G O 4.9.187 #1
ta 1 R0/0: root: The process platform_mgr has been helddown (rc 1sk: 80000000eba5dd00 task.stack: 80000000eb584000
4)
*Feb 28 12:38:55.251: %PMAN-0-PROCFAILCRIT: Switch 1 R0/0: p$ 0 :vp: A critical process platform_mgr has failed (rc 134)
*Feb 28 0000000000000000 12:38:55.613: %PMAN-3-RELOAD_SYSTEM: Switch 1 R0/0: pvp: Reload 0000000010008ce1in g: Peer switch is not standby ready. System will be reloaded
ect active EMP switch, setting emp active switch to 0: EMP_RELN_INFO: Could not 0000000000000000el
$ 4 :AY : Could not elect switch with mgmt port UP
*Feb 28 12:38:55.780000000eb587b2016: %STACKMGR-1-RELOAD: Switch 1 R0/0: stack_mgr: Reloading due 800000010826201c t0o reason Critical process crash
to up8 12:38:56.376: %LINEPR000000000000000TO-5-UPDOWN: Line protocol on Interface Lsmpi18/3, changed state 0000000000000000
*Feb 28 12:38:56.377: %LINEPROTO-5-UPDOWN: Line protocol
$ 8 : on Interface EOBC18/1, changed state to up
*Feb 28 12:38:56.37 00000000000000008: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthern 0000000000000001et0/0, changed state to up
80000000ea092000.379: %LINEPROTO-5-U 80000000eaa71730PD OWN: Line protocol on Interface LIIN18/2, changed state to up
*Feb 28 12:38:58.352: %LINEPROTO-5-UPDOWN: Line protocol on Int
$12 :erface Vlan1, changed state to down
*Feb 28 12:39:00.082: %SYS- 00000000000000007-NVRAM_INIT_WAIT_TIME: Waited 0 seconds for NVRAM to be availab ffffffff81526b74 le
hasfs context:58.260: %SERVICES-3-INVALID_CHASFS: Switch 1 Rffffffff81323a400/0: btman_rotate_immediate: Thread 0xffebd10000 has no global c 0000000000000000
*Feb 28 12:38:58.262: %SERVICES-2-NORESOLVE_ACTIV
$16 :E: Switch 1 R0/0: btman_rotate_immediate: Error resolving active ffffffff81b72c48 FRU: BINOS_FRU_RP
*Feb 28 12:39:00.570: %SYS-5-CONFIG_P: Confi 8000000104df8f38g ured programmatically by process MGMT VRF Process from console ffffffff81b6de20 0000000000000001as vty0
*Feb 28 12:39:00.582: %IOSXE_MGMTVRF-6-CREATE_SUCCESS_e
$20 :d programmatically by process MGMT VRF Process from console as v 80000000eb587ce0ty0
*Feb 28 12:39:01.281: %SYS-5-CONFIG_I: Configured from memo 000000000000002fry by console
*Feb 28 12:39:01.536: %SYS-5-CONFIG_P: Configured 80000000eb587d38 p rogrammatically by process CPP MQC QoS Policy manager from con80000000eb587ce0sole as vty1
*Feb 28 12:39:01.638: %LINK-3-UPDOWN: Interface Gi
$24 :gabitEthernet0/0, changed state to up
*Feb 28 12:39:02.739: %SY 0000000000000004S-5-RESTART: System restarted --
Cisco IOS Software [Gibraltar] 000000fff2f12890 , Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.12.9, RELEASE SOFTWARE (fc2)
Technical Support: http://www.
$28 :cisco.com/techsupport
Copyright (c) 1986-2023 by Cisco Systems, 80000000eb584000 Inc.
Compiled Mon 20-Mar-23 03:14 by mcpre
*Feb 28 12:39:04.480000000eb587b6096: %LINK-3-UPDOWN: Interface Vlan1, changed state to up
*Feb 2 000000ffff9c6fb0 88 12:39:04.932: %IOSXE-1-PLATFORM: Switch 1 R0/0: kernel: BUG: 0000000eb587ce0ad rss-counter state mm:80000000eb391680 idx:3 val:3
*Feb 28 12
Hi : 000000000000004c
:39:05.701: %ONEP_BASE-6-SS_ENABLED: ONEP: Service set Base was Lo : 0000000000000013
enabled by Defaultepc : 80000000eb587ce0 0x80000000eb587ce0
ra : 80000000eb587ce0 0x80000000eb587ce0
Status: 10008ce3 KX SX UX KERNEL EXL IE
Cause : 00800008 (ExcCode 02)
BadVA : 0000000000000001
PrId : 000d900a (Cavium Octeon II)
Modules linked in: bridge stp llc contdev_generic(O) dplr_oobhal(O) dplr_oobnd(O) dplr_pci(O) tipc ip6_udp_tunnel udp_tunnel lsmpilodrv(O) liin(O) lfts(O) lsmpi(O) mtd_map(O) rmonbifo_mod(O) cvmx_gpio(O) cvmx_mdio mtdblock mtd_blkdevs cpldvirt(O) cpldha(O) nfsd ipv6 cfi_cmdset_0002 cfi_probe cfi_util gen_probe
Process mv (pid: 25113, threadinfo=80000000eb584000, task=80000000eba5dd00, tls=000000fff14c7700)
Stack : 80000000e067be40 80000000eb587c18 80000000eb587c28 800000010b9d6da0
80000000ea09301d ffffffff81336054 ffffffff81b6df30 ffffffff814a6cd0
80000000ebef4300 80000000eb362e80 80000000eb587df0 0000000000000001
80000000ea093000 000000fff2f33000 80000000ebef4300 000000ffff9c7638
0000000000000000 80000000eb587ce0 000000ffff9c6fb0 ffffffff81336e38
80000000ea99b210 0000000000000028 0000000000000000 ffffffff8130ec68
80000000ea093000 000000000007463e 8000000000000000 000000ffff9c7060
0000000000000000 0000000000000041 80000000eb587cf0 000000000007463d
80000000ea092000 8101010101010100 ffffffff81a3db48 ffffffff84080018
ffffffff81323a40 000000002f6c6962 80000000eb587df0 0000000000000001
...
Call Trace:
[<ffffffff81336054>] link_path_walk+0x2fc/0x5a8
[<ffffffff814a6cd0>] security_file_alloc+0x58/0x90
[<ffffffff81336e38>] path_openat+0xa0/0x11c0
[<ffffffff8130ec68>] kmem_cache_alloc+0x278/0x288
[<ffffffff81323a40>] SyS_open+0x0/0x28
[<ffffffff81339314>] do_filp_open+0xc4/0x120
[<ffffffff8130ec68>] kmem_cache_alloc+0x278/0x288
[<ffffffff8134a71c>] __alloc_fd+0x6c/0x270
[<ffffffff81323950>] do_sys_open+0x168/0x258
[<ffffffff811782b0>] syscall_common+0x34/0x58
[<ffffffff81323a40>] SyS_open+0x0/0x28

Code: ff9c6fb0 ffffffff 81339314 <80000001> 080a41a0 80000001 0c0040c0 0000000c 4c594012

---[ end trace f4aa3c16b8c49088 ]---
Sending IPI to other cpus...
Will call new kernel at 0470bf40
Bye ...
Linux version 4.9.187 (deeratho@sjc-ads-3552) (gcc version 5.3.0 (GCC) ) #1 Tue Dec 13 08:08:43 PST 2022
Simulated Named Block[0] = size 0x3000000, base_addr 0x4000000
CVMSEG size: 2 cache lines (256 bytes)
Cavium Inc. SDK-5.1.0
bootconsole [early0] enabled
CPU0 revision is: 000d900a (Cavium Octeon II)
Checking for the multiply/shift bug... no.
Checking for the daddiu bug... no.
irq 63: nobody cared (try booting with the "irqpoll" option)
handlers:
[<ffffffff844b3c38>] octeon_cf_interrupt
Disabling IRQ #63
cvm_oct_alloc_fpa_pool(-22, FPA_PACKET_POOL_SIZE) failed.
Failed to register MTD device for flash
----------------------watchdog: watchdog0: watchdog did not stop!

Starting IOS XE kernel dump from previous failure.
----------------------
System will automatically reboot within 40 minutes.
Waiting for block device sd?1 /usb1/1-1/1-1:1\.0 for 10 seconds

^C^C^C
en
conf t
no license smart enable
license smart transport off
no call-home
write memory
reload
usb 1-1: device descriptor read/64, error -145
Found device: /dev/sdb1
mount: mounting /dev/sdb1 on /misc/scratch failed: Invalid argument
df: /misc/scratch: can't find mount point
Available space: 0
VMCORE size: 4230172672
kdump core temporary filename: /misc/scratch/user/core/kernel.rp_RP-EDISON_0.core.TEMP_IN_PROGRESS
Max vmcore size 4230172672

The dmesg log is saved to /misc/scratch/user/core/kernel.rp_RP-EDISON_0.core.TEMP_IN_PROGRESS.txt.

makedumpfile Completed.
================== DMESG ==============================
[ 213.418035] task: 80000000eba5dd00 task.stack: 80000000eb584000
[ 213.538961] $ 0 : 0000000000000000 0000000010008ce1 0000000000000000 0000000000000000
[ 213.974271] $ 4 : 80000000eb587b20 800000010826201c 0000000000000000 0000000000000000
[ 214.386745] $ 8 : 0000000000000000 0000000000000001 80000000eaa71730 80000000ea092000
[ 214.800260] $12 : 0000000000000000 ffffffff81526b74 ffffffff81323a40 0000000000000000
[ 215.213775] $16 : ffffffff81b72c48 8000000104df8f38 ffffffff81b6de20 0000000000000001
[ 215.572564] $20 : 80000000eb587ce0 000000000000002f 80000000eb587d38 80000000eb587ce0
[ 215.986080] $24 : 0000000000000004 000000fff2f12890
[ 216.332936] $28 : 80000000eb584000 80000000eb587b60 000000ffff9c6fb0 80000000eb587ce0
[ 216.745407] Hi : 000000000000004c
[ 216.805419] Lo : 0000000000000013
[ 216.899167] epc : 80000000eb587ce0 0x80000000eb587ce0
[ 216.964786] ra : 80000000eb587ce0 0x80000000eb587ce0
[ 217.011760] Status: 10008ce3 KX SX UX KERNEL EXL IE
[ 217.055508] Cause : 00800008 (ExcCode 02)
[ 217.087797] BadVA : 0000000000000001
[ 217.114879] PrId : 000d900a (Cavium Octeon II)
[ 217.153417] Modules linked in: bridge stp llc contdev_generic(O) dplr_oobhal(O) dplr_oobnd(O) dplr_pci(O) tipc ip6_udp_tunnel udp_tunnel lsmpilodrv(O) liin(O) lfts(O) lsmpi(O) mtd_map(O) rmonbifo_mod(O) cvmx_gpio(O) cvmx_mdio mtdblock mtd_blkdevs cpldvirt(O) cpldha(O) nfsd ipv6 cfi_cmdset_0002 cfi_probe cfi_util gen_probe
[ 217.479442] Process mv (pid: 25113, threadinfo=80000000eb584000, task=80000000eba5dd00, tls=000000fff14c7700)
[ 217.582661] Stack : 80000000e067be40 80000000eb587c18 80000000eb587c28 800000010b9d6da0
[ 217.662863] 80000000ea09301d ffffffff81336054 ffffffff81b6df30 ffffffff814a6cd0
[ 217.743066] 80000000ebef4300 80000000eb362e80 80000000eb587df0 0000000000000001
[ 217.823269] 80000000ea093000 000000fff2f33000 80000000ebef4300 000000ffff9c7638
[ 217.903472] 0000000000000000 80000000eb587ce0 000000ffff9c6fb0 ffffffff81336e38
[ 217.983676] 80000000ea99b210 0000000000000028 0000000000000000 ffffffff8130ec68
[ 218.063879] 80000000ea093000 000000000007463e 8000000000000000 000000ffff9c7060
[ 218.144082] 0000000000000000 0000000000000041 80000000eb587cf0 000000000007463d
[ 218.224286] 80000000ea092000 8101010101010100 ffffffff81a3db48 ffffffff84080018
[ 218.304489] ffffffff81323a40 000000002f6c6962 80000000eb587df0 0000000000000001
[ 218.384692] ...
[ 218.398234] Call Trace:
[ 218.409691]
[ 218.411783] [<ffffffff81336054>] link_path_walk+0x2fc/0x5a8
[ 218.462931] [<ffffffff814a6cd0>] security_file_alloc+0x58/0x90
[ 218.517202] [<ffffffff81336e38>] path_openat+0xa0/0x11c0
[ 218.565223] [<ffffffff8130ec68>] kmem_cache_alloc+0x278/0x288
[ 218.618456] [<ffffffff81323a40>] SyS_open+0x0/0x28
[ 218.660227] [<ffffffff81339314>] do_filp_open+0xc4/0x120
[ 218.708245] [<ffffffff8130ec68>] kmem_cache_alloc+0x278/0x288
[ 218.761471] [<ffffffff8134a71c>] __alloc_fd+0x6c/0x270
[ 218.807405] [<ffffffff81323950>] do_sys_open+0x168/0x258
[ 218.855426] [<ffffffff811782b0>] syscall_common+0x34/0x58
[ 218.904489] [<ffffffff81323a40>] SyS_open+0x0/0x28
[ 218.946255]
[ 218.948439] Code: ff9c6fb0 ffffffff 81339314 <80000001> 080a41a0 80000001 0c0040c0 0000000c 4c594012
[ 219.049474]
[ 219.051948] ---[ end trace f4aa3c16b8c49088 ]---
[ 219.091675] Sending IPI to other cpus...
[ 219.123027] Will call new kernel at 0470bf40
[ 219.158542] Bye ...
=======================================================

Saving a flatten core. Use a following command to unpack
gunzip -c <name>.core.flat.gz | makedumpfile -R <unpacked_core>
Excluding unnecessary pages : [100.0 %] \ ^C

Copying data : [ 0.0 %] -

Copying data : [ 4.1 %] / eta: 3m16sWatchdog ping. 2370 seconds left.watchdog: watchdog0: watchdog did not stop!

gzip: stdout: No space left on device
Kdump failed to finish the core dump, please check if out of space
dmesg filename: /misc/scratch/user/core/kernel.rp_RP-EDISON_0_20250228123931.txt
Filesystem Size Used Available Use% Mounted on
df: /misc/scratch/user/core: can't find mount point
-rw-r--r-- 1 0 0 8204288 Feb 28 12:39 /misc/scratch/user/core/kernel.rp_RP-EDISON_0.core.TEMP_IN_PROGRESS
Deleting the incomplete core file
reboot: Restarting system

Booting...

Leo Laohoo · ‎03-03-2025

RMA the switch.

Blue_Bird · ‎03-03-2025

Hello 259147,

Return Merchandise Authorization(RMA) process for a network switch, which means you are requesting to return a faulty switch to the manufacturer for repair or replacement under the warranty terms; you need to go through the proper procedures to get a replacement device sent to you.

Best regards
******* If This Helps, Please Rate *******