cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Announcements
Join Customer Connection to register!
318
Views
10
Helpful
4
Replies
anonm9k
Beginner

Catalyst 3650 switch keeps rebooting

I have a Catalyst 3650 switch, which keeps rebooting. Model: WS-C3650-24PD-S.

I'm in bootloader, here are the available commands: https://pastebin.com/djfz7zny
Here is the flash: contents: https://pastebin.com/c5Vg4Sai

Error "octeon_wdt: WDT device closed unexpectedly. WDT will not stop! reboot: Restarting system"

Can anyone please help me with this? I saw a bug report on this but it is old and not helping. bugsearch link  and Here is the full message:

 

switch: boot

Getting rest of image
Reading full image into memory...Check base package header ...: done = 16384
Getting rest of image
Reading full image into memory....done
Reading full base package into memory...: done = 27926203
Bundle Image
--------------------------------------
Kernel Address    : 0x534313bc
Kernel Size       : 0x365d84/3562884
Initramfs Address : 0x53797140
Initramfs Size    : 0x16e357b/23999867
Compression Format: mzip

Bootable image at @ ram:0x534313bc
Bootable image segment 0 address range [0x81100000, 0x81bffb30] is in range [0x80180000, 0x90000000].
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@boot_system: 377
Loading Linux kernel with entry point 0x816e0310 ...
Bootloader: Done loading app on core_mask: 0xf

### Launching Linux Kernel (flags = 0x5)

MM [0] MCU version 21 sw ver 0


Front-end Microcode IMG MGR: found 1 microcode images for 1 device.
Image for front-end 0: /tmp/microcode_update/front_end/fe_type_8_1 mismatch: 1

Front-end Microcode IMG MGR: Preparing to program device microcode...
Front-end Microcode IMG MGR: Preparing to program device[0], index=0 ...88464 bytes.
Front-end Microcode IMG MGR: Programming device 0...
% Front-end Microcode IMG MGR: address 0, Could not enable sys_poll


% Front-end Microcode IMG MGR: unable to program device: 0
% Front-end Microcode IMG MGR: malformed microcode cache
Both links down, not waiting for other switches
Switch number is 1
Mar  6 17:16:11.941 RP0/0: %PMAN-3-PROCHOLDDOWN: The process platform_mgr has been helddown (rc 134)

              Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

           cisco Systems, Inc.
           170 West Tasman Drive
           San Jose, California 95134-1706



Cisco IOS Software [Everest], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.6.6, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2019 by Cisco Systems, Inc.
Compiled Thu 11-Apr-19 02:24 by mcpre



Cisco IOS-XE software, Copyright (c) 2005-2019 by cisco Systems, Inc.
All rights reserved.  Certain components of Cisco IOS-XE software are
licensed under the GNU General Public License ("GPL") Version 2.0.  The
software code licensed under GPL Version 2.0 is free software that comes
with ABSOLUTELY NO WARRANTY.  You can redistribute and/or modify such
GPL code under the terms of GPL Version 2.0.  For more details, see the
documentation or "License Notice" file accompanying the IOS-XE software,
or the applicable URL provided on the flyer accompanying the IOS-XE
software.




FIPS: Flash Key Check : Begin
FIPS: Flash Key Check : End, Not Found, FIPS Mode Not Enabled

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

cisco WS-C3650-24PD (MIPS) processor (revision V0) with 852917K/6147K bytes of memory.
Processor board ID FDO2329M1EN
2048K bytes of non-volatile configuration memory.
4194304K bytes of physical memory.
250456K bytes of Crash Files at crashinfo:.
1609272K bytes of Flash at flash:.
0K bytes of WebUI ODM Files at webui:.

Base Ethernet MAC Address          : a4:53:0e:f4:b8:80
Motherboard Assembly Number        : 73-15894-07
Motherboard Serial Number          : FDO23290MHS
Model Revision Number              : V0
Motherboard Revision Number        : A0
Model Number                       : WS-C3650-24PD
System Serial Number               : FDO2329M1EN


%INIT: waited 0 seconds for NVRAM to be available



Press RETURN to get started!


*Mar  6 17:16:32.603: %SMART_LIC-6-AGENT_READY: Smart Agent for Licensing is initialized
*Mar  6 17:16:42.114: dev_pluggable_optics_selftest attribute table internally inconsistent @ 0x1D4

*Mar  6 17:16:51.172: %SPANTREE-5-EXTENDED_SYSID: Extended SysId enabled for type vlan
*Mar  6 17:16:51.976: %LINK-3-UPDOWN: Interface Lsmpi18/3, changed state to up
*Mar  6 17:16:51.977: %LINK-3-UPDOWN: Interface EOBC18/1, changed state to up
*Mar  6 17:16:51.980: %LINK-3-UPDOWN: Interface GigabitEthernet0/0, changed state to down
*Mar  6 17:16:51.981: %LINK-3-UPDOWN: Interface LIIN18/2, changed state to up
*Mar  6 17:16:52.078: WCM-PKI-SHIM: buffer allocation failed for SUDI support check
*Mar  6 17:16:52.081: PKI/SSL unable to send Sudi support to WCM
*Mar  6 17:16:52.358: %HMANRP-6-HMAN_IOS_CHANNEL_INFO: HMAN-IOS channel event for switch 1: EMP_RELAY: Channel UP!
*Mar  6 17:16:52.367: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
*Mar  6 17:16:53.040: %LINEPROTO-5-UPDOWN: Line protocol on Interface Lsmpi18/3, changed state to up
*Mar  6 17:16:53.041: %LINEPROTO-5-UPDOWN: Line protocol on Interface EOBC18/1, changed state to up
*Mar  6 17:16:53.042: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0, changed state to down
*Mar  6 17:16:53.043: %LINEPROTO-5-UPDOWN: Line protocol on Interface LIIN18/2, changed state to up
*Mar  6 17:16:34.234: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr:  Stack port 1 on Switch 1 is nocable
*Mar  6 17:16:34.234: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr:  Stack port 2 on Switch 1 is down
*Mar  6 17:16:34.234: %STACKMGR-6-STACK_LINK_CHANGE: Switch 1 R0/0: stack_mgr:  Stack port 2 on Switch 1 is nocable
*Mar  6 17:16:34.234: %STACKMGR-6-SWITCH_ADDED: Switch 1 R0/0: stack_mgr:  Switch 1 has been added to the stack.
*Mar  6 17:16:34.234: %STACKMGR-6-SWITCH_ADDED: Switch 1 R0/0: stack_mgr:  Switch 1 has been added to the stack.
*Mar  6 17:16:34.234: %STACKMGR-6-SWITCH_ADDED: Switch 1 R0/0: stack_mgr:  Switch 1 has been added to the stack.
*Mar  6 17:16:56.161: %LINEPROTO-5-UPDOWN: Line protocol on Interface Vlan1, changed state to down
*Mar  6 17:16:57.216: %IOSXE_MGMTVRF-6-CREATE_SUCCESS_INFO: Management vrf Mgmt-vrf created with ID 1, ipv4 table-id 0x1, ipv6 table-id 0x1E000001
*Mar  6 17:16:57.287: %SYS-6-CLOCKUPDATE: System clock has been updated from 17:16:57 UTC Sat Mar 6 2021 to 20:16:57 UTC Sat Mar 6 2021, configured from console by vty0.
*Mar  6 17:16:58.092: %SYS-5-CONFIG_I: Configured from memory by console
*Mar  6 17:16:59.038: %SYS-5-RESTART: System restarted --
Cisco IOS Software [Everest], Catalyst L3 Switch Software (CAT3K_CAA-UNIVERSALK9-M), Version 16.6.6, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2019 by Cisco Systems, Inc.
Compiled Thu 11-Apr-19 02:24 by mcpre
*Mar  6 17:16:59.197: %SSH-5-ENABLED: SSH 1.99 has been enabled
*Mar  6 17:16:59.240: %LINK-5-CHANGED: Interface GigabitEthernet0/0, changed state to administratively down
*Mar  6 17:16:59.833: %AAA-3-BADSERVERTYPEERROR: Cannot process accounting server type radius (UNKNOWN)
*Mar  6 17:16:59.954: %LINK-5-CHANGED: Interface Vlan1, changed state to administratively down
*Mar  6 17:17:04.812: %PNP-6-PNP_DISCOVERY_STOPPED: PnP Discovery stopped (Startup Config Present)
*Mar  6 17:17:07.599: %HMANRP-6-EMP_NO_ELECTION_INFO: Could not elect active EMP switch, setting emp active switch to 0: EMP_RELAY: Could not elect switch with mgmt port UP
                                                                                                                                                                            Chassis 1 reloading, reason - Reload command
                         Failed to generate persistent self-signed certificate.
    Secure server will use temporary self-signed certificate.

*Mar  6 17:17:48.384: %IOSXE-0-PLATFORM: Switch 1 R0/0: Mar  6 20:17:48 pvp.sh: %PMAN-0-PROCFAILCRIT: A critical process platform_mgr has failed (rc 134)
*Mar  6 17:17:48.661: %IOSXE-3-PLATFORM: Switch 1 R0/0: Mar  6 20:17:48 pvp.sh: %PMAN-3-RELOAD_SYSTEM: Reloading: Peer switch is not standby ready. System will be reloaded
*Mar  6 17:17:48.736: %STACKMGR-1-RELOAD: Switch 1 R0/0: stack_mgr:  Reloading due to reason Reload command Mar  6 20:17:56.917 FP0/0: %PMAN-5-EXITACTION: Process manager is exiting: reload fp action requested
Mar  6 20:18:02.082 RP0/0: %PMAN-5-EXITACTION: Process manager is exiting: rp processes Mar  6 20:18:32.070 RP0/0: %PMAN-3-PROCESS_NOTIFICATION: System report /crashinfo/system-report_1_20210306-201825-UTC.tar.gz (size: 7597 KB) generated

octeon_wdt: WDT device closed unexpectedly.  WDT will not stop!
reboot: Restarting system

Any help will be appreciated. 

4 REPLIES 4
Leo Laohoo
VIP Community Legend

Contact Cisco TAC and organize for an RMA:  CSCva30394

It says "Known Fixed Releases:      (0)". How is this helpful?

Leo Laohoo
VIP Community Legend


@anonm9k wrote:

It says "Known Fixed Releases:      (0)". How is this helpful?


Read my first comment:  Contact Cisco TAC and organize for an RMA

And if TAC ask questions, tell them "reason" for the RMA is CSCva30394.  (You could also try "Because Leo Laohoo said so".)

marce1000
VIP Advisor