WLC9800-40 reboot loop

[netgn]

We have a spare wlc9800-40 we are trying to use but it keeps rebooting over and over with below.   I've tried to boot from various versions and still get the error output below.  It seems to think there is an HA pair that its not seeing so it reboots???  rommon is super limited on what you can do.  Need to get this WLC9800-40 working and not sure what else I can do.  

RSA Signed RELEASE Image Signature Verification Successful.

Found ICH9 spi controller 8c548086@0:31.0

FlashVer:0, Jedec:0x18ba20, Name:STMICRO_N25Q128AImage validated
Booting image with bootparam="root=/dev/ram rw console=tty1 max_loop=64 pcie_ports=native SR_BOOT=bootflash:packages.conf"

Both links down, not waiting for other chassis
Chassis number is 1

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

Cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software [Cupertino], C9800 Software (C9800_IOSXE-K9), Version 17.9.5, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2024 by Cisco Systems, Inc.
Compiled Tue 30-Jan-24 15:36 by mcpre

This software version supports only Smart Licensing as the software licensing mechanism.

PLEASE READ THE FOLLOWING TERMS CAREFULLY. INSTALLING THE LICENSE OR
LICENSE KEY PROVIDED FOR ANY CISCO SOFTWARE PRODUCT, PRODUCT FEATURE,
AND/OR SUBSEQUENTLY PROVIDED SOFTWARE FEATURES (COLLECTIVELY, THE
"SOFTWARE"), AND/OR USING SUCH SOFTWARE CONSTITUTES YOUR FULL
ACCEPTANCE OF THE FOLLOWING TERMS. YOU MUST NOT PROCEED FURTHER IF YOU
ARE NOT WILLING TO BE BOUND BY ALL THE TERMS SET FORTH HEREIN.

Your use of the Software is subject to the Cisco End User License Agreement
(EULA) and any relevant supplemental terms (SEULA) found at
http://www.cisco.com/c/en/us/about/legal/cloud-and-software/software-terms.html.

You hereby acknowledge and agree that certain Software and/or features are
licensed for a particular term, that the license to such Software and/or
features is valid only for the applicable term and that such Software and/or
features may be shut down or otherwise terminated by Cisco after expiration
of the applicable license term (e.g., 90-day trial period). Cisco reserves
the right to terminate any such Software feature electronically or by any
other means available. While Cisco may provide alerts, it is your sole
responsibility to monitor your usage of any such term Software feature to
ensure that your systems and networks are prepared for a shutdown of the
Software feature.

The default license boot level has been set to none

Database already initialized
FIPS: Flash Key Check : Key Not Found, FIPS Mode Not Enabled
cisco C9800-40-K9 (1GL) processor (revision 1GL) with 3682541K/6147K bytes of memory.
Processor board ID xxxxxxxxx
Router operating mode: Autonomous
1 Virtual Ethernet interface
4 Ten Gigabit Ethernet interfaces
32768K bytes of non-volatile configuration memory.
33554432K bytes of physical memory.
26763263K bytes of eUSB flash at bootflash:.
234365527K bytes of SATA hard disk at harddisk:.
61950976K bytes of USB flash at usb0:.

Base Ethernet MAC Address : xxxxxxxxxxxx

Installation mode is INSTALL
Feb 6 17:29:01.244: %PMAN-3-PROCHOLDDOWN: C0/0: ezman: The process ezman has been helddown (rc 134)
Feb 6 17:29:01.285: %PMAN-0-PROCFAILCRIT: C0/0: pvp: A critical process ezman has failed (rc 134)
Feb 6 17:29:01.370: %PMAN-3-RELOAD_SYSTEM: C0/0: pvp: Reloading: Peer chassis is not standby ready. System will be reloaded

Chassis 1 reloading, reason - Critical process crash
Feb 6 17:29:03.263: %PMAN-5-EXITACTION: C0/0: pvp: Process manager is exiting:
Feb 6 17:29:03.351: %PMAN-5-EXITACTION: F0/0: pvp: Process manager is exiting:

[Scott Fella]

You don't have it connected to the network, just isolated right?  If you can get a prompt you can factory reset the box.

1. enable
2. factory-reset all

[netgn]

No cables connected other than console and I can’t get to # prompt as it keeps rebooting before it gets there with error I posted.

[marce1000]

  - Factory reset will be the only wat out ; have a look at  https://www.cisco.com/c/en/us/td/docs/wireless/controller/9800/9800-40/installation-guide/b-wlc-ig-9800-40/m_factory_reset.html

  M.

[netgn]

I cant factory reset as the WLC isnt coming up to allow me to enter commands.  Is there a way to factory reset using Rommon?

WLC 9800 comes up with syslog

Feb 6 17:29:01.370: %PMAN-3-RELOAD_SYSTEM: C0/0: pvp: Reloading: Peer chassis is not standby ready. System will be reloaded

and then just keeps doing this over and over.  

[netgn]

I do not have access to # prompt to do this.  Thanks for the response.  The WLC just keeps rebooting at this log entry

Feb 6 17:29:01.370: %PMAN-3-RELOAD_SYSTEM: C0/0: pvp: Reloading: Peer chassis is not standby ready. System will be reloaded

[Scott Fella]

You also can try to change the config reg and then erase the startup config, just like what you would do on a Cisco IOS-XE switch. Here is a 9800 ROMMON guide for reference.

https://www.cisco.com/c/en/us/support/docs/wireless/catalyst-9800-series-wireless-controllers/214012-recovering-a-catalyst-9800-controller-fr.html

https://community.cisco.com/t5/networking-knowledge-base/resetting-router-to-factory-default-removing-the-startup/ta-p/3131114

[netgn]

Yea tried this and still no luck.  

rommon 3 >confreg 0x2142

You must reset or power cycle for new config to take effect
rommon 4 >sync
rommon 5 >reset

Resetting .......

System integrity status: 90170200 12030106

System Bootstrap, Version 17.7(3r), RELEASE SOFTWARE
Copyright (c) 1994-2022 by cisco Systems, Inc.

Current image running: Boot ROM0
Last reset cause: LocalSoft

C9800-40-K9 platform with 33554432 Kbytes of main memory

Located C9800-40-universalk9_wlc.17.12.03.SPA.bin, start cluster is 834517

################################################################################### !snipped!
Image loaded
Boot image size = 1409293969 (0x54001e91) bytes

ROM:RSA Self Test Passed
ROM:Sha512 Self Test Passed

Package header rev 3 structure detected
Validating main package signatures

RSA Signed RELEASE Image Signature Verification Successful.
Validating subpackage signatures
Image validated

Both links down, not waiting for other chassis
Chassis number is 1

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

Cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software [Dublin], C9800 Software (C9800_IOSXE-K9), Version 17.12.3, RELEASE SOFTWARE (fc7)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2024 by Cisco Systems, Inc.
Compiled Wed 20-Mar-24 15:46 by mcpre

This software version supports only Smart Licensing as the software licensing mechanism.

PLEASE READ THE FOLLOWING TERMS CAREFULLY. INSTALLING THE LICENSE OR
LICENSE KEY PROVIDED FOR ANY CISCO SOFTWARE PRODUCT, PRODUCT FEATURE,
AND/OR SUBSEQUENTLY PROVIDED SOFTWARE FEATURES (COLLECTIVELY, THE
"SOFTWARE"), AND/OR USING SUCH SOFTWARE CONSTITUTES YOUR FULL
ACCEPTANCE OF THE FOLLOWING TERMS. YOU MUST NOT PROCEED FURTHER IF YOU
ARE NOT WILLING TO BE BOUND BY ALL THE TERMS SET FORTH HEREIN.

Your use of the Software is subject to Cisco's General Terms and any
relevant supplemental terms found at
https://www.cisco.com/site/us/en/about/legal/contract-experience/index.html.

You hereby acknowledge and agree that certain Software and/or features are
licensed for a particular term, that the license to such Software and/or
features is valid only for the applicable term and that such Software and/or
features may be shut down or otherwise terminated by Cisco after expiration
of the applicable license term (e.g., 90-day trial period). Cisco reserves
the right to terminate any such Software feature electronically or by any
other means available. While Cisco may provide alerts, it is your sole
responsibility to monitor your usage of any such term Software feature to
ensure that your systems and networks are prepared for a shutdown of the
Software feature.

The default license boot level has been set to none

Database already initialized
FIPS: Flash Key Check : Key Not Found, FIPS Mode Not Enabled
cisco C9800-40-K9 (1GL) processor (revision 1GL) with 3666043K/6147K bytes of memory.
Processor board ID xxxxxxxxx
Router operating mode: Autonomous
1 Virtual Ethernet interface
4 Ten Gigabit Ethernet interfaces
32768K bytes of non-volatile configuration memory.
33554432K bytes of physical memory.
26763263K bytes of eUSB flash at bootflash:.
234365527K bytes of SATA hard disk at harddisk:.
61950976K bytes of USB flash at usb0:.

Base Ethernet MAC Address : xxxxxxxxx

Installation mode is BUNDLE
Feb 7 10:13:17.524: %PMAN-3-PROCHOLDDOWN: C0/0: ezman: The process ezman has been helddown (rc 134)
Feb 7 10:13:17.567: %PMAN-0-PROCFAILCRIT: C0/0: pvp: A critical process ezman has failed (rc 134)
Feb 7 10:13:17.657: %PMAN-3-RELOAD_SYSTEM: C0/0: pvp: Reloading: Peer chassis is not standby ready. System will be reloaded

Chassis 1 reloading, reason - Critical process crash
Feb 7 10:13:18.503: %PMAN-5-EXITACTION: F0/0: pvp: Process manager is exiting:
Feb 7 10:13:18.554: %PMAN-5-EXITACTION: C0/0: pvp: Process manager is exiting:

[Scott Fella]

Well, you probably still have support on that, just open a TAC case and maybe it needs to be RMA'd.  I'm out of ideas.

[marce1000]

 - @Scott Fella Same opinion here, the device may   need RMA ,

 M.

[Leo Laohoo]

---

@netgn wrote:
Feb 6 17:29:01.244: %PMAN-3-PROCHOLDDOWN: C0/0: ezman: The process ezman has been helddown (rc 134)
Feb 6 17:29:01.285: %PMAN-0-PROCFAILCRIT: C0/0: pvp: A critical process ezman has failed (rc 134)

---

Do the following commands: 

pnpa service restart no-prompt