WLC 5520 - Bootlooping after Power Outage - CLI Goes to Config Wizard

Colton — Mon, 05 Jul 2021 20:16:21 GMT

We have a WLC 5520 that suffered a power loss on Friday. Since then the unit has been inaccisble via its standard IP Address.

Upon gaining console access to the device it appears to be idling at the Configuration Wizard/Autoinstall.

Here are the Error Messages on startup I am seeing...From what I can tell it might be the Flash Storage is full/missing now?

-Sadly the device is 5+ Years old now and we no longer have TAC Support for it at this time.

-Looking to determine if I can get a part replacement vs a full unit replacement worst case.

Let me know if you have any questions and I'll add what I can. Still working at getting access via CLI to the Flash as the HDD Lights on the unit itself appears to be green.

There is not enough free memory in flash to store msg/trap log buffer

Updating license storage ... Error.

Exiting SL process !
sh: 0: unknown operand
Generating Secure Shell DSA Host Key ...
Saving key "/mnt/application/ssh_host_dsa_key" failed: No such file or directory
Generating Secure Shell RSA Host Key ...
Saving key "/mnt/application/ssh_host_rsa_key" failed: No such file or directory
Generating Secure Shell version 1.5 RSA Host Key ...
Saving key "/mnt/application/ssh_host_key" failed: unknown or unsupported key type
Terminated
Unloading host drivers...
Stopping Hardware Acceleration...
Shutting down NA Connector...
Shutting down DB Services...
Shutting down Web Services...
Unloading host NIC drivers...

.o88b. d888888b .d8888. .o88b. .d88b.
d8P Y8 `88' 88' YP d8P Y8 .8P Y8.
8P 88 `8bo. 8P 88 88
8b 88 `Y8b. 8b 88 88
Y8b d8 .88. db 8D Y8b d8 `8b d8'
`Y88P' Y888888P `8888Y' `Y88P' `Y88P'

Restarting application...
Press any key now to reboot instead...
sh: 0: unknown operand
Detecting Hardware ...
Loading host drivers..
Loading host NIC drivers..
Starting Hardware Acceleration...
Generating Secure Shell DSA Host Key ...
Saving key "/mnt/application/ssh_host_dsa_key" failed: No such file or directory
Generating Secure Shell RSA Host Key ...
Saving key "/mnt/application/ssh_host_rsa_key" failed: No such file or directory
Generating Secure Shell version 1.5 RSA Host Key ...
Saving key "/mnt/application/ssh_host_key" failed: unknown or unsupported key type
Could not load host key: /mnt/application/ssh_host_rsa_key
Could not load host key: /mnt/application/ssh_host_dsa_key
Disabling protocol version 2. Could not load host key
sshd: no hostkeys available -- exiting.
Starting DB Services...
Starting Web Services...
Starting NA Connector...

Cryptographic library self-test....
Testing SHA1 Short Message 1
Testing SHA256 Short Message 1
Testing SHA384 Short Message 1
Testing SHA1 Short Message 1
SHA1 POST PASSED
Testing HMAC SHA1 Short Message 1
Testing HMAC SHA2 Short Message 1
Testing HMAC SHA384 Short Message 1
passed!

Failed to create cfg directory
sh: can't create /mnt/application//tmp1: nonexistent directory
Could not open tmp1 file, assuming XML configuration
XML config selected
Failed to create xmlmap directory
iptables: Chain already exists.
ip6tables: Chain already exists.
Validating XML configuration
touch: /mnt/application/xml//clis/XMLInvalidTagConfig.txt: No such file or directory
octeon_device_init: found 1 DPs
XML validation can not be done file open failed
sh: can't create /mnt/application/xml//clis/XMLInvalidTagConfig.txt: nonexistent directory
Cisco is a trademark of Cisco Systems, Inc.
Software Copyright Cisco Systems, Inc. All rights reserved.

Cisco AireOS Version 8.3.143.0
Initializing OS Services: ok
Initializing Serial Services: ok
Initializing Network Services: ok
Failed to read //mnt/images/vinitrd-primary
Failed to read //mnt/images/vinitrd-secondary
Initializing Licensing Storage: failed (22)
Initializing Licensing Services: ok
Starting Statistics Service: ok
Starting ARP Services: Current local time and date: Mon Feb 22 17:38:33 2021
ok
Starting Trap Manager: Failed to create xml directory: /mnt/application/xml/
ok
Starting Network Interface Management Services:
License daemon start initialization.....

License daemon running.....
Failed to create xml directory: /mnt/application/xml/
Failed to create xml directory: /mnt/application/xml/
Failed to create xml directory: /mnt/application/xml/
ok
Starting System Services: Failed to create xml directory: /mnt/application/xml/
Failed to create xml directory: /mnt/application/xml/
ok
Starting FIPS Features: Failed to create xml directory: /mnt/application/xml/
ok : Not enabled
Starting SNMP services: Failed to create xml directory: /mnt/application/xml/
ok
Starting Fastpath Hardware Acceleration: ok
Starting Fastpath DP Heartbeat : ok
Fastpath CPU0.00(0): Starting Fastpath Application. SDK-3.1.0, build 549. Flags-[DUTY CYCLE] : ok
Fastpath CPU0.00(0): Initializing last packet received queue. Num of cores(24)
Fastpath CPU0.00(0): Initializing Global Packet Queue. Num of packets supported(1000)
Fastpath CPU0.00(0): Init MBUF size: 1856, Subsequent MBUF size: 2040
Fastpath CPU0.00(0): Core 0 Initialization and FIPS self-test: ok
Fastpath CPU0.00(0): 24 Cores are being initialized
Fastpath CPU0.00(0): Initializing Timer...
Fastpath CPU0.00(0): Initializing Timer...done.
Fastpath CPU0.00(0): Initializing Timer...
Fastpath CPU0.00(0): Initializing NBAR AGING Timer...done.
Fastpath CPU0.01(0): Core 1 Initialization and FIPS self-test: ok
Fastpath CPU0.02(0): Core 2 Initialization and FIPS self-test: ok
Fastpath CPU0.01(1): ERROR reading temp sensor
Fastpath CPU0.03(1): Core 3 Initialization and FIPS self-test: ok
Fastpath CPU0.04(2): Core 4 Initialization and FIPS self-test: ok
Fastpath CPU0.05(3): Core 5 Initialization and FIPS self-test: ok
Fastpath CPU0.06(4): Core 6 Initialization and FIPS self-test: ok
Fastpath CPU0.07(5): Core 7 Initialization and FIPS self-test: ok
Fastpath CPU0.08(6): Core 8 Initialization and FIPS self-test: ok
Fastpath CPU0.09(7): Core 9 Initialization and FIPS self-test: ok
Fastpath CPU0.10(8): Core 10 Initialization and FIPS self-test: ok
Fastpath CPU0.11(9): Core 11 Initialization and FIPS self-test: ok
Fastpath CPU0.12(10): Core 12 Initialization and FIPS self-test: ok
Starting Switching Services: ok
Starting QoS Services: ok
Starting Policy Manager: ok
Starting Data Transport Link Layer: ok
Starting Access Control List Services: ok
Starting System Interfaces: ok
Starting Client Troubleshooting Service: ok
Starting Certificate Database: Failed to create xml directory: /mnt/application/xml/
Unable to load system certificate!!! Contact your Cisco Systems Inc. technical support representativeInitializing Curl Globally..
ok
Starting VPN Services: ok
Starting Management Frame Protection: ok
Starting DNS Services: ok
cp: can't stat '/mnt/application/cert.cmxcloudCA.pem': No such file or directory
ok
HBL initialization is successful
Starting Licensing Services: ok
Starting Redundancy: ok
Start rmgrPingTaskok
Starting LWAPP: Failed to create xml directory: /mnt/application/xml/
ok
Starting CAPWAP: capwapAcInit:Failed to read bundled AP image info
ok
Starting LOCP: ok
Starting Security Services: ok
Starting Policy Manager: ok
Starting Authentication Engine: ok
Starting Mobility Management: Failed to create xml directory: /mnt/application/xml/
ok
Starting Capwap Ping Component: ok
Starting AVC Services: ok
Starting AVC Flex Services: ok
Starting Virtual AP Services: Failed to create xml directory: /mnt/application/xml/
Failed to create xml directory: /mnt/application/xml/
sh: can't create /mnt/application/dc_embedded_profiles.c: nonexistent directory
ok
Starting AireWave Director: Failed to create xml directory: /mnt/application/xml/
ok
Starting Network Time Services: Failed to create xml directory: /mnt/application/xml/
ok
Starting Cisco Discovery Protocol: ok
Starting Broadcast Services: ok
Starting Logging Services: ok
Starting DHCP Server: ok
Starting IDS Signature Manager: ok
Starting RFID Tag Tracking: ok
Starting RF Profiles: ok
Starting Environment Status Monitoring Service: ok
Starting RAID Volume Status Monitoring Service: ok
Starting Mesh Services: ok
Starting TSM: ok
Starting CIDS Services: ok
Starting Ethernet-over-IP: ok
Starting DTLS server: enabled in CAPWAP
Starting CleanAir: ok
Starting WIPS: ok
Starting SSHPM LSC PROV LIST: ok
Starting RRC Services: ok
Starting SXP Services: ok
Starting Alarm Services: ok
Starting FMC HS: ok
Starting IPv6 Services: ok
Starting Config Sync Manager : ok
Starting Hotspot Services: Failed to create xml directory: /mnt/application/xml/
ok
Starting Tunnel Services New: ok
Starting PMIP Services: ok
Starting Portal Server Services: ok
Starting mDNS Services: ok

Starting Data Externalization services: Fan Policy : Low power
ok
Starting Management Services:
after sleep Current local time and date: Mon Feb 22 17:38:33 2021
Web Server: CLI: Secure Web: Web Admin Certificate not found (error).
Failed to create xml directory: /mnt/application/xml/
Starting IPSec Profiles component: ok

Re: WLC 5520 - Bootlooping after Power Outage - CLI Goes to Config Wiz

asif.javed — Fri, 07 Jul 2023 07:26:46 GMT

I am also having same issue. Were you able to find any solution?

Re: WLC 5520 - Bootlooping after Power Outage - CLI Goes to Config Wiz

Mark Elsen — Fri, 07 Jul 2023 08:51:45 GMT

@asif.javed - Please note that your query is usually less productive : people may have other engagements ,no longer working at the particular place , using other hardware and various other related arguments : best is to post in a new thread , and describe problems as you are seeing it, your controller output might be slightly different for instance which can be important in terms of analyzing the problem (e.g.)

Re: WLC 5520 - Bootlooping after Power Outage - CLI Goes to Config Wiz

nsital — Wed, 09 Aug 2023 13:40:41 GMT

This is Hardware issue. Device needs to be replaced.

topic Re: WLC 5520 - Bootlooping after Power Outage - CLI Goes to Config Wiz in Wireless

WLC 5520 - Bootlooping after Power Outage - CLI Goes to Config Wizard

Re: WLC 5520 - Bootlooping after Power Outage - CLI Goes to Config Wiz

Re: WLC 5520 - Bootlooping after Power Outage - CLI Goes to Config Wiz

Re: WLC 5520 - Bootlooping after Power Outage - CLI Goes to Config Wiz