02-03-2020 02:58 PM - edited 07-05-2021 11:38 AM
I have been using 4 CAP3602s with a WLC 2500 for about a year now, and when I came in on 1/30/20 all 4 of them were blinking green and not connected to the WLC. I was able to get one to rejoin by rebooting it, but the other 3 are all not joining. Here is the boot up log:
IOS Bootloader - Starting system.
flash is writable
FLASH CHIP: Numonyx Mirrorbit (0089)
Xmodem file system is available.
flashfs[0]: 60 files, 8 directories
flashfs[0]: 0 orphaned files, 0 orphaned directories
flashfs[0]: Total bytes: 31997952
flashfs[0]: Bytes used: 13837312
flashfs[0]: Bytes available: 18160640
flashfs[0]: flashfs fsck took 16 seconds.
Reading cookie from SEEPROM
Base Ethernet MAC address: d4:8c:b5:e4:2a:c7
Ethernet speed is 100 Mb - FULL Duplex
Loading "flash:/ap3g2-k9w8-mx.153-3.JA12/ap3g2-k9w8-mx.153-3.JA12"...#########################
File "flash:/ap3g2-k9w8-mx.153-3.JA12/ap3g2-k9w8-mx.153-3.JA12" uncompressed and installed, entry point: 0x2003000
executing...
Secondary Bootloader - Starting system.
Tide MB - 32MB of flash
Xmodem file system is available.
flashfs[0]: 60 files, 8 directories
flashfs[0]: 0 orphaned files, 0 orphaned directories
flashfs[0]: Total bytes: 31997952
flashfs[0]: Bytes used: 13837312
flashfs[0]: Bytes available: 18160640
flashfs[0]: flashfs fsck took 8 seconds.
flashfs[1]: 0 files, 1 directories
flashfs[1]: 0 orphaned files, 0 orphaned directories
flashfs[1]: Total bytes: 12257280
flashfs[1]: Bytes used: 1024
flashfs[1]: Bytes available: 12256256
flashfs[1]: flashfs fsck took 1 seconds.
Base Ethernet MAC address: d4:8c:b5:e4:2a:c7
2600/3600 AP, PID: 'AIR-CAP3602I-A-K9 '. Checking for BL upgrade...
BL: C3600 Boot Loader (AP3G2-BOOT-M) LoaderVersion 12.4(23)JY, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Compiled Thu 03-Oct-13 03:35 by sdcunha
BL Build year: 13
Unable to locate IOS image with name **xx**.
Boot CMD: 'boot flash:/ap3g2-k9w8-mx.153-3.JA12/ap3g2-k9w8-xx.153-3.JA12'
Loading "flash:/ap3g2-k9w8-mx.153-3.JA12/ap3g2-k9w8-xx.153-3.JA12"...################################################
File "flash:/ap3g2-k9w8-mx.153-3.JA12/ap3g2-k9w8-xx.153-3.JA12" uncompressed and installed, entry point: 0x1003000
executing...
Restricted Rights Legend
Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.
cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706
Cisco IOS Software, C3600 Software (AP3G2-K9W8-M), Version 15.3(3)JA12, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2017 by Cisco Systems, Inc.
Compiled Fri 20-Oct-17 20:51 by prod_rel_team
Tide MB - 32MB of flash
Initializing flashfs...
flashfs[2]: 60 files, 8 directories
flashfs[2]: 0 orphaned files, 0 orphaned directories
flashfs[2]: Total bytes: 31739904
flashfs[2]: Bytes used: 13837312
flashfs[2]: Bytes available: 17902592
flashfs[2]: flashfs fsck took 9 seconds.
flashfs[2]: Initialization complete.
flashfs[4]: 0 files, 1 directories
flashfs[4]: 0 orphaned files, 0 orphaned directories
flashfs[4]: Total bytes: 11999232
flashfs[4]: Bytes used: 1024
flashfs[4]: Bytes available: 11998208
flashfs[4]: flashfs fsck took 0 seconds.
flashfs[4]: Initialization complete.
Copying radio files from flash: to ram:
Copy in progress...CCCCC
Copy in progress...CCC
Copy in progress...CCCC
Copy in progress...CCCC
Copy in progress...CC
Copy in progress...CCCC
Copy in progress...CC
Copy in progress...CCCCCC
Copy in progress...CCCC
Copy in progress...CC
Uncompressing radio files...
...done Initializing flashfs.
Radio0 present 8764 8000 0 A8000000 A8010000 0
Rate table has 650 entries (20 legacy/224 11n/406 11ac)
POWER TABLE FILENAME = ram:/X2.bin
Radio1 present 8764 8000 0 88000000 88010000 4
POWER TABLE FILENAME = ram:/X5.bin
Radio2 not present 0 0 0 0 0 8
This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.
A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html
If you require further assistance please contact us by sending email to
export@cisco.com.
cisco AIR-CAP3602I-A-K9 (PowerPC) processor (revision A0) with 188398K/60928K bytes of memory.
Processor board ID FTX1630GNTE
PowerPC CPU at 800Mhz, revision number 0x2151
Last reset from power-on
LWAPP image version 8.0.152.0
1 Gigabit Ethernet interface
2 802.11 Radios
32K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address: D4:8C:B5:E4:2A:C7
Part Number : 73-14521-02
PCA Assembly Number : 800-37501-02
PCA Revision Number : A0
PCB Serial Number : FOC16296PJ0
Top Assembly Part Number : 800-35852-02
Top Assembly Serial Number : FTX1630GNTE
Top Revision Number : C0
Product/Model Number : AIR-CAP3602I-A-K9
% Please define a domain-name first.
Press RETURN to get started!
*Mar 1 00:00:14.519: %SOAP_FIPS-2-SELF_TEST_IOS_SUCCESS: IOS crypto FIPS self test passed (15)
*Mar 1 00:00:14.975: Registering HW DTLS
*Mar 1 00:00:15.071: APAVC: Initial WLAN Buffers Given to System is 2500
*Mar 1 00:00:15.119: APAVC: WlanPAKs 18174 RadioPaks 17566
*Mar 1 00:00:17.435: %LINK-6-UPDOWN: Interface GigabitEthernet0, changed state to up
*Mar 1 00:00:21.403: %SOAP_FIPS-2-SELF_TEST_RAD_SUCCESS: RADIO crypto FIPS self test passed on interface Dot11Radio 0 (4)
*Mar 1 00:00:21.515: loading Power Tables from ram:/X2.bin. Class = A
*Mar 1 00:00:21.515: record size of 3ss: 1168 read_ptr: 4DEE9B6
*Mar 1 00:00:27.855: %SOAP_FIPS-2-SELF_TEST_RAD_SUCCESS: RADIO crypto FIPS self test passed on interface Dot11Radio 1 (4)
*Mar 1 00:00:27.899: loading Power Tables from ram:/X5.bin. Class = A
*Mar 1 00:00:27.899: record size of 3ss: 1168 read_ptr: 4DEE9B6
Failed to check if timer is initialized, NULL timer handler
*Mar 1 00:00:28.015: %LWAPP-3-CLIENTERRORLOG: Load nvram:/lwapp_ap.cfg config failed, trying backup...
*Mar 1 00:00:28.019: %LWAPP-3-CLIENTERRORLOG: Load nvram:/lwapp_ap.cfg.bak config failed...
*Mar 1 00:00:28.131: Wait until the stile protocol list is initialized.
*Mar 1 00:00:29.379: Start STILE Activation
capwap_read_version_info: Info file flash:/ap3g2-k9w8-mx.153-3.JA4/info not find
*Mar 1 00:00:31.167: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to down
*Mar 1 00:00:32.259: %SYS-5-RESTART: System restarted --
Cisco IOS Software, C3600 Software (AP3G2-K9W8-M), Version 15.3(3)JA12, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2017 by Cisco Systems, Inc.
Compiled Fri 20-Oct-17 20:51 by prod_rel_team
*Mar 1 00:00:32.259: %SNMP-5-COLDSTART: SNMP agent on host ap is undergoing a cold start
*Jul 20 12:23:05.247: %CDP_PD-4-POWER_OK: Full power - HIGH_POWER inline power source
*Jul 20 12:23:06.091: %LINEPROTO-5-UPDOWN: Line protocol on Interface BVI1, changed state to up
*Jul 20 12:23:06.895: %LWAPP-3-CLIENTERRORLOG: Load nvram:/lwapp_ap.cfg config failed, trying backup...
*Jul 20 12:23:06.895: %LWAPP-3-CLIENTERRORLOG: Load nvram:/lwapp_ap.cfg.bak config failed...
*Jul 20 12:23:07.311: %LINK-6-UPDOWN: Interface Dot11Radio0, changed state to uplwapp_crypto_init: MIC Present and Parsed Successfully
*Jul 20 12:23:07.471: %SSH-5-ENABLED: SSH 2.0 has been enabled
*Jul 20 12:23:07.471: %LINK-6-UPDOWN: Interface Dot11Radio1, changed state to up
*Jul 20 12:23:08.311: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio0, changed state to down
*Jul 20 12:23:08.523: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to down
*Jul 20 12:23:17.091: %LINK-6-UPDOWN: Interface BVI1, changed state to down
*Jul 20 12:23:18.091: %LINEPROTO-5-UPDOWN: Line protocol on Interface BVI1, changed state to down
*Jul 20 12:23:20.187: %SOAP_FIPS-2-SELF_TEST_HW_SUCCESS: HW crypto FIPS self test passed (2-16)
*Jul 20 12:23:20.187: DPAA Initialization Complete
*Jul 20 12:23:20.187: %SYS-3-HARIKARI: Process DPAA INIT top-level routine exited
*Jul 20 12:23:21.187: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to up
*Jul 20 12:23:23.191: %LINK-6-UPDOWN: Interface BVI1, changed state to up
*Jul 20 12:23:23.443: Currently running a Release Image
validate_sha2_block: Failed to get certificate chain
*Jul 20 12:23:23.863: Using SHA-1 signed certificate for image signing validation.
*Jul 20 12:23:24.351: %LINEPROTO-5-UPDOWN: Line protocol on Interface BVI1, changed state to up
*Jul 20 12:23:30.579: APAVC: Succeeded to activate all the STILE protocols.
*Jul 20 12:23:30.579: APAVC: Registering with CFT
*Jul 20 12:23:30.579: APAVC: CFT registration of delete callback succeeded
*Jul 20 12:23:30.579: APAVC: Reattaching Original Buffer pool for system use
*Jul 20 12:23:30.579: Pool-ReAtach: paks 18174 radio17566
%Default route without gateway, if not a point-to-point interface, may impact performance
*Jul 20 12:23:37.623: AP image integrity check PASSED
*Jul 20 12:23:37.627: %LWAPP-3-CLIENTERRORLOG: Load nvram:/lwapp_ap.cfg config failed, trying backup...
*Jul 20 12:23:37.631: %LWAPP-3-CLIENTERRORLOG: Load nvram:/lwapp_ap.cfg.bak config failed...
*Jul 20 12:23:37.695: validate_sha2_block:No SHA2 Block present on this AP.
*Jul 20 12:23:37.715: %LINK-5-CHANGED: Interface Dot11Radio0, changed state to reset
*Jul 20 12:23:38.807: %LINK-6-UPDOWN: Interface Dot11Radio0, changed state to up
*Jul 20 12:23:38.815: %LINK-5-CHANGED: Interface Dot11Radio1, changed state to reset
*Jul 20 12:23:39.807: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio0, changed state to up
*Jul 20 12:23:39.907: %LINK-6-UPDOWN: Interface Dot11Radio1, changed state to up
*Jul 20 12:23:40.907: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to up
%Error opening flash:/capwap-saved-config (No such file or directory)
%Error opening flash:/capwap-saved-config-bak (No such file or directory)
*Jul 20 12:23:47.723: %SYS-6-LOGGINGHOST_STARTSTOP: Logging to host 255.255.255.255 port 0 CLI Request Triggered
Not in Bound state.
*Jul 20 12:24:47.731: %CAPWAP-3-DHCP_RENEW: Could not discover WLC. Either IP address is not assigned or assigned IP is wrong. Renewing DHCP IP.
I know it is not a DHCP server or a controller problem, as I have an AP working on that controller as well as 2 other controllers with multiple APs that did not have the same problems. Thanks in advance for your help.
02-03-2020 03:52 PM
@r3kr4p wrote:
*Jul 20 12:23:40.907: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to up
Post the complete output to the WLC command "sh time".
Look at the time and date of the AP.
02-03-2020 04:14 PM
I do not have access to the AP right now, but I changed the time to within a minute of the controllers when I first booted it after resetting it. I did that on all 3 of the APs that are not connecting. I also tried setting a static IP that is within the subnet of the controller and that did not work.
02-03-2020 04:59 PM
02-05-2020 07:47 AM
My apologies, I should read more carefully. Here is the output of sh time from the WLC:
(Cisco Controller) >show time
Time............................................. Wed Feb 5 09:44:41 2020
Timezone delta................................... 0:0
Timezone location................................ (GMT -6:00) Central Time (US and Canada)
NTP Servers
NTP Polling Interval......................... 3600
Index NTP Key Index NTP Server NTP Msg Auth Status
------- ----------------------------------------------------------------------------------
1 0 10.160.0.1 AUTH DISABLED
02-05-2020 01:29 PM
02-05-2020 01:33 PM
I rebooted all non-functioning aps and they still did not connect.
(Cisco Controller) >show sysinfo
Manufacturer's Name.............................. Cisco Systems Inc.
Product Name..................................... Cisco Controller
Product Version.................................. 8.0.152.0
Bootloader Version............................... 1.0.20
Field Recovery Image Version..................... 7.6.101.1
Firmware Version................................. PIC 20.0
Build Type....................................... DATA + WPS
System Name...................................... BAPS-WLC
System Location..................................
System Contact...................................
System ObjectID.................................. 1.3.6.1.4.1.9.1.1279
IP Address....................................... 10.160.0.8
IPv6 Address..................................... ::
Last Reset....................................... Software reset
System Up Time................................... 4 days 23 hrs 28 mins 30 secs
System Timezone Location......................... (GMT -6:00) Central Time (US a nd Canada)
System Stats Realtime Interval................... 5
System Stats Normal Interval..................... 180
--More-- or (q)uit
Configured Country............................... US - United States
Operating Environment............................ Commercial (0 to 40 C)
Internal Temp Alarm Limits....................... 0 to 65 C
Internal Temperature............................. +36 C
External Temperature............................. +39 C
Fan Status....................................... 3800 rpm
State of 802.11b Network......................... Disabled
State of 802.11a Network......................... Enabled
Number of WLANs.................................. 16
Number of Active Clients......................... 3
Burned-in MAC Address............................ 84:80:2D:F9:78:A0
Maximum number of APs supported.................. 75
System Nas-Id....................................
WLC MIC Certificate Types........................ SHA1/SHA2
02-05-2020 02:12 PM
@r3kr4p wrote:
*Jul 20 12:24:47.731: %CAPWAP-3-DHCP_RENEW: Could not discover WLC. Either IP address is not assigned or assigned IP is wrong. Renewing DHCP IP.
Oh wait ... I actually didn't see this until now.
What happens if you enter this command into the AP: capwap ap primary-base <WLC NAME> <WLC IP ADDRESS>
02-05-2020 02:19 PM
I tried that, nothing happened. I expect that is because it does not have an IP.
02-05-2020 03:06 PM
@r3kr4p wrote:
I expect that is because it does not have an IP.
Check the DHCP server.
Nothing will work if the APs are not getting valid IP addresses.
02-05-2020 03:09 PM
Alright thank you.
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide