Refurbished AIR-CAP3702I-B-K9

[ColeB20570]

We recently purchased 10 refurbished Cisco AIR-CAP3702I-B-K9 AP's.

When connected to our network, they don't automatically connect to the WLC. I attempted to manually input the controller IP information, but I'm not seeing the interface I'd expect to see on an AP. The APs do pull a DHCP address, but they all get the same IP. Even when I attempt to factory reset the APs, the command are not available or don't seem to make a difference.

It looks like some version of switch OS was installed on the APs. I've attached what I'm seeing. 

Has anyone seen this before? Have a work around?

[balaji.bandi]

What WLC and code running ? i would reset to factory and load IOS code manually.

[ColeB20570]

Our WLC is quite old. We have a 5500 running 8.3.133.0. We have over a hundred other CAP3702s running just fine.

I am not able to factory reset. I've attempted to do that, but the commands are not the same. Whatever version of code installed on these is not what I'm used to seeing. It doesn't even show the command prompt correctly. When you factory reset, it should go to an ap: prompt. I'm seeing an ap> prompt. I can then go into "enable" mode and get an ap# prompt. 

I was going to load a new version of firmware via TFTP, but it will not take any of the commands to do so.

[balaji.bandi]

connect the console to AP and post complete boot logs and see what is wrong, also worth noting as @Leo Laohoo suggested field notices

[ColeB20570]

Here is the boot up.

*Mar 1 19:53:02.771: %DOT11-5-EXPECTED_RADIO_RESET: Restarting Radio interface Dot11Radio0 due to the reason code 11
*Mar 1 19:53:02.771: %DOT11-5-EXPECTED_RADIO_RESET: Restarting Radio interface Dot11Radio1 due to the reason code 11
*Mar 1 19:53:02.779: %SYS-5-RELOAD: Reload requested by console. Reload Reason: Reload Command.
IOS Bootloader - Starting system.
flash is writable
Tide XL MB - 40MB of flash
Xmodem file system is available.
flashfs[0]: 239 files, 7 directories
flashfs[0]: 0 orphaned files, 0 orphaned directories
flashfs[0]: Total bytes: 41158656
flashfs[0]: Bytes used: 13944320
flashfs[0]: Bytes available: 27214336
flashfs[0]: flashfs fsck took 10 seconds.
Base Ethernet MAC address: d4:78:9b:fa:77:f4
Ethernet speed is 100 Mb - FULL Duplex
Unable to get our ip address: no "IP_ADDR" variable set

The system has encountered an error initializing the
TFTP file system. The system is ignoring the error and
continuing to boot. If you abort the boot process,
the following commands will set IP_ADDR, DEFAULT_ROUTER
and NETMASK environment variables, initialize the tftp
system, and load the operating system software:

set IP_ADDR
set DEFAULT_ROUTER
set NETMASK
tftp_init
boot

Loading "flash:/ap3g2-k9w7-mx.153-3.JPL/ap3g2-k9w7-mx.153-3.JPL"...#########################

File "flash:/ap3g2-k9w7-mx.153-3.JPL/ap3g2-k9w7-mx.153-3.JPL" uncompressed and installed, entry point: 0x2003000
executing...

Secondary Bootloader - Starting system.
Montserrat Board
40MB format
Tide XL MB - 40MB of flash
Xmodem file system is available.
flashfs[0]: 239 files, 7 directories
flashfs[0]: 0 orphaned files, 0 orphaned directories
flashfs[0]: Total bytes: 41158656
flashfs[0]: Bytes used: 13944320
flashfs[0]: Bytes available: 27214336
flashfs[0]: flashfs fsck took 10 seconds.
flashfs[1]: 0 files, 1 directories
flashfs[1]: 0 orphaned files, 0 orphaned directories
flashfs[1]: Total bytes: 12257280
flashfs[1]: Bytes used: 1024
flashfs[1]: Bytes available: 12256256
flashfs[1]: flashfs fsck took 1 seconds.
Base Ethernet MAC address: d4:78:9b:fa:77:f4
Unable to locate IOS image with name **xx**.
Boot CMD: 'boot flash:/ap3g2-k9w7-mx.153-3.JPL/ap3g2-k9w7-xx.153-3.JPL'
Loading "flash:/ap3g2-k9w7-mx.153-3.JPL/ap3g2-k9w7-xx.153-3.JPL"...############################################
File "flash:/ap3g2-k9w7-mx.153-3.JPL/ap3g2-k9w7-xx.153-3.JPL" uncompressed and installed, entry point: 0x1003000
executing...

Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

cisco Systems, Inc.
170 West Tasman Drive
San Jose, California 95134-1706

Cisco IOS Software, C3700 Software (AP3G2-K9W7-M), Version 15.3(3)JPL, RELEASE SOFTWARE (fc4)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2021 by Cisco Systems, Inc.
Compiled Fri 03-Dec-21 23:11 by mcpre

Montserrat Board
40MB format
Tide XL MB - 40MB of flash
Initializing flashfs...

flashfs[2]: 239 files, 7 directories
flashfs[2]: 0 orphaned files, 0 orphaned directories
flashfs[2]: Total bytes: 40900608
flashfs[2]: Bytes used: 13944320
flashfs[2]: Bytes available: 26956288
flashfs[2]: flashfs fsck took 12 seconds.
flashfs[2]: Initialization complete.
flashfs[4]: 0 files, 1 directories
flashfs[4]: 0 orphaned files, 0 orphaned directories
flashfs[4]: Total bytes: 11999232
flashfs[4]: Bytes used: 1024
flashfs[4]: Bytes available: 11998208
flashfs[4]: flashfs fsck took 0 seconds.
flashfs[4]: Initialization complete.
Copying radio files from flash: to ram:
Copy in progress...CCCCC
Copy in progress...CCC
Copy in progress...CCCC
Copy in progress...CCCC
Copy in progress...CC
Copy in progress...CC
Copy in progress...CCCC
Copy in progress...CC
Copy in progress...CCCCCCCC
Copy in progress...CCCC
Copy in progress...CC
Copy in progress...C
Uncompressing radio files...
...done Initializing flashfs.

Radio0 present 8764 8000 0 A8000000 A8010000 0
Rate table has 650 entries (20 legacy/224 11n/406 11ac)

POWER TABLE FILENAME = ram:/Q2.bin

Radio1 present 8864 8000 0 80000000 80100000 4
POWER TABLE FILENAME = ram:/Q5.bin

Radio2 not present 0 0 0 0 0 8
This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

cisco AIR-SAP3702I-B-K9 (PowerPC) processor (revision A0) with 376814K/134656K bytes of memory.
Processor board ID FCW2313NEAF
PowerPC CPU at 800Mhz, revision number 0x2151
Last reset from power-on
1 Gigabit Ethernet interface
2 802.11 Radios

32K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address: D4:78:9B:FA:77:F4
Part Number : 73-15243-02
PCB Serial Number : FOC23104VKF
Top Assembly Part Number : 068-100891-02
Top Assembly Serial Number : FCW2313NEAF
Top Revision Number : B0
Product/Model Number : AIR-CAP3702I-B-K9

System is configured with default enable secret.Please change it before enabling HTTP Server

Press RETURN to get started!

*Mar 1 00:00:17.063: %SOAP_FIPS-2-SELF_TEST_IOS_SUCCESS: IOS crypto FIPS self test passed (15)
*Mar 1 00:00:23.219: %SOAP_FIPS-2-SELF_TEST_RAD_SUCCESS: RADIO crypto FIPS self test passed on interface Dot11Radio 0 (4)
*Mar 1 00:00:23.331: loading Power Tables from ram:/Q2.bin. Class = A
*Mar 1 00:00:23.335: record size of 3ss: 1168 read_ptr: 495424E

*Mar 1 00:00
ap>
ap>:28.535: %SOAP_FIPS-2-SELF_TEST_RAD_SUCCESS: RADIO crypto FIPS self test passed on interface Dot11Radio 1 (4)
*Mar 1 00:00:28.579: loading Power Tables from ram:/Q5.bin. Class = B
*Mar 1 00:00:28.611: record size of vht: 2904 read_ptr: 495424E

*Mar 1 00:00:28.747: SCHED: Ethernet Bridge Process: install watched boolean System Initialized(493C494), os:1 ah:0
*Mar 1 00:00:30.831: %LINK-6-UPDOWN: Interface GigabitEthernet0, changed state to up
*Mar 1 19:53:02.039: Starting Ethernet promiscuous mode
*Mar 1 19:53:02.059: %DOT11-5-EXPECTED_RADIO_RESET: Restarting Radio interface Dot11Radio0 due to the reason code 10
*Mar 1 19:53:02.063: %DOT11-5-EXPECTED_RADIO_RESET: Restarting Radio interface Dot11Radio1 due to the reason code 10
*Mar 1 19:53:02.063: %DOT11-5-EXPECTED_RADIO_RESET: Restarting Radio interface Dot11Radio0 due to the reason code 27
*Mar 1 19:53:02.063: %DOT11-5-EXPECTED_RADIO_RESET: Restarting Radio interface Dot11Radio1 due to the reason code 27
*Mar 1 19:53:02.079: %LINK-5-CHANGED: Interface Dot11Radio0, changed state to administratively down
*Mar 1 19:53:02.079: %LINK-5-CHANGED: Interface Dot11Radio1, changed state to administratively down
*Mar 1 19:53:02.079: %DOT11-5-EXPECTED_RADIO_RESET: Restarting Radio interface Dot11Radio0 due to the reason code 10
*Mar 1 19:53:02.079: %DOT11-5-EXPECTED_RADIO_RESET: Restarting Radio interface Dot11Radio1 due to the reason code 10
*Mar 1 19:53:02.135: SCHED: Ethernet Bridge Process: remove watched boolean System Initialized(493C494)
*Mar 1 19:53:02.135: SCHED: Ethernet Bridge Process: install watched queue Soap BVI input queue(492EB9C), os:0 ah:0
*Mar 1 19:53:02.135: No configuration in NVRAM..Auto Install initiated..
*Mar 1 19:53:02.559: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to down
*Mar 1 19:53:03.071: %LINEPROTO-5-UPDOWN: Line protocol on Interface BVI1, changed state to up
*Mar 1 19:53:03.079: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio0, changed state to down
*Mar 1 19:53:03.079: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to down
*Mar 1 19:53:06.735: %SOAP_FIPS-2-SELF_TEST_HW_SUCCESS: HW crypto FIPS self test passed (0-0)
*Mar 1 19:53:06.735: DPAA Initialization Complete
*Mar 1 19:53:06.735: %SYS-3-HARIKARI: Process DPAA INIT top-level routine exited
*Mar 1 19:53:07.735: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to up
*Mar 1 19:53:11.939: %DHCP-6-ADDRESS_ASSIGN: Interface BVI1 assigned DHCP address 10.55.54.1, mask 255.255.254.0, hostname ap

ap>

[Leo Laohoo]

Wait a second ... Look at the prompt.  It is an "ap>" and not "AP<MAC ADDRESS>". 

This AP is loaded with Autonomous IOS.  

1. CAPWAP RCV can be found HERE and download the filename "ap3g2-rcvk9w8-tar.153-3.JK8b.tar".
2. Put the file into a TFTP server. 
3. Use the following command to extract the firmware into the AP:  archive download-sw /no-reload tftp://<TFTP IP ADDRESS>/ap3g2-rcvk9w8-tar.153-3.JK8b.tar
4. wr erase default
5. Reboot the AP

[Leo Laohoo]

I suspect you will be encountering two major bugs: 

1. FN - 63942 - Wireless Lightweight Access Points and WLAN Controllers Fail to Create CAPWAP Connections Due to Certificate Expiration
2. FN - 72524 - During Software Upgrade/Downgrade, Cisco IOS APs Might Remain in Downloading State After December 4, 2022 Due to Certificate Expiration

[ColeB20570]

We have definitely run into FN-63942. TAC suggested we change the date on the WLC to something like 2020. Being a medical facility, we are worried what other issue this might cause with medical devices on the wireless network. We are just holding out and hoping the new controllers and funding for the APs arrive this year.

When I've run into those issues previously, you can see it happen via console during boot up. I'm not seeing it as of now.

[Leo Laohoo]

---

@ColeB20570 wrote:
Top Assembly Serial Number : FCW2313NEAF

---

TAC and I are wrong.  Base on the serial number of the AP, this AP is 4 years old.  FN-63942 does not apply to this AP.

This is something else.  

[jocke9292]

ap3g2-k9w7-xx.153-3.JPL looks to be an autonomous software and also it says "cisco AIR-SAP3702I-B-K9". If there's no join attempts to the wlc in the console you need tot change the software