Controller c9800 AP 9120AXI stuck in operation state downloading

[GiuseppeCarmine]

Hello everyone, 

I'm trying to register two  APs 9120AXI to a c9800.

c9800 software version: Cisco IOS XE Software, Version 16.12.04a

AP, current software version: Cisco AP Software, ap1g7-k9w8 Version: 8.10.105.0

It has been two days already, and the APs are still in downloading.

I have no access to the APs through ssh.

Any suggestions?

[Scott Fella]

Reboot the AP’s is your only solution. Shut down the PoE.

[GiuseppeCarmine]

Hello Scott,

isn't that risky when you are downloading the OS from the controller?

[Scott Fella]

Not at all. I’ve done that many times when stuck.

[pieterh · Accepted solution]

connect a console cable to the AP to check console logging.
we experienced some issues where the new software was successfully downloaded to the AP,
but the boot-variable was not correctly changed to the new version. the AP then reloads with the AP recovery image.
this can be recognized by "RCVR" in the booted image name like: Loading "flash:/ap3g2-rcvk9w8-mx/ap3g2-rcvk9w8-mx"
this cycle download image -> boot -> load recovery image keeps repeating!
solutions are 
- boot into rommon
   change the boot variable
      set (display all variables)
      set BOOT ..... (variable name in capitals!)
      boot
- boot into rommon
   manually boot the correct image
- boot into AP OS (recovery image)
  login with cisco Cisco
  debug capwap console cli (hidden command to enable local config changes)
  re-config boot variable 
   show boot    
      conf t
         no boot .....
         boot system .....
   end     (NB! no need to write because boot variable is not stored in the startup-config on flash but in NVRAM)
  NB! you need to complete this within the timeout before it reloads  automatically
  reload

[GiuseppeCarmine]

Hello Pieterh,

Is there any command I can run on the controller to verify it?

It won't be easy to get console access from that remote site but I'll try.

Thanks

[pieterh]

first: it can be seen on the switchport, you can see the port going up/down repeatedly as the AP reboots
and with show cdp neighbors <interfacename> detail (repeat multiple times) you can see what image is active

second: when you copy the MAC address from above info you can start a debug on the controller
troubleshooting -> radioactive trace -> add mac address of AP -> start (if not allready started)
after 10-15 minutes download the logs and look for confirmation if this situation occurs