C9115 Image does not download images from tftp server

[witek99]

Hi,

I'm trying to update my AP from the controller via tftp but I get an error while downloading the image.

Logs From EWC

Aug 23 10:45:59.048: %INSTALL-3-OPERATION_ERROR_MESSAGE: Chassis 1 R0/0: install_engine: Failed to install_add package tftp://10.250.0.55/UP_AP/C9800-AP-iosxe-wlc.bin, Error: Failed to download file tftp://10.250.0.55/UP_AP/C9800-AP-iosxe-wlc.bin: Connection timed out

Aug 23 10:45:18.142: %INSTALL-5-INSTALL_START_INFO: Chassis 1 R0/0: install_engine: Started install add

Aug 23 10:45:15.296: %INSTALL-3-OPERATION_ERROR_MESSAGE: Chassis 1 R0/0: install_engine: Failed to install_remove package backup_image:C9800-AP-iosxe-wlc.bin, Error: [1/R0 2/R0]: FAILED: Cleanup failed in switch 1/R0 2/R0

Aug 23 10:45:15.251: %INSTALL-3-OPERATION_ERROR_MESSAGE: Chassis 1 R0/0: install_engine: Failed to install_remove package backup_image:C9800-AP-iosxe-wlc.bin, Error: [Invalid|Invalid(ERR, )]: File backup_image:C9800-AP-iosxe-wlc.bin is Invalid, please specify a valid filename

Aug 23 10:45:08.276: %INSTALL-5-INSTALL_START_INFO: Chassis 1 R0/0: install_engine: Started install remove

Aug 23 10:45:06.938: %CLIENT_EXCLUSION_SERVER-5-ADD_TO_EXCLUSIONLIST_REASON_DYNAMIC: Chassis 1 R0/0: wncd: Client MAC: 28c5.38d9.dcb6 was added to exclusion list associated with AP Name:PLBLO03-APR009, BSSID:MAC: 2c1a.051d.0c6e, reason:Wrong PSK

Aug 23 10:45:05.578: %WEBUI-6-INSTALL_OPERATION_INFO: Chassis 1 User: admin, Install Operation: ADD PROFILE default

Aug 23 10:44:52.946: %SYS-5-CONFIG_P: Configured programmatically by process SEP_webui_wsma_http from console as admin on vty0

Logs from TFTP server

Connection received from 10.250.22.4 on port 53061 [23/08 12:45:20.093]
Read request for file <UP_AP/C9800-AP-iosxe-wlc.bin>. Mode octet [23/08 12:45:20.094]
OACK: <blksize=8192,> [23/08 12:45:20.094]
Using local port 55204 [23/08 12:45:20.094]
Peer returns ERROR <Session terminated> -> aborting transfer [23/08 12:45:20.101]
Connection received from 10.250.22.4 on port 54569 [23/08 12:45:20.103]
Read request for file <UP_AP/C9800-AP-iosxe-wlc.bin>. Mode octet [23/08 12:45:20.105]
OACK: <blksize=8192,> [23/08 12:45:20.106]
Using local port 55205 [23/08 12:45:20.106]
TIMEOUT waiting for Ack block #1415 [23/08 12:45:36.877]

I try to

0#install remove inactive
install_remove: START Wed Aug 23 12:51:54 CET 2023
sed: can't read packages.conf: No such file or directory
Cleaning up unnecessary package files
Scanning boot directory for packages ... done.
Preparing packages list to delete ...
done.

SUCCESS: No extra package or provisioning files found on media. Nothing to clean.
Cleaning up unnecessary package files
Scanning boot directory for packages ... done.
Preparing packages list to delete ...
sed: can't read packages.conf: No such file or directory
done.

SUCCESS: No extra package or provisioning files found on media. Nothing to clean.
SUCCESS: install_remove Wed Aug 23 12:52:09 CET 2023

I already restarted EWC.

My Firmware

PLBLO03-WLC000#show ap image
Total number of APs : 9

Number of APs
Initiated : 0
Downloading : 0
Predownloading : 0
Completed downloading : 0
Completed predownloading : 0
Not Supported : 0
Failed to Predownload : 0
Predownload in progress : No
AP Name Primary Image Backup Image Predownload Status Predownload Version Next Retry Time Retry Count
-------------------------------------------------------------------------------------------------------------------------------------------------------
PLBLO03-APR001 17.6.3.33 17.8.0.144 None 0.0.0.0 0 0
PLBLO03-APR009 17.6.3.33 17.8.0.144 None 0.0.0.0 0 0
PLBLO03-APR004 17.6.3.33 17.8.0.144 None 0.0.0.0 0 0
PLBLO03-APR002 17.6.3.33 17.8.0.144 None 0.0.0.0 0 0
PLBLO03-APR003 17.6.3.33 17.8.0.144 None 0.0.0.0 0 0
PLBLO03-APR008 17.6.3.33 17.8.0.144 None 0.0.0.0 0 0
PLBLO03-APR006 17.6.3.33 17.8.0.144 None 0.0.0.0 0 0
PLBLO03-APR007 17.6.3.33 17.8.0.144 None 0.0.0.0 0 0
PLBLO03-APR010 17.6.3.33 17.8.0.144 None 0.0.0.0 0 0

I would be grateful for any hints to solve this problem.

[marce1000]

 - Note that using an external tftp server is necessary on EWC to hold AP images as explained in :
               https://www.cisco.com/c/en/us/td/docs/wireless/controller/ewc/17-1/config-guide/ewc_cg_17_11/image_download.html#id_128466

                            Did you configure that as such ?

 M.

[witek99]

Yes.

I've already done it a few times before and it wasn't a problem now unfortunately there is a problem. EWC starts to download the image but after a few percent the download stops. I suppose it may be due to lack of space but I don't know how to check.

[marce1000]

  - To check space ; logon to the target AP and issue the command dir ; same applies to the EWC-AP  , on both platforms issue the command show logging after the aborted tftp ,

 M.

[witek99]

There is no dir command on AP.

i can do:

 on EWC dir

 

The logs from EWC is in my first post.

There is no logs on AP related with updating on AP. 

It seems to me that the image is sent to the EWC first and then the EWC sends to the AP, so if the image does not copy completely to the EWC on the AP, there is no trace of an update attempt.

[marce1000]

             >...It seems to me that the image is sent to the EWC first and then the EWC sends to the AP
  - Not sure on that , otherwise the whole tftp setup would be kind of meaningless and the EWC would still need the space to hold the target AP image. Anyway a few other things to try are : 1) Tweak the tftp transfer timeout settings (increase) on the tftp server if such settings are available or 2) (related) try with another tftp server brand(/os)

 M.

[Rich R]

Is it the EWC AP you're trying to upgrade or a subordinate AP?
Why not use http upload on the GUI direct from your PC?
I used TFTP to install EWC originally and have used http for all upgrades since, but I just have a single EWC AP.
Have you tried reloading it?  The install scripts can sometimes get themselves in a mess which needs a reload to clear. 

On one occasion I could not get it sorted out so I did a restore from
https://www.cisco.com/c/en/us/support/docs/wireless/catalyst-9120axi-access-point/217537-repairing-c9120-c9115-access-points-from.html then upgraded to the latest CAPWAP image and then converted to EWC again!  Remember to save a copy of your config before doing that of course...