cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
5307
Views
5
Helpful
11
Replies
Highlighted
Beginner

Access point loosing connection to WLC 7.6.130

Hi ALL,

When we are trying to move the access points from 7.0.116 controller to 7.6.130 (5500). Access point is continuously loosing the connection with wlc and registering back.

Can anyone please help! Below are the logs. please let me know if you required any more information.

 

*Nov 20 10:05:23.547: %LWAPP-3-CLIENTERRORLOG: Switching to Connected mode
., 3)20 10:06:11.279: %CAPWAP-3-ERRORLOG: Retransmission count for packet exceeded max(CAPWAP_WTP_EVENT_REQUEST
*Nov 20 10:06:11.283: %LWAPP-3-CLIENTERRORLOG: Switching to Standalone mode
*Nov 20 10:06:11.287: %CAPWAP-3-ERRORLOG: GOING BACK TO DISCOVER MODE
*Nov 20 10:06:11.287: %DTLS-5-SEND_ALERT: Send FATAL : Close notify Alert to 10.50.65.61:5246
*Nov 20 10:06:21.343: %CAPWAP-3-ERRORLOG: Selected MWAR 'ERFWS019.u70015'(index 0).
*Nov 20 10:06:21.343: %CAPWAP-3-ERRORLOG: Go join a capwap controller
*Nov 20 10:06:22.000: %CAPWAP-5-DTLSREQSEND: DTLS connection request sent peer_ip: 10.50.65.61 peer_port: 5246
*Nov 20 10:06:22.615: %CAPWAP-5-DTLSREQSUCC: DTLS connection created sucessfully peer_ip: 10.50.65.61 peer_port: 5246
*Nov 20 10:06:22.615: %CAPWAP-5-SENDJOIN: sending Join Request to 10.50.65.61
*Nov 20 10:06:22.671: %CAPWAP-3-ERRORLOG: Invalid event 10 & state 5 combination.
*Nov 20 10:06:22.671: %CAPWAP-3-ERRORLOG: CAPWAP SM handler: Failed to process message type 10 state 5.
*Nov 20 10:06:22.671: %CAPWAP-3-ERRORLOG: Failed to handle capwap control message from controller
*Nov 20 10:06:22.671: %CAPWAP-3-ERRORLOG: Failed to process encrypted capwap packet from 10.50.65.61
*Nov 20 10:06:22.763: Starting Ethernet promiscuous mode
*Nov 20 10:06:23.163: %LWAPP-4-CLIENTEVENTLOG: OfficeExtend Localssid saved in AP flash
*Nov 20 10:06:23.387: %CAPWAP-5-JOINEDCONTROLLER: AP has joined controller ERFWS019.u70015
*Nov 20 10:06:24.439: %LWAPP-4-CLIENTEVENTLOG: No Flex ACL map configuration file to load. Connect to controller to get configuration file
*Nov 20 10:06:24.439: %LWAPP-4-CLIENTEVENTLOG: No Flex ACL map configuration file to load. Connect to controller to get configuration file
*Nov 20 10:06:24.439: %LWAPP-4-CLIENTEVENTLOG: No LS Flex ACL map configuration file to load. Connect to controller to get configuration file
*Nov 20 10:06:24.439: %LWAPP-4-CLIENTEVENTLOG: No Central Dhcp map configuration file to load. Connect to controller to get configuration file
*Nov 20 10:06:24.439: %CAPWAP-3-ERRORLOG:
File flash:/configs/AP_LAYER2_ACL_MAPPING_PAYLOAD_file not found
*Nov 20 10:06:24.439: %CAPWAP-3-ERRORLOG: Configuration file flash:/configs/AP_LAYER2_ACL_MAPPING_PAYLOAD_file read failed

*Nov 20 10:06:24.439: %LWAPP-3-CLIENTERRORLOG: Switching to Connected mode
., 3)20 10:07:11.167: %CAPWAP-3-ERRORLOG: Retransmission count for packet exceeded max(CAPWAP_WTP_EVENT_REQUEST
*Nov 20 10:07:11.171: %LWAPP-3-CLIENTERRORLOG: Switching to Standalone mode


.

 

 

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
VIP Mentor

Did you check the vlan mapping details are there in the AP ?

Try to put it back to local mode & the configure the FlexConnect mode again & see

HTH

Rasika

**** Pls rate all useful responses ****

View solution in original post

11 REPLIES 11
Highlighted
VIP Mentor

Did you check the vlan mapping details are there in the AP ?

Try to put it back to local mode & the configure the FlexConnect mode again & see

HTH

Rasika

**** Pls rate all useful responses ****

View solution in original post

Highlighted

We could able to successful move many HREAP ap's to 7.6.130 ver, but having issues with few HREAP access points.

When it registered to 7.6 controller, by default its showing in local mode only. when trying to change anything from GUI it is not accepting the changes applied on it.

As you said, I have got any idea. That I will change the AP mode in 7.0.116 controller and push it to 7.6

here I will configure it hreap again :)

Thank you for answering, will come with a update

 

 

 

Highlighted


*Aug  3 03:49:40.377: %CAPWAP-3-ERRORLOG: Retransmission count for packet exceeded max(CAPWAP_WTP_EVENT_REQUEST., 3)
*Aug  3 03:49:40.387: %LWAPP-3-CLIENTERRORLOG: Switching to Standalone mode
*Aug  3 03:49:40.387: %CAPWAP-3-ERRORLOG: GOING BACK TO DISCOVER MODE
*Aug  3 03:49:40.387: %DTLS-5-SEND_ALERT: Send FATAL : Close notify Alert to 10.110.1.1:5246
*Aug  3 03:49:41.652: %WIDS-6-DISABLED: IDS Signature is removed and disabled.
*Aug  3 03:49:51.657: %CAPWAP-3-ERRORLOG: Selected MWAR 'WLC01'(index 0).
*Aug  3 03:49:51.657: %CAPWAP-3-ERRORLOG: Go join a capwap controller
*Aug  3 03:49:42.000: %CAPWAP-5-DTLSREQSEND: DTLS connection request sent peer_ip: 10.110.1.1 peer_port: 5246
*Aug  3 03:49:42.781: %CAPWAP-5-DTLSREQSUCC: DTLS connection created sucessfully peer_ip: 10.110.1.1 peer_port: 5246
*Aug  3 03:49:42.782: %CAPWAP-5-SENDJOIN: sending Join Request to 10.110.1.1
*Aug  3 03:49:42.840: %CAPWAP-3-ERRORLOG: Invalid event 10 & state 5 combination.
*Aug  3 03:49:42.840: %CAPWAP-3-ERRORLOG: CAPWAP SM handler: Failed to process message type 10 state 5.
*Aug  3 03:49:42.841: %CAPWAP-3-ERRORLOG: Failed to handle capwap control message from controller
*Aug  3 03:49:42.841: %CAPWAP-3-ERRORLOG: Failed to process encrypted capwap packet from 10.110.1.1
*Aug  3 03:49:42.939: Starting Ethernet promiscuous mode
*Aug  3 03:49:43.688: %LWAPP-4-CLIENTEVENTLOG: OfficeExtend Localssid saved in AP flash
*Aug  3 03:49:43.979: %CAPWAP-5-JOINEDCONTROLLER: AP has joined controller 'WLC01'
*Aug  3 03:49:45.239: %LWAPP-4-CLIENTEVENTLOG: No Flex ACL map configuration file to load. Connect to controller to get configuration file
*Aug  3 03:49:45.240: %LWAPP-4-CLIENTEVENTLOG: No Flex ACL map configuration file to load. Connect to controller to get configuration file
*Aug  3 03:49:45.241: %LWAPP-4-CLIENTEVENTLOG: No LS Flex ACL map configuration file to load. Connect to controller to get configuration file
*Aug  3 03:49:45.242: %LWAPP-4-CLIENTEVENTLOG: No Central Dhcp map configuration file to load. Connect to controller to get configuration fileWLAN id 5, SSID fa-Access, L2ACL , L2ACL AP

*Aug  3 03:49:45.243: %LWAPP-3-CLIENTERRORLOG: Switching to Connected mode
*Aug  3 03:49:46.500: %WIDS-6-ENABLED: IDS Signature is loaded and enabled

 

 

I have 150+ APs registered on this AP but only one location has this issue but latency is below 100 ms.

 

anyone found the solution on this ??

 

Highlighted

I have changed the mode to local and tried to push to 7.6.130 controller but still same issue with different logs this time

%LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio0, changed state to up
*Nov 21 09:58:49.807: %DOT11-3-RADIO_INVALID_FREQ_FOR_CHAN: Frequency not found for channel 0 in domain 0
-Traceback= 294FA0z 8F6BA4z 893278z 8B6E98z 8B7118z 92C8DCz 92CE90z 92D43Cz 92D4E4z 92DE00z 3FEF44z
., 5)21 09:59:15.227: %CAPWAP-3-ERRORLOG: Retransmission count for packet exceeded max(CAPWAP_WTP_EVENT_REQUEST

Highlighted
Beginner
Beginner

Hi

 

Did you find a solution on this. I seem to have more or less a similar issue?

 

Regards Rasmus

Highlighted
Beginner

We had a similar issue at one of our remote sites.  Our infrastructure is a Centralized system with several remote sites.

From what it seems, the site that had the issue had a network upgrade. WAN Modem replacement. In the process, the site had temporarily switched over to the backup WAN circuit. However, when the upgrade was done, it seemed that all the APs had corrupted data when they failed back to the Primary WAN circuit. The flexconnect config may have been corrupted.
A reboot of all the APs fixed the issue. Opened a case with Cisco to narrow down the actual issue. Waiting.

 

 

See excerpt from logs similar on all APs:

 

*May 23 20:30:31.979: AP has SHA2 MIC certificate - Using SHA2 MIC certificate for DTLS.
May 23 20:30:32.000: %CAPWAP-5-DTLSREQSEND: DTLS connection request sent peer_ip: X.X.X.X peer_port: 5246
*May 23 20:30:32.499: %CAPWAP-5-DTLSREQSUCC: DTLS connection created sucessfully peer_ip: X.X.X.X peer_port: 5246
*May 23 20:30:32.499: %CAPWAP-5-SENDJOIN: sending Join Request to X.X.X.X
*May 23 20:30:37.499: %CAPWAP-5-SENDJOIN: sending Join Request to X.X.X.X
*May 23 20:30:39.795: %LWAPP-4-CLIENTEVENTLOG: OfficeExtend Localssid saved in AP flash
*May 23 20:30:41.603: %CAPWAP-5-JOINEDCONTROLLER: AP has joined controller XXXX-XX-wlc01
*May 23 20:30:41.711: %LWAPP-4-CLIENTEVENTLOG: No Flex ACL map configuration file to load. Connect to controller to get configuration file
*May 23 20:30:41.711: %LWAPP-4-CLIENTEVENTLOG: No Flex ACL map configuration file to load. Connect to controller to get configuration file
*May 23 20:30:41.711: %LWAPP-4-CLIENTEVENTLOG: No LS Flex ACL map configuration file to load. Connect to controller to get configuration file
*May 23 20:30:41.711: %LWAPP-4-CLIENTEVENTLOG: No Central Dhcp map configuration file to load. Connect to controller to get configuration fileWLAN id 1, SSID XXX, L2ACL , L2ACL AP
WLAN id 2, SSID XXX2, L2ACL , L2ACL AP
WLAN id 3, SSID XXX3, L2ACL , L2ACL AP

*May 23 20:30:41.819: %LWAPP-3-CLIENTERRORLOG: Switching to Connected mode
*May 23 20:30:42.463: [m102x_set_lanport_config] Cannot enable AUX port while POE, connect AC or Inj sourcecapwap_delete_all_l2Acls_in_nacl_list:336. Deleting all L2Acls in AP config

Highlighted

Hi Paul,

 

I have the exact logs as yours. What was the resolution to your issue?

Highlighted

Hello Almarez,

                    I vaguely remember this incident and it may or may not be applicabe to your situation. However,  I think we had high utilization issues on that WLC. We must have been running the CISCO AVC on the WLC which led to some reaper reset error. Hence, the APs couldn't download their flexconnect configurations.

 

Highlighted

Hi Paul,

Our WLC 5508 here also had the reaper reset error. Twice for the last month. Did you upgrade the firmware version? And did it solve the issue?

Highlighted

I got rid of the Cisco AVC which was causing the high Utilization that was bugging down the CPU and that fixed it. I would advise that you look for the specific reaper error/task name and then search the bug tool. Mine was the "NFV9_Task error".

This was the error I documented:  

 

WLC crashed 05-07-2018 @ 12:54pm:  Analysis of Failure: Software was stopped by the reaper for the following reason: Reaper Reset: Task "NFV9_Task" missed software watchdog !

Task NFV9_Task is consuming 100% (99% user, 0% system) Stackdump from NFV9_Task

%OSAPI-3-MSGQ_RUNNING_HIGH: osapi_msgq.c:926 Message queue nfv9queue is nearing full. Capacity 4096 Messages 3892.

 

A further Bug search on Cisco's Bug Search tool showed an AVC issue and workaround.

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvc01365

 

 

Symptom:
A wireless LAN controller may unexpectedly reload with messages similar to the following:

Task Name: NFV9_Task
Reason: Reaper Reset

Analysis of Failure:

Software was stopped by the reaper for the following reason:
Reaper Reset: Task "NFV9_Task" missed software watchdog

Conditions:
AVC is in use.

Workaround:
Disable AVC.

 

Highlighted

We ran into issues with AVC and terado traffic from Windows machines. With AVC, the controller inspects each frame and that caused the controller to eventually crash. I believe this was fixed in v8.2 or 8.3
-Scott
*** Please rate helpful posts ***
Content for Community-Ad