All SSID Disappear for 20 seconds on Cisco 5500 Series WLC

[Demandonio]

Hi all,

its like two weeks I'm experiencing a big problem in a production infrastructure.

Sometimes, like 8-9 times a day, every SSID disappear and the clients start losing connection, then after 20-30 seconds they appear again and everyone start reconnecting.

It seems like that radio signal (both 2.4 and 5 GHz) "restarts" but I cant understand why.

Can someone help me finding the problem and fixing it?

The firmware version is 8.5.120.0, but I cant upgrade it because the activities are 24/7.

Thank you in advance for your suggestions.

Antonio

[marce1000]

 - Enable syslogging on your WLC following the link below ; use level informational or debugging if still more info is needed to track the problem (followup on syslog messages from the WLC on the syslog-server) :

       https://www.cisco.com/c/en/us/support/docs/wireless/4100-series-wireless-lan-controllers/107252-WLC-Syslog-Server.html

M.

[Demandonio]

---

@marce1000 wrote:

 - Enable syslogging on your WLC following the link below ; use level informational or debugging if still more info is needed to track the problem (followup on syslog messages from the WLC on the syslog-server) :

       https://www.cisco.com/c/en/us/support/docs/wireless/4100-series-wireless-lan-controllers/107252-WLC-Syslog-Server.html

M.

---

I have no syslog servers. Which kind do you suggest me? It will be used just for this purpose.

I can see a lot of "message log". I'm pasting just the first page, it may be useful.

*Dot1x_NW_MsgTask_6: Oct 22 14:51:57.386: %DOT1X-3-INVALID_REPLAY_CTR: [PA]1x_eapkey.c:452 Invalid replay counter from client 9c:4f:cf:03:af:f6 - got 00 00 00 00 00 00 00 01, expected 00 00 00 00 00 00 00 00

*Dot1x_NW_MsgTask_1: Oct 22 14:51:09.262: %DOT1X-3-PSK_CONFIG_ERR: [PA]1x_ptsm.c:729 Client 28:be:03:80:c4:89 may be using an incorrect PSK

*apfReceiveTask: Oct 22 14:50:54.262: %APF-3-NO_FRAMED_IP_ADDRESS: [PA]apf_radius.c:2640 'AcctStop' clt MAC: 1c:67:58:c2:2e:44  AP MAC: 00:72:78:18:de:c0 Role 'Local' PemState 'START' SSID 'xxxx' Connected for '28' secs

*Dot1x_NW_MsgTask_6: Oct 22 14:50:15.336: %DOT1X-3-INVALID_REPLAY_CTR: [PA]1x_eapkey.c:452 Invalid replay counter from client 9c:4f:cf:03:af:f6 - got 00 00 00 00 00 00 00 03, expected 00 00 00 00 00 00 00 04

*sisfSwitcherTask: Oct 22 14:50:05.903: %LOG-3-Q_IND: [PA]apf_80211.c:14659  There is no PMK cache entry for client40:bc:60:3f:8c:a6. Can't do preauth

*apfMsConnTask_3: Oct 22 14:50:03.031: %APF-3-PREAUTH_FAILURE: [PA]apf_80211.c:14659  There is no PMK cache entry for client40:bc:60:3f:8c:a6. Can't do preauth

*apfMsConnTask_3: Oct 22 14:50:02.717: %APF-3-PREAUTH_FAILURE: [PA]apf_80211.c:14659  There is no PMK cache entry for client40:bc:60:3f:8c:a6. Can't do preauth

*apfOrphanSocketTask: Oct 22 14:49:39.898: %IPV6-3-ORPHAN_ADDR_LEARNING_FAILED: [PA]ipv6_net.c:1071 client mac =d4:e6:b7:77:15:ab, ipv6 address fe80::d6e6:b7ff:fe77:15ab,vlan=87 numIpv6Addr =1, orphan=1 failed to learn address.

*Dot1x_NW_MsgTask_6: Oct 22 14:49:35.722: %DOT1X-3-INVALID_REPLAY_CTR: [PA]1x_eapkey.c:452 Invalid replay counter from client 9c:4f:cf:03:af:f6 - got 00 00 00 00 00 00 00 01, expected 00 00 00 00 00 00 00 00

*Dot1x_NW_MsgTask_3: Oct 22 14:49:35.658: %DOT1X-3-PSK_CONFIG_ERR: [PA]1x_ptsm.c:729 Client 00:10:20:41:f9:e3 may be using an incorrect PSK

*dot1xMsgTask: Oct 22 14:49:33.459: %DOT1X-3-WPA_SEND_STATE_ERR: [PA]1x_kxsm.c:1700 Unable to send EAPOL-key msg  - invalid WPA state (2) - client 00:10:20:41:f9:e3

*apfMsConnTask_1: Oct 22 14:49:32.486: %APF-3-CHECK_SUPP_RATES_FAILED: [PA]apf_utils.c:219 Could not check supported rates. Invalid Supported Rates from station . Length :0. Mobile MAC: 00:10:20:41:f9:e3.

*apfMsConnTask_1: Oct 22 14:49:29.283: %APF-3-CHECK_SUPP_RATES_FAILED: [PA]apf_utils.c:219 Could not check supported rates. Invalid Supported Rates from station . Length :0. Mobile MAC: 00:10:20:41:f9:e3.

*apfMsConnTask_1: Oct 22 14:49:26.080: %APF-3-CHECK_SUPP_RATES_FAILED: [PA]apf_utils.c:219 Could not check supported rates. Invalid Supported Rates from station . Length :0. Mobile MAC: 00:10:20:41:f9:e3.

*apfMsConnTask_1: Oct 22 14:49:22.972: %APF-3-CHECK_SUPP_RATES_FAILED: [PA]apf_utils.c:219 Could not check supported rates. Invalid Supported Rates from station . Length :0. Mobile MAC: 00:10:20:41:f9:e3.

[Demandonio]

Last thing I found on the net is disabling fast transition, into wlans configuration.

I can test it, but does it affect the roaming functionality?

[Leo Laohoo · Accepted solution]

I've used 8.5.120.0 and I can confidently say that that version is not stable and reliable.

[leighs]

Hi, So just to clarify - The solution proposed here is that "the version of SW is not stable!" What am i missing here?? I have the same issues on an 8510 controller, running 8.5.161, so any suggestions?? thanks in advance

[Leo Laohoo]

---

@leighs wrote:

 I have the same issues on an 8510 controller, running 8.5.161, so any suggestions?? thanks in advance

---

Create a new thread so we can have a look.

[leighs]

I'll try that - thanks