06-11-2023 05:55 AM
Could everyone reading this with Catalyst AX series APs and a 9800 WLC do "show ap slots" and look for APs that have the slot 1 radio showing up as "802.11b/g" ? For example an affected AP will look like this in the output of "show ap slots":
ap-name 3 C9130AXI-B 802.11b/g 802.11b/g 802.11a
Seeing an issue on 17.9.3 (also happened once on 17.9.1) where there is apparently a 1/1000 or so chance that a Catalyst AX series AP will join the controller with regulatory domain mismatch on slot 1 even though the country code is set globally and in the AP join profile. Observed on C9130AXI-B here; other models may be affected.
Rebooting the affected AP works around the issue, but the problem is very hard to detect; the only way I've found of manually detecting it so far is to do "show ap slots" via SSH and look for slot 1 radios showing up as "802.11b/g" - which is not correct for the 9130AXI-B, or probably any Catalyst AP. DNAC doesn't throw an alarm about it, and the radio slot will be missing entirely from the output of "show ap dot11 5ghz summary".
This issue will cause affected APs to have a slot 1 5ghz dedicated radio out of operation until the AP is rebooted, which has caused a coverage complaint for me before where someone noticed on a stumbler that 5ghz coverage was bad in a particular area.
I have a TAC case open but since this issue doesn't happen very often - might need community help to get it noticed, and probably if others are experiencing it for them to open TAC cases as well.
06-11-2023 06:07 AM
Please provide the first seven characters of the Serial Number.
06-16-2023 05:09 AM
FJC2529, it's a VID 02, I've also seen it on one with the first seven chars of the serial FJC2640 which is a VID 03.
06-16-2023 02:03 PM
I've got those and I do not see them.
Raise a TAC Case and get them to check.
IMPORTANT: Make sure the TAC Case is queued in NAM/LATAM or EUMA only.
06-12-2023 06:11 AM
I don't see any cases of it across 789 APs.
06-21-2023 06:47 AM
Alright thanks for looking. Just FYI everyone should probably check their deployment after each upgrade though, it seems like whatever this is is a roughly 1/1000 chance to occur in any given deployment, probably some startup race condition between the AP and the WLC. I have a TAC case open, not sure I'll be able to reproduce it though. Next time I see it I'll collect the trace logs from the WLC for that AP.
07-13-2023 06:39 AM - edited 07-13-2023 06:52 AM
had this happen to a couple more APs, seems maybe possible that it only happens when the image is upgraded, and only happens to 9130AXI-B so far. These are on AP image version 17.9.3.203. At this point I think I'm just going to wait and see if it happens to any APs when upgrading to 17.9.4 when that comes out.
output of show logging profile wireless filtered by base radio MAC of an affected AP:
2023/07/12 13:42:43.007321393 {wncd_x_R0-1}{1}: [capwapac-smgr-sess] [22145]: (note): MAC: c884.a1ce.7800 Received CAPWAP config status request
2023/07/12 13:42:43.007383342 {wncd_x_R0-1}{1}: [capwapac-smgr-srvr] [22145]: (note): MAC: c884.a1ce.7800 Successfully handled Config status request.
2023/07/12 13:42:43.007626780 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Failed to verify reg domain slot. Get radio band record with band_id 0 error:22
2023/07/12 13:42:43.007639597 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Failed to verify reg domain slot. Get radio band record with band_id 0 error:22
2023/07/12 13:42:43.007650777 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Failed to verify reg domain slot. Get radio band record with band_id 0 error:22
2023/07/12 13:42:43.007655205 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Failed to process mac oper cfg payload. Received invalid fragmentation threshold 0 for slot 2 band 1
2023/07/12 13:42:43.007663019 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Failed to process mac oper cfg payload. Received invalid fragmentation threshold 0 for slot 2 band 1
2023/07/12 13:42:43.007665745 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Failed to process mac oper cfg payload. Received invalid fragmentation threshold 0 for slot 1 band 1
2023/07/12 13:42:43.007670207 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Failed to process mac oper cfg payload. Received invalid fragmentation threshold 0 for slot 1 band 1
2023/07/12 13:42:43.007672569 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Failed to process mac oper cfg payload. Received invalid fragmentation threshold 0 for slot 0 band 0
2023/07/12 13:42:43.007676625 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Failed to process mac oper cfg payload. Received invalid fragmentation threshold 0 for slot 0 band 0
2023/07/12 13:42:43.007787936 {wncd_x_R0-1}{1}: [mesh-db] [22145]: (ERR): c884.a1ce.7800 Mesh db dca channel change status: rec not found. Record should have been present
2023/07/12 13:42:43.007800818 {wncd_x_R0-1}{1}: [mesh-db] [22145]: (ERR): c884.a1ce.7800 Mesh db dca channel change status: rec not found. Record should have been present
2023/07/12 13:42:43.008574299 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Failed to verify reg domain slot. Get radio band record with band_id 0 error:22
2023/07/12 13:42:43.008574795 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Set reg domain check status. regulatory domain validation failed for country US, slot 2
2023/07/12 13:42:43.008601568 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Failed to verify reg domain slot. Get radio band record with band_id 0 error:22
2023/07/12 13:42:43.008601974 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Set reg domain check status. regulatory domain validation failed for country US, slot 2
2023/07/12 13:42:43.008639070 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Failed to verify reg domain slot. Get radio band record with band_id 0 error:22
2023/07/12 13:42:43.008639514 {wncd_x_R0-1}{1}: [apmgr-capwap-config] [22145]: (ERR): c884.a1ce.7800 Set reg domain check status. regulatory domain validation failed for country US, slot 2
2023/07/12 13:42:43.008646728 {wncd_x_R0-1}{1}: [apmgr-msgelem] [22145]: (ERR): c884.a1ce.7800 Disable oper state for radio 2 did not meet the criteria to enable radio
08-22-2023 02:11 PM
This is still happening in 17.9.4 but it's probably more like a 1/3000 chance on upgrade, only had one AP affected this time
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide