AIR-CAP2702I-A-K9 boot up issues...

[jimmysands73_2]

In a recent deployment this week we installed roughly 70 APs, two of which are not seen by the controller,  Vlan tagging has been verified. 

I consoled into one and the complete logs are at the bottom of this.

Here are some notable entries:

*Mar  1 00:01:15.911: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to up
%Error opening flash:/capwap-saved-config (No such file or directory)

*Mar  1 00:01:25.507: Interface Dot11Radio0: not starting because stop-on-failure set
Translating "CISCO-CAPWAP-CONTROLLER.AD.CCSD.NET"...domain server (172.31.8.193)

*Dec 18 21:23:09.531: %CAPWAP-5-SENDJOIN: sending Join Request to 10.132.176.12
*Dec 18 21:23:14.531: %CAPWAP-5-SENDJOIN: sending Join Request to 10.132.176.12
*Dec 18 21:24:07.999: %DTLS-5-SEND_ALERT: Send FATAL : Close notify Alert to 10.132.176.12:5246
*Dec 18 21:24:08.067: bsnInitRcbSlot: slot 0 has venus radio(UNSUPPORT)
*Dec 18 21:24:08.083: bsnUnlockDevice: not bring radio up: radio 0 is in admin disable state
*Dec 18 21:24:08.087: %LWAPP-4-CLIENTEVENTLOG: Not sending change state post as the radio admin is down, lrad state = 5

The LEDs end up in this state:

Cycling through green,red, and off
Discovery/join process in proress.   Then it appears to reboot.

Here are the complete boot up process:

IOS Bootloader - Starting system.
flash is writable
Antigua Board
40MB format
Tide XL MB - 40MB of flash
Xmodem file system is available.
flashfs[0]: 68 files, 9 directories
flashfs[0]: 0 orphaned files, 0 orphaned directories
flashfs[0]: Total bytes: 41158656
flashfs[0]: Bytes used: 19839488
flashfs[0]: Bytes available: 21319168
flashfs[0]: flashfs fsck took 10 seconds.
Base Ethernet MAC address: a8:9d:21:7f:f8:34
Ethernet speed is 1000 Mb - FULL Duplex
Loading "flash:/ap3g2-k9w8-mx.153-3.JA3/ap3g2-k9w8-mx.153-3.JA3"...#########################

File "flash:/ap3g2-k9w8-mx.153-3.JA3/ap3g2-k9w8-mx.153-3.JA3" uncompressed and installed, entry point: 0x2003000
executing...

Secondary Bootloader - Starting system.
Antigua Board Pre-Pilot
40MB format
Tide XL MB - 40MB of flash
Xmodem file system is available.
flashfs[0]: 68 files, 9 directories
flashfs[0]: 0 orphaned files, 0 orphaned directories
flashfs[0]: Total bytes: 41158656
flashfs[0]: Bytes used: 19839488
flashfs[0]: Bytes available: 21319168
flashfs[0]: flashfs fsck took 11 seconds.
flashfs[1]: 0 files, 1 directories
flashfs[1]: 0 orphaned files, 0 orphaned directories
flashfs[1]: Total bytes: 12257280
flashfs[1]: Bytes used: 1024
flashfs[1]: Bytes available: 12256256
flashfs[1]: flashfs fsck took 0 seconds.
Base Ethernet MAC address: a8:9d:21:7f:f8:34
Boot CMD: 'boot  flash:/ap3g2-k9w8-mx.153-3.JA3/ap3g2-k9w8-xx.153-3.JA3;flash:/ap3g2-rcvk9w8-mx/ap3g2-rcvk9w8-xx'
Loading "flash:/ap3g2-k9w8-mx.153-3.JA3/ap3g2-k9w8-xx.153-3.JA3"...###############################################
File "flash:/ap3g2-k9w8-mx.153-3.JA3/ap3g2-k9w8-xx.153-3.JA3" uncompressed and installed, entry point: 0x1003000
executing...

              Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

           cisco Systems, Inc.
           170 West Tasman Drive
           San Jose, California 95134-1706



Cisco IOS Software, C2700 Software (AP3G2-K9W8-M), Version 15.3(3)JA3, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2015 by Cisco Systems, Inc.
Compiled Thu 19-Feb-15 10:21 by prod_rel_team

Antigua Board Pre-Pilot
40MB format
Tide XL MB - 40MB of flash
Initializing flashfs...

flashfs[2]: 68 files, 9 directories
flashfs[2]: 0 orphaned files, 0 orphaned directories
flashfs[2]: Total bytes: 40900608
flashfs[2]: Bytes used: 19839488
flashfs[2]: Bytes available: 21061120
flashfs[2]: flashfs fsck took 11 seconds.
flashfs[2]: Initialization complete.
flashfs[4]: 0 files, 1 directories
flashfs[4]: 0 orphaned files, 0 orphaned directories
flashfs[4]: Total bytes: 11999232
flashfs[4]: Bytes used: 1024
flashfs[4]: Bytes available: 11998208
flashfs[4]: flashfs fsck took 1 seconds.
flashfs[4]: Initialization complete.
Copying radio files from flash: to ram:
Copy in progress...CCCCC
Copy in progress...CCC
Copy in progress...CCCC
Copy in progress...CCCC
Copy in progress...CC
Copy in progress...CCCC
Copy in progress...CC
Copy in progress...CCCCCC
Copy in progress...CCCC
Copy in progress...CC
Uncompressing radio files...
...done Initializing flashfs.

Radio0  present 8764 8000 0 A8000000 A8010000 0
 nop failed

Rate table has 426 entries (20 legacy/0 11n/406 11ac)

POWER TABLE FILENAME = ram:/A5.bin

Radio1  present 8864 8000 0 80000000 80100000 4
POWER TABLE FILENAME = ram:/U5.bin

This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.

A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html

If you require further assistance please contact us by sending email to
export@cisco.com.

cisco AIR-CAP2702I-A-K9 (PowerPC) processor (revision A0) with 376810K/134656K bytes of memory.
Processor board ID FCW1911N03F
PowerPC CPU at 800Mhz, revision number 0x2151
Last reset from power-on
LWAPP image version 8.0.115.0
1 Gigabit Ethernet interface
2 802.11 Radios

32K bytes of flash-simulated non-volatile configuration memory.
Base ethernet MAC Address: A8:9D:21:7F:F8:34
Part Number                          : 73-15824-03
PCA Assembly Number                  : 000-00000-00
PCA Revision Number                  :
PCB Serial Number                    : FOC191018A7
Top Assembly Part Number             : 068-100373-01
Top Assembly Serial Number           : FCW1911N03F
Top Revision Number                  : A0
Product/Model Number                 : AIR-CAP2702I-A-K9
% Please define a domain-name first.


Press RETURN to get started!


*Mar  1 00:00:16.247: %SOAP_FIPS-2-SELF_TEST_IOS_SUCCESS: IOS crypto FIPS self test passed (15)
*Mar  1 00:00:16.703: Registering HW DTLS

*Mar  1 00:00:16.711: APAVC: Initial WLAN Buffers Given to System is  2500

*Mar  1 00:00:16.759: APAVC:  WlanPAKs 42878 RadioPaks  42270

*Mar  1 00:00:16.759: Starting Ethernet promiscuous mode
*Mar  1 00:00:30.095: Cmd Timeout After 12s

*Mar  1 00:00:30.095: mvl_handle_timeout called cmdtype=[0x2]

*Mar  1 00:00:30.095: %DOT11-2-RESET_RADIO: Restarting Radio interface Dot11Radio0 due to FW: hostmem badmagic=00000000, ev=1, @01CB3E6D,s@0113D711
*Mar  1 00:00:30.099: %LINK-6-UPDOWN: Interface GigabitEthernet0, changed state to up
*Mar  1 00:00:30.099: %LINK-6-UPDOWN: Interface GigabitEthernet1, changed state to up
*Mar  1 00:00:30.115: %DOT11-2-RESET_RADIO: Restarting Radio interface Dot11Radio0 due to nop failed
*Mar  1 00:00:30.227: %DOT11-2-NO_PWR_TBL: Interface Dot11Radio0, no radio Power Table file (ram:/A5.bin) was found
*Mar  1 00:00:30.227:  FREE PWR TABLES
*Mar  1 00:00:35.299: %SOAP_FIPS-2-SELF_TEST_RAD_SUCCESS: RADIO crypto FIPS self test passed on interface Dot11Radio 1 (4)
*Mar  1 00:00:35.343: Loading Power Tables from ram:/U5.bin. Class = A
*Mar  1 00:00:35.343:  record size of vht: 2904 read_ptr: 4A74DDE

*Mar  1 00:00:35.499: Wait until the stile protocol list is initialized.

*Mar  1 00:00:36.707: Start STILE Activation

*Mar  1 00:00:38.651: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to down
*Mar  1 00:00:38.651: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1, changed state to down
*Mar  1 00:00:39.523: %SYS-5-RESTART: System restarted --
Cisco IOS Software, C2700 Software (AP3G2-K9W8-M), Version 15.3(3)JA3, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2015 by Cisco Systems, Inc.
Compiled Thu 19-Feb-15 10:21 by prod_rel_team
*Mar  1 00:00:39.523: %SNMP-5-COLDSTART: SNMP agent on host APa89d.217f.f834 is undergoing a cold start
*Mar  1 00:00:39.799: %CDP_PD-4-POWER_OK: Full power - HIGH_POWER inline power source
*Mar  1 00:00:40.643: %LINEPROTO-5-UPDOWN: Line protocol on Interface BVI1, changed state to up
*Mar  1 00:00:41.247: bsnInitRcbSlot: slot 0 has venus radio(UNSUPPORT)
*Mar  1 00:00:41.463: bsnUnlockDevice: not bring radio up: radio 0 is in admin disable statelwapp_crypto_init: MIC Present and Parsed Successfully

*Mar  1 00:00:41.819: %LINK-6-UPDOWN: Interface Dot11Radio1, changed state to up
*Mar  1 00:00:41.819: %LINK-5-CHANGED: Interface GigabitEthernet1, changed state to administratively down
*Mar  1 00:00:41.819: %SSH-5-ENABLED: SSH 2.0 has been enabled
*Mar  1 00:00:42.871: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to down
*Mar  1 00:00:51.627: %LINK-6-UPDOWN: Interface BVI1, changed state to down
*Mar  1 00:00:52.703: %LINEPROTO-5-UPDOWN: Line protocol on Interface BVI1, changed state to down
*Mar  1 00:00:54.723: %SOAP_FIPS-2-SELF_TEST_HW_SUCCESS: HW crypto FIPS self test passed (2-16)
*Mar  1 00:00:54.723: DPAA Initialization Complete
*Mar  1 00:00:54.723: %SYS-3-HARIKARI: Process DPAA INIT top-level routine exited
*Mar  1 00:00:54.723: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to up
*Mar  1 00:00:56.731: %LINK-6-UPDOWN: Interface BVI1, changed state to up
*Mar  1 00:00:57.731: %LINEPROTO-5-UPDOWN: Line protocol on Interface BVI1, changed state to up
*Mar  1 00:00:57.967: Currently running a Release Image

*Mar  1 00:00:58.387: Using SHA-2 signed certificate for image signing validation.
*Mar  1 00:00:58.475: %DHCP-6-ADDRESS_ASSIGN: Interface BVI1 assigned DHCP address 10.132.176.82, mask 255.255.255.0, hostname APa89d.217f.f834

*Mar  1 00:01:04.947: APAVC: Succeeded to activate all the STILE protocols.

*Mar  1 00:01:04.947: APAVC: Registering with CFT

*Mar  1 00:01:04.947: APAVC: CFT registration of delete callback succeeded

*Mar  1 00:01:04.947: APAVC: Reattaching  Original Buffer pool for system use

*Mar  1 00:01:04.947: Pool-ReAtach: paks 42878 radio42270
%Default route without gateway, if not a point-to-point interface, may impact performance
*Mar  1 00:01:12.355: AP image integrity check PASSED

*Mar  1 00:01:12.799: %EVT-4-WRN: Write of flash:/event.r0 done
*Mar  1 00:01:13.471: mvl_radio_coredump: Last reset code: 37; hostmem ptr 188FE6D8
*Mar  1 00:01:13.475: Writing radio coredump to 'flash:/r0.rcore', flags 1

*Mar  1 00:01:13.475: Free space on flash for radio core dump: 20012712
*Mar  1 00:01:13.515: %LINK-5-CHANGED: Interface Dot11Radio1, changed state to reset
*Mar  1 00:01:14.907: %LINK-6-UPDOWN: Interface Dot11Radio1, changed state to up
*Mar  1 00:01:15.911: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to up
%Error opening flash:/capwap-saved-config (No such file or directory)
*Mar  1 00:01:22.483: %SYS-6-LOGGINGHOST_STARTSTOP: Logging to host 255.255.255.255 port 514 CLI Request Triggered

*Mar  1 00:01:25.499: Cmd Timeout After 12s

*Mar  1 00:01:25.499: mvl_handle_timeout called cmdtype=[0x26]

*Mar  1 00:01:25.499: FW coredump command failed 0/0.
*Mar  1 00:01:25.499: No coredump info received from firmware
*Mar  1 00:01:25.507: Interface Dot11Radio0: not starting because stop-on-failure set
Translating "CISCO-CAPWAP-CONTROLLER.AD.CCSD.NET"...domain server (172.31.8.193)

*Mar  1 00:01:43.635: AP has SHA2 MIC certificate - Using SHA2 MIC certificate for DTLS.

*Dec 18 21:23:08.000: %CAPWAP-5-DTLSREQSEND: DTLS connection request sent peer_ip: 10.132.176.12 peer_port: 5246
*Dec 18 21:23:09.531: %CAPWAP-5-DTLSREQSUCC: DTLS connection created sucessfully peer_ip: 10.132.176.12 peer_port: 5246
*Dec 18 21:23:09.531: %CAPWAP-5-SENDJOIN: sending Join Request to 10.132.176.12
*Dec 18 21:23:14.531: %CAPWAP-5-SENDJOIN: sending Join Request to 10.132.176.12
*Dec 18 21:24:07.999: %DTLS-5-SEND_ALERT: Send FATAL : Close notify Alert to 10.132.176.12:5246
*Dec 18 21:24:08.067: bsnInitRcbSlot: slot 0 has venus radio(UNSUPPORT)
*Dec 18 21:24:08.083: bsnUnlockDevice: not bring radio up: radio 0 is in admin disable state
*Dec 18 21:24:08.087: %LWAPP-4-CLIENTEVENTLOG: Not sending change state post as the radio admin is down, lrad state = 5
*Dec 18 21:24:08.091: %LINK-5-CHANGED: Interface Dot11Radio1, changed state to administratively down
*Dec 18 21:24:08.107: %LINK-6-UPDOWN: Interface Dot11Radio1, changed state to up
*Dec 18 21:24:09.091: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to down
*Dec 18 21:24:09.119: %LINK-6-UPDOWN: Interface Dot11Radio1, changed state to down
*Dec 18 21:24:09.127: %LINK-5-CHANGED: Interface Dot11Radio1, changed state to reset
*Dec 18 21:24:10.147: %LINK-6-UPDOWN: Interface Dot11Radio1, changed state to up
*Dec 18 21:24:11.147: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to up
*Dec 18 21:24:18.107: AP has SHA2 MIC certificate - Using SHA2 MIC certificate for DTLS.

at which point the 16 lines above are repeated.  The are new OOB APs.

Does the logs above give a clue as to why it wont join contoller?

[Leo Laohoo]

bsnInitRcbSlot: slot 0 has venus radio(UNSUPPORT)

Post the complete output to the WLC command of "sh sysinfo".  The AP has a Regulatory Domain of "-A".  I want to see if the controller is configured for "-A" or not.

[jimmysands73_2]

The controller currently has about 68 other APs asscociated to it jfyi.

Requested info:

(Cisco Controller) >show sysinfo

Manufacturer's Name.............................. Cisco Systems Inc.
Product Name..................................... Cisco Controller
Product Version.................................. 8.0.115.0
Bootloader Version............................... 1.0.20
Field Recovery Image Version..................... 7.6.101.1
Firmware Version................................. FPGA 1.7, Env 1.8, USB console 2.2
Build Type....................................... DATA + WPS

System Name...................................... 0433-WLAN-CS5508-01
System Location..................................
System Contact...................................
System ObjectID.................................. 1.3.6.1.4.1.9.1.1069
Redundancy Mode.................................. Disabled
IP Address....................................... 10.132.176.12
IPv6 Address..................................... ::
Last Reset....................................... Software reset
System Up Time................................... 4 days 19 hrs 36 mins 45 secs
System Timezone Location......................... (GMT -8:00) Pacific Time (US and Canada)
System Stats Realtime Interval................... 5
System Stats Normal Interval..................... 180

Configured Country............................... US  - United States

--More-- or (q)uit
Operating Environment............................ Commercial (0 to 40 C)
Internal Temp Alarm Limits....................... 0 to 65 C
Internal Temperature............................. +44 C
External Temperature............................. +23 C
Fan Status....................................... OK

State of 802.11b Network......................... Enabled
State of 802.11a Network......................... Enabled
Number of WLANs.................................. 3
Number of Active Clients......................... 46

Burned-in MAC Address............................ 80:E0:1D:8B:68:80
Power Supply 1................................... Present, OK
Power Supply 2................................... Present, OK
Maximum number of APs supported.................. 500
System Nas-Id.................................... Cisco_8b:68:84
WLC MIC Certificate Types........................ SHA1/SHA2

(Cisco Controller) >

[Leo Laohoo]

no radio Power Table file (ram:/A5.bin) was found

Thanks for the "sh sysinfo" output, Jimmy.  That helps. 

I'm just reviewing what you've posted and I don't like the looks of this error message.  May I ask if you can post the first "page" of the command "sh controller dot110"?   I want to see what "version" is the firmware of the radio.  

If my suspicion is correct, you're hitting Cisco Bug ID: CSCuu42396.  I've made some comments in CSC HERE.  Let's hope I'm wrong.

[jimmysands73_2]

Will get back to you tomorrow when I go onsite. Thanks for your time.

The bug checker you link previously is for

Product:

Cisco Aironet 3700 Series

We have 2702's deployed.  But I logged into one of them and noticed it is on the same software ver as ones listed on the bug page:

Cisco IOS Software, C2700 Software (AP3G2-K9W8-M), Version 15.3(3)JA3, RELEASE SOFTWARE (fc1)

[jimmysands73_2]

That command produced a substantial amount of output....I chopped off some of it at the end, if you need it let me know.  But the output shows the (I think) telltale sign of all 00's for Mac address.  Is it time to call Cisco and RMA it?

APa89d.217f.f834#sh controllers dot11Radio 0
!
interface Dot11Radio0
Radio , Base Address 0000.0000.0000, BBlock version 0.00, Software version 0.00.0
Serial number:
Unused dynamic SQRAM memory: 0x00000000 (0 KB)
Unused dynamic SDRAM memory: 0x007FEF0C (8187 KB)
Spectrum FW version: 0.0.0
Radio stopped due to nop failed
Number of supported simultaneous BSSID on Dot11Radio0: 16
Carrier Set:  () (-A)
Uniform Spreading Required: No
Configured Frequency: 0 MHz  Channel 0
Allowed Frequencies:
Listen Frequencies:
         5180( 36)  5200( 40)  5220( 44)  5240( 48)  5260( 52)  5280( 56)  5300( 60)  5320( 64)  5500(100)  5520(104)
         5540(108)  5560(112)  5580(116)  5600(120)  5620(124)  5640(128)  5660(132)  5680(136)  5700(140)  5720(144)
         5745(149)  5765(153)  5785(157)  5805(161)  5825(165)
Beacon Flags: 0, Interface Flags 40108, Interface Events 0, Mode 9; Beacons are disabled; Probes are disabled
Configured TxPower:             0 mW (Level Index 0)
Allowed Power Levels:            0  0  0  0  0  0  0  0  dBm
Allowed Client Power Levels:     0  0  0  0  0  0  0  0  dBm
Antenna:                        Rx[]
                                Tx[]
                                External
                                Gain [Allowed, In Use 0]  (dBi x 2), In Use 0]  (dBi x 2), In Use 0]  (dBi x 2), In Use 0]  (dBi x 2), Reported 0, In Use 0]  (dBi x 2)
Active Rates:
Current Rates:  basic-1.0 basic-2.0 basic-5.5 basic-11.0 6.0 9.0 12.0 18.0 24.0 36.0 48.0 54.0
Allowed Rates:  1.0 2.0 5.5 6.0 9.0 11.0 12.0 18.0 24.0 36.0 48.0 54.0
All Rates:  1.0 2.0 5.5 11.0 6.0 9.0 12.0 18.0 24.0 36.0 48.0 54.0
Default Rates:  basic-1.0 basic-2.0 basic-5.5 basic-11.0 6.0 9.0 12.0 18.0 24.0 36.0 48.0 54.0
Best Range Rates:  basic-1.0 2.0 5.5 11.0 6.0 9.0 12.0 18.0 24.0 36.0 48.0 54.0
Best Throughput Rates:  basic-1.0 basic-2.0 basic-5.5 basic-11.0 basic-6.0 basic-9.0 basic-12.0 basic-18.0 basic-24.0 basic-36.0 basic-48.0 basic-54.0
Current Voice Rates:  basic-5.5 basic-11.0 6.0 12.0 24.0 [disabled until voice packet-discard enabled]
Default Voice Rates:  basic-5.5 basic-11.0 6.0 12.0 24.0
Managment Rates:
Multicast Rates:
 Multicast Active rate: 0.0
RTS Rates:
RTS Active rate 0.0
RTS Max rate 0.0
 Local Packet Rate Probing is disabled : Packet Size 20
Data Rate Sensitivity (rate, SNR dB, Contention dBm)
( 6.0, 15, -89)   ( 9.0, 16, -88)   (12.0, 18, -88)   (18.0, 19, -86)
(24.0, 20, -85)   (36.0, 24, -81)   (48.0, 27, -78)   (54.0, 31, -77)
CVBF: Enabled in IOS, radio FW bfmr flags 0x0 (enabled)
Number of MFP Indices: 10
Driver tx timeout:60
QOS Tag Status: disabled

RFID Tag Detection: Disabled
Multicast Address filtered:
Packet type filtered:
Probe limit: active off, filter on, count 0, time 0
Assoc limit: active off, count 0, time 0
GAS Req limit: active off, count 0, time 0
Radio Management (RM) Configuration: Regular AP, Mode 1, Disabled
ELM Disabled, Host State:Off Promiscuous Mode dwelling 0 %

MCST RSCs: [0]0x0 [1]0x0 [2]0x0 [3]0x0 [4]0x0 [5]0x0 [6]0x0 [7]0x0 [8]0x0
TKIP Cum Stats: STA            MIC-L-Errs MIC-R-Errs Replay   C-Measure
                0000.0000.0000 00000000   00000000   00000000 00000000
AES-CCMP Cum Stats: 00000000 replays discarded
Channel Utilization Extensions: Disabled
 SMPS Mode: Enabled
QBSS Load: 0x0 Tx 0 Rx 0 AP 0
 EDCA Turbo On Thresholds 60 10 4, Policing Stats: Rx downgrades 0, Tx downgrades 0
Classifier Stats tx_on_up6  0, tx_on_up4 0
Configured Local Access Class Parameters
  Back      : cw-min 4 cw-max 10 fixed-slot 7 admission-control Off txop 0
  Best      : cw-min 4 cw-max 6 fixed-slot 3 admission-control Off txop 0
  Video     : cw-min 3 cw-max 4 fixed-slot 1 admission-control Off txop 3008
  Voice     : cw-min 2 cw-max 3 fixed-slot 1 admission-control Off txop 1504
Configured Local Custom Access Class Parameters
  Back      : cw-min 4 cw-max 10 fixed-slot 7 admission-control Off txop 0
  Best      : cw-min 1 cw-max 2 fixed-slot 1 admission-control Off txop 0
  Video     : cw-min 3 cw-max 4 fixed-slot 1 admission-control Off txop 3008
  Voice     : cw-min 2 cw-max 3 fixed-slot 1 admission-control Off txop 1504
Configured Cell Access Class Parameters
  Back      : cw-min 4 cw-max 10 fixed-slot 7 admission-control Off txop 0
  Best      : cw-min 4 cw-max 10 fixed-slot 3 admission-control Off txop 0
  Video     : cw-min 3 cw-max 4 fixed-slot 2 admission-control Off txop 3008
  Voice     : cw-min 2 cw-max 3 fixed-slot 2 admission-control Off txop 1504
Active Access Class Parameters
  Back      : cw-min 0 cw-max 0 fixed-slot 0 admission-control Off txop 0
  Best      : cw-min 0 cw-max 0 fixed-slot 0 admission-control Off txop 0
  Video     : cw-min 0 cw-max 0 fixed-slot 0 admission-control Off txop 0
  Voice     : cw-min 0 cw-max 0 fixed-slot 0 admission-control Off txop 0
SIP stats sip_udp_rx_pkt 0, sip_tcp_rx_pkt 0,downlink classified_pkt 0,uplink classified_pkt 0,num_processed_SIP_Calls 0
 BA Info: Lost List Count: 0 Head:0
 Off Channel Rdy 0 Done 0 0 0
Transmit queues: Limit 27839 Current 0 In-Progress 0 ACQ inserts 0 deletes 0 reins 0
       ---- Active ------ In-Progress --------------- Counts --------------
        Cnt  Quo  Bas  Max  Cl  Cnt  Quo  Bas       Sent   Discard  Fail    Retry  Multi
Uplink    0   64    0    0    0    0    0    0          0         0     0        0      0
Voice     0  512    0    0    0    0    0    0          0         0     0        0      0
Video     0 1024    0    0    0    0    0    0          0         0     0        0      0
Best      0 1024    0    0    0    0    0    0          0         0     0        0      0
Back      0  128    0    0    0    0    0    0          0         0     0        0      0
BSSIDS Index Flags State Next Held Defer NonDefer Clients Tsf Dtim  Txq Vlan
Driver TX blocks: Realign - 0
Off Channel Stats: Last Duration 0, Errors: Timeouts 0 Tx 0 Intr 0
---Clients 0  AID VLAN Status:S/I/B/A Age TxQ-R(A) Mode Enc Key  Rate  Mask Tx   Rx             BVI   Split-ACL Client-ACL WebAuth-ACL L2-ACL
                 RxPkts KBytes  Dup Dec Mic Txc  TxPkts  KBytes  Retry RSSI SNR
               (Client) MaxPri DefUniPri DefMultPri WiredProt
               IP Address      Pauses  Idle   RateTx   RateDataTx   RSC
MVL Req=0, In=0
Video Report:  Cnt  Rate  Retries/Tot
8021x auth in prog 0 allowed 0
Vlan BSSID   Clients PSP Pri/U/M HT Flags/Encr  Key0 Key1 Key2 Key3 iGTK  SSIDs MFP
   0n 0000 0        0  0    0 0 0  0    0 0              DIS

Packet Tx (in radio) Metrics
 Max Stuck time: Normal 0 MC 0 Off Channel 0
 Stuck Cnt        Normal     MC    Off Channel
 Paks > 30 Secs     0         0         0
 Paks > 20 Secs     0         0         0
 Paks > 15 Secs     0
 Paks > 10 Secs     0         0         0
 Paks >  5 Secs     0
 Paks >  1 Secs     0         0         0
Protocol 0
Radio MAC SoC ID: 0, Rev: 0
Data Offsets: 0 72

[jimmysands73_2]

So I called Cisco, got a charming tech named Tim, he advised/emailed to format flash: and reload the files.  We tried, Netsight Manager was blocking port 10031 ( I think that was the port)...took forever to figure that out, so while he was on the call we never got it uploaded.  Tried 3 diff tftp programs, all returned strange errors.   I returned a few hours later and got it uploaded, no change ibehavior....past few days  had other duties so plan on returning to site tomorrow.

[Leo Laohoo]

Jimmy, 

My apologies.  Your reply did not hit my Notification tab (even now).  

The issue with this is the firmware of the AP is faulty.  I was told that there was supposed-to-be a code to "check" the sanity of the radio firmware.  This code is either broken (so badly) or was removed (by mistake).