Hi Leo,    There is no FW rule.    good pickup leo, I cant ping 10.1.1.231 from the AP but can ping 10.1.1.230 ( switch management)    WLC cant ping anything in the 20 range ( not even 10.1.20.1, switches SVI)    will look into my routing, thanks mate.   ... View more

below is a show capwap events:    (Cisco Controller) >debug capwap events enable    (Cisco Controller) >*spamApTask5: Feb 01 12:11:36.368: f4:4e:05:aa:a6:a0 Discovery Request from 10.1.20.75:19514   *spamApTask5: Feb 01 12:11:36.368: f4:4e:05:aa:a6:a0 Join Priority Processing status = 0, Incoming Ap's Priority 1, MaxLrads = 5, joined Aps =0 *spamApTask5: Feb 01 12:11:36.368: apModel: AIR-CAP3702I-Z-K9   *spamApTask5: Feb 01 12:11:36.368: apType = 45 apModel: AIR-CAP3702I-Z-K9   *spamApTask5: Feb 01 12:11:36.368: f4:4e:05:aa:a6:a0 Discovery Response sent to 10.1.20.75 port 19514   *spamApTask5: Feb 01 12:11:36.368: f4:4e:05:aa:a6:a0 Discovery Response sent to 10.1.20.75:19514   *spamApTask5: Feb 01 12:11:36.368: f4:4e:05:aa:a6:a0 Discovery Request from 10.1.20.75:19514   *spamApTask5: Feb 01 12:11:36.368: f4:4e:05:aa:a6:a0 Join Priority Processing status = 0, Incoming Ap's Priority 1, MaxLrads = 5, joined Aps =0 *spamApTask5: Feb 01 12:11:36.368: apModel: AIR-CAP3702I-Z-K9   *spamApTask5: Feb 01 12:11:36.368: apType = 45 apModel: AIR-CAP3702I-Z-K9   *spamApTask5: Feb 01 12:11:36.369: f4:4e:05:aa:a6:a0 Discovery Response sent to 10.1.20.75 port 19514   *spamApTask5: Feb 01 12:11:36.369: f4:4e:05:aa:a6:a0 Discovery Response sent to 10.1.20.75:19514   *spamApTask6: Feb 01 12:11:41.183: f4:4e:05:b6:ce:f0 Discovery Request from 10.1.20.76:29162     show capwap error's:      debug capwap errors enable*spamApTask4: Feb 01 12:15:04.668: f4:4e:05:b6:ce:f0 ApModel: AIR-CAP3702I-Z-K9   *spamApTask4: Feb 01 12:15:04.668: Unknown AP type. Using Controller Version!!!   debug capwap errors ena*spamApTask3: Feb 01 12:15:09.851: f4:4e:05:aa:a6:a0 ApModel: AIR-CAP3702I-Z-K9   *spamApTask3: Feb 01 12:15:09.851: Unknown AP type. Using Controller Version!!!   *spamApTask3: Feb 01 12:15:09.852: f4:4e:05:aa:a6:a0 ApModel: AIR-CAP3702I-Z-K9 ... View more

Hi Hulmiho,    Thanks for that, I removed the interface and still no luck.  ... View more

Hey Scott,    I gave that a shot and still no luck, log's from AP boot up:   IIOS Bootloader - Starting system. flash is writable Tide XL MB - 40MB of flash Xmodem file system is available. flashfs[0]: 67 files, 9 directories flashfs[0]: 0 orphaned files, 0 orphaned directories flashfs[0]: Total bytes: 41158656 flashfs[0]: Bytes used: 20894208 flashfs[0]: Bytes available: 20264448 flashfs[0]: flashfs fsck took 20 seconds. Base Ethernet MAC address: f4:4e:05:b7:1e:84 Ethernet speed is 100 Mb - FULL Duplex Loading "flash:/ap3g2-k9w8-mx.153-3.JA1/ap3g2-k9w8-mx.153-3.JA1"...#########################   File "flash:/ap3g2-k9w8-mx.153-3.JA1/ap3g2-k9w8-mx.153-3.JA1" uncompressed and installed, entry point: 0x2003000 executing...   Secondary Bootloader - Starting system. Montserrat Board 40MB format Tide XL MB - 40MB of flash Xmodem file system is available. flashfs[0]: 67 files, 9 directories flashfs[0]: 0 orphaned files, 0 orphaned directories flashfs[0]: Total bytes: 41158656 flashfs[0]: Bytes used: 20894208 flashfs[0]: Bytes available: 20264448 flashfs[0]: flashfs fsck took 21 seconds. flashfs[1]: 0 files, 1 directories flashfs[1]: 0 orphaned files, 0 orphaned directories flashfs[1]: Total bytes: 12257280 flashfs[1]: Bytes used: 1024 flashfs[1]: Bytes available: 12256256 flashfs[1]: flashfs fsck took 1 seconds. Base Ethernet MAC address: f4:4e:05:b7:1e:84 Boot CMD: 'boot  flash:/ap3g2-k9w8-mx.153-3.JA1/ap3g2-k9w8-xx.153-3.JA1;flash:/ap3g2-k9w8-mx.153-3.JA1/ap3g2-k9w8-xx.153-3.JA1' Loading "flash:/ap3g2-k9w8-mx.153-3.JA1/ap3g2-k9w8-xx.153-3.JA1"...############################################### File "flash:/ap3g2-k9w8-mx.153-3.JA1/ap3g2-k9w8-xx.153-3.JA1" uncompressed and installed, entry point: 0x1003000 executing...                 Restricted Rights Legend   Use, duplication, or disclosure by the Government is subject to restrictions as set forth in subparagraph (c) of the Commercial Computer Software - Restricted Rights clause at FAR sec. 52.227-19 and subparagraph (c) (1) (ii) of the Rights in Technical Data and Computer Software clause at DFARS sec. 252.227-7013.              cisco Systems, Inc.            170 West Tasman Drive            San Jose, California 95134-1706     Cisco IOS Software, C3700 Software (AP3G2-K9W8-M), Version 15.3(3)JA1, RELEASE SOFTWARE (fc1) Technical Support: http://www.cisco.com/techsupport Copyright (c) 1986-2014 by Cisco Systems, Inc. Compiled Fri 19-Dec-14 11:20 by prod_rel_team   Montserrat Board 40MB format Tide XL MB - 40MB of flash Initializing flashfs...   flashfs[2]: 67 files, 9 directories flashfs[2]: 0 orphaned files, 0 orphaned directories flashfs[2]: Total bytes: 40900608 flashfs[2]: Bytes used: 20894208 flashfs[2]: Bytes available: 20006400 flashfs[2]: flashfs fsck took 14 seconds. flashfs[2]: Initialization complete. flashfs[4]: 0 files, 1 directories flashfs[4]: 0 orphaned files, 0 orphaned directories flashfs[4]: Total bytes: 11999232 flashfs[4]: Bytes used: 1024 flashfs[4]: Bytes available: 11998208 flashfs[4]: flashfs fsck took 0 seconds. flashfs[4]: Initialization complete. Copying radio files from flash: to ram: Copy in progress...CCCCC Copy in progress...CCC Copy in progress...CCCC Copy in progress...CCCC Copy in progress...CC Copy in progress...CCCC Copy in progress...CC Copy in progress...CCCCC Copy in progress...CCCC Copy in progress...CC Uncompressing radio files... ...done Initializing flashfs.   Radio0  present 8764 8000 0 A8000000 A8010000 0 Rate table has 650 entries (20 legacy/224 11n/406 11ac)   POWER TABLE FILENAME = ram:/Q2.bin   Radio1  present 8864 8000 0 80000000 80100000 4 POWER TABLE FILENAME = ram:/Q5.bin   Radio2 not present 0 0 0 0 0 8 This product contains cryptographic features and is subject to United States and local country laws governing import, export, transfer and use. Delivery of Cisco cryptographic products does not imply third-party authority to import, export, distribute or use encryption. Importers, exporters, distributors and users are responsible for compliance with U.S. and local country laws. By using this product you agree to comply with applicable laws and regulations. If you are unable to comply with U.S. and local laws, return this product immediately.   A summary of U.S. laws governing Cisco cryptographic products may be found at: http://www.cisco.com/wwl/export/crypto/tool/stqrg.html   If you require further assistance please contact us by sending email to export@cisco.com.   cisco AIR-CAP3702I-Z-K9 (PowerPC) processor (revision A0) with 376810K/134656K bytes of memory. Processor board ID FGL1838X4T1 PowerPC CPU at 800Mhz, revision number 0x2151 Last reset from power-on LWAPP image version 8.0.110.0 1 Gigabit Ethernet interface 2 802.11 Radios   32K bytes of flash-simulated non-volatile configuration memory. Base ethernet MAC Address: F4:4E:05:B7:1E:84 Part Number                          : 73-15243-01 PCA Assembly Number                  : 000-00000-00 PCA Revision Number                  : PCB Serial Number                    : FOC18343WPR Top Assembly Part Number             : 068-05054-03 Top Assembly Serial Number           : FGL1838X4T1 Top Revision Number                  : A0 Product/Model Number                 : AIR-CAP3702I-Z-K9 % Please define a domain-name first.     Press RETURN to get started!     *Mar  1 00:00:19.295: %SOAP_FIPS-2-SELF_TEST_IOS_SUCCESS: IOS crypto FIPS self test passed (15) *Mar  1 00:00:19.755: Registering HW DTLS   *Mar  1 00:00:19.763: APAVC: Initial WLAN Buffers Given to System is  2500   *Mar  1 00:00:19.815: APAVC:  WlanPAKs 42878 RadioPaks  42270   *Mar  1 00:00:22.127: %LINK-6-UPDOWN: Interface GigabitEthernet0, changed state to up *Mar  1 00:00:26.055: %SOAP_FIPS-2-SELF_TEST_RAD_SUCCESS: RADIO crypto FIPS self test passed on interface Dot11Radio 0 (4) *Mar  1 00:00:26.167: Loading Power Tables from ram:/Q2.bin. Class = A *Mar  1 00:00:26.167:  record size of 3ss: 1168 read_ptr: 4F9698E   *Mar  1 00:00:31.207: %SOAP_FIPS-2-SELF_TEST_RAD_SUCCESS: RADIO crypto FIPS self test passed on interface Dot11Radio 1 (4) *Mar  1 00:00:31.251: Loading Power Tables from ram:/Q5.bin. Class = Z *Mar  1 00:00:31.251:  record size of vht: 2904 read_ptr: 4F9698E   *Mar  1 00:00:31.407: Wait until the stile protocol list is initialized.   *Mar  1 00:00:32.651: Start STILE Activation   *Mar  1 00:00:34.571: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to down *Mar  1 00:00:35.447: %SYS-5-RESTART: System restarted -- Cisco IOS Software, C3700 Software (AP3G2-K9W8-M), Version 15.3(3)JA1, RELEASE SOFTWARE (fc1) Technical Support: http://www.cisco.com/techsupport Copyright (c) 1986-2014 by Cisco Systems, Inc. Compiled Fri 19-Dec-14 11:20 by prod_rel_team *Mar  1 00:00:35.447: %SNMP-5-COLDSTART: SNMP agent on host Test_1 is undergoing a cold start *Mar  1 00:00:36.563: %LINEPROTO-5-UPDOWN: Line protocol on Interface BVI1, changed state to up *Mar  1 00:00:37.787: %LINK-6-UPDOWN: Interface Dot11Radio0, changed state to uplwapp_crypto_init: MIC Present and Parsed Successfully   *Mar  1 00:00:37.939: %SSH-5-ENABLED: SSH 2.0 has been enabled *Mar  1 00:00:37.939: %LINK-6-UPDOWN: Interface Dot11Radio1, changed state to up *Mar  1 00:00:38.987: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio0, changed state to down *Mar  1 00:00:38.987: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to down *Mar  1 00:00:47.567: %LINK-6-UPDOWN: Interface BVI1, changed state to down *Mar  1 00:00:48.567: %LINEPROTO-5-UPDOWN: Line protocol on Interface BVI1, changed state to down *Mar  1 00:00:50.431: %SOAP_FIPS-2-SELF_TEST_HW_SUCCESS: HW crypto FIPS self test passed (2-16) *Mar  1 00:00:50.431: DPAA Initialization Complete *Mar  1 00:00:50.431: %SYS-3-HARIKARI: Process DPAA INIT top-level routine exited *Mar  1 00:00:51.431: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0, changed state to up *Mar  1 00:00:53.435: %LINK-6-UPDOWN: Interface BVI1, changed state to up *Mar  1 00:00:53.867: Currently running a Release Image   *Mar  1 00:00:54.287: Incorrect certificate in SHA2 PB !   *Mar  1 00:00:54.287: Using SHA-1 signed certificate for image signing validation. *Mar  1 00:00:54.575: %LINEPROTO-5-UPDOWN: Line protocol on Interface BVI1, changed state to up *Mar  1 00:00:59.787: %DHCP-6-ADDRESS_ASSIGN: Interface BVI1 assigned DHCP address 10.1.20.2, mask 255.255.255.0, hostname Test_1   *Mar  1 00:01:02.707: APAVC: Succeeded to activate all the STILE protocols.   *Mar  1 00:01:02.707: APAVC: Registering with CFT   *Mar  1 00:01:02.707: APAVC: CFT registration of delete callback succeeded   *Mar  1 00:01:02.707: APAVC: Reattaching  Original Buffer pool for system use   *Mar  1 00:01:02.707: Pool-ReAtach: paks 42878 radio42270 %Default route without gateway, if not a point-to-point interface, may impact performance *Mar  1 00:01:10.103: AP image integrity check PASSED   *Mar  1 00:01:10.187: Incorrect certificate in SHA2 PB !   *Mar  1 00:01:10.203: %LINK-5-CHANGED: Interface Dot11Radio0, changed state to reset *Mar  1 00:01:10.203: %LINK-5-CHANGED: Interface Dot11Radio1, changed state to reset *Mar  1 00:01:11.591: %CDP_PD-4-POWER_OK: 15.4 W power - NEGOTIATED inline power source *Mar  1 00:01:12.691: %LINK-6-UPDOWN: Interface Dot11Radio0, changed state to up *Mar  1 00:01:13.691: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio0, changed state to up *Mar  1 00:01:13.947: %LINK-6-UPDOWN: Interface Dot11Radio1, changed state to up *Mar  1 00:01:14.947: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to up *Mar  1 00:01:20.211: %SYS-6-LOGGINGHOST_STARTSTOP: Logging to host 255.255.255.255 port 514 CLI Request Triggered Translating "CISCO-CAPWAP-CONTROLLER"...domain server (255.255.255.255) *Mar  1 00:01:31.215: %CAPWAP-5-DHCP_OPTION_43: Controller address 10.1.1.231 obtained through DHCP   *Mar  1 00:02:11.599: %CDP_PD-4-POWER_OK: Full power - NEGOTIATED inline power source *Mar  1 00:02:11.603: %LINK-6-UPDOWN: Interface Dot11Radio0, changed state to down *Mar  1 00:02:11.611: %LINK-5-CHANGED: Interface Dot11Radio0, changed state to reset *Mar  1 00:02:12.603: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio0, changed state to down *Mar  1 00:02:12.639: %LINK-6-UPDOWN: Interface Dot11Radio0, changed state to up *Mar  1 00:02:12.647: %LINK-6-UPDOWN: Interface Dot11Radio1, changed state to down *Mar  1 00:02:12.655: %LINK-5-CHANGED: Interface Dot11Radio1, changed state to reset *Mar  1 00:02:13.639: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio0, changed state to up *Mar  1 00:02:13.647: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to down *Mar  1 00:02:13.699: %LINK-6-UPDOWN: Interface Dot11Radio1, changed state to up *Mar  1 00:02:14.699: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to up Not in Bound state. *Mar  1 00:02:44.719: %CAPWAP-3-DHCP_RENEW: Could not discover WLC. Either IP address is not assigned or assigned IP is wrong. Renewing DHCP IP. *Mar  1 00:02:49.839: %DHCP-6-ADDRESS_ASSIGN: Interface BVI1 assigned DHCP address 10.1.20.3, mask 255.255.255.0, hostname Test_1   Translating "CISCO-CAPWAP-CONTROLLER"...domain server (255.255.255.255) *Mar  1 00:02:55.719: %CAPWAP-5-DHCP_OPTION_43: Controller address 10.1.1.231 obtained through DHCP   Not in Bound state. *Mar  1 00:03:59.219: %CAPWAP-3-DHCP_RENEW: Could not discover WLC. Either IP address is not assigned or assigned IP is wrong. Renewing DHCP IP. *Mar  1 00:04:04.343: %DHCP-6-ADDRESS_ASSIGN: Interface BVI1 assigned DHCP address 10.1.20.4, mask 255.255.255.0, hostname Test_1   Translating "CISCO-CAPWAP-CONTROLLER"...domain server (255.255.255.255) *Mar  1 00:04:10.223: %CAPWAP-5-DHCP_OPTION_43: Controller address 10.1.1.231 obtained through DHCP ... View more

Hey Leo,    please find sh sysinfo:    isco Controller) >show sysinfo   Manufacturer's Name.............................. Cisco Systems Inc. Product Name..................................... Cisco Controller Product Version.................................. 8.0.110.0 Bootloader Version............................... 1.0.20 Field Recovery Image Version..................... 7.6.101.1 Firmware Version................................. PIC 16.0     Build Type....................................... DATA + WPS   System Name...................................... WLC System Location..................................  System Contact...................................  System ObjectID.................................. 1.3.6.1.4.1.9.1.1279 IP Address....................................... 10.1.1.231 IPv6 Address..................................... :: Last Reset....................................... Power on reset System Up Time................................... 0 days 0 hrs 16 mins 2 secs System Timezone Location......................... (GMT +8:00) HongKong, Bejing, Chongquing System Stats Realtime Interval................... 5 System Stats Normal Interval..................... 180   --More-- or (q)uit   Configured Country............................... AU  - Australia Operating Environment............................ Commercial (0 to 40 C) Internal Temp Alarm Limits....................... 0 to 65 C Internal Temperature............................. +29 C External Temperature............................. +33 C Fan Status....................................... 3600 rpm   State of 802.11b Network......................... Enabled State of 802.11a Network......................... Enabled Number of WLANs.................................. 2 Number of Active Clients......................... 0   Burned-in MAC Address............................ CC:D8:C1:40:16:40 Maximum number of APs supported.................. 75 System Nas-Id.................................... WLC WLC MIC Certificate Types........................ SHA1 ... View more

 Any tips on things to try?    this is happening to another AP also ( same model). it looks to me like every time they reboot they lose parts on the config, yet the name ( test-1) seems to have saved. and they do not re-download the config from the controller so they are saving a few things.    Thanks  ... View more

Hey Scott,    Thanks mate for all your help so far, the above logs was from an AP that has already joined the WLC and once I moved the AP it looks like it went straight to option 43 and "forgot" about the IP of the WLC. to me it doesn't look like it is saving the IP of the WLC.    ... View more

Hey Leo,    I am running code 8.0.110.0 so the bug "should" be resolved as I went from 7.6 straight to 8.0.110.0, I was having this issue before I did the upgrade but was getting a different error ( I think it was more related to my time sync issues)    will post a sh sysinfo once home from work, odd as the AP's work if on the same vlan as the management address but bugs do odd things.    thanks   ... View more

Hi Scott,    I Just moved one of the AP's back to Vlan 20, and left the config as it, and I am getting the same errors and the time has gone back to the 1 or march:    Username: Not in Bound state.cisco Password: *Mar  1 00:03:32.915: %CAPWAP-3-DHCP_RENEW: Could not discover WLC using DHCP IP. Renewing DHCP IP. *Mar  1 00:03:38.015: %CAPWAP-3-ERRORLOG: Invalid event 40 & state 2 combination. *Mar  1 00:03:38.035: %DHCP-6-ADDRESS_ASSIGN: Interface BVI1 assigned DHCP address 10.1.20.122, mask 255.255.255.0, hostname APf44e.05b7.1e84 Translating "CISCO-CAPWAP-CONTROLLER"...domain server (255.255.255.255) *Mar  1 00:03:43.915: %CAPWAP-5-DHCP_OPTION_43: Controller address 10.1.1.231 obtained throug   ??? it looks like the AP's have reset them selfs?    EDIT I also tryed to set the time manually on the AP and still no luck, time is fine on both switch and WLC.  ... View more

Just looking at the logs on the AP and it looks as they it still had the wrong time up until it found the controller on the same VLAN,    *Mar  1 00:01:09.431: %LINEPROTO-5-UPDOWN: Line protocol on Interface Dot11Radio1, changed state to up *Mar  1 00:01:09.735: %DHCP-6-ADDRESS_ASSIGN: Interface BVI1 assigned DHCP address 10.1.1.3, mask 255.255.255.0, hostname APf44e.05b7.1e84 *Mar  1 00:01:12.115: Logging LWAPP message to 255.255.255.255. Translating "CISCO-CAPWAP-CONTROLLER"...domain server (255.255.255.255) *Mar  1 00:01:23.119: %CAPWAP-3-ERRORLOG: Did not get log server settings from DHCP. *Mar  1 00:01:23.143: %CAPWAP-3-ERRORLOG: Could Not resolve CISCO-CAPWAP-CONTROLLER *Mar  1 00:01:33.143: %CAPWAP-3-ERRORLOG: Go join a capwap controller *Jan 20 06:06:59.000: %CAPWAP-5-DTLSREQSEND: DTLS connection request sent peer_ip: 10.1.1.231 peer_port: 5246 *Jan 20 06:06:59.411: %CAPWAP-5-DTLSREQSUCC: DTLS connection created sucessfully peer_ip: 10.1.1.231 peer_port: 5246 *Jan 20 06:06:59.411: %CAPWAP-5-SENDJOIN: sending Join Request to 10.1.1.231   so by the looks it should have still worked when it was on VLAN 20 and once it found the WLC it should have changed its time to match?  The time on the WLC was correct it was the time on the Switch that I changed.    sorry to keep bugging but it just looks to me like an odd error. I will reset one of my AP's tomorrow and do a little bit more playing around. ( the joys of a lab :) )   Thanks heaps for your help Scott!     ... View more

Thanks Scott, I did test it in Vlan 20 before I made the jump to the same Vlan as the WLC.    it just looks a little odd as it gets the IP of the WLC but then looks like it try's the CAPWAP route of the option 43 route?   ... View more

Hi Scott,    thanks for that, I fixed the time issue and placed the AP's into the same Vlan and they joined.   my switch config is below  ip dhcp pool WAP_Pool    network 10.1.20.0 255.255.255.0    default-router 10.1.20.1     option 43 hex f104.0a01.01e7   and my controller config is attached.   The AP's are in Vlan 20 and management is vlan 10     Thanks   ... View more