02-09-2017 02:04 AM
Since upgrading from Prime 3.1.4 to 3.1.5 I have had nothing but issues. CPU has gone crazy on the VM, No wireless site maps load at all and nothing seems to be updating properly.
Currently trying to recover from this issue.
Beware and make sure you have a good backup before the update.
02-09-2017 05:18 AM
Did you test with a different web browser? It's best not to use Chrome, I have several issues with it and PI 3.1.5. Works best in Internet Explorer here. Could be a browser cache issue though.
02-09-2017 05:22 AM
Good call but its the same with IE 11 and Firefox 51.0.
Tried a reboot. ncs stop/start and ncs clean.
Server boots fine. It's just every single map shows as a broken image.
I'm giving Cisco a crack at fixing it with TAC. If not i'm going to restore a VM backup and go back to 3.1.4.
02-09-2017 05:27 AM
Good idea. Please post the solution here, once it could be resolved.
02-10-2017 01:10 AM
- Check the memory usage on the Prime VM; possibly you may need to allocate more memory to the VM.
M.
02-13-2017 11:11 AM
So... 3.1.4 was fine for you? I upgraded from 3.1.0 to 3.1.4 and seems the processes are using way too much RAM and CPU for the number of devices I am managing. Would you mind sharing the output of "top" ?
Thanks!
Gary
02-13-2017 11:40 PM
Let's put it like this, I didn't notice the swap usage, but I also didn't especially check it. Though I'd say it wasn't there at 3.1.4 and it's now here.
Top output from 3.1.5, after 4 days since the last reboot:
top - 08:39:10 up 4 days, 19:17, 1 user, load average: 1.45, 1.26, 1.30
Tasks: 307 total, 1 running, 306 sleeping, 0 stopped, 0 zombie
Cpu(s): 13.5%us, 2.4%sy, 0.0%ni, 83.2%id, 0.7%wa, 0.0%hi, 0.2%si, 0.0%st
Mem: 16333448k total, 16034268k used, 299180k free, 47056k buffers
Swap: 16383996k total, 3804096k used, 12579900k free, 6229008k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7487 prime 20 0 11.7g 6.3g 170m S 85.7 40.5 1721:19 java
1242 oracle 20 0 3433m 831m 825m S 17.6 5.2 0:44.61 oracle_1242_wcs
3764 root 20 0 98.5m 1116 880 S 12.3 0.0 683:10.88 Xvfb
5295 root 20 0 2408m 270m 6748 S 6.6 1.7 386:39.67 java
5298 root 20 0 2432m 354m 6736 S 6.6 2.2 386:57.49 java
5296 root 20 0 2784m 338m 6620 S 6.3 2.1 382:52.61 java
25406 oracle 20 0 3439m 1.4g 1.4g S 4.0 8.8 4:37.02 oracle_25406_wc
4783 oracle 20 0 3426m 191m 190m S 0.7 1.2 6:24.66 ora_mmnl_wcs
3864 prime 20 0 2142m 314m 6532 S 0.3 2.0 26:57.18 java
7059 root 20 0 5781m 932m 3320 S 0.3 5.8 26:03.37 sam_daemon
11836 admin 20 0 15168 1416 940 R 0.3 0.0 0:00.17 top
1 root 20 0 19364 1152 868 S 0.0 0.0 0:16.02 init
2 root 20 0 0 0 0 S 0.0 0.0 0:00.08 kthreadd
3 root RT 0 0 0 0 S 0.0 0.0 0:00.98 migration/0
4 root 20 0 0 0 0 S 0.0 0.0 0:31.64 ksoftirqd/0
5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0
7 root RT 0 0 0 0 S 0.0 0.0 0:02.26 migration/1
8 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/1
9 root 20 0 0 0 0 S 0.0 0.0 0:27.19 ksoftirqd/1
I have 1 wireless controller with around 180 APs integrated and I use the Assurance feature. Around 500 Wi-Fi clients currently online.
02-14-2017 02:18 AM
Here is my TOP for comparison (VM on ESX) 8 CPU/ 24GB ram /800GB disk
top - 10:11:03 up 18:11, 1 user, load average: 2.59, 3.39, 3.98
Tasks: 346 total, 4 running, 342 sleeping, 0 stopped, 0 zombie
Cpu(s): 45.7%us, 1.8%sy, 0.0%ni, 49.2%id, 3.2%wa, 0.0%hi, 0.1%si, 0.0%st
Mem: 24607316k total, 24332272k used, 275044k free, 42472k buffers
Swap: 16383996k total, 604920k used, 15779076k free, 6931784k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1625 oracle 20 0 4579m 2.2g 2.1g R 97.4 9.5 18:15.75 oracle_1625_wcs
7607 oracle 20 0 4457m 459m 453m R 96.7 1.9 0:30.55 oracle_7607_wcs
7593 oracle 20 0 4538m 499m 492m R 74.4 2.1 1:45.38 oracle_7593_wcs
7656 prime 20 0 14.8g 9.1g 187m S 66.1 38.6 846:02.83 java
7617 oracle 20 0 4520m 837m 831m S 11.0 3.5 2:10.57 oracle_7617_wcs
1627 oracle 20 0 4523m 1.4g 1.4g S 10.3 5.9 10:47.08 oracle_1627_wcs
3698 root 20 0 98.5m 1104 884 S 4.7 0.0 53:23.45 Xvfb
5361 oracle 20 0 4510m 784m 777m S 3.7 3.3 2:26.44 oracle_5361_wcs
5229 root 20 0 2771m 354m 7168 S 3.0 1.5 29:12.57 java
5238 root 20 0 2280m 221m 7164 S 3.0 0.9 27:28.15 java
5240 root 20 0 2245m 285m 7148 S 3.0 1.2 30:14.61 java
5232 root 20 0 2267m 223m 7148 S 2.7 0.9 32:15.48 java
7688 oracle 20 0 4455m 532m 527m S 1.3 2.2 0:52.78 oracle_7688_wcs
4808 oracle 20 0 4450m 30m 30m S 0.7 0.1 0:22.96 ora_lg00_wcs
7059 root 20 0 4316m 681m 832 S 0.7 2.8 1:47.60 da_daemon
14059 admin 20 0 15268 1472 940 R 0.7 0.0 0:00.18 top
4800 oracle 20 0 4454m 54m 51m S 0.3 0.2 0:50.15 ora_dia0_wcs
4802 oracle 20 0 4487m 1.1g 1.0g S 0.3 4.5 1:33.57 ora_dbw0_wcs
4804 oracle 20 0 4450m 33m 32m S 0.3 0.1 2:39.44 ora_lgwr_wcs
4822 oracle 20 0 4450m 102m 102m S 0.3 0.4 0:44.88 ora_mmnl_wcs
17338 root 20 0 114m 1312 684 S 0.3 0.0 0:02.09 crond
1 root 20 0 19236 1088 820 S 0.0 0.0 0:15.76 init
2 root 20 0 0 0 0 S 0.0 0.0 0:00.02 kthreadd
3 root RT 0 0 0 0 S 0.0 0.0 0:00.50 migration/0
4 root 20 0 0 0 0 S 0.0 0.0 0:01.33 ksoftirqd/0
5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0
7 root RT 0 0 0 0 S 0.0 0.0 0:00.41 migration/1
8 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/1
9 root 20 0 0 0 0 S 0.0 0.0 0:01.18 ksoftirqd/1
11 root RT 0 0 0 0 S 0.0 0.0 0:00.62 migration/2
12 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/2
13 root 20 0 0 0 0 S 0.0 0.0 0:01.01 ksoftirqd/2
15 root RT 0 0 0 0 S 0.0 0.0 0:00.58 migration/3
16 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/3
17 root 20 0 0 0 0 S 0.0 0.0 0:01.16 ksoftirqd/3
19 root RT 0 0 0 0 S 0.0 0.0 0:00.57 migration/4
20 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/4
21 root 20 0 0 0 0 S 0.0 0.0 0:01.01 ksoftirqd/4
23 root RT 0 0 0 0 S 0.0 0.0 0:00.78 migration/5
24 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/5
25 root 20 0 0 0 0 S 0.0 0.0 0:01.16 ksoftirqd/5
27 root RT 0 0 0 0 S 0.0 0.0 0:00.66 migration/6
28 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/6
29 root 20 0 0 0 0 S 0.0 0.0 0:00.99 ksoftirqd/6
31 root RT 0 0 0 0 S 0.0 0.0 0:00.62 migration/7
32 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/7
33 root 20 0 0 0 0 S 0.0 0.0 0:01.15 ksoftirqd/7
35 root 20 0 0 0 0 S 0.0 0.0 0:01.81 events/0
36 root 20 0 0 0 0 S 0.0 0.0 0:02.23 events/1
37 root 20 0 0 0 0 S 0.0 0.0 0:01.85 events/2
38 root 20 0 0 0 0 S 0.0 0.0 0:01.88 events/3
39 root 20 0 0 0 0 S 0.0 0.0 0:01.66 events/4
40 root 20 0 0 0 0 S 0.0 0.0 0:19.78 events/5
02-14-2017 02:17 AM
I found other issues with 3.1.5. I had no 'Save' button (only cancel) on the Unified AP page when I was trying to change an ap-group! So i had to do this on the controller.
So I decided to restore a full VM backup from prior to the upgrade and went back to 3.1.4 (with device pack 6)
So I was in a working state. We are replacing the wifi site maps on a campus with new ones as the current ones were out of date, and poor resolution. To do this we created a new campus and put the new APs onto new maps as we refresh the site.
I removed all APs from a floor on the old maps and deleted the floors, then deleted the building. It seemed to be okay at first, but now NO maps will load at all on any campus!
Logged a fresh call this morning as this is a bit of a nightmare.
03-02-2017 11:16 AM
My maps issue was resolved by TAC. It was unrelated to 3.1.5 however I have show stopping issues with 3.1.5.
The maps issue was caused by a '.' instead of a null value in the database for the name of one map image. When deleting that building, Prime deletes the related map images from disk. (/opt/CSCOlumos/domainmaps/) the dot caused it to erase the contents of the entire directory. Hence maps all broke.
I restored from a backup and we are all back and running. The bad database row was corrected.
I installed device pack 8 with no issues but when i install 3.1.5 I have missing buttons in various pages, Unified AP configuration has no Save button (only cancel).
Also if you Audit a WLC there is no buttons on this screen to refesh prime with the controller settings.
I have reverted to 3.1.4 as I cannot spend any more time with a non working prime to log with TAC, i am too busy at the moment. Hopefully someone else can take up this bug with them.
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide