cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
1450
Views
0
Helpful
9
Replies

Cisco Prime MR 3.1.5 Lots of Issues

chris.brunt
Level 1
Level 1

Since upgrading from Prime 3.1.4 to 3.1.5 I have had nothing but issues. CPU has gone crazy on the VM, No wireless site maps load at all and nothing seems to be updating properly.

Currently trying to recover from this issue.

Beware and make sure you have a good backup before the update.

9 Replies 9

patoberli
VIP Alumni
VIP Alumni

Did you test with a different web browser? It's best not to use Chrome, I have several issues with it and PI 3.1.5. Works best in Internet Explorer here. Could be a browser cache issue though.

Good call but its the same with IE 11 and Firefox 51.0.

Tried a reboot. ncs stop/start and ncs clean.

Server boots fine. It's just every single map shows as a broken image.

I'm giving Cisco a crack at fixing it with TAC. If not i'm going to restore a VM backup and go back to 3.1.4.

Good idea. Please post the solution here, once it could be resolved.

marce1000
VIP
VIP

 - Check the memory usage on the Prime VM; possibly you may need to allocate more memory to the VM.

M.



-- ' 'Good body every evening' ' this sentence was once spotted on a logo at the entrance of a Weight Watchers Club !

gary.gatten
Level 1
Level 1

So...  3.1.4 was fine for you?  I upgraded from 3.1.0 to 3.1.4 and seems the processes are using way too much RAM and CPU for the number of devices I am managing.  Would you mind sharing the output of "top" ?

Thanks!

Gary

Let's put it like this, I didn't notice the swap usage, but I also didn't especially check it. Though I'd say it wasn't there at 3.1.4 and it's now here.

Top output from 3.1.5, after 4 days since the last reboot:

top - 08:39:10 up 4 days, 19:17,  1 user,  load average: 1.45, 1.26, 1.30
Tasks: 307 total,   1 running, 306 sleeping,   0 stopped,   0 zombie
Cpu(s): 13.5%us,  2.4%sy,  0.0%ni, 83.2%id,  0.7%wa,  0.0%hi,  0.2%si,  0.0%st
Mem:  16333448k total, 16034268k used,   299180k free,    47056k buffers
Swap: 16383996k total,  3804096k used, 12579900k free,  6229008k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                       
 7487 prime     20   0 11.7g 6.3g 170m S 85.7 40.5   1721:19 java                           
 1242 oracle    20   0 3433m 831m 825m S 17.6  5.2   0:44.61 oracle_1242_wcs                
 3764 root      20   0 98.5m 1116  880 S 12.3  0.0 683:10.88 Xvfb                           
 5295 root      20   0 2408m 270m 6748 S  6.6  1.7 386:39.67 java                           
 5298 root      20   0 2432m 354m 6736 S  6.6  2.2 386:57.49 java                           
 5296 root      20   0 2784m 338m 6620 S  6.3  2.1 382:52.61 java                           
25406 oracle    20   0 3439m 1.4g 1.4g S  4.0  8.8   4:37.02 oracle_25406_wc                
 4783 oracle    20   0 3426m 191m 190m S  0.7  1.2   6:24.66 ora_mmnl_wcs                   
 3864 prime     20   0 2142m 314m 6532 S  0.3  2.0  26:57.18 java                           
 7059 root      20   0 5781m 932m 3320 S  0.3  5.8  26:03.37 sam_daemon                     
11836 admin     20   0 15168 1416  940 R  0.3  0.0   0:00.17 top                            
    1 root      20   0 19364 1152  868 S  0.0  0.0   0:16.02 init                           
    2 root      20   0     0    0    0 S  0.0  0.0   0:00.08 kthreadd                       
    3 root      RT   0     0    0    0 S  0.0  0.0   0:00.98 migration/0                    
    4 root      20   0     0    0    0 S  0.0  0.0   0:31.64 ksoftirqd/0                    
    5 root      RT   0     0    0    0 S  0.0  0.0   0:00.00 stopper/0                      
    7 root      RT   0     0    0    0 S  0.0  0.0   0:02.26 migration/1                    
    8 root      RT   0     0    0    0 S  0.0  0.0   0:00.00 stopper/1                      
    9 root      20   0     0    0    0 S  0.0  0.0   0:27.19 ksoftirqd/1                     
  

I have 1 wireless controller with around 180 APs integrated and I use the Assurance feature. Around 500 Wi-Fi clients currently online.

Here is my TOP for comparison (VM on ESX) 8 CPU/ 24GB ram /800GB disk

top - 10:11:03 up 18:11, 1 user, load average: 2.59, 3.39, 3.98
Tasks: 346 total, 4 running, 342 sleeping, 0 stopped, 0 zombie
Cpu(s): 45.7%us, 1.8%sy, 0.0%ni, 49.2%id, 3.2%wa, 0.0%hi, 0.1%si, 0.0%st
Mem: 24607316k total, 24332272k used, 275044k free, 42472k buffers
Swap: 16383996k total, 604920k used, 15779076k free, 6931784k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1625 oracle 20 0 4579m 2.2g 2.1g R 97.4 9.5 18:15.75 oracle_1625_wcs
7607 oracle 20 0 4457m 459m 453m R 96.7 1.9 0:30.55 oracle_7607_wcs
7593 oracle 20 0 4538m 499m 492m R 74.4 2.1 1:45.38 oracle_7593_wcs
7656 prime 20 0 14.8g 9.1g 187m S 66.1 38.6 846:02.83 java
7617 oracle 20 0 4520m 837m 831m S 11.0 3.5 2:10.57 oracle_7617_wcs
1627 oracle 20 0 4523m 1.4g 1.4g S 10.3 5.9 10:47.08 oracle_1627_wcs
3698 root 20 0 98.5m 1104 884 S 4.7 0.0 53:23.45 Xvfb
5361 oracle 20 0 4510m 784m 777m S 3.7 3.3 2:26.44 oracle_5361_wcs
5229 root 20 0 2771m 354m 7168 S 3.0 1.5 29:12.57 java
5238 root 20 0 2280m 221m 7164 S 3.0 0.9 27:28.15 java
5240 root 20 0 2245m 285m 7148 S 3.0 1.2 30:14.61 java
5232 root 20 0 2267m 223m 7148 S 2.7 0.9 32:15.48 java
7688 oracle 20 0 4455m 532m 527m S 1.3 2.2 0:52.78 oracle_7688_wcs
4808 oracle 20 0 4450m 30m 30m S 0.7 0.1 0:22.96 ora_lg00_wcs
7059 root 20 0 4316m 681m 832 S 0.7 2.8 1:47.60 da_daemon
14059 admin 20 0 15268 1472 940 R 0.7 0.0 0:00.18 top
4800 oracle 20 0 4454m 54m 51m S 0.3 0.2 0:50.15 ora_dia0_wcs
4802 oracle 20 0 4487m 1.1g 1.0g S 0.3 4.5 1:33.57 ora_dbw0_wcs
4804 oracle 20 0 4450m 33m 32m S 0.3 0.1 2:39.44 ora_lgwr_wcs
4822 oracle 20 0 4450m 102m 102m S 0.3 0.4 0:44.88 ora_mmnl_wcs
17338 root 20 0 114m 1312 684 S 0.3 0.0 0:02.09 crond
1 root 20 0 19236 1088 820 S 0.0 0.0 0:15.76 init
2 root 20 0 0 0 0 S 0.0 0.0 0:00.02 kthreadd
3 root RT 0 0 0 0 S 0.0 0.0 0:00.50 migration/0
4 root 20 0 0 0 0 S 0.0 0.0 0:01.33 ksoftirqd/0
5 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/0
7 root RT 0 0 0 0 S 0.0 0.0 0:00.41 migration/1
8 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/1
9 root 20 0 0 0 0 S 0.0 0.0 0:01.18 ksoftirqd/1
11 root RT 0 0 0 0 S 0.0 0.0 0:00.62 migration/2
12 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/2
13 root 20 0 0 0 0 S 0.0 0.0 0:01.01 ksoftirqd/2
15 root RT 0 0 0 0 S 0.0 0.0 0:00.58 migration/3
16 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/3
17 root 20 0 0 0 0 S 0.0 0.0 0:01.16 ksoftirqd/3
19 root RT 0 0 0 0 S 0.0 0.0 0:00.57 migration/4
20 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/4
21 root 20 0 0 0 0 S 0.0 0.0 0:01.01 ksoftirqd/4
23 root RT 0 0 0 0 S 0.0 0.0 0:00.78 migration/5
24 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/5
25 root 20 0 0 0 0 S 0.0 0.0 0:01.16 ksoftirqd/5
27 root RT 0 0 0 0 S 0.0 0.0 0:00.66 migration/6
28 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/6
29 root 20 0 0 0 0 S 0.0 0.0 0:00.99 ksoftirqd/6
31 root RT 0 0 0 0 S 0.0 0.0 0:00.62 migration/7
32 root RT 0 0 0 0 S 0.0 0.0 0:00.00 stopper/7
33 root 20 0 0 0 0 S 0.0 0.0 0:01.15 ksoftirqd/7
35 root 20 0 0 0 0 S 0.0 0.0 0:01.81 events/0
36 root 20 0 0 0 0 S 0.0 0.0 0:02.23 events/1
37 root 20 0 0 0 0 S 0.0 0.0 0:01.85 events/2
38 root 20 0 0 0 0 S 0.0 0.0 0:01.88 events/3
39 root 20 0 0 0 0 S 0.0 0.0 0:01.66 events/4
40 root 20 0 0 0 0 S 0.0 0.0 0:19.78 events/5

chris.brunt
Level 1
Level 1

I found other issues with 3.1.5. I had no 'Save' button (only cancel) on the Unified AP page when I was trying to change an ap-group! So i had to do this on the controller.

So I decided to restore a full VM backup from prior to the upgrade and went back to 3.1.4 (with device pack 6)

So I was in a working state. We are replacing the wifi site maps on a campus with new ones as the current ones were out of date, and poor resolution. To do this we created a new campus and put the new APs onto new maps as we refresh the site.

I removed all APs from a floor on the old maps and deleted the floors, then deleted the building. It seemed to be okay at first, but now NO maps will load at all on any campus!

Logged a fresh call this morning as this is a bit of a nightmare.

chris.brunt
Level 1
Level 1

My maps issue was resolved by TAC. It was unrelated to 3.1.5 however I have show stopping issues with 3.1.5.

The maps issue was caused by a '.' instead of a null value in the database for the name of one map image. When deleting that building, Prime deletes the related map images from disk. (/opt/CSCOlumos/domainmaps/) the dot caused it to erase the contents of the entire directory. Hence maps all broke.

I restored from a backup and we are all back and running. The bad database row was corrected.

I installed device pack 8 with no issues but when i install 3.1.5 I have missing buttons in various pages, Unified AP configuration has no Save button (only cancel).

Also if you Audit a WLC there is no buttons on this screen to refesh prime with the controller settings.

I have reverted to 3.1.4 as I cannot spend any more time with a non working prime to log with TAC, i am too busy at the moment. Hopefully someone else can take up this bug with them.

Getting Started

Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: