cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
1309
Views
0
Helpful
5
Replies

Prime Infrastructure 2.x - Possible to Install On Own Hardware NOT as a VM?

Nickolus Looper
Level 1
Level 1

Hi All -

At my company, we're doing everything we can to improve PI performance, but it's still god-awful slow.

- 24 GB RAM

- 16 vCPUs

- Moved it to its own ESXi host

 

Has anyone heard of taking the ISO and installing PI on your own bare-metal server with crazy specs?

Or, installing the PI application on top of your own Redhat Enterprise server, again with crazy specs?

 

We have 82 WLCs and thousands of LAPs in our implementation.  We haven't even added switches or autonomous APs yet!

We've followed all recommendations in the Performance Tuning section of the system guide.

Ideas?

 

Thanks!

5 Replies 5

Darren Starr
Level 4
Level 4

PI is a bear, but as a "virtualization expert" which means I basically can use virtualization acronyms fluently without making too big a fool of myself, I can assure you that installing anything on bare metal will almost certainly slow it down in modern environments... with the exception of CML which is double virtualized (nested KVM in VMware).

If you inspect the virtual memory architecture of modern operating systems, virtualization is an amazing feature since the secondary lookup address table allows something like a monitored cache to occur. 

If you want to make a real performance difference, I recommend using Cisco servers with Cisco 10Gbe NICs (think VIC 1225, VIC 1285 or at least P81E) to provide VMFEX to the PI virtual machines. This can actually give you a 15-30% boost in reality if you have a high bandwidth consumption. This is because it will remove the virtualization host from networking and free up massive CPU resources that are wasted by software based networking (hence the reason SDN VMware NSX style is so insanely expensive).

There are some other extreme methods you might look into... for example, consider using hardware accelerated Java. This requires special hardware and doesn't really provide too much benefit anymore now that dynamic recompilation and tracing JIT technology is mature.

I have found that there are some real benefits to replacing classic WLCs with 3850 switches at times, but I'd have to see your actual environment to see where your performance bottleneck is.

Can I recommend that you configure SNMP on Linux and use a monitoring system like Cacti to watch the actual PI server and monitor resource usage for a few days and identify what's actually causing the bottleneck?

I really appreciate the ideas.

What sort of data do you recommend I focus on in the snmp monitoring?  Maybe which processes are utilizing the most CPU and memory?  I'm so-so in the Linux world, but learning.

I would read up on netsnmp to configure a SNMP agent for Linux and focus on CPU, network, ram and cache misses per process.

I have attached the output of ps -ef, and I notice there are many instances of some processes, like:

migration

ksoftirqd

kblockd

oraclewcs

 

Also, CPU utilization shown:

ade # mpstat -P ALL
Linux 2.6.18-238.1.1.el5 (scea4nms2001)         12/30/14

16:31:16     CPU   %user   %nice    %sys %iowait    %irq   %soft  %steal   %idle    intr/s
16:31:16     all   24.26    0.00    2.30    8.62    0.13    1.46    0.00   63.23   1227.89
16:31:16       0   22.01    0.00    1.82    0.34    0.00    1.28    0.00   74.55    251.97
16:31:16       1   21.97    0.00    1.95    0.35    0.07    1.49    0.00   74.16     66.04
16:31:16       2   23.41    0.00    1.96    0.30    0.00    1.37    0.00   72.96      0.00
16:31:16       3   23.41    0.00    1.95    0.30    0.00    1.37    0.00   72.97      0.00
16:31:16       4   23.39    0.00    1.95    0.30    0.00    1.38    0.00   72.98      0.00
16:31:16       5   23.35    0.00    1.95    0.29    0.00    1.38    0.00   73.02      0.00
16:31:16       6   23.42    0.00    1.95    0.30    0.00    1.38    0.00   72.96      0.00
16:31:16       7   23.32    0.00    1.95    0.29    0.00    1.38    0.00   73.05      0.00
16:31:16       8   25.56    0.00    2.17   11.12    0.00    1.20    0.00   59.95      0.00
16:31:16       9   25.53    0.00    2.18   11.12    0.00    1.19    0.00   59.97      0.00
16:31:16      10   25.48    0.00    2.17   11.09    0.00    1.19    0.00   60.07      0.00
16:31:16      11   25.39    0.00    2.15   11.11    0.00    1.19    0.00   60.16      0.00
16:31:16      12   25.34    0.00    2.15   11.11    0.00    1.19    0.00   60.21      0.00
16:31:16      13   25.24    0.00    2.14   11.12    0.00    1.19    0.00   60.30      2.36
16:31:16      14   25.24    0.00    3.44   31.44    0.61    2.00    0.00   37.28    302.52
16:31:16      15   26.10    0.00    4.87   37.54    1.45    3.17    0.00   26.88    605.00
ade #

One point we're currently investigating is the type of storage supporting this vm - note the high iowait times for some of the CPUs.

Also, in the top output, the java and oracle processes are consuming quite a bit of resources (though that may be completely normal).

Review Cisco Networking for a $25 gift card