topic Re: ISE Key Performance Metrics - Units? in Network Access Control

ISE Key Performance Metrics - Units?

justinbodie — Thu, 24 Aug 2017 18:51:57 GMT

Hi all,

I'd like to get some more information on the key performance metrics (KPMs) in ISE ---- specifically, what units are they using to report some of the metrics?

Specifically, how is "server load" calculated, and how is latency per request reported? I'm pretty sure it's not UNIX server load since mine ranges from 25 to 50.

Thanks!

Justin

Key Performance Metrics

Re: ISE Key Performance Metrics - Units?

Craig Hyps — Fri, 25 Aug 2017 09:13:32 GMT

The metrics are derived from MnT and logs acquired from auth process. For example...

2017-04-17 22:22:34.295 +05:30 0000000341 70000 NOTICE System-Stats: ISE Utilization, ConfigVersionId=66, SysStatsUtilizationCpu=4.87%, SysStatsUtilizationNetwork=eth0: rcvd = 86848\; sent = 4869 \;rcvd_dropped = 0\; sent_dropped = 0, SysStatsUtilizationMemory=77.77%, SysStatsUtilizationDiskIO=2.17%, SysStatsUtilizationDiskSpace=14% /, SysStatsUtilizationDiskSpace=23% /boot, SysStatsUtilizationDiskSpace=2% /storedconfig, SysStatsUtilizationDiskSpace=1% /tmp, SysStatsUtilizationDiskSpace=17% /opt, SysStatsUtilizationDiskSpace=1% /localdisk, AverageRadiusRequestLatency=0, AverageTacacsRequestLatency=0, DeltaRadiusRequestCount=0, DeltaTacacsRequestCount=0, SysStatsUtilizationLoadAvg=0.20, SysStatsCpuCount=4, SysStatsProcessMemoryMB=7926, ActiveSessionCount=0,

That said, I have had an ongoing discussion with engineering to provide better information to clarify the data represented by KPM so that it is more consumable and actionable.

/Craig

Re: ISE Key Performance Metrics - Units?

justinbodie — Mon, 28 Aug 2017 15:40:45 GMT

Thanks. That is helpful, but I do need to know the measurement units for latency and load.

-Justin

Re: ISE Key Performance Metrics - Units?

hslai — Mon, 28 Aug 2017 15:52:56 GMT

Latency is in milliseconds.

System load averages is in processes, as it is the average number of processes (for the past 5 minutes on the time of collection) that are either in a runnable or uninterruptable state.

Re: ISE Key Performance Metrics - Units?

justinbodie — Mon, 28 Aug 2017 15:56:12 GMT

Got it. So the system load average is not really load, but the number of processes running in ISE (such as would be shown in the "show application status ise" ?

Thank you,

Justin

Re: ISE Key Performance Metrics - Units?

hslai — Mon, 28 Aug 2017 16:02:00 GMT

This is how Linux/Unix represents "loads". In ISE admin CLI, "tech top" shows the numbers. This is not what shown by "show application status ise".

ise-1/admin# tech top

Invoking tech top. Press Control-C to interrupt.

top - 16:01:24 up 33 days, 14:16, 1 user, load average: 1.21, 0.50, 0.39

...

Re: ISE Key Performance Metrics - Units?

justinbodie — Mon, 28 Aug 2017 16:13:13 GMT

The KPM report in ISE doesn't seem to correlate with 'tech top' either.

ISE KPM report shows average load around 20-28.

Tech Top shows load average around 0.66 to 0.75....

So what is the load really saying in the KPM report in ISE?

Thanks!
Justin

Re: ISE Key Performance Metrics - Units?

hslai — Mon, 28 Aug 2017 16:39:31 GMT

The data in top is a snapshot at one particular time. The KPM is usually generated and averaged over each hour for the last 24 hours.

Thanks to Craig in correcting me.

KPM data are calculated differently from the raw data points, as below:

ROUND (AVG (load_avg / cpu_count) * 100, 2) avg_load,

ROUND (MAX (load_avg / cpu_count) * 100, 2) max_load

We should probably call them as per-CPU load average percentiles.

Re: ISE Key Performance Metrics - Units?

fadli.kurniawan — Thu, 17 Dec 2020 14:23:42 GMT

Hi Justin,

What commands to see the key performance metrics on ISE? here only showing "tech top" command not all information

Re: ISE Key Performance Metrics - Units?

justinbodie — Thu, 17 Dec 2020 15:00:21 GMT

The easiest way is to run the Key Performance Metrics (KPM) report in the ISE GUI.
(Operations > Reports > Diagnostics > Key Performance Metrics)
-Justin