topic Re: Identity Services Engine I/O Bandwidth Performance Check Failed in Network Access Control

Identity Services Engine I/O Bandwidth Performance Check Failed

gregflowers — Thu, 03 Mar 2022 18:50:07 GMT

How do I correct this health check failure? I am looking to install patch 5.

Cisco ISE
Version 3.0.0.458
Installed Patches 2,4
Product Identifier (PID) SNS-3655-K9

I/O Bandwidth Performance Check 0/10

One(or more) failures have occured.

"onFailure": "warning",
"updateTime": 1646331988308,
"remediationMsg": "Make sure VM has enough resources to be able to meet the I/O requirements for ISE to perform better. Recommended writing to disk bandwidth is at least 50 MB/second and reading from disk bandwidth is at least 300 MB/second.",
"message": "hiialslew001.ingalls.ingallscorp.com - null $ hiialspsc001.ingalls.ingallscorp.com - null $ hiiiseavd-psn01.ingalls.ingallscorp.com - null $ hiiiseavd-psn02.ingalls.ingallscorp.com - null $ hiiisepsc-mnt01.ingalls.ingallscorp.com - null $ hiiisepsc-mnt02.ingalls.ingallscorp.com - null $ hiiisepsc-pan01.ingalls.ingallscorp.com - null $ hiiisepsc-pan02.ingalls.ingallscorp.com - null $ hiiisepsc-psn01.ingalls.ingallscorp.com - null $ hiiisepsc-psn02.ingalls.ingallscorp.com - null $ ",
"ExecutionTime": 10,
"nodes": [
{
"name": "hiialslew001.ingalls.ingallscorp.com",
"status": "Warning"
},
{
"name": "hiialspsc001.ingalls.ingallscorp.com",
"status": "Warning"
},
{
"name": "hiiiseavd-psn01.ingalls.ingallscorp.com",
"status": "Warning"
},
{
"name": "hiiiseavd-psn02.ingalls.ingallscorp.com",
"status": "Warning"
},
{
"name": "hiiisepsc-mnt01.ingalls.ingallscorp.com",
"status": "Warning"
},
{
"name": "hiiisepsc-mnt02.ingalls.ingallscorp.com",
"status": "Warning"
},
{
"name": "hiiisepsc-pan01.ingalls.ingallscorp.com",
"status": "Warning"
},
{
"name": "hiiisepsc-pan02.ingalls.ingallscorp.com",
"status": "Warning"
},
{
"name": "hiiisepsc-psn01.ingalls.ingallscorp.com",
"status": "Warning"
},
{
"name": "hiiisepsc-psn02.ingalls.ingallscorp.com",
"status": "Warning"
}
],
"CheckType": "local",
"displayname": "I/O Bandwidth Performance Check",
"percentage": 100,
"name": "IO_BANDWIDTH_CHECK",
"successMsg": "I/O bandwidth performance is within supported guidelines.",
"successnodes": 0,
"status": "Warning"
},

Re: Identity Services Engine I/O Bandwidth Performance Check Failed

balaji.bandi — Thu, 03 Mar 2022 18:59:05 GMT

Just to clarify you have working ISE 3.0 you applying patch 4 you getting an error :

This is the requirement :

Recommended writing to disk bandwidth is at least 50 MB/second and reading from disk bandwidth is at least 300 MB/second.",

check what is I/O

#show tech | begin "disk IO perf"

Re: Identity Services Engine I/O Bandwidth Performance Check Failed

gregflowers — Thu, 03 Mar 2022 19:04:24 GMT

working ISE 3.0 on 10 servers

applying patch 5

# show tech | begin "disk IO perf"
WARNING: bridge-nf-call-iptables is disabled
WARNING: bridge-nf-call-ip6tables is disabled
WARNING: the overlay storage-driver is deprecated, and will be removed in a future release.
sysctl: reading key "net.ipv6.conf.all.stable_secret"
sysctl: reading key "net.ipv6.conf.br-a3ce7709a075.stable_secret"
sysctl: reading key "net.ipv6.conf.br-ef28cb5a263a.stable_secret"
sysctl: reading key "net.ipv6.conf.default.stable_secret"
sysctl: reading key "net.ipv6.conf.docker0.stable_secret"
sysctl: reading key "net.ipv6.conf.eth0.stable_secret"
sysctl: reading key "net.ipv6.conf.eth1.stable_secret"
sysctl: reading key "net.ipv6.conf.eth2.stable_secret"
sysctl: reading key "net.ipv6.conf.eth3.stable_secret"
sysctl: reading key "net.ipv6.conf.eth4.stable_secret"
sysctl: reading key "net.ipv6.conf.eth5.stable_secret"
sysctl: reading key "net.ipv6.conf.lo.stable_secret"
sysctl: reading key "net.ipv6.conf.veth2270e45.stable_secret"
sysctl: reading key "net.ipv6.conf.veth5a7f0d1.stable_secret"
sysctl: reading key "net.ipv6.conf.vethebbe909.stable_secret"
Measuring disk IO performance
*****************************************
Disk I/O bandwidth filesystem test, writing 300 MB to /opt:
314572800 bytes (315 MB) copied, 2.6338 s, 119 MB/s
Disk I/O bandwidth filesystem read test, reading 300 MB from /opt:
314572800 bytes (315 MB) copied, 0.0796235 s, 4.0 GB/s

*****************************************
Displaying sdparm on /dev/sd[abcd]...
*****************************************
/dev/sda: Cisco UCSC-RAID12G-2GB 5.01
Caching (SBC) mode page:
WCE 1 [cha: y, def: 1, sav: 1]
RCD 0 [cha: n, def: 0, sav: 0]
Control mode page:
SWP 0 [cha: n, def: 0, sav: 0]

*****************************************
Displaying IO Performance diagnostics ...
*****************************************
write: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=1
...
read: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=1
...
fio-3.1
Starting 8 processes
write: Laying out IO file (1 file / 100MiB)
write: Laying out IO file (1 file / 100MiB)
write: Laying out IO file (1 file / 100MiB)
write: Laying out IO file (1 file / 100MiB)
read: Laying out IO file (1 file / 100MiB)
read: Laying out IO file (1 file / 100MiB)
read: Laying out IO file (1 file / 100MiB)
read: Laying out IO file (1 file / 100MiB)

write: (groupid=0, jobs=8): err= 0: pid=80354: Thu Mar 3 13:02:37 2022
read: IOPS=58, BW=58.0MiB/s (61.8MB/s)(93.0MiB/1577msec)
clat (usec): min=290, max=590247, avg=49364.56, stdev=77521.03
lat (usec): min=290, max=590248, avg=49364.93, stdev=77521.09
clat percentiles (usec):
| 1.00th=[ 289], 5.00th=[ 297], 10.00th=[ 306], 20.00th=[ 1237],
| 30.00th=[ 1385], 40.00th=[ 1795], 50.00th=[ 23200], 60.00th=[ 39584],
| 70.00th=[ 69731], 80.00th=[ 90702], 90.00th=[135267], 95.00th=[164627],
| 99.00th=[591397], 99.50th=[591397], 99.90th=[591397], 99.95th=[591397],
| 99.99th=[591397]
bw ( KiB/s): min= 8175, max=30720, per=37.73%, avg=22781.88, stdev=8791.53, samples=8
iops : min= 7, max= 30, avg=22.12, stdev= 8.82, samples=8
write: IOPS=4494, BW=4494MiB/s (4713MB/s)(400MiB/89msec)
clat (usec): min=403, max=2411, avg=855.60, stdev=219.30
lat (usec): min=429, max=2436, avg=879.84, stdev=220.78
clat percentiles (usec):
| 1.00th=[ 652], 5.00th=[ 709], 10.00th=[ 717], 20.00th=[ 725],
| 30.00th=[ 734], 40.00th=[ 742], 50.00th=[ 775], 60.00th=[ 816],
| 70.00th=[ 881], 80.00th=[ 930], 90.00th=[ 1057], 95.00th=[ 1352],

Re: Identity Services Engine I/O Bandwidth Performance Check Failed

gregflowers — Sun, 06 Mar 2022 18:44:19 GMT

Does any have a solution? or suggestions?

Re: Identity Services Engine I/O Bandwidth Performance Check Failed

Marcelo Morais — Sun, 06 Mar 2022 20:59:50 GMT

Hi @gregflowers ,

your ISE is 3.0 P4, your I/O Writing & Reading are >50MB/s and >300MB/s and these numbers are good.

Are you receiving any Insufficient Virtual Machine Resources at Home > Alarms dashboard?

Hope this helps !!!

Re: Identity Services Engine I/O Bandwidth Performance Check Failed

gregflowers — Sun, 06 Mar 2022 21:32:37 GMT

The VM's are reporting all is good. The health report contains the only alarms/warnings (I/O) for the systems.

Re: Identity Services Engine I/O Bandwidth Performance Check Failed

balaji.bandi — Sun, 06 Mar 2022 22:18:27 GMT

as per the information Looks good, suggest opening a TAC case advised.