topic Re: ISE VM Disk space issue for version 2.7 in Network Access Control

ISE VM Disk space issue for version 2.7

MD SHAHNAWAZ — Mon, 15 May 2023 10:25:38 GMT

hi All,

we are currently running ISE 2.7 version on VM and we could see lots of errors because of Disk issue. below is the error which is highlighted, because of the disk error we are facing replication issue, backup issue etc.

any recommendation to resolve this issue?

Checking Disk Space...

*****************************************

df -h output...

Filesystem Size Used Avail Use% Mounted on

/dev/sda2 15G 2.8G 11G 21% /

devtmpfs 32G 0 32G 0% /dev

tmpfs 32G 0 32G 0% /dev/shm

tmpfs 32G 1.5M 32G 1% /run

tmpfs 32G 0 32G 0% /sys/fs/cgroup

/dev/sda1 477M 124M 324M 28% /boot

/dev/sda3 93M 1.6M 85M 2% /storedconfig

/dev/sda6 1.9G 7.2M 1.8G 1% /tmp

/dev/sda7 1.2T 829G 270G 76% /opt

tmpfs 6.3G 0 6.3G 0% /run/user/440

/dev/dm-1 100G 128M 100G 1% /opt/docker/runtime/devicemapper/mnt/24a3a3821f7bd9c37af694dc46909f0ed135ea32952e0ee942260c246e4415f8

tmpfs 6.3G 0 6.3G 0% /run/user/301

tmpfs 6.3G 0 6.3G 0% /run/user/321

tmpfs 6.3G 0 6.3G 0% /run/user/0

tmpfs 6.3G 0 6.3G 0% /run/user/304

tmpfs 6.3G 0 6.3G 0% /run/user/322

Re: ISE VM Disk space issue for version 2.7

ahollifield — Mon, 15 May 2023 12:41:28 GMT

What patch version of 2.7? https://www.cisco.com/c/en/us/products/collateral/security/identity-services-engine/bulletin-c25-2943876.html

Re: ISE VM Disk space issue for version 2.7

Charlie Moreton — Mon, 15 May 2023 19:32:02 GMT

Was size disk is allocated to this VM?

Re: ISE VM Disk space issue for version 2.7

Marcelo Morais — Tue, 16 May 2023 01:46:11 GMT

Hi @ MD SHAHNAWAZ ,

1st the OPT threshold to generate a Backup is 70% ... to clean some space you have two options:

open a TAC Case to clear some old files (via root access)
increase your Disk to 600 GB (probably you have less than that)

2nd if you are facing Replication Issues, please take a look at ISE - Slow Replication , ISE 2.7 P8 or P9 is a MUST !!!

3rd if you are facing Insufficient Virtual Machine alarms ... please take a look at CSCwe44886 ISE 2.7 patch 8 lowers read test speeds from CLI causing "Insufficient Virtual Machine Resources" , the fix is expected to come out for releases from version 2.7 to 3.2.

Hope this helps !!!

Re: ISE VM Disk space issue for version 2.7

MD SHAHNAWAZ — Thu, 18 May 2023 07:20:41 GMT

hi @ahollifield we are running on patch 6, because of low disk space backup is also getting failed.

Re: ISE VM Disk space issue for version 2.7

ahollifield — Thu, 18 May 2023 13:24:55 GMT

What size disk do you have allocated to this node?

Re: ISE VM Disk space issue for version 2.7

MDBee — Wed, 12 Feb 2025 13:46:48 GMT

If the /opt directory usage is too high then configuration backups will fail. In my case the /opt directory was at 76% usage. To reduce the size of it I had a TAC case with Cisco. They attempted to reduce space with root access with no success. The fix when working with cisco was the below (this does not require root access).

1. application configure ise
2. Type "1" to select the "Reset M&T Database".

This took 10-15 minutes to complete but after it was complete the /opt directory was then down to 24% usage.

Note: It doesn't work on the primary node as the database is being used by the active session. You need to promote the secondary node to the primary and ran the "Reset M&T Database" on the ISE node that is now the secondary one. If this still doesn't help further Cisco TAC help may be required.

Re: ISE VM Disk space issue for version 2.7

Marcelo Morais — Wed, 12 Feb 2025 14:06:28 GMT

Hi @MDBee ,

for Reset MnT Database or application reset-config ... please take a look at:

CSCwm91931 Observing Schedule export failing and data is not getting in Health Summary in Longevity setup.

Best regards.