Symptoms:
FMC is showing high unmanaged disk usage alert on /ngfw.
FTD HA standby unit failed due to low disk space 96% on /ngfw
FTD version 7.0.5
Diagnosis:
Checked the disk utilization on the FTD CLI.
/opt/cisco/csp was utilizing 62%.
sda6 partition was utilizing 96%
Used below command the list the high disk usage files and later deleted the old troubleshooting files, upgrade files, log files.
find /ngfw -type f -print0 | xargs -0 du -h | sort -rh | head -n 30
Deleted the large file
# rm <filename>
We checked that many open deleted files are still there.
#lsof | grep deleted
lina 11138 11309 lina.core root 134u REG 8,6 40630058805 282929123 /opt/cisco/csp/applications/cisco-ftd.6.2.0.362__ftd_001_JAD204802REX6JI9I4/app_data/disk0/log/asa-ssp_ntp.log.1 (deleted)
lina 11138 11310 lina.core root 134u REG 8,6 40630058805 282929123 /opt/cisco/csp/applications/cisco-ftd.6.2.0.362__ftd_001_JAD204802REX6JI9I4/app_data/disk0/log/asa-ssp_ntp.log.1 (deleted)
We tried to restart the syslog-ng process to clear all the open deleted files but It didn't work.
Solution:
You can run below command and monitor the partition usage.
OmniQuery.pl -db mdb -e "flush logs;"
Some customers directly restarted the firewall, and post reboot, the usage reduced to 9 % for /opt/cisco/csp and 30% for sda6 partition.
Suggested to upgrade to 7.4.2 version.