LogPartitionLowWaterMarkExceeded UsedDiskSpace : 90 MessageString : Common Disk utilization hits

[Vijay Patil]

Facing issue with the alert "LogPartitionLowWaterMarkExceeded UsedDiskSpace : 90 MessageString : Common Disk utilization hits"

Found that Common log space is 90% utilize

done following steps

• Open the RTMT plugin installed on the local Machine
• Give the IP address and Credentials of the CUCM
• Navigate to Trace and Log Central and click on Remote Browse
• Select Crash Dumps radio button and click Next
• Check Cisco CTIManager and Cisco CallManager.
• Click Next and Finish.

which gives error "No Files for Service Cisco CTIManager" & "No Files for Service Cisco Callmanager"

Post which follow

It wasn't until I adjusted the number of trace files that are kept to avoid hitting the low water mark again.

which give error

how to find which logs are use space so that will delete those logs

[Manish Gogna]

Hi Vijay,

You can first check under Trace Configuration in Cisco Unified Serviceability if any traces are set to detailed level. Try setting them to a lower level if they are not needed. Additinally, you can check for the most common trace file numbers by running the following commands in the CLI

CDR / CAR
admin:file list activelog cm/cdr_repository/*/*

Callmanager logs
admin:file list activelog /cm/trace/ccm/sdl

CTI manager
admin:file list activelog /cm/trace/cti/sdl

If the number of trace files is very large you can delete them using RTMT by selecting the desired range. Please remember to select a range that is not too large else it may adversely affect the system.

You may also consider the option of scheduled trace collection as explained here

https://supportforums.cisco.com/document/31766/scheduled-trace-collection-rtmt-cucm-appliance-model

Manish

- Do rate helpful posts -

[Vijay Patil]

Hello Manish,

Actually we done CM upgrade of 9.1.2.11008-1 to 9.1.2.13900-10

We follow above steps its show many files in output for mention commands ..but when we try to delete files RTMT completes task but space not increase

[Manish Gogna · Accepted solution]

Hi Vijay,

Try to set the low watermark to 20 high watermark to 25 and restart the Log partition monitoring service. Once the logs are purged, revert to default values of low and high water mark.

Manish

[Vijay Patil]

Hi Manish,,

Is the mention step is documented or Cisco approved step so that we convenes customer .....

We set Low as 90 & High as 95...now it is 92 ....if the Common disk size reach 95 ie high ...so logs will be purged of get deleted ....

[Manish Gogna]

Hi Vijay,

I have seen this work, not all troubleshooting steps will be documented. However, if you are looking for official or approved procedures for your customer then you should engage TAC.

Manish

[Vijay Patil]

He Manish,

I hope above step Purge logs & not delete

[Christian Quiroga]

Hello,

Is there any command to set low watermark and high watermark via CLI on CUCM.

Thanks.

[Vijay Patil]

Hello Christian,

We faced this issue after the CUCM upgrade..there was active & inactive version on system also logs are generated ..for which we follow the below mention steps ...where then also partition space was not that much free so we ran the COP file

to clean the log partition and delete unnecessary log files, please complete the following

1.   Set CallManager traces into Error level for all nodes until Detailed level traces are needed.

From the Serviceability webpage > Trace > Configuration > Pick the publisher node > CM Services > Cisco CallManager (Active) > check Apply to All nodes check box and set the Debug Trace Level into Error

On the same page, please make sure that Max no. of file is set to the default value which is 753

Trace Output Settings

MaximumNo. of Files*   375

MAximum File Size(MB)* 2

2. Please execute show diskusage common sort CLI command and find what traces are filling the disk; Tomcat, CAR, CLI ,etc ; and then set the Debug Trace Level for the corresponding services into the lowest.  

3. use TLC (Trace and Log Central) via RTMT to download and delete the files from the Server manually. Alternatively, you can also use CLI file get or file delete commands to transfer or to delete the files.

4. Check if there are a lot of Core dump files generated, by executing utils core active list CLI command.

5.

1. Launch RTMT, and select Alert Center.

• Right click LogPartitionLowWaterMarkExceeded, select "Set Alert/Properties", and change its threshold value on the second page to 30%.
• Right click LogPartitionHighWaterMarkExceeded, select "Set Alert/Properties", and change its threshold value on the second page to 50%.
• LPM polls every 5 mins, so wait for 5-10 mins and verify that disk space has cleared by looking in Disk Usage.
• After the space has been cleared out reset the LogPartitionHighWaterMarkExceeded and LogPartitionLowWaterMarkExceeded back to their default values. 

Also, please follow below instructions to install freespace cop file that should automatically purge all log files:

1. From Cisco.com, download FreeCommonSpace cop file. Please make sure to download the file that does match your version:

Downloads Home > Products > Unified Communications > Call Control > Unified Communications Manager (CallManager) > Unified Communications Manager Version 9.1 > Unified Communications Manager / CallManager / Cisco Unity Connection Utilities-COP-Files

2. Please review “Installation Procedure” section in the readme file for more information on how to install the file: http://www.cisco.com/web/software/282204704/108295/ciscocm.free_common_space_v1.1.pdf