cancel
Showing results forĀ 
Search instead forĀ 
Did you mean:Ā 
cancel
3036
Views
5
Helpful
2
Replies

CUC Failed - Tomcat's memory usage is unusually high

ccg-collab1
Level 2
Level 2

Hi All,

Good Day. We would like to ask the error we encountered in CUC version 9.1.2.10000-28 utils diagnose test. See the below error:

test - tomcat_memory : Failed - Tomcat's memory usage is unusually high. Use the 'utils diagnose module tomcat_heapdump' command to generate a memory dump for further analysis. Note, creating the memory dump will increase CPU usage and disk I/O for several minutes. Web services will also be disabled while the memory dump is generated.

Also, we found that there is also an issue on the replication of CUC Pub and Sub.

admin:utils dbreplication runtimestate

DB and Replication Services: ALL RUNNING

DB CLI Status: No other dbreplication CLI is running...

Cluster Replication State: BROADCAST SYNC Completed on 1 servers at: 2016-11-24-13-57
Last Sync Result: SYNC COMPLETED 0 tables sync'ed out of 603
Sync Errors: 1 Errors or failures were found
Use this command to see the output- file view activelog /cm/trace/dbl/2016_11_24_13_57_44_dbl_repl_cdr_Broadcast.log

DB Version: ccm9_1_2_10000_28
Repltimeout set to: 300s
PROCESS option set to: 1

Cluster Detailed View from MAKTDUC01 (2 Servers):

PING CDR Server REPL. DBver& REPL. REPLICATION SETUP
SERVER-NAME IP ADDRESS (msec) RPC? (ID) & STATUS QUEUE TABLES LOOP? (RTMT) & details
----------- ------------ ------ ---- -------------- ----- ------- ----- -----------------
MAKTDUC01 10.249.125.246 0.078 Yes (2) Connected 0 match Yes (2) PUB Setup Completed
MAKTDUC02 10.249.125.247 0.350 Yes (?) Off-Line N/A match N/A (4) Setup Completed

The CUC Sub is Off-Line eventhough we can access it and it is reachable from the CUC Publisher. 

We would like to know if you also experienced this king of error or issue. As per checking, there is a bug seems related to this error. 

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCue39140/?referring_site=bugquickviewclick

Hope you can share your input so that we can prepare an action plan to resolve the issue. Do we need to upgrade the CUC to the latest version since this version is the base version of 9.1(2)?

For additional information. Kindly see the output of show status:

show status

Host Name : MAKTDUC01
Date : Tue Feb 7, 2017 10:30:33
Time Zone : Philippines Time (Asia/Manila)
Locale : en_US.UTF-8
Product Ver : 9.1.2.10000-28
OS Ver : 5.0.0.0-2
License MAC : 793c1f0492bc

Uptime:
10:30:34 up 74 days, 19:38, 1 user, load average: 0.58, 0.59, 0.62

CPU Idle: 99.02% System: 00.00% User: 00.98%
IOWAIT: 00.00% IRQ: 00.00% Soft: 00.00% Intr/sec: 539.22

Memory Total: 4016548K
Free: 159608K
Used: 3856940K
Cached: 1118352K
Shared: 0K
Buffers: 87528K

Total Free Used
Disk/active 29233880K 20844608K 8087480K (28%)
Disk/inactive 29233944K 27548780K 176200K (1%)
Disk/logging 101789720K 64675204K 31860436K (34%)

Than you so much,

Kier

2 Replies 2

Manish Gogna
Cisco Employee
Cisco Employee

Hi Kier,

Upgrade is recommended if you are running the base version of CUC 9.1.2 but before you upgrade the database replication and Tomcat issues need to be fixed else there will be issues during or after upgrade. One of the simple steps you can try if not already is to reboot the Unity Connection cluster and see if that helps. If the issue goes away then upgrade to the latest SU release of 9.1.2 available on cisco.com.

HTH

Manish

Hi Manish,

Thank you so much for your reply. Actually, I'm checking other information and it seems you are correct that we need to upgrade the CUC to the latest SU of 9.1. We will try to resolved first the replication issue before we proceed on the CUC upgrade. Thanks again.

Kier