CUCM Subscriber Tomcat

[albanobernardo]

Hi! My subscriber is not ok, and I need help. 

admin:utils diagnose test

Starting diagnostic test(s)
===========================
test - disk_space : Passed (available: 7928 MB, used: 11368 MB)
skip - disk_files : This module must be run directly and off hours
test - service_manager : Passed
test - tomcat : Failed - Tomcat is not running.
test - tomcat_deadlocks : Failed - Tomcat is not running.
test - tomcat_keystore : Failed - Tomcat is not running.
test - tomcat_connectors : Failed - Tomcat is not running.
test - tomcat_threads : Failed - Tomcat is not running.
test - tomcat_memory : Failed - Tomcat is not running.
test - tomcat_sessions : Failed - Tomcat is not running.
skip - tomcat_heapdump : This module must be run directly and off hours
test - validate_network : Passed
test - raid : Passed
test - system_info : Passed (Collected system information in diagnostic log)
test - ntp_reachability : Passed
test - ntp_clock_drift : Passed
test - ntp_stratum : Passed
skip - sdl_fragmentation : This module must be run directly and off hours
skip - sdi_fragmentation : This module must be run directly and off hours
test - ipv6_networking : Passed

Diagnostics Completed

[Deepak Kumar R]

Hello albanobernado,

Looks like your Cisco Tomcat service is not running. Pls verify this using the CLI command "Utils service list". If yes, please try to start the service using the CLI command "Utils service start Cisco Tomcat"

Regards,

Deepak Kumar

[albanobernardo]

Hi @Deepak Kumar R i run the command:

admin:utils service list

Requesting service status, please wait...
System SSH [STARTED]
Cluster Manager [STARTED]
Service Manager is running
Getting list of all services
>> Return code = 0
A Cisco DB[STARTED]
A Cisco DB Replicator[STARTED]
Cisco AMC Service[STARTED]
Cisco AXL Web Service[STOPPED] Commanded Out of Service
Cisco Audit Event Service[STARTED]
Cisco CAR DB[STOPPED] Commanded Out of Service
Cisco CAR Scheduler[STOPPED] Commanded Out of Service
Cisco CDP[STARTED]
Cisco CDP Agent[STARTED]
Cisco CDR Agent[STARTED]
Cisco CDR Repository Manager[STOPPED] Commanded Out of Service
Cisco CTIManager[STARTING]
Cisco CTL Provider[STARTED]
Cisco CallManager[STARTING]
Cisco CallManager Admin[STOPPED] Commanded Out of Service
Cisco CallManager Cisco IP Phone Services[STOPPED] Commanded Out of Service
Cisco CallManager Personal Directory[STOPPED] Commanded Out of Service
Cisco CallManager SNMP Service[STARTED]
Cisco CallManager Serviceability[STOPPED] Commanded Out of Service
Cisco CallManager Serviceability RTMT[STOPPED] Commanded Out of Service
Cisco Certificate Change Notification[STARTED]
Cisco Certificate Expiry Monitor[STARTED]
Cisco Change Credential Application[STOPPED] Commanded Out of Service
Cisco DHCP Monitor Service[STARTED]
Cisco DRF Local[STARTED]
Cisco DRF Master[STOPPED] Commanded Out of Service
Cisco Database Layer Monitor[STARTED]
Cisco Dialed Number Analyzer[STOPPED] Commanded Out of Service
Cisco Dialed Number Analyzer Server[STARTED]
Cisco E911[STOPPED] Commanded Out of Service
Cisco ELM Admin[STOPPED] Commanded Out of Service
Cisco ELM Client Service[STOPPED] Commanded Out of Service
Cisco ELM DB[STARTING]
Cisco ELM Server[STARTING]
Cisco Extended Functions[STARTED]
Cisco Extension Mobility[STOPPED] Commanded Out of Service
Cisco Extension Mobility Application[STOPPED] Commanded Out of Service
Cisco IP Manager Assistant[STOPPED] Commanded Out of Service
Cisco IP Voice Media Streaming App[STARTED]
Cisco Intercluster Lookup Service[STARTED]
Cisco License Manager[STOPPED] Commanded Out of Service
Cisco Location Bandwidth Manager[STARTED]
Cisco Log Partition Monitoring Tool[STARTED]
Cisco Messaging Interface[STARTING]
Cisco RIS Data Collector[STARTED]
Cisco RTMT Reporter Servlet[STOPPED] Commanded Out of Service
Cisco SOAP - CallRecord Service[STOPPED] Commanded Out of Service
Cisco Serviceability Reporter[STARTED]
Cisco Syslog Agent[STARTED]
Cisco Tftp[STARTING]
Cisco Tomcat[STARTING]
Cisco Tomcat Stats Servlet[STOPPED] Commanded Out of Service
Cisco Trace Collection Service[STARTED]
Cisco Trace Collection Servlet[STOPPED] Commanded Out of Service
Cisco Trust Verification Service[STARTED]
Cisco UXL Web Service[STOPPED] Commanded Out of Service
Cisco User Data Services[STOPPED] Commanded Out of Service
Cisco WebDialer Web Service[STOPPED] Commanded Out of Service
Host Resources Agent[STARTED]
MIB2 Agent[STARTED]
Platform Administrative Web Service[STOPPED] Commanded Out of Service
SNMP Master Agent[STARTED]
SOAP - Diagnostic Portal Database Service[STOPPED] Commanded Out of Service
SOAP -Log Collection APIs[STOPPED] Commanded Out of Service
SOAP -Performance Monitoring APIs[STOPPED] Commanded Out of Service
SOAP -Real-Time Service APIs[STOPPED] Commanded Out of Service
System Application Agent[STARTED]
Cisco Bulk Provisioning Service[STOPPED] Service Not Activated
Cisco CAR Web Service[STOPPED] Service Not Activated
Cisco Certificate Authority Proxy Function[STOPPED] Service Not Activated
Cisco DirSync[STOPPED] Service Not Activated
Cisco ELM Resource API[STOPPED] Service Not Activated
Cisco SOAP - CDRonDemand Service[STOPPED] Service Not Activated
Cisco TAPS Service[STOPPED] Service Not Activated
Cisco Unified Mobile Voice Access Service[STOPPED] Service Not Activated
Primary Node =false

[Deepak Kumar R]

Not just Tomcat, many other services are also not running. Have you tried rebooting this subcriber node ?

[albanobernardo]

Yes, I just rebooting this subcriber node. But the others services that are not running have the tag "Commanded Out of Service"

[Deepak Kumar R]

TFTP, ELM and few other including Tomcat were struck in starting state. The only option is to try restarting the service or reboot the server (since multiple services are struck in starting state).

[b.winter]

It seems, that the service is stopped. Have you checked that?
Troubleshooting basics.

[albanobernardo]

Yes, I have checked it. And I run de recovery ISO already, but didn't work. So I need help

[b.winter]

But the Tomcat service is in "starting" state. If you have rebooted the service, this is one of the last services to be started fully. After restart, it probably takes 10 to 15 minutes for Tomcat to start. At this point, there is nothing to worry about or to troubleshoot.

It's unnecessary to check any service states or do a diagnose test, while the server isn't fully started yet.

[albanobernardo]

My server has been like this for about 1 year in this same state.

[Deepak Kumar R]

What is the status now after the reboot ? Please give minimum 20 to 25 mins after reboot for the services to come up.

[albanobernardo]

State holds but I'm trying to start service by service.

[albanobernardo]

admin:utils diagnose test

Starting diagnostic test(s)
===========================
test - disk_space : Passed (available: 7928 MB, used: 11368 MB)
skip - disk_files : This module must be run directly and off hours
test - service_manager : Passed
test - tomcat : Passed
test - tomcat_deadlocks : Failed - Two or more Tomcat threads are deadlocked. Please collect all of the Tomcat logs for root cause analysis: file get activelog tomcat/logs/*
test - tomcat_keystore : Failed - The Tomcat keystore has been corrupted.
test - tomcat_connectors : Failed - The HTTP and HTTPS ports are not responding to local requests. Please collect all of the Tomcat logs for root cause analysis: file get activelog tomcat/logs/*
test - tomcat_threads : Passed
test - tomcat_memory : Passed
test - tomcat_sessions : Passed
skip - tomcat_heapdump : This module must be run directly and off hours
test - validate_network : Passed
test - raid : Passed
test - system_info : Passed (Collected system information in diagnostic log)
test - ntp_reachability : Passed
test - ntp_clock_drift : Passed
test - ntp_stratum : Passed
skip - sdl_fragmentation : This module must be run directly and off hours
skip - sdi_fragmentation : This module must be run directly and off hours
test - ipv6_networking : Passed

Diagnostics Completed