cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
1820
Views
0
Helpful
10
Replies

LMS 3.2 device center is not loading

tomeq82
Level 1
Level 1

Hi,

For some unknown reason "Device Center" stopped working. Device Center is opening, but it stucks on loading contents... Unfortunately it happens on both of our servers (one of them working as DCR Slave). The only thing I could recall that would affect this is the rotation of /var/log/syslog_info file which I did some time ago...

Is there any way to easily debug this (which logs should I look at?) or to restart a process without restarting daemon manager?

Greets,

Tomek

1 Accepted Solution

Accepted Solutions

Joe Clarke
Cisco Employee
Cisco Employee

Device Center writes its logs to the Tomcat stdout.log under NMSROOT/MDC/tomcat/logs.  The output of http://SERVER/cwhp/ThreadDump.jsp may also prove useful. The log rotation would not affect Device Center. Things that have been known to mess with Device Center are expired applications.  If you have HUM installed with an eval license, and that license has expired, you should remove HUM or install a purchased license.  There could also be a hung process with which Device Center is trying to communicate.  I know you don't want to do it, but a Daemon Manager restart may clear this up.

View solution in original post

10 Replies 10

Joe Clarke
Cisco Employee
Cisco Employee

Device Center writes its logs to the Tomcat stdout.log under NMSROOT/MDC/tomcat/logs.  The output of http://SERVER/cwhp/ThreadDump.jsp may also prove useful. The log rotation would not affect Device Center. Things that have been known to mess with Device Center are expired applications.  If you have HUM installed with an eval license, and that license has expired, you should remove HUM or install a purchased license.  There could also be a hung process with which Device Center is trying to communicate.  I know you don't want to do it, but a Daemon Manager restart may clear this up.

I did tomcat's stdout.log rotation also - i did that manually from LMS log rotation utility, but the file seems ok (permissions are ok - casuser/casusers, rw) and something is still writing to it. I've removed gziped archives from directory but this didn't help.

Licenses are ok and we are not using any evaluations...

TaskDump.js showing nothing out of ordinary but I'm no java junkie

I'll try to restart Daemon Manager but first I would like to try to fix "online" without doing this...

Here are some tail stdout.log outputs, it stucks after last line and the page loading ends up with empty "Device Center" screen...

[Mon May 16 09:51:19 CEST 2011]login::service. Redirecting to SSL port

[Mon May 16 09:51:19 CEST 2011]login::service. Checking for valid request.

[Mon May 16 09:51:39 CEST 2011]  CoreContextNexus ValidateConnection:true

[Mon May 16 09:51:39 CEST 2011] Invoke doLicenseCheck!

[Mon May 16 09:51:39 CEST 2011]  DoLicenseCheck Returned:true

[ Mon May 16 09:51:39 CEST 2011 ] INFO   [DeviceCenterAction : perform]  : Inside Device Center Action class

[ Mon May 16 09:51:39 CEST 2011 ] INFO   [DeviceCenterAction : perform]  : Starting Threads

[ Mon May 16 09:51:39 CEST 2011 ] INFO   [DeviceCenterAction : perform]  : End of starting Threads

[ Mon May 16 09:51:39 CEST 2011 ] INFO   [DeviceCenterAction : perform]  : Start of OGS Processing

[ Mon May 16 09:51:39 CEST 2011 ] INFO   [DeviceCenterAction : run]  : Inside Run method

[ Mon May 16 09:51:39 CEST 2011 ] INFO   [DeviceCenterAction : run]  : Getting Cache instance

[ Mon May 16 09:51:39 CEST 2011 ] INFO   [DeviceCenterAction : run]  : Creating CMIC Interactor instance

[ Mon May 16 09:51:39 CEST 2011 ] INFO   [DeviceCenterAction : run]  : Inside Run method

[ Mon May 16 09:51:39 CEST 2011 ] INFO   [DeviceCenterAction : run]  : Getting DCR Instance

[ Mon May 16 09:51:39 CEST 2011 ] INFO   [DeviceCenterAction : run]  : Obtained DCR Instance

[Mon May 16 09:51:41 CEST 2011]  CoreContextNexus ValidateConnection:true

[Mon May 16 09:51:41 CEST 2011] Invoke doLicenseCheck!

[Mon May 16 09:51:41 CEST 2011]  DoLicenseCheck Returned:true

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DeviceCenterAction : perform]  : Inside Device Center Action class

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DeviceCenterAction : perform]  : Starting Threads

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DeviceCenterAction : perform]  : End of starting Threads

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DeviceCenterAction : perform]  : Start of OGS Processing

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DeviceCenterAction : run]  : Inside Run method

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DeviceCenterAction : run]  : Getting DCR Instance

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DeviceCenterAction : run]  : Obtained DCR Instance

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DeviceCenterAction : run]  : Inside Run method

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DeviceCenterAction : run]  : Getting Cache instance

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DeviceCenterAction : perform]  : End of OGS Processing

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DeviceCenterAction : run]  : Creating CMIC Interactor instance

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DeviceCenterDeviceFilter : createGroups]  : Inside Creategroups function

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [DCRInteractor : getPIDMData]  : Inside the function getGroupsAndObjects

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [CMICInteractor : GetApplications]  : Inside function GetApplications

[ Mon May 16 09:51:41 CEST 2011 ] INFO   [CMICInteractor : GetApplications]  : CMIC return hash size is = 8

In case proxy creation in the constructor failed ...

[Mon May 16 09:52:03 CEST 2011]  CoreContextNexus ValidateConnection:true

[Mon May 16 09:52:03 CEST 2011] Invoke doLicenseCheck!

[Mon May 16 09:52:03 CEST 2011]  DoLicenseCheck Returned:true

May 16, 2011 9:52:03 AM org.apache.catalina.core.ApplicationContext log

INFO: action: UIIController processActionForward does not have a screenID so no authorization was done for /WEB-INF/screens/portal/view/RMESyslogAlerts.jsp.

Local Server URL :http://11.1.1.1:1741

Key :::RME_SyslogAlerts;

Buffer length from mem :::31

Buffer size from mem :::12

Data is from API:: RME Syslog Alerts

It looks like Device Center is hanging trying to get the list of devices managed by each of the LMS applications.  Seeing the ThreadDump.jsp output may help identify exactly what is causing the lock up to occur.

I am having the same problem.

Stdout and ThreadDump attached.

Restarting daemon now....

The thread dump points to an issue with connecting to the CSTM server.  Try a Daemon Manager restart, if the problem returns, start a new thread.  Multiple thread dumps will be required to see what threads are really stuck.  One of the suspect threads is doing name resolution of the server.  It's hard to say if this thread is stuck or just happened to be running at the time the dump was taken.  If it is stuck, this could point to some kind of DNS or resolver problem on the server.

Daemon Manager restart helped. Unfortunately I didn't cactch the ThreadDump.jsp during hang.

HI again

#Thomasz - glad to hear your problem has been solved!

For me daemon restart did'nt help, device center takes 3-5 min. to load.

Joseph do you have an idea why I see these long loading times?

this has been an issue after LMS 3.2 SP1 upgrade.

Thanks

Hi Joseph

I have attaced 4 x threadDump

To be honest I don't really know what to look for in these files!

Please start a new thread for your issue.  This is different than the initial author's problem.