Various LMS Errors

[Gerren Murphy]

Hello,

A new install of LMS 4.0 is showing the following error(s) in various parts of the UI:

1. JRM server is down  or inaccessible for this user (Admin > System)

2. Error in communicating with DCR Server. (Inventory > Add/Import/Manage Devices)

3. Self Test Fail to query ani.DbVersion Error: Invalid user ID or password (DBD: login failed)

Thanks for any and all assistance.

[Joe Clarke]

Post the output of pdshow from this server.

[Gerren Murphy]

That's what's tough, every time I've run that command, it says something along the lines of the daemon is busy doing other things, please try again later. I don't remember the exact verbiage, and can't get in at the moment to get it either.

When I run the self-test, it shows pass on everything but the database connection. I tried installing LMS  both in the "basic" install mode where the system generates a DB password, and in advanced mode and I specified a password. Both ways got the same result.

This is on a box where 3.2 was previously installed then uninstalled, so I'm wondering if it's a registry key somewhere that's the issue. Should have more for you on Wednesday.

[Joe Clarke]

Yes, the command will hang, but that's because you have a failing process that we to troubleshoot.  If you wait long enough (up to an hour).  The command will return useful data.  Wait until it does, then post the output.

[Gerren Murphy]

Output of pdshow

=================

    Process= UPMDbEngine
    State  = Program started - No mgt msgs received
    Pid    = 312
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:18:00 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Application started by administrator request.

    Process= UPMDbMonitor
    State  = Running normally
    Pid    = 132
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:18:04 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = DbMonitor Running Normally.

    Process= Tomcat
    State  = Program started - No mgt msgs received
    Pid    = 196
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:18:08 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Application started by administrator request.

    Process= TomcatMonitor
    State  = Running normally
    Pid    = 2896
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:18:12 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Tomcat Server up

    Process= Apache
    State  = Program started - No mgt msgs received
    Pid    = 3904
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:21:42 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Application started by administrator request.

    Process= RMEDbEngine
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= Proxy
    State  = Program started - No mgt msgs received
    Pid    = 5628
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:25:02 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

    Process= NameServer
    State  = Program started - No mgt msgs received
    Pid    = 5636
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:25:03 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

    Process= NameServiceMonitor
    State  = Running normally
    Pid    = 5700
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:25:07 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = NameServer is fully up now !

    Process= EDS
    State  = Running normally
    Pid    = 5740
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:25:11 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Initialization complete

    Process= EDS-GCF
    State  = Running normally
    Pid    = 6000
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:26:29 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = GCF Initialization complete at Mon Jan 17 14:27:29 EST 2011

    Process= LicenseServer
    State  = Program started - No mgt msgs received
    Pid    = 6008
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:26:29 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

    Process= INVDbEngine
    State  = Program started - No mgt msgs received
    Pid    = 6016
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:26:31 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Application started by administrator request.

    Process= FHPurgeTask
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= FHDbEngine
    State  = Program started - No mgt msgs received
    Pid    = 2868
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:26:37 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Application started by administrator request.

    Process= ESS
    State  = Program started - No mgt msgs received
    Pid    = 1588
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:26:41 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

    Process= EssMonitor
    State  = Running normally
    Pid    = 2716
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:26:45 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = ESS is fully up now !

    Process= DCRServer
    State  = Failed to run
    Pid    = 0
    RC     = -3
    Signo  = 1073741821
    Start  = N/A
    Stop   = 1/17/2011 3:30:31 PM
    Core   = Not applicable
    Info   = Application failed or was registered incorrectly.

    Process= CMFOGSServer
    State  = Administrator has shut down this server
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:31:46 PM
    Stop   = 1/17/2011 3:30:31 PM
    Core   = Not applicable
    Info   = Server started by admin request

    Process= EssentialsDM
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= ConfigMgmtServer
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= ConfigUtilityService
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= ICServer
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= EnergyWise
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= PMCOGSServer
    State  = Program started - No mgt msgs received
    Pid    = 7444
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:31:46 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

    Process= IPMOGSServer
    State  = Administrator has shut down this server
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:31:46 PM
    Stop   = 1/17/2011 3:30:31 PM
    Core   = Not applicable
    Info   = Server started by admin request

    Process= TISServer
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= DFMOGSServer
    State  = Program started - No mgt msgs received
    Pid    = 7468
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:31:46 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

    Process= InventoryCollector
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= Interactor
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= InventoryCollector1
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= Interactor1
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= PTMServer
    State  = Program started - No mgt msgs received
    Pid    = 7652
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:31:50 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

    Process= UPMProcess
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= EventFramework
    State  = Program started - No mgt msgs received
    Pid    = 7660
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:31:50 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

    Process= jrm
    State  = Administrator has shut down this server
    Pid    = 0
    RC     = 1
    Signo  = 0
    Start  = 1/17/2011 3:12:10 PM
    Stop   = 1/17/2011 3:30:31 PM
    Core   = Not applicable
    Info   = Server started by admin request

    Process= CTMJrmServer
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= ChangeAudit
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= SyslogAnalyzer
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= DataPurge
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= IPMProcess
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= TISDiscoveryJobCreate
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= PMServer
    State  = Running normally
    Pid    = 5592
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:40:10 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = PMServer is up and running

    Process= SyslogCollector
    State  = Running normally
    Pid    = 5624
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:40:14 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = SyslogCollector Started at Mon Jan 17 14:40:14 EST 2011

    Process= EPMDbEngine
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= EPMServer
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= FHServer
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= NOSServer
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= diskWatcher
    State  = Running normally
    Pid    = 6612
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:34 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = diskWatcher initialized OK.

    Process= DFMMultiProcLogger
    State  = Program started - No mgt msgs received
    Pid    = 6492
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:34 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

    Process= DFMLogServer
    State  = Program started - No mgt msgs received
    Pid    = 7112
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:34 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

    Process= DFMCTMStartup
    State  = Administrator has shut down this server
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:34 PM
    Stop   = 1/17/2011 3:30:31 PM
    Core   = Not applicable
    Info   = Server started by admin request

    Process= DfmBroker
    State  = Program started - No mgt msgs received
    Pid    = 7232
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:34 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

    Process= DfmServer
    State  = Running normally
    Pid    = 7272
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:38 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = DfmServer initialized OK.

    Process= DfmServer1
    State  = Running normally
    Pid    = 7300
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:38 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = DfmServer1 initialized OK.

    Process= DCRDevicePoll
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= CSRegistryServer
    State  = Running normally
    Pid    = 7304
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:38 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = CSRegistryServer is running in other process

    Process= CSDiscovery
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= ANIDbEngine
    State  = Program started - No mgt msgs received
    Pid    = 7312
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:40 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Application started by administrator request.

    Process= ANIServer
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= UTMajorAcquisition
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= MACUHIC
    State  = Running normally
    Pid    = 7836
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:44 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Started.

    Process= UTLITE
    State  = Running normally
    Pid    = 7740
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:45 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Started.

    Process= UTManager
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= WlseUHIC
    State  = Never started
    Pid    = 0
    RC     = 0
    Signo  = 0
    Start  = N/A
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Not applicable,

    Process= AdapterServer1
    State  = Program started - No mgt msgs received
    Pid    = 7708
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:45 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

    Process= AdapterServer
    State  = Program started - No mgt msgs received
    Pid    = 7672
    RC     = 0
    Signo  = 0
    Start  = 1/17/2011 2:43:45 PM
    Stop   = Not applicable
    Core   = Not applicable
    Info   = Server started by admin request

[Joe Clarke]

Looks like there is a problem with DCRServer.  Please post the dcr.log and DCRServer.log.  There also appears to be an issue with the RME database.  Have a look at https://supportforums.cisco.com/docs/DOC-8796 .  Try performing transaction log recovery on the RME database.  If that does not work, you will either need to reinitialize the RME database or restore LMS from a known good backup.