LMS 4.2.4 - not starting up Correctly

[Ian Beck]

Hi,

Can some one please advise.

I am have an issue with LMS where it is not fully comming up. I have shut down and restarted several times, with the latest giving me the following result within the macuhic.log, attached also PDSHOW :

Informational: Starting Cisco Process Manager communication thread

log4j:WARN No appenders could be found for logger (org.apache.activemq.transport.WireFormatNegotiator).

log4j:WARN Please initialize the log4j system properly.

CtrlPlaneListener -- Waiting to receive messages!  Topic --> ut.uhic.mac

Intializing the Controler 1 = log Pkg = com.cisco.nm.cm.ut.ctrlplane.ctrls.LogCtrl

messages will remian logged to file: macuhic.log

Intializing the Controler 2 = cblog Pkg = com.cisco.nm.cm.ut.ctrlplane.ctrls.CBLogCtrl

Intializing the Controler 3 = gen Pkg = com.cisco.nm.cm.ut.ctrlplane.ctrls.GenericCtrl

Intializing the Controler 4 = vqueue Pkg = com.cisco.nm.cm.ut.ctrlplane.ctrls.VQCtrl

Intializing the Controler 5 = db Pkg = com.cisco.nm.cm.ut.uhic.mac.ctrls.DBUpdateCtrl

Executing IDM Procedures

Failed to create Tables. Transaction Rolled back

Failed to create Tables. Transaction Rolled back

: com.sybase.jdbc2.jdbc.SybSQLException: SQL Anywhere Error -110: Item 'getAuthenticatedUsers_ACS' already exists

Loading locationDetails jars

Setting Java path in windows

com.sybase.jdbc2.jdbc.SybSQLException: SQL Anywhere Error -110: Item 'locationDetails.jar' already exists

    at com.sybase.jdbc2.tds.Tds.processEed(Tds.java:2884)

    at com.sybase.jdbc2.tds.Tds.nextResult(Tds.java:2206)

    at com.sybase.jdbc2.jdbc.ResultGetter.nextResult(ResultGetter.java:69)

    at com.sybase.jdbc2.jdbc.SybStatement.nextResult(SybStatement.java:220)

    at com.sybase.jdbc2.jdbc.SybStatement.nextResult(SybStatement.java:203)

    at com.sybase.jdbc2.jdbc.SybStatement.updateLoop(SybStatement.java:1702)

    at com.sybase.jdbc2.jdbc.SybStatement.executeUpdate(SybStatement.java:1685)

    at com.sybase.jdbc2.jdbc.SybStatement.executeUpdate(SybStatement.java:431)

    at com.cisco.nm.cm.ut.ctrlplane.ctrls.DBCtrl.medianetQuery(DBCtrl.java:100)

    at com.cisco.nm.cm.ut.ctrlplane.ctrls.DBCtrl.initializeDBSchema(DBCtrl.java:78)

    at com.cisco.nm.cm.ut.ctrlplane.ctrls.DBCtrl.init(DBCtrl.java:56)

    at com.cisco.nm.cm.ut.uhic.mac.ctrls.DBUpdateCtrl.<init>(DBUpdateCtrl.java:53)

    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)

    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)

    at java.lang.reflect.Constructor.newInstance(Constructor.java:513)

    at com.cisco.nm.cm.ut.ctrlplane.EntityCtrlMgr.initialize(EntityCtrlMgr.java:497)

    at com.cisco.nm.cm.ut.ctrlplane.EntityCtrlMgr.initControlers(EntityCtrlMgr.java:529)

    at com.cisco.nm.cm.ut.ctrlplane.EntityCtrlMgr.main(EntityCtrlMgr.java:898)

The number of DB connections:2

class com.cisco.nm.cm.ut.db.DBConnectionCreated new Database connection [hashCode = 10217370]

class com.cisco.nm.cm.ut.db.DBConnectionsuccessfully connected to db-url jdbc:odbc:cwsi

Creating Threads :8

Intializing the Controler 6 = filter Pkg = com.cisco.nm.cm.ut.uhic.mac.ctrls.FilterCtrl

Intializing the Controler 7 = dec Pkg = com.cisco.nm.cm.ut.uhic.mac.ctrls.DecodeCtrl

Intializing the Controler 8 = tpm Pkg = com.cisco.nm.cm.ut.ctrlplane.ctrls.TPMCtrl

Created TPM

Intializing the Controler 9 = sktsend Pkg = com.cisco.nm.cm.ut.uhic.mac.ctrls.SktSenderCtrl

Intializing the Controler 10 = skt Pkg = com.cisco.nm.cm.ut.ctrlplane.ctrls.SocketCtrl

Started Socket Listener

class com.cisco.nm.cm.ut.db.DBConnectionClosed Database connection [hashCode = 10217370]

[AFROJ AHMAD]

Hi Ian,

Thanks for the details.

Enable the Debugging for Daemon Manager as below :

1. Go to Run and issue the regedit command.

2. Go to this key and add the entries:

HKEY_LOCAL_MACHINE\Software\Cisco\ResourceManager\CurrentVersion\Environment

Values:

PX_DBG=1

PX_MY_DEBUG=1

PX_MY_TRACE=1

PX_DBG_LEVEL=1

Note: for adding a value:

* Right click on the Environment Right side and choose New > String Value.

* Provide the name of the value

* Right click on the value name and choose Modify.

* Provide the value 1 and click on OK

Close the Regedit.

3. Stop the daemon manager

From the CLI:

> net stop crmdmgtd

4. Restart the daemon Manager by issuing:

> net start crmdmgtd

wait for the 4-5 min ,collect the log file

5. Send me the following file: dmgtDbg.log (NMSROOT/CSCOpx/log)

IMP: As soon as you collect the dmgtDbg.log file , Remove those 4 Entries from REGISTRY.

Thanks-
Afroz
[Do rate the useful post]
****Ratings Encourages Contributors ****.

[Ian Beck]

Hi Afroj,

The intresting point is I can not find the Key

HKEY_LOCAL_MACHINE\Software\Cisco\ResourceManager\CurrentVersion\Environment

In the Registry !!!

There is no

HKEY_LOCAL_MACHINE\Software\Cisco

[AFROJ AHMAD]

Hi Ian,

look under:

HKEY_LOCAL_MACHINE\Software\ Wow6432Node

Thanks-
Afroz
[Do rate the useful post]
****Ratings Encourages Contributors ****

[Ian Beck]

Thanks and as requested

[AFROJ AHMAD]

Hi Ian ,

file does not contail enough information.

after enabling the debug .. you need to restart the daemon manager ..

after you have logs ..remove the PX entries from registry

Thanks-
Afroz
[Do rate the useful post]
****Ratings Encourages Contributors ****

[Ian Beck]

Hi Afroj,

The first file was after the Server had rebotted, after adding the Debug options and had started up on its own.

I have now shut down the processes again and restarted.

From what I can see the system has now come up fully !!!

And is now running normally.

I have attached the debug file and pdshow for you to look at.

I will now delete the debug reg settings.

[AFROJ AHMAD]

Hi Ian,

Thanks for sharing the logs.from the shared logs , I did not find any root cause of the issue.

looks like some Ports was in a blocked state ,which would have released after several restart.

from the pdshow output , I can all the processes are running fine

Thanks-
Afroz
[Do rate the useful post]
****Ratings Encourages Contributors ****

[Ian Beck]

Hi Afroj,

I would like to thank you for assiting and providing the help which finally resolved the issue.

Rgrades

Ian

[AFROJ AHMAD]

I am really glad to know everything is fine.

Thanks-
Afroz
[Do rate the useful post]
****Ratings Encourages Contributors ****