EPMServer processes don't die after dmgtd stop - LMS 4.2 Solaris

[kviola1]

I am unable to kill EPMServer processes after shutting down LMS 4.2 on Solaris 10. There are still 60 or so EPMServer processes running. Killing them manually does not work as they appear to restart again after killing. Only way to knock them off is to reboot the system. Why does dmgtd stop not kill all LMS processes and is there a patch required for LMS 4.2 or Solaris 10 that would help?

EPMServer processes attached:

Thanks.                

[Michel Hegeraat]

Strange indeed. Not seeing this on linux in LMS 4.2.

You can kill them all at once.  kill pid1 pid2 pid3

You may also want to check the parrent pids. 1338 is parent of several EPMServer processes

His parrant is 995.

Find out what this process is and kill it too if needed.

Cheers,

Michel

[kviola1]

Michel - I tried killing them all with -9 but a number of them keep coming back whether I kill the PID or its parent. See files I sent in reply to Vinod.

Thanks,

Ken.

[Vinod Arya]

This is extremely strange to know 60+ EPMServer processes are there as mostly there are less than 60 processes for complete ciscoworks are there.

Is it possible for you to share NMSROOT/bin/pdshow output to see if more processes are running than normal?

This issue was there in LMS 3.x mostly where DFM processes were not stopped by daemon, and was addressed with

CSCta56151, but it is not there in LMS 4.x and mostly not in LMS 4.2 for sure. There may be some issues with install or OS side,as i too dont see this on my win LMS 4.2.

What is the output of command ps -aef after the daemon manager stops? Also, do you see any error in

/var/adm/CSCOpx/log/daemons.log or dmgtd.log for EPMServer?

Are you running a Master-slave setup? Is you Fault Management enabled/disabled on your LMS Server you see issue with?

-Thanks

Vinod

[kviola1]

Vinod - please see the pdshow output just prior to dmgtd stop. After stopping daemon manager, the ps -aef was run with a grep on CSC shows all of the EPMServer processes still running. I included a portion of the dmgtd.log and daemons.log file timestamped just before the dmgtd stop at 12:19am. A couple of statements show possible errors in stopping EPMServer - see dmgtd-log-EPMServer.txt.

The server is not running in a master-slave setup -- it's standalone.

Hopefully you can make some sense of this.

Thanks,

Ken.

[kviola1]

Any luck on resolving this problem? This is happening on multiple servers. Cannot kill EPMServer processes manually or by running .../etc/init.d/dmgtd stop to kill server. Killing processing directly will respawn same processes again. Only recourse is to reboot with these processes active.

: ps -ef|grep CSC

casuser 29811 29803   0 18:36:49 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

    root 18722 16794   0 10:32:21 pts/2       0:00 grep CSC

casuser   546     1   0   Aug 15 ?           0:00 /bin/bash /opt/CSCOpx/MDC/tomcat/webapps/rme/WEB-INF/compliancemgr/compliance/b

casuser 29803     1   0 18:36:34 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29808 29800   0 18:36:48 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29800     1   0 18:36:33 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29821 29811   0 18:37:05 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29817 29808   0 18:37:04 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29819 29810   0 18:37:05 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29790     1   0 18:35:37 ?           0:00 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29799     1   0 18:36:33 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29814 29805   0 18:36:51 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29839 29827   0 18:37:36 ?           0:00 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29810 29799   0 18:36:49 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29805     1   0 18:36:35 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29824 29814   0 18:37:09 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29827 29817   0 18:37:20 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29829 29819   0 18:37:21 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29831 29821   0 18:37:21 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29838 29829   0 18:37:36 ?           0:00 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29833 29824   0 18:37:24 ?           0:01 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29840 29831   0 18:37:37 ?           0:00 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5

casuser 29841 29833   0 18:37:40 ?           0:00 CSCO.EPMServer -Xms64M -Xmx1024m -cp:p conf/epm/patch:lib/classpath//cesar-v0-5