I have installed LMS 3.2 on a 64 bit Windows Server 2003 R2 Standard edition with Service pack 2
The main problem is that the apache service will not start.
It seems like all the other ciscoworks services starts, but not the apache services.
How do I solve this problem?
Solved! Go to Solution.
according to your netstat output, it seems that Tomcat (TCP/9009) takes more than 20 min to start. If that is the case, this is too long for TomcatMonitor to wait for and thus it will not be started -causing other dependent processes (like Apache) to fail also.
I guess your virus scanner is the culprit of this issue. Just for a short test disable it and try to stop and start LMS (in a DOS box: net stop crmdmgtdand when it has finished, net start crmdmgtd)
If LMS is working now, you should configure the virus scanner to not touch the CSCOpx directory (at least for online scans).
Joel, I dropped in and didn't read the whole thread in detail, sorry - but you clearly put the finger on this before and I agree with you that this is the most likely cause
Yes, Apache depends on Tomcat. As I mentioned before, AntiVirus/security software is the most likely culprit here. Since you cannot disable it due to security reasons, you need to setup an exclusion in McAfee for on-access scanning of the CSCOpx folder and all its subfolders.
In fact, I was just about to update this thread since just finished working with another customer with same issues and McAfee was at fault. After adding the exclusion daemons came back up fine. You need to make sure this exclusion still exists just before you restart daemons since it can get removed without noticing. You also need to make sure the exclusion remains throughout a reboot so the problem does not happen again after reboot.
This is documented here for your reference:
No worries, your help and anyone elses is always appreciated and we both came to same conclusion.
Both TomcatMonitor and Apache are down which will cause many other processes to go down with them. Try this:
1. Shutdown daemons: net stop crmdmgtd.
2. In DOS go to CSCOpx\bin path and run:
perl hostnamechange.pl -ohost
3. Enter the correct hostname as seen in a "hostname" output on DOS.
4. Restart daemons: net start crmdmgtd. Go to CSCOpx\objects\dmgt\ready, once the daemon lock is gone, see if Apache and TomcatMonitor are now up.
I have checked the installation log and the only differense I found was that the old hostname was in upercase and the new hostname from the DOS command "hostname" was in lowercase and I then ran the command "hostnamechange.pl" but apache still does't start.
Is it a tomcat problem or some sort of conflict with other running services?
Any other suggestion please?
Create dummy D:\Program Files\CSCOpx\MDC\Apache\log\error_log and D:\Program Files\CSCOpx\MDC\Apache\log\mod_jk.log files and then restart daemons. Then they should contain some information we can use. Since the daemons will be down, lets take this chance to try all this:
1. Stop daemons:
net stop crmdmgtd
2. Remove all server.* under D:\Program Files\CSCOpx\MDC\Apache\conf\ssl.
3. CD to D:\Program Files\MDC\Apache in DOS and issue:
perl NMSROOT\MDC\Apache\ConfigSSL.pl -disable
perl NMSROOT\MDC\Apache\ConfigSSL.pl -enable
4. Fill out the information.
5. Issue "netstat -anob > C:\netstat.txt" and post this file.
6. CD to D:\Program Files\CSCOpx\MDC\Apache and issue:
apache.exe -t -d D:\Progra~1\CSCOpx\MDC\Apache
7. Restart daemons:
net start crmdmgtd
If still no go, post:
- Any Event Viewer related errros
- Output of pdreg -l Apache
I have done task 1 to 7 and the everything worked but when I restarted the server the same problem was back with apache not running.
It seems for me that if the server has been up and running for a few hours and I stop and start the deamons and I have a lucky day, everything work ok.
The Deamon Manager will not start Apache if the system is recently booted
---Apache\log\error_log is still empty but I hope you will find some interesting things in the other log files
If I understood correctly, when you start daemons it works, but if you reboot problem comes back. If that is so, it would seem some other application is causing a conflict with LMS. Turn off any AntiVirus/security software and make sure DEP is set to Windows essential programs only.
You forgot the "netsat ouput" which would show what is using which ports. Can you please confirm that if you do "net stop crmdmgtd - net start crmdmgtd" Apache comes up, and then if you reboot it does not?
What other applications are installed on this server? Also post the CSCOpx\lib\classpath\md.properties.
I have changed the DEP to "Windows essential program only"
And I can confirm that if I wait a few hours and do a net stop crmdmgtd - net start crmdmgtd Apache comes up if I'm lucky.
Our wintel team has installed some tools they need for management of the server and nothing else is installed as far as I know. The server is running McAfee antivirus
Are those the only errors you see in the Event Viewer? Do not seem to be related to this problem. Post the CSCOpx\MDC\Apache\conf\httpd.conf and a screenshot of all installed Apps along with all contents under CSCOpx\MDC\Apache\logs. Are you able to temporarily disable AntiVirus and security software and reboot to test?