Extension mobility login and logout is taking considerable long time to refelect on cisco phone

[geeta.kumari1]

Hi All,

We are using cucm version 8.6.2.

Whenever a user logins with extension mobility it takes longer time to load the user profile. Also when user logouts it takes sometime and then shows successful but still phone displays the extension number of profile.

I have restarted Tomcat service still no luck. Checked dbreplicatuon which shows high value in Replication queue  around 3000 for subscriber. The value varies from 200 to 3000+.

Ntp status shows time as unsynchronize and on subscriber it shows NTP stratum 6.

Im suspecting dbreplication to be slow due to NTP.

Can anyone please advise me if im suspecting correct. Also can anyone answer the below  with their expertise - 

1) If i will perform utils ntp restart will this cause dbreplication to go bad (pls note same ntp server is used on two different cucm cluster and ntp status for them also in unsynchronize but no high replication queue observed )

2) I understand that NTP ip address is also used one of the parameter to generate a license MAC for generating DLU license for 8.6 cucm. If I add a new NTP server and then restart the NTP service will it affect cucm licensing and do we need rehost license.

Regards,

Geeta

[Elliot Dierksen · Accepted solution]

You can add additional NTP servers without that changing the license MAC. If you remove the original one, that will change the license MAC.

Is your rate of change in the database that high? I wonder if you have some network or storage issues that are causing the replication to be slow. EM login/logout changes the configuration on the publisher which must then be replicated to the subscriber. Assuming the phones register to the subscriber, that would certainly explain why the updates take a long time. I have had some issues with memory leaks in early versions on CM9.1 where I had to reboot the servers every ~= 3 months, or EM would get wonky. That seems to be fixed on a more current version of 9.1.

[geeta.kumari1]

Hi Elliot,

Thanks for your reply.

I too identified that one of the HDD in UCS server was faulty and same is now replaced and storage looks good. I can see alarm indication for battery replacement in UCS server, not sure can this also cause service degradation.

After replacing the HDD I can find the CPU and memory utilisation of CUCM is now normal compare to earlier but still I can see that when a user logout from extension mobility  the user profile extension takes 5 minute to disappear from the phone.

Both Publisher and subscriber are hosted on same UCS server.

Regards,

Geeta

[Aseem Anand]

Hi,

Can you test it on a couple of test phones by creating a new service URL for extension mobility and point this URL to Subscriber to see if you get a different result?

Regards,

Aseem Anand

[geeta.kumari1]

Hi Aseem,

I tried with subscriber IP  for extension mobility and the http response is fast. Any clue ?

Regards,

Geeta

[Jitender Bhandari]

Hi Geeta,

do "show process load" on the server where EM was pointed before and check if tomcat service is using high CPU\memory.

you can also do "utils diagnose test".

Try restarting tomcat on problem server and see if it clears the issue by "utils service restart Cisco Tomcat"

JB

[geeta.kumari1]

Hi Jitendra,

I had found Tomcat to use high memory and had restarted the Tomcat service but it didnt solved the issue.

Regards,

Geeta

[Aseem Anand]

Hi Geeta,

Thanks for testing it! Is the SUB you tested with is in different datacenter or its in same DC where PUB is?

Get the output of:

Utils core active list

show status

show process using-most cpu

show process using-most memory

Utils diagnose test

Check event viewer application logs from the PUB for errors related to low virtual memory/CPU pegging or swap partition

Also make sure:

1. If you are using VMWare snapshots then delete it

2. Disable LRO on ESXI

Disable LRO
 http://docwiki.cisco.com/wiki/Disable_LRO

Aseem

[geeta.kumari1]

Hi Aseem,

I have attached the output of Publisher and subscriber. LRO is disable in ESXI. At present CPU pegging is not found. 

[Aseem Anand · Accepted solution]

Hi Geeta,

It seems you are having issues in Synching with NTP server. Can you check the NTP server's reachability from CUC by running  a ping using the command " Utils network ping followed by the IP address of the NTP server".

If the NTP server is not reachable then fix the reachability. Also, try restarting the NTP using the command " Utils ntp restart". If the PUB still shows restarting status on PUB after restarting the NTP then you need to reboot the PUB.

Just FYI: Since you are running version 8.6 of CUCM, if you change NTP server then you will have get the licenses rehosted as the license mac will get changed so be careful while changing it.

Aseem

[geeta.kumari1]

Hi Aseem,

The NTP Server used is a windows 2012 server so the time shows unsynchronized in NTP status.

There are total 3 cluster where this ntp server is used and the service delay is observed only in this cluster. I can see replication queue count to be varying from 2000 to 800  which looks high to me.

Will doing ntp restart will of any help.

Regards,

Geeta

[Aseem Anand]

Hi Geeta,

WIndows NTP servers are not supported by Cisco. You need to change the NTP server and used an IOS based NTP, it could be a router local to the CUCM. Once you change NTP reference get the license rehosted by opening a ticket with licensing. You can send an email to licensing@cisco.com with the old and new license MAC which you can check from the output of the show status from CLI. 

For reference: Take the screenshot of the DLU's on CUCM before making any change.

Aseem

[geeta.kumari1]

HI Aseem,

Can you please confirm the grace period available when license goes invalid and the time taken by licensing team to provide  the new license.

Regards,

Geeta

[Aseem Anand]

Hi Geeta,

Correction, if the licenses get expired/invalid the system will run for a grace period of 30 days. In version 9.X onwards the grace period is 60 days.The licensing team is generally quick to respond. if you send an email at licensing@cisco.com and provide them the details below then the response should be quick:

1. Sales order

2. new license mac which you can collect from the output of show status

3. Screenshot of license usage report from the current setup

Obtaining Rehosted Licenses When You Change License MAC Parameters

When you change any of the parameters that create the license MAC, the license that you obtained with it becomes invalid. You must request a rehosting of the license to obtain a valid license. The old license continues to work for a 30-day grace period.

To rehost your licenses, you must open a case with the licensing team. Contact the licensing team at licensing@cisco.com.

During the grace period, you can change the settings back to the licensed values to make your original license valid again. If you need more than 30 days of grace period, change your settings back to the licensed values, then change them back to the new values that you want to use. You will get another 30- day grace period.

http://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cucm/install/8_0_2/install/cmins802.html#wp585284

Aseem

(please rate if useful)

[geeta.kumari1]

Hi Aseem,

If I add the new IOS NTP device and still if there is no luck in extension mobility delay issue  and if I delete the newly add NTP device, will my old license will be restored. Do this needs License manager and cisco callmanager service to be restarted.

Regards,

Geeta