Error 2254 in CUCM User

mikedufford · ‎06-20-2016

Hello - I'm working with CUCM 10.5.2. We have 1 publisher and 7 subscribers in our cluster. Recently, one of the subscribers in the cluster is not allowing Extension Mobility logins for newer users. When I look at the publisher, the user looks fine - however, on the subscriber in question, I am seeing the following error in End User Configuration:

Error: [2254] ADMIN_ERROR_NO_UDT_IN_USER_PROFILE

I have tried the following steps:

1. Restart Extension Mobility, TFTP, and Tomcat services on the subscriber in question

2. Check dbreplication status - see below (g_7 is the subscriber in question that I am connected into console):

SERVER                 ID STATE    STATUS     QUEUE CONNECTION CHANGED
-----------------------------------------------------------------------
g_11_ccm10_5_2_13900_12   11 Active   Connected       0 Jun 18 15:19:35
g_12_ccm10_5_2_13900_12   12 Active   Connected       0 Jun 18 15:19:35
g_13_ccm10_5_2_13900_12   13 Active   Connected       0 Jun 18 15:19:35
g_2_ccm10_5_2_13900_12    2 Active   Connected       0 Apr 10 07:40:43
g_3_ccm10_5_2_13900_12    3 Active   Connected       0 Apr 10 07:26:22
g_4_ccm10_5_2_13900_12    4 Active   Connected       0 Apr 15 10:42:55
g_6_ccm10_5_2_13900_12    6 Active   Connected       0 Jun 18 15:19:35
g_7_ccm10_5_2_13900_12    7 Active   Local           0
g_9_ccm10_5_2_13900_12    9 Active   Connected       0 Apr 10 07:28:59

3. Check dbreplication runtimestate - see below (NYCUCM1 is the server I am connected to):

                                      PING      DB/RPC/   REPL.    Replication    REPLICATION SETUP
SERVER-NAME         IP ADDRESS        (msec)    DbMon?    QUEUE    Group ID       (RTMT) & DB Status
-----------         ----------        ------    -------   -----    -----------    ------------------
NYCUCM       x.x.x.x       21.127    Y/Y/Y     0        (g_6)          (2) Setup Completed
NYCUCM1       x.x.x.x      0.016     Y/Y/Y     0        (g_7)          (2) Setup Completed
ASUB2         x.x.x.x       37.153    Y/Y/Y     0        (g_13)         (2) Setup Completed
BSUB2         x.x.x.x       27.463    Y/Y/Y     0        (g_4)          (2) Setup Completed
JSUB1         x.x.x.x     49.776    Y/Y/Y     0        (g_11)         (2) Setup Completed
BTFTP1        x.x.x.x       19.294    Y/Y/Y     148      (g_9)          (2) Setup Completed
BPUB1         x.x.x.x       15.865    Y/Y/Y     0        (g_2)          (2) Setup Completed
BSUB1         x.x.x.x       15.517    Y/Y/Y     0        (g_3)          (2) Setup Completed
BOSUB1         x.x.x.x      57.694    Y/Y/Y     0        (g_12)         (2) Setup Completed

At this point I am at a loss, I worked with a TAC engineer for a while today but did not get very far. I have never seen this error before and did not get any relevant hits when I Googled the error code. Has anyone seen this prior?

Shashank Mahajan · ‎06-20-2016

This error points to a Database replication issue between the Publisher and Subscriber nodes. Please provide output of the following commands from the Publisher node:

- utils dbreplication runtimestate
- utils ntp status

We need to verify that Publisher is synced with an NTP server and the status of replication is good.

mikedufford · ‎06-20-2016

Hello Shashank - thank you for the insight. Here is the output of those commands:

utils dbreplication runtimestate:

Cluster Replication State: Replication status command started at: 2016-06-20-19-27
Replication status command COMPLETED 681 tables checked out of 681
Last Completed Table: devicenumplanmapremdestmap
Errors or Mismatches Were Found!!!

Use 'file view activelog cm/trace/dbl/sdi/ReplicationStatus.2016_06_20_19_27_45.out' to see the details

DB Version: ccm10_5_2_13900_12
Repltimeout set to: 780s
PROCESS option set to: 1

Cluster Detailed View from BWOCUCMPUB1 (9 Servers):

PING DB/RPC/ REPL. Replication REPLICATION SETUP
SERVER-NAME IP ADDRESS (msec) DbMon? QUEUE Group ID (RTMT) & Details
----------- ---------- ------ ------- ----- ----------- ------------------
NSUB3 x.x.x.x 9.029 Y/Y/Y 0 (g_6) (2) Setup Completed
ASUB2 x.x.x.x 31.842 Y/Y/Y 0 (g_13) (2) Setup Completed
BSUB2 x.x.x.x 0.103 Y/Y/Y 0 (g_4) (2) Setup Completed
NSUB1 x.x.x.x 10.285 Y/Y/Y 0 (g_7) (2) Setup Completed
BSUB1 x.x.x.x 0.268 Y/Y/Y 0 (g_3) (2) Setup Completed
JSUB1 x.x.x.x 29.252 Y/Y/Y 0 (g_11) (2) Setup Completed
BPUB1 x.x.x.x 0.012 Y/Y/Y 0 (g_2) (2) Setup Completed
BTFTP1 x.x.x.x 0.392 Y/Y/Y 0 (g_9) (2) Setup Completed
BOSUB1 x.x.x.x 48.568 Y/Y/Y 0 (g_12) (2) Setup Completed

utils ntp status:

ntpd (pid 12373) is running...

remote refid st t when poll reach delay offset jitter
==============================================================================
*137.1.5.45 192.5.41.209 2 u 1049 1024 377 0.296 0.565 1.094

synchronised to NTP server (137.1.5.45) at stratum 3
time correct to within 75 ms
polling server every 1024 s

Current time in UTC is : Tue Jun 21 01:59:06 UTC 2016
Current time in America/New_York is : Mon Jun 20 21:59:06 EDT 2016

Shashank Mahajan · ‎06-21-2016

We can see DBreplication issue from the attached output:

utils dbreplication runtimestate:

Cluster Replication State: Replication status command started at: 2016-06-20-19-27
Replication status command COMPLETED 681 tables checked out of 681
Last Completed Table: devicenumplanmapremdestmap
Errors or Mismatches Were Found!!!

You can repair dbreplication using the command "utils dbreplication repair all" on Publisher node.

mikedufford · ‎06-21-2016

I actually ended up doing a utils dbreplication reset on the publisher and subscriber in question in the cluster, which seems to have resolved this issue. Thanks for the help!

virendra pathak · ‎04-01-2018

Hello Mike,

i am also getting the below error. here is the output of asked services details for your reference.

admin:utils ntp status

ntpd (pid 26725) is running...

remote refid st t when poll reach delay offset jitter

==============================================================================

*166.118.169.225 166.118.169.224 5 u 440 1024 377 1.218 0.273 9.565

+166.118.153.226 166.118.153.224 5 u 106 1024 377 1.562 6.490 2.770

synchronised to NTP server (166.118.169.225) at stratum 6

time correct to within 274 ms

polling server every 1024 s

Current time in UTC is : Mon Apr 2 01:40:14 UTC 2018

Current time in Asia/Singapore is : Mon Apr 2 09:40:14 SGT 2018

admin:utils dbreplication runtimestate

Server Time: Mon Apr 2 09:41:17 SGT 2018

Cluster Replication State: Replication status command started at: 2015-08-11-21-38

Replication status command COMPLETED 680 tables checked out of 680

Last Completed Table: devicenumplanmapremdestmap

No Errors or Mismatches found.

Use 'file view activelog cm/trace/dbl/sdi/ReplicationStatus.2015_08_11_21_38_25.out' to see the details

DB Version: ccm10_5_1_10000_7

Repltimeout set to: 300s

PROCESS option set to: 1

Cluster Detailed View from p11tpbx01pub (5 Servers):

PING DB/RPC/ REPL. Replication REPLICATION SETUP

SERVER-NAME IP ADDRESS (msec) DbMon? QUEUE Group ID (RTMT) & Details

----------- ---------- ------ ------- ----- ----------- ------------------

p11tpbx01sub 157.206.177.197 0.173 Y/Y/Y 0 (g_3) (2) Setup Completed

p21tpbx01sub 157.206.177.228 1.295 Y/Y/Y 0 (g_4) (2) Setup Completed

p11tpbx01pub 157.206.177.196 0.031 Y/Y/Y 0 (g_2) (2) Setup Completed

p11tpbx01tftp 157.206.177.198 0.230 Y/Y/Y 0 (g_5) (2) Setup Completed

p21tpbx01tftp 157.206.177.229 1.323 Y/Y/Y 0 (g_6) (2) Setup Completed

Please help me to fix the issue.

Regards

Viru

Chris Deren · ‎02-24-2021

I just ran into the same error when attempting to add new local users in CUCM, did you or anyone else resolve this issue?