Solved: File Manager in PARTIAL_SERVICE on PUB - UCCX 12.5 SU2

tsuntken · ‎06-01-2022

Cisco Unified CCX Engine --> Manager Manager --> File Manager

The SUB is 100% IN_SERVICE

This is a brand new build. I have done multiple reboots.

Replication and Datastores all look good

System version: 12.5.1.11002-481 (SU2)

I believe this is causing my script Upload Document step to go to Unsuccessful.

6 Screenshots attached

Hoping someone has a solution before i contact TAC

Thank you so much in advance.

Tom S

tsuntken · ‎06-02-2022

TAC needed to remote in and resolve

View solution in original post

tsuntken · ‎06-02-2022

Here are exeptions I found in MIVR logs...

417381: Jun 02 09:23:25.694 CDT %MIVR-FILE_MGR-4-SYNC_NOT_COMPLETE:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.file.impl.FileTypeSyncThread Synchronization did not complete.: Class=class com.cisco.doc.UserDocument,Exception=com.cisco.file.impl.SyncFailedException: creation of Folders failed
417382: Jun 02 09:23:25.694 CDT %MIVR-FILE_MGR-4-EXCEPTION:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread:com.cisco.file.impl.SyncFailedException: creation of Folders failed
417383: Jun 02 09:23:25.695 CDT %MIVR-FILE_MGR-4-EXCEPTION:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: at com.cisco.file.impl.FileTypeSyncThread.performSync(FileTypeSyncThread.java:2631)
417384: Jun 02 09:23:25.695 CDT %MIVR-FILE_MGR-4-EXCEPTION:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: at com.cisco.file.impl.FileTypeSyncThread.run(FileTypeSyncThread.java:1411)
417385: Jun 02 09:23:25.695 CDT %MIVR-FILE_MGR-4-EXCEPTION:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: at com.cisco.executor.impl.ExecutorStubImpl$RequestImpl.runCommand(ExecutorStubImpl.java:690)
417386: Jun 02 09:23:25.695 CDT %MIVR-FILE_MGR-4-EXCEPTION:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: at com.cisco.executor.impl.ExecutorStubImpl$RequestImpl.run(ExecutorStubImpl.java:486)
417387: Jun 02 09:23:25.695 CDT %MIVR-FILE_MGR-4-EXCEPTION:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: at com.cisco.executor.impl.ExecutorStubImpl$RequestImpl.run(ExecutorStubImpl.java:762)
417388: Jun 02 09:23:25.695 CDT %MIVR-FILE_MGR-4-EXCEPTION:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: at com.cisco.executor.impl.ThreadStubImpl$RequestImpl.run(ThreadStubImpl.java:570)
417389: Jun 02 09:23:25.695 CDT %MIVR-FILE_MGR-4-EXCEPTION:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: at com.cisco.util.ThreadPoolFactory$ThreadImpl.run(ThreadPoolFactory.java:853)
417390: Jun 02 09:23:25.695 CDT %MIVR-FILE_MGR-6-SYNC_OPERATION_STARTED:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.file.impl.FileTypeSyncThread Synchronization started.: Class=class com.cisco.doc.UserDocument,Synchronization status=2022-06-02 09:23:25.695:Synching
417391: Jun 02 09:23:25.702 CDT %MIVR-DOC_MGR-1-MGR_PARTIAL_SERVICE: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.doc.impl.DocumentManagerImpl Document Manager in partial service
417392: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.bootstrap.impl.BootstrapManagerImpl, state = IN SERVICE, name=Bootstrap Manager
417393: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.config.impl.ConfigManagerImpl, state = IN SERVICE, name=Config Manager
417394: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.executor.impl.ExecutorManagerImpl, state = IN SERVICE, name=Executor Manager
417395: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.cluster.impl.manager.ClusterManagerImpl, state = IN SERVICE, name=Cluster Manager
417396: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.wfapi.impl.WFEngineImpl, state = IN SERVICE, name=Cisco Unified CCX Engine
417397: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.script.impl.ScriptManagerImpl, state = IN SERVICE, name=Script Manager
417398: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.app.impl.ApplicationManagerImpl, state = IN SERVICE, name=Application Manager
417399: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.prompt.impl.PromptManagerImpl, state = IN SERVICE, name=Prompt Manager
417400: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.grammar.impl.GrammarManagerImpl, state = IN SERVICE, name=Grammar Manager
417401: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.doc.impl.DocumentManagerImpl, state = PARTIAL SERVICE, name=Document Manager
417402: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.file.impl.FileManagerImpl, state = PARTIAL SERVICE, name=File Manager
417403: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.dialog.impl.RTPPortManagerImpl, state = IN SERVICE, name=RTP Port Manager
417404: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.channel.impl.ChannelManagerImpl, state = IN SERVICE, name=Channel Manager
417405: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.contact.impl.ContactManagerImpl, state = IN SERVICE, name=Contact Manager
417406: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.session.impl.SessionManagerImpl, state = IN SERVICE, name=Session Manager
417407: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.expression.impl.ExpressionManagerImpl, state = IN SERVICE, name=Expression Manager
417408: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.database.impl.DatabaseManagerImpl, state = IN SERVICE, name=Database Manager
417409: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.user.impl.CCMUserManagerImpl, state = IN SERVICE, name=User Manager
417410: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl Manager name => class com.cisco.socket.impl.SocketManagerImpl, state = IN SERVICE, name=Socket Manager
417411: Jun 02 09:23:25.702 CDT %MIVR-MGR_MGR-7-UNK: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.manager.impl.ManagerManagerImpl State is the same => PARTIAL SERVICE, no change
417412: Jun 02 09:23:25.710 CDT %MIVR-FILE_MGR-4-SYNC_INVALID_STATE:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.file.impl.FileTypeSyncThread Synchronization detected invalid state: Class=class com.cisco.doc.UserDocument,Reason=createFolder:/opt/cisco/uccx/Documents/User/default/webapps:could not be created
417413: Jun 02 09:23:25.710 CDT %MIVR-FILE_MGR-4-SYNC_INVALID_STATE:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.file.impl.FileTypeSyncThread Synchronization detected invalid state: Class=class com.cisco.doc.UserDocument,Reason=createFolder:/opt/cisco/uccx/Documents/User/default/webapps/ROOT:could not be created
417414: Jun 02 09:23:25.710 CDT %MIVR-FILE_MGR-6-SYNCHRONIZATION_UPDATE:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.file.impl.FileTypeSyncThread FileManager RDS to local disk synchronization: Class=class com.cisco.doc.UserDocument,Information=MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0Folders for creation failed folders:
417415: Jun 02 09:23:25.710 CDT %MIVR-FILE_MGR-6-SYNCHRONIZATION_UPDATE:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.file.impl.FileTypeSyncThread FileManager RDS to local disk synchronization: Class=class com.cisco.doc.UserDocument,Information=folder:/opt/cisco/uccx/Documents/User/default/webapps
417416: Jun 02 09:23:25.710 CDT %MIVR-FILE_MGR-6-SYNCHRONIZATION_UPDATE:THREAD:MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.file.impl.FileTypeSyncThread FileManager RDS to local disk synchronization: Class=class com.cisco.doc.UserDocument,Information=folder:/opt/cisco/uccx/Documents/User/default/webapps/ROOT
417417: Jun 02 09:23:25.710 CDT %MIVR-DOC_MGR-6-MGR_IN_SERVICE: [MIVR_FILE_MGR_CUSTOM_CLASSPATH_SYNCZR-18-0-FileTypeSyncThread] com.cisco.doc.impl.DocumentManagerImpl Document Manager in service

tsuntken · ‎06-02-2022

Looks like a bug...

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCwa45885

UCCX Engine stays in partial service due to File Manager component after a fresh installation.
CSCwa45885

Description - Issue observed during lab test.

Symptom: UCCX Engine stays in partial service due to File Manager component

Conditions: Newly installed UCCX 12.5su2 server services came up except for the File Manager service which remained in Partial State.

Workaround: Contact Cisco TAC for workaround.

Further Problem Description: UCCX Engine stays in partial service due to File Manager component.

Known Affected Releases (1 of 1)
12.5(1)SU2

Waiting for resolution from TAC

tsuntken · ‎06-02-2022

TAC needed to remote in and resolve

NickyA · ‎06-09-2022

Just a note, after TAC apply the fix they have to restart the CCX Engine

Sami Ahmad · ‎07-27-2022

I just had a TAC engineer apply the fix on two different deployments. One of them was in production and didn’t have to restart CCX Engine.

johan234 · ‎08-15-2022

chmod -R 775 /opt/cisco/uccx/Documents/User/default

jung-yoon lee · ‎01-31-2023

Running the ES04 patch fixed it.

mfischer · ‎03-11-2023

Had it after switch version on the Sub. I guess my fault was doing the switch version while not all services on the Pub were IN SERVICE, but I am not sure. For me a restart of the Pub has resolved the issue.