Inter-cluster peer in Presence

[Phil Bradley]

Is it possible to create an inter-cluster peer between Presence 8.6 and 10.6? I am upgrading and didn't know if this is compatible or not.

[Manish Gogna]

Hi Phil,

The Intercluster peer configuration requirements for both 8.6 and 10.5 talk about the same domain as the pre-requisite, there is no mention of any limitations with diff versions of IM&P so it should be fine

http://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cups/8_6/english/configAdmin/CUPdeploy/dgintercluster.html#42533

http://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cucm/im_presence/configAdminGuide/10_5_1/CUP0_BK_CE43108E_00_config-admin-guide-imp-105/CUP0_BK_CE43108E_00_config-admin-guide-imp-105_chapter_01.html#CUP0_RF_I4FE5843_00

HTH

Manish

[Phil Bradley]

I am receiving these errors on the 8.6 machine.

The following incompatible peer(s) have been detected:x.x.x.x Please verify that each inter-cluster peer is compatible. This failure may indicate a version mismatch with the specified peer(s) (fix)

Invalid inter-cluster proxy domains. The following peers have a proxy domain that does not match the local proxy domain:x.x.x.x Please verify that each inter-cluster peer has the appropriate proxy domain value.

Peer Connectivity  Not reachable (Check peer address is valid, AXL is running on peer and AXL username/password credentials are valid) 

The 10.6 to 8.6 connection looks ok.

[Jaime Valencia]

It is supported as per the compatibility matrix, have you tried removing the inter-cluster peer and adding it again?

http://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cucm/compat/10_x/cucm_b_compatibility-matrix-cucm-imp-10x.html#CUP0_RF_I0092C6B_00

Do you have the same IM&P domain on both clusters?

[Phil Bradley]

Where is the IM&P domain set in 8.6 and 10.6? 

[Jaime Valencia]

presence -> domains

[Phil Bradley]

What about 8.6? There is no domains menu.

Is it under cluster topology - settings?

[Jaime Valencia]

On 8.6 that would be the domain where your IM&P server is, or go to your server under cluster topology, and see what your users show as their IM address, that would be the domain they're using.

[Phil Bradley]

10.6 shows a check for intercluster domain under the troubleshooter, so I assume the domain is good. The problem is 8.6 will not connect to 10.6. I can ping the server and login to the Axl service fine on the 10.6 machine.

[Phil Bradley]

8.6 does not have a im address under topology that I can find. I do see it in 10.6 though.

[Jaime Valencia]

If you issue the command: show network eth0

Do you see a domain listed there?

But if you do not see the IM address as user@domain, you have some problem.

[Phil Bradley]

Yes, it is the same domain. I did get 10.6 connected to 8.6 successfully. The certificates on the 8.6 server had expired.

I still cannot get 8.6 connected to 10.6. I have verified that I can ping the 10.6 server from 8.6 and I have tested the AXL username by hitting the webpage. Here is the error.

Peer Connectivity Not reachable (Check peer address is valid, AXL is running on peer and AXL username/password credentials are valid)
Not reachable (Check peer address is valid, AXL is running on peer and AXL username/password credentials are valid) Peer Compatibility Unknown

Unknown Peer Proxy Domain Unknown

Unknown Cluster ID Unknown

Unknown CUP Version Unknown

Unknown CUCM Publisher Version Unknown

Unknown Unique CUCM Cluster Unknown

Unknown Associated Users 1

1 Associated Users Duplicate Users 0

0 Duplicate Users Certificate Status Unknown Details Unknown

[Phil Bradley]

Inter-clustering Troubleshooter from 10.6

Verify any inter-cluster Peer entries exist
Verify inter-cluster Sync Agent service (local) is running
Verify valid inter-cluster Peers (check reachability)
Verify AXL connectivity of each reachable inter-cluster peer
Verify that each inter-cluster peer is compatible with this IM and Presence Service
Verify peers have the same default domain as the local IM and Presence Service Server
Verify peers have the same IM Address Scheme value configured
Verify peers point at unique CUCM Clusters.
Verify that each TLS-enabled inter-cluster peer has successfully exchanged security certificates
Verify users are associated (have been synchronized) with each inter-cluster peer
Verify that the XMPP Federation Security Settings match on all inter-clustered peers.
Verify that XMPP Federation has been uniformly disabled or is enabled on at least one node in all clusters.
Verify that the default Admin Policy is consistent across all inter-cluster peers.
Verify that the Host Policy is consistent across all inter-cluster peers.
Verify that cluster ID is unique across all inter-cluster peers.

[Phil Bradley]

Edit: Here is additional trace information on the 10.5 server showing the 8.6 connecting.

<SOAP-ENV:Envelope xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"><SOAP-ENV:Header/><SOAP-ENV:Body><axl:getCertificateSummary><userid>AXL_USER</userid><component>SERVICE_ESP</component></axl:getCertificateSummary></SOAP-ENV:Body></SOAP-ENV:Envelope>

2017-03-31 08:08:00,570 ERROR [http-bio-443-exec-18] servletRouters.AXLFilter - com.cisco.www.servletRouters.AXLFilter@15e9c98
com.sun.xml.internal.messaging.saaj.SOAPExceptionImpl: Unable to create envelope from given source:
at com.sun.xml.internal.messaging.saaj.soap.EnvelopeFactory.createEnvelope(EnvelopeFactory.java:117)
at com.sun.xml.internal.messaging.saaj.soap.ver1_1.SOAPPart1_1Impl.createEnvelopeFromSource(SOAPPart1_1Impl.java:68)
at com.sun.xml.internal.messaging.saaj.soap.SOAPPartImpl.getEnvelope(SOAPPartImpl.java:128)
at com.cisco.www.servletRouters.AXLFilter.isWriteRequest(Unknown Source)
at com.cisco.www.servletRouters.AXLFilter.checkThrottleStatus(Unknown Source)
at com.cisco.www.servletRouters.AXLFilter.doFilter(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at com.cisco.vos.platform.tomcat.valves.CiscoResponseHeaderFilter.doFilter(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:610)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:312)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1040)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:313)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: javax.xml.transform.TransformerException: org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: 139; The prefix "axl" for element "axl:getCertificateSummary" is not bound.
at org.apache.xalan.transformer.TransformerIdentityImpl.transform(TransformerIdentityImpl.java:469)
at com.sun.xml.internal.messaging.saaj.util.transform.EfficientStreamingTransformer.transform(EfficientStreamingTransformer.java:399)
at com.sun.xml.internal.messaging.saaj.soap.EnvelopeFactory.createEnvelope(EnvelopeFactory.java:108)
... 28 more
Caused by: org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: 139; The prefix "axl" for element "axl:getCertificateSummary" is not bound.
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1239)
at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:648)
at org.xml.sax.helpers.XMLFilterImpl.parse(XMLFilterImpl.java:357)
at org.apache.xalan.transformer.TransformerIdentityImpl.transform(TransformerIdentityImpl.java:452)
... 30 more

CAUSE:

javax.xml.transform.TransformerException: org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: 139; The prefix "axl" for element "axl:getCertificateSummary" is not bound.
at org.apache.xalan.transformer.TransformerIdentityImpl.transform(TransformerIdentityImpl.java:469)
at com.sun.xml.internal.messaging.saaj.util.transform.EfficientStreamingTransformer.transform(EfficientStreamingTransformer.java:399)
at com.sun.xml.internal.messaging.saaj.soap.EnvelopeFactory.createEnvelope(EnvelopeFactory.java:108)
at com.sun.xml.internal.messaging.saaj.soap.ver1_1.SOAPPart1_1Impl.createEnvelopeFromSource(SOAPPart1_1Impl.java:68)
at com.sun.xml.internal.messaging.saaj.soap.SOAPPartImpl.getEnvelope(SOAPPartImpl.java:128)
at com.cisco.www.servletRouters.AXLFilter.isWriteRequest(Unknown Source)
at com.cisco.www.servletRouters.AXLFilter.checkThrottleStatus(Unknown Source)
at com.cisco.www.servletRouters.AXLFilter.doFilter(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at com.cisco.vos.platform.tomcat.valves.CiscoResponseHeaderFilter.doFilter(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:610)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:312)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1040)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:313)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: 139; The prefix "axl" for element "axl:getCertificateSummary" is not bound.
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1239)
at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:648)
at org.xml.sax.helpers.XMLFilterImpl.parse(XMLFilterImpl.java:357)
at org.apache.xalan.transformer.TransformerIdentityImpl.transform(TransformerIdentityImpl.java:452)
... 30 more
---------
org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: 139; The prefix "axl" for element "axl:getCertificateSummary" is not bound.
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1239)
at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:648)
at org.xml.sax.helpers.XMLFilterImpl.parse(XMLFilterImpl.java:357)
at org.apache.xalan.transformer.TransformerIdentityImpl.transform(TransformerIdentityImpl.java:452)
at com.sun.xml.internal.messaging.saaj.util.transform.EfficientStreamingTransformer.transform(EfficientStreamingTransformer.java:399)
at com.sun.xml.internal.messaging.saaj.soap.EnvelopeFactory.createEnvelope(EnvelopeFactory.java:108)
at com.sun.xml.internal.messaging.saaj.soap.ver1_1.SOAPPart1_1Impl.createEnvelopeFromSource(SOAPPart1_1Impl.java:68)
at com.sun.xml.internal.messaging.saaj.soap.SOAPPartImpl.getEnvelope(SOAPPartImpl.java:128)
at com.cisco.www.servletRouters.AXLFilter.isWriteRequest(Unknown Source)
at com.cisco.www.servletRouters.AXLFilter.checkThrottleStatus(Unknown Source)
at com.cisco.www.servletRouters.AXLFilter.doFilter(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at com.cisco.vos.platform.tomcat.valves.CiscoResponseHeaderFilter.doFilter(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:610)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:312)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1040)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:313)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

From the 10.6 AXL RTMT trace, I see the following coming from the 8.6 server when trying to add the inter-cluster.

<SOAP-ENV:Envelope xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"><SOAP-ENV:Header/><SOAP-ENV:Body><axl:executeSQLQuery sequence="1490929599915" xmlns:axl="http://www.cisco.com/AXL/API/8.0"><sql>SELECT LIMIT 1 1 FROM componentversion</sql></axl:executeSQLQuery></SOAP-ENV:Body></SOAP-ENV:Envelope>

2017-03-30 23:06:40,162 ERROR [http-bio-443-exec-6] servletRouters.AXLFilter - Failed to set the value of counter: 4 value: 0 rc= -1
2017-03-30 23:06:40,163 INFO [http-bio-443-exec-6] servletRouters.AXLAlpha - Ver:null
2017-03-30 23:06:40,221 INFO [http-bio-443-exec-6] servletRouters.AXLAlpha - Going to axis--->
2017-03-30 23:06:40,230 INFO [http-bio-443-exec-6] servletRouters.AXLAlpha - Request processed by AXIS
2017-03-30 23:06:40,231 INFO [http-bio-443-exec-6] servletRouters.AXLFilter - Request 1490928732274 from 10.6.23.11 response size: 338 time 81ms
2017-03-30 23:07:10,115 INFO [http-bio-443-exec-23] servletRouters.AXLFilter - Received request 1490928732275 from GLPS_AXL at IP x.x.x.x
2017-03-30 23:07:10,116 INFO [http-bio-443-exec-23] servletRouters.AXLFilter - AXL REQUEST :

[Phil Bradley]

Jaime,

This appears to be a bug in 8.6.(1). I just upgraded to 8.6(5) SU5 and everything works now.