TFTP Download Failed and phones unable to use translation patterns

[cacmarkw]

Hey guys,

I appreciate any help offered, thanks in advanced. We have an old phone system across multiple locations, in my prior thread I was able to fix most of it after the network was "upgraded" to Unifi UDM Pro gateways and their 48-port switches. I'm still having some issues...

We have a main corporate office, it hosts the VPN network to several of our smaller locations (let's call them small sites). It also hosts all of the servers, including CCM.

It looks like we can use patterns at each small site for inside-the-site calls, or to the main office OK. If they try to use a pattern from one small site to another it rings and then goes silent, neither party at either site can hear anything. An example would be dial 1111 at smallsiteA to reach smallsiteB, it would ring then go silent when B picks up, and neither side would hear anything.

I noticed in the CCM in multiple locations (conference bridges, transcoders, media termination points) that only the main office is registered, while the rest are unknown status/IP Address. I was thinking the new network VPN could be at play, but I can copy XML configs from the CCM publisher and subscriber server using tftp at the small sites?

I tried show ccm-manager at the main office and at the small sites and noticed TFTP download failed is occurring a ton now, in the past I would get some success at least. Examples:

MGCP Domain Name: smallsite.domain
Priority Status Host
============================================================
Primary Registered 10.0.100.11
First Backup None
Second Backup None

Current active Call Manager: 10.0.100.11
Backhaul/Redundant link port: 2428
Failover Interval: 30 seconds
Keepalive Interval: 15 seconds
Last keepalive sent: 18:10:14 PST Nov 22 2021 (elapsed time: 00:00:05 )
Last MGCP traffic time: 18:10:14 PST Nov 22 2021 (elapsed time: 00:00:05 )
Last failover time: None
Last switchback time: None
Switchback mode: Graceful
MGCP Fallback mode: Enabled/OFF
Last MGCP Fallback start time: None
Last MGCP Fallback end time: None
MGCP Download Tones: Disabled
TFTP retry count to shut Ports: 2

Configuration Auto-Download Information
=======================================
No configurations downloaded
Current state: Downloading XML file
Configuration Download statistics:
Download Attempted : 1
Download Successful : 0
Download Failed : 0
TFTP Download Failed : 2315
Configuration Attempted : 0
Configuration Successful : 0
Configuration Failed(Parsing): 0
Configuration Failed(config) : 0
Last config download command:
FAX mode: disable
Configuration Error History:

MGCP Domain Name: MainOffice.domain
Priority Status Host
============================================================
Primary Registered 10.0.100.11
First Backup None
Second Backup None

Current active Call Manager: 10.0.100.11
Backhaul/Redundant link port: 2428
Failover Interval: 30 seconds
Keepalive Interval: 15 seconds
Last keepalive sent: 18:14:19 PST Nov 22 2021 (elapsed time: 00:00:01 )
Last MGCP traffic time: 18:14:19 PST Nov 22 2021 (elapsed time: 00:00:01 )
Last failover time: None
Last switchback time: None
Switchback mode: Graceful
MGCP Fallback mode: Enabled/OFF
Last MGCP Fallback start time: None
Last MGCP Fallback end time: None
MGCP Download Tones: Disabled
TFTP retry count to shut Ports: 2

Backhaul Link info:
Link Protocol: TCP
Remote Port Number: 2428
Remote IP Address: 10.0.100.11
Current Link State: OPEN
Statistics:
Packets recvd: 3842
Recv failures: 0
Packets xmitted: 3586
Xmit failures: 0
PRI Ports being backhauled:
Slot 0, VIC 2, port 0
Configuration Auto-Download Information
=======================================
No configurations downloaded
Current state: Downloading XML file
Configuration Download statistics:
Download Attempted : 1
Download Successful : 0
Download Failed : 0
TFTP Download Failed : 3196
Configuration Attempted : 0
Configuration Successful : 0
Configuration Failed(Parsing): 0
Configuration Failed(config) : 0
Last config download command:
FAX mode: disable
Configuration Error History:

I've read recently that having this setting may help with the TFTP failed downloads:

ip tftp source-interface Loopback(#)

but we had similar in our smallsite configs and restoring to that didn't help:

ip tftp source-interface Loopback0

interface Loopback0
no ip address

We used to get some failures but some successes too, but now it's 100% failures even though I can manually copy files over TFTP to the small sites from the CCM servers at the main office. Do I need to re-register them somehow or what? Normal dialing phone numbers the calls seem to work fine now. I'm not sure how else to troubleshoot this issue.

Thanks for any and all help!

Mark

[Roger Kallberg]

Very likely all of your issue are related to communication issue(s) over the VPN. Make sure that you have full connectivity across all networks on all ports.

[cacmarkw]

Thank you, I thought so as well but verified the VPN was up by issuing the "ipsec statusall" command on the gateways.

I found out that the TFTP issue was that it was showing as registered with one server, but trying to pull from another server on "ccm-manager config server", thanks to "debug ccm-manager errors" and "debug ccm-manager config-download all". Doing "show ccm-manager" didnb't show this at all, only the debugging clued me in that I had the config server set incorrectly. Changing the config server to the registered version pulled the config over.

I'm still troubleshooting the pattern dialing issues, but I noticed the small sites often had mixed up conference bridges, media termination points, and transcoders with each other. I'm going to swap them to what should be the appropriate values and will post back afterwards, what amazes me is this system supposedly worked properly before, but we'll never know now.

Do you have any recommended debugs to monitor translation patterns? I'm not a phone guy, but if I get diagnostics I can usually muddle my way through the issue.

[Leonardo Santana]

Hi,

Use the Cisco Dialed Number Analyzer on CUCM to see how the calls are being routed according to the dialed number.

Check this video:

https://www.youtube.com/watch?v=0eYO90kC7F0 

[cacmarkw]

Thanks!

I'm going to try and restart the phones/system after fixing the conference bridges, media termination points, and transcoders entries.

I tried the video you suggested @Leonardo Santana , didn't see any issues popping up myself, see attached file.

I also found this article here, with information from Manish Gogna but I don't have CDR Analysis and Reporting here available, we are on CuCM v8.6.2 if that matters. https://community.cisco.com/t5/ip-telephony-and-phones/find-calls-to-translation-patterns/td-p/2321345

If you are looking at an option to find the calls made to specific translation patterns on cucm, you can use the following method.

Navigate to Cisco Unified Serviceability >> Tools >> CDR Analysis and Reporting

Once the new menu opens up, Go to CDR >> Export CDR.

Export the CDR Dump and Right Click on the CDR link and Save Link as.

This will save it as a text file and you can convert it to CSV which will open in Excel format.

Then you can easily search for calls made to any translation pattern.