UCCE Integration with Nuance

[Ahmed Adeyemi]

Integrating with Nuance and was wondering if anyone has ever done Speech-to-Text from the CVP side. I have the Nuance server stood up with required license and have no idea on how to receive audio to convert it into text.

[david.macias]

This is more of a configuration issue. You need to make sure your GW or VVB are configured correctly so you can then use the ASR/TTS resources needed.

david

[Ahmed Adeyemi]

Thanks for the response David. I am able to get the ASR/TTS pieces to work. I am trying to find out how the Speech-to-Text (STT) to work.

[david.macias]

So I've never done STT through Nuance. I've done it with LumenVox via Asterisk and in DialogFlow via CVP, but never in Nuance. So the only thing I can think of is that you look at the Nuance utterance logs for the SST results, but I don't know of a way to programmatically get them while the call is active. I would check the documentation to confirm.

david

[Ahmed Adeyemi]

Ok, DialogFlow is my other option as well. I am getting an error when doing this but not able to determine what is truly going on. Please can you lend a hand with this? I am using the DFText when it comes to CVPApp

10.10.17.94.1648057035780.7.DFText,03/23/2022 10:37:15.811,DialogFlow_01,element,warning,A substitution representing Element data from element "DialogFlow_01" and variable named "fulfillment_text" referred to non-existent information. An empty string was substituted instead.

10.10.17.94.1648057035780.7.DFText,03/23/2022 10:37:17.327,DialogFlow_01,element,error,error: HOST:127.0.0.1 Error message:UNKNOWN

[david.macias]

Does using DF work at all? Can you post the error log and more of the activity log? Do you see the call hit DF?

david

[Ahmed Adeyemi]

It doesn't work at all. In a traditional sense, I have Nuance (TTS/ASR) in VVB, but looking at DialogFlow, I don't truly see that you add anything inside of VVB. I have honestly also not found any clear instructions for setting up the DialogFlow aspect.

I created my GoogleAccount, created a service account, project, and gave it the DialogAdmin API permission. I also Downloaded the JSON file which is what I used as the service key. The project ID is what I used for the username which is also what I used in the CVP Application.

Error Log

10.10.17.94.1648057035780.7.DFText,03/23/2022 10:37:17.327,A VoiceXML error occurred of type "error": HOST:127.0.0.1 Error message:UNKNOWN
10.10.17.94.1648057035780.7.DFText,03/23/2022 10:37:17.327,An error has occurred.

[Ahmed Adeyemi]

Ok, i got a slight progress but i was wondering if you could share how you did the Speech to Text. Also how did you add the Speech Server and ASR to VVB when using Google AI?

See attached my activity log.