Troubleshooting ASR error.noresource exceptions

[cdnadmin]

Subject: RE: Troubleshooting ASR error.noresource exceptions
Replied by: Hemal Mehta on 13-07-2011 02:54:54 PM

Hello,
 
I'm struggling with finding root causes of some intermittent error.noresource errors, also, actually gaining value from this exception. Having recently integrated Nuance 8.5 with our environment I've been struggling to decern what the error.noreasource event is telling me each time i see it (I can of course see the problem when i get to the Nuance logs but handling it effectively in call studio is a different story).
 
I see this come back when there is a bad compile on a grammar, bad fetch on grammar, when Nuance is out of licensing, and network issues seem to trigger it as well. Its frustrating that this event seems to be a catch-all for various types of errors encountered between gateway and Nuance ASR. My biggest issue is that we've moved from test into production where I'm now seeing about a .4% rate of error.noresources. I know we're not exceeding ports used on Nuance end, I know the grammars are there and can be fetched properly by ASR, there is nothing unique about certain calls which receive the noresource error, it sparatically appears about .4% of the time regardless of the application that is running.

My real question is, is there a way from our end (cisco side) to see further into this error?  I am using hot events to handle the expception right now but there seems to be no way to know on our end whether it was a network error, licensing issue, bad grammar, missing grammar, etc..  they all throw the same exception. It would be really nice to handle these events disctinctly rather than lump them into the no.resource bucket where I need to drop into a DTMF only application.
 
Thank you,
Ryan

Yes, first step is to enable extended debugging and get more info on the error. Do you enable vxml logs, debugs on gateway logs.  You will see more info on these. Enable these and post what you are seeing.
This document was generated from CDN thread

Created by: Ryam Hilfers on 13-07-2011 02:39:00 PM
Hello,
 
I'm struggling with finding root causes of some intermittent error.noresource errors, also, actually gaining value from this exception. Having recently integrated Nuance 8.5 with our environment I've been struggling to decern what the error.noreasource event is telling me each time i see it (I can of course see the problem when i get to the Nuance logs but handling it effectively in call studio is a different story).
 
I see this come back when there is a bad compile on a grammar, bad fetch on grammar, when Nuance is out of licensing, and network issues seem to trigger it as well. Its frustrating that this event seems to be a catch-all for various types of errors encountered between gateway and Nuance ASR. My biggest issue is that we've moved from test into production where I'm now seeing about a .4% rate of error.noresources. I know we're not exceeding ports used on Nuance end, I know the grammars are there and can be fetched properly by ASR, there is nothing unique about certain calls which receive the noresource error, it sparatically appears about .4% of the time regardless of the application that is running.

My real question is, is there a way from our end (cisco side) to see further into this error?  I am using hot events to handle the expception right now but there seems to be no way to know on our end whether it was a network error, licensing issue, bad grammar, missing grammar, etc..  they all throw the same exception. It would be really nice to handle these events disctinctly rather than lump them into the no.resource bucket where I need to drop into a DTMF only application.
 
Thank you,
Ryan

Subject: Re: New Message from Hemal Mehta in Customer Voice Portal (CVP) - CVP - All
Replied by: Janine Graves on 13-07-2011 04:07:20 PM
I agree with your complaint.
Can someone at Cisco explain why they now return only the one event
'error.noresource' rather than the more information events from the CVP
4 or 7 days (such as, media.resource.failure.asr or tts, etc). It's not
very useful from a debugging perspective.

Do you have access to the MRCP logs on the ASR server?

Janine





On 7/13/2011 12:54 PM, Cisco Developer Community Forums wrote:
> Hemal Mehta has created a new message in the forum "CVP - All Versions":
>
> --------------------------------------------------------------
> Hello,
> Â
> I'm struggling with finding root causes of some intermittent
> error.noresource errors, also, actually gaining value from this
> exception. Having recently integrated Nuance 8.5 with our environment
> I've been struggling to decern what the error.noreasource event is
> telling me each time i see it (I can of course see the problem when i
> get to the Nuance logs but handling it effectively in call studio is a
> different story).
> Â
> I see this come back when there is a bad compile on a grammar, bad
> fetch on grammar, when Nuance is out of licensing, and network issues
> seem to trigger it as well. Its frustrating that this event seems to
> be a catch-all for various types of errors encountered between gateway
> and Nuance ASR. My biggest issue is that we've moved from test into
> production where I'm now seeing about a .4% rate of error.noresources.
> I know we're not exceeding ports used on Nuance end, I know the
> grammars are there and can be fetched properly by ASR, there is
> nothing unique about certain calls which receive the noresource error,
> it sparatically appears about .4% of the time regardless of the
> application that is running.
>
> My real question is, is there a way from our end (cisco side) to see
> further into this error? Â I am using hot events to handle the
> expception right now but there seems to be no way to know on our end
> whether it was a network error, licensing issue, bad grammar, missing
> grammar, etc.. Â they all throw the same exception. It would be really
> nice to handle these events disctinctly rather than lump them into the
> no.resource bucket where I need to drop into a DTMF only application.
> Â
> Thank you,
> Ryan
>
>
> Yes, first step is to enable extended debugging and get more info on
> the error. Do you enable vxml logs, debugs on gateway logs.  You will
> see more info on these. Enable these and post what you are seeing.
> --
> To respond to this post, please click the following link:
>
> <http://developer.cisco.com/web/cvp/forums/-/message_boards/view_message/4219538>
>
> or simply reply to this email.

--
Janine Graves

Subject: RE: Troubleshooting ASR error.noresource exceptions
Replied by: Ryam Hilfers on 19-07-2011 01:58:29 PM
I do have access to those logs..  however they are off the domain and it is a painful process to get them. That has been my only way of troubleshooting this. I guess i'm just expressing my frustration with the error.noresource exception and wondering if anyone on the board has some suggestions to handling it nicely at an application level.  Thanks for the reply Janine,  glad i'm not the only one struggling with this one.

-Ryan

Subject: Re: New Message from Ryam Hilfers in Customer Voice Portal (CVP) - CVP - Al
Replied by: Janine Graves on 19-07-2011 05:40:49 PM
It looks like you can turn on mrcp error logging on the gateway and see
the errors coming back from the ASR server.
I don't know why they convert it into error.noresource, maybe it's a bug
- I also get that for missing audio files in CVP8.
Can you submit a TAC case on it?

Janine


> --------------------------------------------------------------
> I do have access to those logs.. however they are off the domain and
> it is a painful process to get them. That has been my only way of
> troubleshooting this. I guess i'm just expressing my frustration with
> the error.noresource exception and wondering if anyone on the board
> has some suggestions to handling it nicely at an application level.
> Thanks for the reply Janine, glad i'm not the only one struggling with
> this one.
>
> -Ryan
> --
> To respond to this post, please click the following link:
>
> <http://developer.cisco.com/web/cvp/forums/-/message_boards/view_message/4246136>
>
> or simply reply to this email.

--
Janine Graves

Subject: RE: New Message from Janine Graves in Customer Voice Portal (CVP) - CVP - A
Replied by: Hemal Mehta on 19-07-2011 05:46:49 PM
Janine,
      I am getting several basic errors in 8.X.  I have opened TAC cases and Cisco is looking into. Also for missing audio file in 8.5, instead of getting 404 badfetch, I am getting session timeout errors.



A VoiceXML Session timeout occurred at element XXXXX: A session has timed out after 1 minutes. This is most likely caused by a start of call class or action element at the top of the callflow not completing before the voice browser's fetch timeout occurred. To resolve it ensure this class executes in a timely manner or run it in the background. Session timeouts may also occur under high load or if there


Hemal
From: Cisco Developer Community Forums [mailto:cdicuser@developer.cisco.com]
Sent: Tuesday, July 19, 2011 4:41 PM
To: cdicuser@developer.cisco.com
Subject: New Message from Janine Graves in Customer Voice Portal (CVP) - CVP - All Versions: Re: New Message from Ryam Hilfers in Customer Voice Portal (CVP) - CVP - Al

Janine Graves has created a new message in the forum "CVP - All Versions":

--------------------------------------------------------------
It looks like you can turn on mrcp error logging on the gateway and see
the errors coming back from the ASR server.
I don't know why they convert it into error.noresource, maybe it's a bug
- I also get that for missing audio files in CVP8.
Can you submit a TAC case on it?

Janine


> --------------------------------------------------------------
> I do have access to those logs.. however they are off the domain and
> it is a painful process to get them. That has been my only way of
> troubleshooting this. I guess i'm just expressing my frustration with
> the error.noresource exception and wondering if anyone on the board
> has some suggestions to handling it nicely at an application level.
> Thanks for the reply Janine, glad i'm not the only one struggling with
> this one.
>
> -Ryan
> --
> To respond to this post, please click the following link:
>
> <http://developer.cisco.com/web/cvp/forums/-/message_boards/view_message/4246136>
>
> or simply reply to this email.

--
Janine Graves
--
To respond to this post, please click the following link:

<http://developer.cisco.com/web/cvp/forums/-/message_boards/view_message/4248691>

or simply reply to this email.

Subject: Re: New Message from Hemal Mehta in Customer Voice Portal (CVP) - CVP - All
Replied by: Janine Graves on 19-07-2011 06:02:49 PM
Let me know when there's a fix or a patch. thanks Hemal.


On 7/19/2011 5:46 PM, Cisco Developer Community Forums wrote:
> Hemal Mehta has created a new message in the forum "CVP - All Versions":
>
> --------------------------------------------------------------
> Janine,
> I am getting several basic errors in 8.X. I have opened TAC cases and
> Cisco is looking into. Also for missing audio file in 8.5, instead of
> getting 404 badfetch, I am getting session timeout errors.
>
>
>
> A VoiceXML Session timeout occurred at element XXXXX: A session has
> timed out after 1 minutes. This is most likely caused by a start of
> call class or action element at the top of the callflow not completing
> before the voice browser's fetch timeout occurred. To resolve it
> ensure this class executes in a timely manner or run it in the
> background. Session timeouts may also occur under high load or if there
>
>
> Hemal
> From: Cisco Developer Community Forums
> [mailto:cdicuser@developer.cisco.com]
> Sent: Tuesday, July 19, 2011 4:41 PM
> To: cdicuser@developer.cisco.com
> Subject: New Message from Janine Graves in Customer Voice Portal (CVP)
> - CVP - All Versions: Re: New Message from Ryam Hilfers in Customer
> Voice Portal (CVP) - CVP - Al
>
> Janine Graves has created a new message in the forum "CVP - All Versions":
>
> --------------------------------------------------------------
> It looks like you can turn on mrcp error logging on the gateway and see
> the errors coming back from the ASR server.
> I don't know why they convert it into error.noresource, maybe it's a bug
> - I also get that for missing audio files in CVP8.
> Can you submit a TAC case on it?
>
> Janine
>
>
> > --------------------------------------------------------------
> > I do have access to those logs.. however they are off the domain and
> > it is a painful process to get them. That has been my only way of
> > troubleshooting this. I guess i'm just expressing my frustration with
> > the error.noresource exception and wondering if anyone on the board
> > has some suggestions to handling it nicely at an application level.
> > Thanks for the reply Janine, glad i'm not the only one struggling with
> > this one.
> >
> > -Ryan
> > --
> > To respond to this post, please click the following link:
> >
> >
> <http://developer.cisco.com/web/cvp/forums/-/message_boards/view_message/4246136>
> >
> > or simply reply to this email.
>
> --
> Janine Graves
> --
> To respond to this post, please click the following link:
>
> <http://developer.cisco.com/web/cvp/forums/-/message_boards/view_message/4248691>
>
> or simply reply to this email.
> --
> To respond to this post, please click the following link:
>
> <http://developer.cisco.com/web/cvp/forums/-/message_boards/view_message/4248705>
>
> or simply reply to this email.

--
Janine Graves

Subject: RE: Troubleshooting ASR error.noresource exceptions
Replied by: Hemal Mehta on 19-07-2011 10:05:56 PM
Sure, will do so Janine.

Hemal

Subject: RE: Re: New Message from Ryam Hilfers in Customer Voice Portal (CVP) - CVP
Replied by: Ryam Hilfers on 14-09-2011 01:25:30 PM
Janine/Hemal, I currently have a TAC case open and upon referencing CSCto77602 (which is only kind-of related) I have been informed by my engineer that:
 

The essence of the defect seems to be that if the ASR doesn't have
available resources to handle the call (or I guess if it encounters a
failure in general), it throws an event, which should be correlated back
to the calling VXML application as
'error.com.cisco.media.resource.unavailable.asr', which can be handled
using the default catch statements to close the VXML application
gracefully and to pass the call back to ICM for further treatment. It
seems that somewhere around IOS 12.4(24)T05, that stopped happening
causing an abrupt ending of the call..    
 
Later the engineer said:
"Yeah I've done some more reading since and I have the distinct
impression that any error from the Nuance end is mapped to
error.noresource, rather than proper VXML events as they were before. I suspect this needs to be
re-evaluated in IOS code as obviously you can't do proper handling like
this."
 
I have moved the case to the IOS team and am further troubleshooting...  

Thought it was kind of interesting...  hopefully some proper error handling will be the result of this. 
 

It looks like you can turn on mrcp error logging on the gateway and see
the errors coming back from the ASR server.
I don't know why they convert it into error.noresource, maybe it's a bug
- I also get that for missing audio files in CVP8.
Can you submit a TAC case on it?

Janine

> --------------------------------------------------------------
> I do have access to those logs.. however they are off the domain and
> it is a painful process to get them. That has been my only way of
> troubleshooting this. I guess i'm just expressing my frustration with
> the error.noresource exception and wondering if anyone on the board
> has some suggestions to handling it nicely at an application level.
> Thanks for the reply Janine, glad i'm not the only one struggling with
> this one.
>
> -Ryan
> --
> To respond to this post, please click the following link:
>
> <http://developer.cisco.com/web/cvp/forums/-/message_boards/view_message/4246136>
>
> or simply reply to this email.

--
Janine Graves

Subject: RE: Re: New Message from Ryam Hilfers in Customer Voice Portal (CVP) - CVP
Replied by: Kishore Pardasani on 19-10-2011 04:29:33 PM
Has anyone had any progress on this issue?

Subject: RE: Re: New Message from Ryam Hilfers in Customer Voice Portal (CVP) - CVP
Replied by: Heidi Tran on 19-10-2011 04:30:59 PM
Ryan,
Were you able to get more information from the IOS team on this.  We are running into a similar issue where we would like to have the 'error.com.cisco.media.resource.unavailable.asr' event rather than the 'error.noresource' being returned.
 
Thanks,
 

Janine/Hemal, I currently have a TAC case open and upon referencing CSCto77602 (which is only kind-of related) I have been informed by my engineer that:
 

The essence of the defect seems to be that if the ASR doesn't have
available resources to handle the call (or I guess if it encounters a
failure in general), it throws an event, which should be correlated back
to the calling VXML application as
'error.com.cisco.media.resource.unavailable.asr', which can be handled
using the default catch statements to close the VXML application
gracefully and to pass the call back to ICM for further treatment. It
seems that somewhere around IOS 12.4(24)T05, that stopped happening
causing an abrupt ending of the call..    
 
Later the engineer said:
"Yeah I've done some more reading since and I have the distinct
impression that any error from the Nuance end is mapped to
error.noresource, rather than proper VXML events as they were before. I suspect this needs to be
re-evaluated in IOS code as obviously you can't do proper handling like
this."
 
I have moved the case to the IOS team and am further troubleshooting...  

Thought it was kind of interesting...  hopefully some proper error handling will be the result of this. 
 



It looks like you can turn on mrcp error logging on the gateway and see
the errors coming back from the ASR server.
I don't know why they convert it into error.noresource, maybe it's a bug
- I also get that for missing audio files in CVP8.
Can you submit a TAC case on it?

Janine




> --------------------------------------------------------------
> I do have access to those logs.. however they are off the domain and
> it is a painful process to get them. That has been my only way of
> troubleshooting this. I guess i'm just expressing my frustration with
> the error.noresource exception and wondering if anyone on the board
> has some suggestions to handling it nicely at an application level.
> Thanks for the reply Janine, glad i'm not the only one struggling with
> this one.
>
> -Ryan
> --
> To respond to this post, please click the following link:
>
> <http://developer.cisco.com/web/cvp/forums/-/message_boards/view_message/4246136>
>
> or simply reply to this email.

--
Janine Graves

Subject: RE: Re: New Message from Ryam Hilfers in Customer Voice Portal (CVP) - CVP
Replied by: Ryam Hilfers on 19-10-2011 04:57:08 PM
Hey Heidi,

What I got from TAC was that any 15.1T release has a known bug "CSCto77602".  This bug causes most events to come back as error.noresource. Even causes a disconnect in some situations such as ASR throwing SPEECH_TOO_EARLY. I can reproduce this by yelling into the phone as the menu application starts, sure enough there is an MRCP SPEECH_TOO_EARLY event sent and the gateway disconnects the call and I see a session timeout in the VXML server logs.

The solution given was to upgrade to 15.1(4)M2.  Still working through the hoops to get that happening in my environment, so I cannot comment if this resolved the issues or not....

Please keep us updated if you find a resolution, I fear that the upgrade is only going to solve the unhandled events and still leave us with error.noresource coming back for every exception. I even get this instead of a badfetch for missing wav files now :/

-Ryan

Subject: RE: Re: New Message from Ryam Hilfers in Customer Voice Portal (CVP) - CVP
Replied by: Heidi Tran on 20-10-2011 08:31:05 AM
Thanks Ryan for the update.  We will let you know as well if we find a resolution.
 

Hey Heidi,

What I got from TAC was that any 15.1T release has a known bug "CSCto77602".  This bug causes most events to come back as error.noresource. Even causes a disconnect in some situations such as ASR throwing SPEECH_TOO_EARLY. I can reproduce this by yelling into the phone as the menu application starts, sure enough there is an MRCP SPEECH_TOO_EARLY event sent and the gateway disconnects the call and I see a session timeout in the VXML server logs.

The solution given was to upgrade to 15.1(4)M2.  Still working through the hoops to get that happening in my environment, so I cannot comment if this resolved the issues or not....

Please keep us updated if you find a resolution, I fear that the upgrade is only going to solve the unhandled events and still leave us with error.noresource coming back for every exception. I even get this instead of a badfetch for missing wav files now :/

-Ryan

Subject: RE: Re: New Message from Ryam Hilfers in Customer Voice Portal (CVP) - CVP
Replied by: Michael Aossey on 22-01-2012 07:43:37 PM

Thanks Ryan for the update.  We will let you know as well if we find a resolution.


Hey Heidi,

What I got from TAC was that any 15.1T release has a known bug "CSCto77602".  This bug causes most events to come back as error.noresource. Even causes a disconnect in some situations such as ASR throwing SPEECH_TOO_EARLY. I can reproduce this by yelling into the phone as the menu application starts, sure enough there is an MRCP SPEECH_TOO_EARLY event sent and the gateway disconnects the call and I see a session timeout in the VXML server logs.

The solution given was to upgrade to 15.1(4)M2.  Still working through the hoops to get that happening in my environment, so I cannot comment if this resolved the issues or not....

Please keep us updated if you find a resolution, I fear that the upgrade is only going to solve the unhandled events and still leave us with error.noresource coming back for every exception. I even get this instead of a badfetch for missing wav files now :/

-Ryan

 
Was anyone able to find a solution to this issue?  We have upgraded the GW to 15.1(4)M2 and still get the same result.  This is using external grammars in a form that was working fine with CVP 4.1 and is now failing after the server was upgraded to 8.5(1).  Any help would be appreciated.
 
Thanks, Mike

Subject: RE: Troubleshooting ASR error.noresource exceptions
Replied by: Janine Graves on 12-04-2012 09:34:17 PM
Does anyone know if Cisco has fixed the IOS code so that Nuance ASR errors are not reported as 'error.noresource'?
It's been a long time since this issue began and I'd hope it's been addressed by now.
Thanks, Janine

Subject: RE: Troubleshooting ASR error.noresource exceptions
Replied by: Ryan Hilfers on 13-04-2012 01:40:30 PM

Does anyone know if Cisco has fixed the IOS code so that Nuance ASR errors are not reported as 'error.noresource'?
It's been a long time since this issue began and I'd hope it's been addressed by now.
Thanks, Janine

Hi Janine,
I currently still experience the same error.noresource events for all Nuance related issues.. even badfetches for audio files (sometimes it seems:/). On my current project the customer is still not in a position to upgrade an IOS and our lab is down so I have not pursued this further, however it is definitely still frustrating and would be very intersted if anyone else has made headway.
Thanks,
Ryan

Subject: RE: Troubleshooting ASR error.noresource exceptions
Replied by: Vladimir Lozano Martinez on 11-05-2012 12:58:58 PM
I was experiencing this same error, and I solve this by upgrading the IOS and reviewing that all file fotmat has been saved as UTF-8 (not as ANSI)

[mirzamohaseen]

Did anyone got the solution ?