Strange UC560 crashing issue - Page 2

cmonteith · ‎09-28-2011

Hello Group!

I've put in a new UC560 in our office to serve as our phone system as well as a living demo unit for clients. I'm having a very strange issue that I wanted to float out by the group here and see if anyone else is getting the same issues.

Last night I moved our trunks (a combination of FXO B1 lines and SIP from a ITSP) over to the UC560 and twice today the system has completely "frozen". All phones drop off, can't ping the UC560 on either the WAN or any LAN IP addresses. Connecting via Console I get no responce at all.

My only option in these cases has been a power cycle of the unit. When it comes back up, everything starts working agian.

There is no crash file in the flash, and a show ver is telling me Last reload type: Normal Reload.

I'm running the software uc500-advipservicesk9-mz.151-2.T4

99.9% of this was configured via CCA 3.1.1, the only adjustments made at the CLI level have been one translation group edit, and a couple access list adjustments for the ACL attached to the WAN port (Gi0/0)

We've already RMA'd the 560 once due to crash/reloads while it was being tested on the bench. The replacement unit wasn't having any issues or lock ups while sitting on the bench after being configured. It only stated doing this once in production with calls going through it.

One extra note...it apears I can make this also lock up at any time by performing the "backup" operation in CCA. Each time I have attempted this, the system will go unresponcive as I described above.

I can manually tftp off the configuration without an issue...have not attemoted a manual fto backup of the CUE module yet...

-Chad

bill.roland · ‎10-18-2011

No problem David. I'd be very interested to hear if it makes any difference in your issues with parking.

Bill

Cristian Zaharia · ‎08-25-2012

Hi Chad.

What is the version of your system bootstrap? (see show version output).

In case is 15.0(1r)XA, release software (fc1) you have to upgrade to 15.0(1r)XA3 (recommended) - this might not be the latest though.

Cristian

danplacek · ‎08-27-2012

Cristian:

Did you check the date on this thread???

This is all from 2011.

mark · ‎10-25-2012

Hi guys,

Any updates on this. I have two UC560's doing the same thing. One had been in for about a year and the other is brand new. Cisco support also recommended reseting the new one to factory... I just spent 20 hours setting up for the new customer, that's the last thing I want to do. The only thing I notice that they have in common is usining the g0/0 for internet or routing. I have other 560's and they are fine. The other common thing is using SG300 switches. I am honestly about ready to give up and stop selling the UC500 series. Support isnt very good.

paolo bevilacqua · ‎10-26-2012

You should start mentioning exact IOS being used.

Then if not latest, send 'show stacks' to support, or post it here, for a very simple question: "does it match a know bug location, yes or not". The first answer is the much better one as likely a fix is available already-

mark · ‎10-26-2012

Paolo,

I have two UC560's doing the same thing. Cris suggested upgrading the ROMMON on one of them which I will try with TAC, I have had a case on each open for about a week and niether engineer can figure it out and my customers are loosing patience. Here is the answer to you first questions, as you will see they are on different IOS versions. I will post the show stacks in a while

West_UC#show version
Cisco IOS Software, UC500 Software (UC500-ADVIPSERVICESK9-M), Version 15.1(4)M4b
, CIBU Special
Small Business Support: http://www.cisco.com/go/smallbizhelp
Copyright (c) 1986-2012 by Cisco Systems, Inc.
Compiled Fri 18-May-12 15:06 by CIBU

ROM: System Bootstrap, Version 15.0(1r)XA3, RELEASE SOFTWARE (fc1)

and here is the info for the older UC that is doing the same thing.

RGULC#show version
Cisco IOS Software, UC500 Software (UC500-ADVIPSERVICESK9-M), Version 15.1(2)T4, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2011 by Cisco Systems, Inc.
Compiled Tue 12-Jul-11 22:01 by prod_rel_team

ROM: System Bootstrap, Version 15.0(1r)XA, RELEASE SOFTWARE (fc1)

paolo bevilacqua · ‎10-26-2012

I would update the second.to 15.1(4)M4b. Or wait few days to bring them both to 15.1(4)M5.

Then if both still crash again with same "show stacks", you know you have a consistant bug crash, and should not be difficult to have it resolved once given to the correct escalation team.

mark · ‎10-26-2012

Here are the show stacks for both

West_UC#show stacks
Minimum process stacks:
Free/Size   Name
8092/9000   EEM ED RF
11124/12000 MRIB IPv4 Init Process
11128/12000 MRIB IPv6 Init Process
4184/6000   EEM Shell Director
4892/6000   Inspect Init Msg
5116/6000   SPAN Subsystem
58892/60000 script background loader
15288/24000 Init
58604/60000 EEM Auto Registration Proc
4816/6000   DIB error message
5128/6000   SASL MAIN
2104/3000   allegro libretto init
5124/6000   LICENSE AGENT DEFAULT
11128/12000 HTTP SSL PKI CERTIFICATE CREATE PROC
4920/6000   RADIUS INITCONFIG
5168/6000   FLEX DSPRM boot download main
5124/6000   IP SLAs Deferred Schedule Processor
9040/12000 TFTP Server
2124/3000   Rom Random Update Process
13828/24000 HTTP CP
33868/36000 TCP Command
16620/24000 Virtual Exec
21724/24000 TTY Daemon
10664/12000 EzVPN Client Process
17036/24000 Exec

Interrupt level stacks:
Level    Called Unused/Size Name
4    20912497   4924/9000 Host/PCI Bridge Interrupt
5           0   9000/9000 Timebase Reference Interrupt
6       49503   8716/9000 16552 Con/Aux Interrupt
7    20070203   8900/9000 M8300_TIMER_INTERRUPT

Spurious interrupts: 140205

RGULC#show stacks
Minimum process stacks:
Free/Size   Name
8100/9000   EEM ED RF
11136/12000 MRIB IPv4 Init Process
11136/12000 MRIB IPv6 Init Process
4892/6000   Inspect Init Msg
5124/6000   SPAN Subsystem
58900/60000 script background loader
3288/12000 Init
58624/60000 EEM Auto Registration Proc
4816/6000   DIB error message
5132/6000   SASL MAIN
2112/3000   allegro libretto init
5128/6000   LICENSE AGENT DEFAULT
4924/6000   RADIUS INITCONFIG
5664/12000 HTTP SSL PKI CERTIFICATE CREATE PROC
5132/6000   FLEX DSPRM boot download main
9244/12000 TFTP Server
5124/6000   IP SLAs Deferred Schedule Processor
2136/3000   Rom Random Update Process
21100/24000 HTTP CP
9028/12000 SSH Process
33988/36000 TCP Command
Minimum process stacks:
Free/Size   Name
5052/12000 Virtual Exec

Interrupt level stacks:
Level    Called Unused/Size Name
4    25910179   5824/9000 Host/PCI Bridge Interrupt
5           0   9000/9000 Timebase Reference Interrupt
6       33992   8760/9000 16552 Con/Aux Interrupt
7    19470953   8904/9000 M8300_TIMER_INTERRUPT

Spurious interrupts: 81796

paolo bevilacqua · ‎10-26-2012

This output does not show crash, can you checl "show version" or presence of crashfiles.

mark · ‎10-31-2012

I found the problem, I have never seen a router crash because of this but we learn something new everyday. There was a duplex mismatch on G0/0 that was causing the entire system to crash. So if you have a duplex mismatch on a UC560, watch out, the entire system will stop responding.