ACE 4710 not responding

ranjith.kanisan · ‎06-12-2013

Hi,

We have to ACE 4710 device in our network and we have facing device hung issue in our Primary ACE. We are not able to get management access or direct console access to the device when the issue is happened and also we are not able to reach the vlan interface IP or/VIP. Please find the below output we got through monitor that we are connected to the ACE.

Booting localboot(c4710ace-t1k9-mz.A5_1_2.bin)

kernel=(hd0,1)/c4710ace-t1k9-mz.A5_1_2.bin ro root=LABEL=/ auto console=ttyS0,9

600n8 quiet bigphysarea=32768

[Linux-bzImage,setup=0x1400,size=0xe75a16c]

Uncompressing linux Ok, booting the kernal.

Issue is resolved after we manually rebooted the ACE. We have collected the sh tech after the reboot.

Software version : A5 1.2

Kindly suggest what may cause this issue.

Thanks in Adavance.

Regards,

Ranjith

Cesar Roque · ‎06-12-2013

Hi Ranjith,

it could be a problem with the flash drive of the ACE. Please gather a console output when the ACE is booting.

Just connect the console cable like you do to any Switch or Router and get the output from there.

---------------------
Cesar R
ANS Team

--------------------- Cesar R ANS Team

ranjith.kanisan · ‎06-13-2013

Hi,

We have collected the console logs while we done the reboot. Please find the below output.

------------------------------------------------ Boot log -----------------------------------------------------------------------------

ÐS ÀS AMIBIOS(C)2005 American Megatrends, Inc. BIOS Date: 08/25/09 09:37:25 Ver: 08.00.11 CPU : Intel(R) Pentium(R) 4 CPU 3.40GHz Speed : 3.40 GHz Broadcom NetXtreme Ethernet Boot Agent v8.1.53 Copyright (C) 2000-2005 Broadcom Corporation All rights reserved. Press Ctrl-S to Enter Configuration Menu ... Broadcom NetXtreme Ethernet Boot Agent v8.1.53 AMIBIOS(C)2005 American Megatrends, Inc. BIOS Date: 08/25/09 09:37:25 Ver: 08.00.11 CPU : Intel(R) Pentium(R) 4 CPU 3.40GHz Speed : 3.40 GHz Press F2 to run Setup Press F12 for BBS POPUP DDR2 Frequency:667 MHz, ECC Support in Dual-Channel Interleaved Mode Initializing USB Controllers .. Done. 6144MB OK USB Device(s): 1 Keyboard Auto-Detecting Pri Slave...IDE Hard Disk Pri Slave : 1GB CompactFlash Card CF B612J GRUB Loading stage2........ GNU GRUB version 0.95.1 (639K lower / 3144640K upper memory) *************************************************************************** * localboot(ACE_APPLIANCE_RECOVERY_IMAGE.bin) * * localboot(c4710ace-t1k9-mz.A5_1_2.bin) * * localboot(c4710ace-t1k9-mz.A4_2_0.bin) * * * * * * * * * * * * * * * * * * * *************************************************************************** Use the * and * keys to select which entry is highlighted. Press enter to boot the selected OS, 'e' to edit the commands before booting, or 'c' for a command-line. The highlighted entry will be booted automatically in 1 seconds. kernel=(hd0,1)/c4710ace-t1k9-mz.A5_1_2.bin ro root=LABEL=/ auto console=ttyS0,9 600n8 quiet bigphysarea=32768 [Linux-bzImage, setup=0x1400, size=0xe75a16c] INIT: version 2.85 booting

b4 lspci

1 Cavium device(s) found.

Bringing up NP 0

Downloading U-Boot to NP card 0

Downloading DP image to NP card 0

Starting DP image on NP card on all cores

DP image started on NP card

Setting up dynamic memory size

Initializing Shared Memory

INIT: Entering runlevel: 3

Testing PCI path for Octeon(0)....

This may take some time, Please wait ....

PCI test loop , count 0

PCI path is ready

Starting services...

Waiting for 3 seconds to enter setup mode...

Certificate & key are up to date

.

Installing MySQL

groupadd: group nobody exists

useradd: user nobody exists

MySQL Installed

Installing JRE

JRE Installed

Starting sysmgr processes.. Please wait...Done!!!

IDC4-INTR-ACE-01 login: admin

Password:

Cisco Application Control Software (ACSW)

TAC support: http://www.cisco.com/tac

The copyrights to certain works contained herein are owned by

other third parties and are used and distributed under license.

Some parts of this software are covered under the GNU Public

License. A copy of the license is available at

http://www.gnu.org/licenses/gpl.html.

----------------------------------------------------------------------------------------------------------------------------------------------------------------------

We have not found any error related to flash while booting ACE.

Regards,

Ranjith

Jorge Bejarano · ‎06-15-2013

Ranjith,

Can you upload a #show version and # dir core: ?

Jorge

ranjith.kanisan · ‎06-17-2013

Hi,

Please find the below output.

IDC4-INTR-ACE-01/Admin# dir core:

2457 Dec 19 13:06:12 2012 SYSTEM_STATS

            Usage for core: filesystem
                     1071104 bytes total used
                   202025984 bytes free
                   203097088 bytes total

IDC4-INTR-ACE-01/Admin# sh version

Cisco Application Control Software (ACSW)

TAC support: http://www.cisco.com/tac

The copyrights to certain works contained herein are owned by

other third parties and are used and distributed under license.

Some parts of this software are covered under the GNU Public

License. A copy of the license is available at

http://www.gnu.org/licenses/gpl.html.

Software

loader: Version 0.95.1

system: Version A5(1.2) [build 3.0(0)A5(1.2) adbuild_19:38:58-2012/01/17_/a

uto/adbure_nightly4/renumber/rel_a5_1_2_throttle/REL_3_0_0_A5_1_2]

system image file: (hd0,1)/c4710ace-t1k9-mz.A5_1_2.bin

Device Manager version 5.1 (0) 20111215:1009

installed license: no feature license is installed

Hardware

cpu info:

Motherboard:

number of cpu(s): 2

Daughtercard:

number of cpu(s): 16

memory info:

total: 6225528 kB, free: 4343804 kB

shared: 0 kB, buffers: 12936 kB, cached 0 kB

cf info:

filesystem: /dev/hdb2

total: 861668 kB, used: 787528 kB, available: 30368 kB

last boot reason: Unknown

configuration register: 0x1

IDC4-INTR-ACE-01 kernel uptime is 0 days 0 hour 2 minute(s) 21 second(s)

Regards,

Ranjith

Jorge Bejarano · ‎06-17-2013

Ranjith,

After the reboot, ACE did not generate any core dump and does not anything under last boot reason.

I would recommend to monitor the behavior and if the issue re-occurs, open a TAC case right away and console to try to get some outputs and take a look of the messages when the situation happens.

Hope this helps!

Jorge