ISE Database failure

Frank Lothar Weber · ‎02-07-2013

Hi, all.

Anyone ever had this error on ISE :

ISE application is responding veeeery slowly, a "show app stat ise" doesn't complete at all ...

I have no idea what to do ...

Rgs

Frank

nspasov · ‎02-08-2013

Are you by any chance running ISE 1.1 ?

Frank Lothar Weber · ‎02-09-2013

No, this is the version ISE is running on :

sh ver

Cisco Application Deployment Engine OS Release: 2.0

ADE-OS Build Version: 2.0.4.018

ADE-OS System Architecture: i386

Hostname: deess01nise01

Version information of installed applications

---------------------------------------------

Cisco Identity Services Engine

---------------------------------------------

Version : 1.1.2.145

Build Date : Fri Oct 26 21:10:35 2012

Install Date : Thu Nov 8 17:56:09 2012

Cisco Identity Services Engine Patch

---------------------------------------------

Version : 2

Install Date : Sun Dec 16 18:22:32 2012

Tarik Admani · ‎02-09-2013

Is this running on virtual machine or appliance? If vm what are the specs of your vm. Also are you using thin provisioning, how many cpu cores and memory is the instance running? Is this a distributed setup?

Sent from Cisco Technical Support Android App

Frank Lothar Weber · ‎02-10-2013

Hi,

no, this is not a VM, it is the big appliance:

deess01nise01/xia0wf# sh inventory

NAME: "ISE-3395-K9        chassis", DESCR: "ISE-3395-K9        chassis"
PID: ISE-3395-K9       , VID: V01 , SN: Kxxxxxxxx
Total RAM Memory: 3997824 kB
CPU Core Count: 8
CPU 0: Model Info: Intel(R) Xeon(R) CPU           E5504 @ 2.00GHz
CPU 1: Model Info: Intel(R) Xeon(R) CPU           E5504 @ 2.00GHz
CPU 2: Model Info: Intel(R) Xeon(R) CPU           E5504 @ 2.00GHz
CPU 3: Model Info: Intel(R) Xeon(R) CPU           E5504 @ 2.00GHz
CPU 4: Model Info: Intel(R) Xeon(R) CPU           E5504 @ 2.00GHz
CPU 5: Model Info: Intel(R) Xeon(R) CPU           E5504 @ 2.00GHz
CPU 6: Model Info: Intel(R) Xeon(R) CPU           E5504 @ 2.00GHz
CPU 7: Model Info: Intel(R) Xeon(R) CPU           E5504 @ 2.00GHz
Hard Disk Count(*): 1
Disk 0: Device Name: /dev/sda
Disk 0: Capacity: 597.90 GB
Disk 0: Geometry: 255 heads 63 sectors/track 72702 cylinders
NIC Count: 4
NIC 0: Device Name: eth0
NIC 0: HW Address: 5C:F3:FC:E6:F0:B4
NIC 0: Driver Descr: Broadcom NetXtreme II BCM5706/5708/5709/5716 Driver
NIC 1: Device Name: eth1
NIC 1: HW Address: 5C:F3:FC:E6:F0:B6
NIC 1: Driver Descr: Broadcom NetXtreme II BCM5706/5708/5709/5716 Driver
NIC 2: Device Name: eth2
NIC 2: HW Address: 5C:F3:FC:6A:D1:D0
NIC 2: Driver Descr: Broadcom NetXtreme II BCM5706/5708/5709/5716 Driver
NIC 3: Device Name: eth3
NIC 3: HW Address: 5C:F3:FC:6A:D1:D2
NIC 3: Driver Descr: Broadcom NetXtreme II BCM5706/5708/5709/5716 Driver

(*) Hard Disk Count may be Logical.

It is also running as a single instance setup, not as a distributed setup.

If the box and features turn out to work fine, additional boxes and vms will be added to the setup.

The services activtated on the machine are "profiling" (via dhcp, snmp and device-sensors from a few access switches) and radius authentication (from one wireless controller 5508).

The box also fires a lot of these alarms:

90 minutes later, this alarm seems to be cleared:

Rgs

Frank

nspasov · ‎02-10-2013

Hmm that is strange. There were a lot of DB related issues with 1.1 and that is why I was wondering if you were running that version.

With regards to the second screen shot: How many endpoints do you have authenticating to this node?

Lastly, when this error occurs can you check the output of "show disks" and post it here.

Frank Lothar Weber · ‎02-11-2013

Hi,

the box is getting quite a lot of authentications (up to 32000 a day), but this should not be a problem for a 3395, should it ???

The disks seem to be fine at this moment also:

sh disks

disk repository: 5% used (618744 of 14877092)

Internal filesystems:

/ : 71% used ( 360053204 of 540283556)

/tmp : 3% used ( 41788 of 1976268)

/storedconfig : 7% used ( 5695 of 93327)

/boot : 9% used ( 40491 of 489992)

/dev/shm : 0% used ( 0 of 1998912)

all internal filesystems have sufficient free space

The "database failure" alam is not fired at the same time, I cannot predict the time when it is going to be fired.

Rgs

Frank

Tarik Admani · ‎02-11-2013

Frank,

Are you running any other services on this box like posturing? There has been a few issues related to the purging operations on ISE and you may need to open a tac request in order to see if you are experiencing the same issues.

Thanks,

Tarik Admani
*Please rate helpful posts*