ACS 5.5 Monitoring and Report Viewer not working

[petebardak1]

Hi, 

ACS and AAA is working fine, but whenever I try to launch the Monitoring and Report Viewer on ACS v5.5 I get the a message saying "The monitoring and reports database is currently unavailable. Attempting to reconnect in 5 seconds. If problem persists, please contact your ACS administrator."

I tried stopping/starting ACS via CLI and reloading the whole box but it still comes up as unavailable.  Below is the current status.  Some processes are not running, does anyone know how to start these processes? I recently had to reinstall this appliance and restore from backup.  This is how it's been ever since.  Is there something else I should be addressing to resolve my issue?

pru-acs01/admin# show application status acs

ACS role: PRIMARY

Process 'database' running
Process 'management' running
Process 'runtime' running
Process 'ntpd' running
Process 'view-database' not monitored
Process 'view-jobmanager' not monitored
Process 'view-alertmanager' not monitored
Process 'view-collector' not monitored
Process 'view-logprocessor' not monitored

[karans]

hi,

Please share output of below command on CLI:

#show disks

It seems the restore you performed had corrupted the view-database or it had corrupted database. We might have to do a fresh install for view database.

Thanks

[petebardak1]

Thanks for responding.  Here you go.  

pru-acs01/admin# show disks

disk repository: 1% used (184272 of 64466716)

Internal filesystems:
/ : 6% used ( 379992 of 7935392)
/altroot : 2% used ( 17652 of 983960)
/recovery : 2% used ( 17652 of 983960)
/opt : 58% used ( 193693196 of 357093884)
/storedconfig : 2% used ( 17772 of 988116)
/home : 2% used ( 17740 of 983960)
/tmp : 2% used ( 149712 of 7935392)
/var : 3% used ( 228580 of 9903432)
/usr : 12% used ( 857624 of 7935392)
/storeddata : 30% used ( 1401424 of 4951688)
/boot : 37% used ( 34594 of 101086)
/dev/shm : 0% used ( 0 of 2008576)
all internal filesystems have sufficient free space

pru-acs01/admin#

[karans]

Hi,

View database is showing very high as /opt shows 58%. As per recommendation it should not be exceeding 40% and ideally as low as possible.

You need to clear the view database logs and you can follow below steps for it:

acs/acsadmin# acs-config

Escape character is CNTL/D.

Username: xxxx ( GUI ADMIN USERNAME)

Password: xxxx ( GUI ADMIN PASSWORD)

acs/acsadmin(config-acs)#acsview replace-cleandb

Running this will clear all the view logs (authentication logs) from the disk.

Thanks

[petebardak1]

So I seem to be getting an message when logging into CLI throuh SSH or Console. Nobody else is logged in but me..... 

pru-acs01/admin# acs-config
sh: /opt/CSCOacs/mgmt/cli/acs-config-log: Read-only file system

Your ACS config session has failed.
It is possible that you have exceeded
the maximum number of allowed ACS config CLI sessions.
Close any open sessions and try again.

pru-acs01/admin# show login cli
admin ttyS0 Fri Sep 16 20:17 still logged in
admin pts/1 Fri Sep 16 20:14 - 20:16 (00:02) :pts/0:S.0
admin pts/0 Fri Sep 16 20:14 - 20:16 (00:02) opchcl0140.comp.opti
ver.com
admin pts/1 Fri Sep 16 20:05 - 20:13 (00:08) :pts/0:S.0
admin pts/0 Fri Sep 16 20:05 - 20:13 (00:08) opchcl0140.comp.opti
ver.com
admin pts/1 Fri Sep 16 18:37 - 19:07 (00:30) :pts/0:S.0
admin pts/0 Fri Sep 16 18:37 - 19:07 (00:30) opchcl0140.comp.opti
ver.com
admin pts/1 Thu Sep 15 14:21 - 15:29 (01:08) :pts/0:S.0
admin pts/0 Thu Sep 15 14:21 - 15:29 (01:08) opchcl0140.comp.opti
ver.com
admin pts/1 Wed Sep 14 01:25 - 01:55 (00:30) :pts/0:S.0

wtmp begins Thu Sep 1 00:20:54 2016

[Gagandeep Singh]

Try reloading the ACS or restart of services.

Let us know if it works or not

Regards

Gagan

PS: rate it as correct if helps!!!!

[petebardak1]

Ok, I need to schedule downtime then.  I'll let you know.  Thanks!

[Gagandeep Singh]

okay!!!!

Keep this thread running.

Rate as correct if it works!!!!

Regards

Gagan

[petebardak1]

Hard reboot didn't fix the problem.  It's still giving me the following message

Your ACS config session has failed.
It is possible that you have exceeded
the maximum number of allowed ACS config CLI sessions.
Close any open sessions and try again

At this point, I can't even try any of your suggestions :(

[Gagandeep Singh]

We had issue 

CSCtw84073    Unable to enter acs-config

https://bst.cloudapps.cisco.com/bugsearch/bug/CSCtw84073/?reffering_site=dumpcr

Ideally it should not there on ACS 5.5

If still it is behaving like this. Potentially need to reimage server.

Regards

Gagan

PS: rate if it helps!!!

[petebardak1]

Because I can't get into acs-config, I can't enable migration also.  Not sure I'll be rebuilding ACS again, our install isn't that big.  

We bought Cisco ISE so I think I'll just set that up from scratch and decom that ACS server.  

Thanks Gagan for offering help.  Maybe this tread will help someone else in the future.    

[Gagandeep Singh]

Hi,

Please rate as correct if it helps!!!

Regards

Gagan

[vthaluru]

Hi Petebardak1,

No need to go to the acs-config mode to enable migration and you can use following command (acs config-web-interface migration).

Thanks

VenkataKrishna

[petebardak1]

I think my ACS server is too far gone . . . getting the following error

pru-acs01/admin# acs config-web-interface migration enable
Failed to modify webapp state

Thanks anyway for offering some suggestions.  

[Jatin Katyal]

Looks like this is coming in your way - Reboot should fix the problem for you.

CSCuv10632    Cisco ACS reporting "Failed to modify webapp state"

~ Jatin