cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
3949
Views
0
Helpful
5
Replies

Cisco ACS 5.3 receiving alarms for View-collector down

sridharan26
Level 1
Level 1

Below are the logs captured from MonitoringAndReportingCollector.log  file for the issue (No update received since ... View-collector process may be down)

Sep 20 2013 14:36:51 com.cisco.nm.acs.view.collector.Main$LicenseAndSyncTimerTask.run(Main.java:148) FATAL Main timer Acs.MGMT.ACSVIEW Cannot open connection

org.hibernate.exception.GenericJDBCException: Cannot open connection

        at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:91)

        at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:79)

        at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43)

        at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:29)

        at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:318)

        at org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:109)

        at org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement(AbstractBatcher.java:105)

        at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:1561)

        at org.hibernate.loader.Loader.doQuery(Loader.java:661)

        at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:224)

        at org.hibernate.loader.Loader.doList(Loader.java:2150)

        at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2029)

        at org.hibernate.loader.Loader.list(Loader.java:2024)

        at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:369)

        at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:300)

        at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:146)

        at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1093)

        at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)

        at com.cisco.nm.acs.mgmt.db.Db.hql(Db.java:785)

        at com.cisco.nm.acs.mgmt.db.Db.query(Db.java:748)

        at com.cisco.nm.acs.mgmt.db.Db.getAll(Db.java:503)

        at com.cisco.nm.acs.view.collector.AcsServer.sync(AcsServer.java:25)

        at com.cisco.nm.acs.view.collector.Main$LicenseAndSyncTimerTask.run(Main.java:145)

        at java.util.TimerThread.mainLoop(Unknown Source)

        at java.util.TimerThread.run(Unknown Source)

Caused by: java.sql.SQLException: Connections could not be acquired from the underlying database!

        at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:106)

        at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:529)

        at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128)

        at org.hibernate.connection.C3P0ConnectionProvider.getConnection(C3P0ConnectionProvider.java:35)

        at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:315)

        ... 20 more

Caused by: com.mchange.v2.resourcepool.CannotAcquireResourceException: A ResourcePool could not acquire a resource from its primary factory or source.

        at com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1319)

        at com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:557)

        at com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:477)

        at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:525)

        ... 23 more

Sep 20 2013 14:37:41 com.cisco.nm.acs.view.dbms.impl.ACS5ManagerDAOImpl.getSecurityGroups(ACS5ManagerDAOImpl.java:1184) ERROR Main timer Acs.MGMT.ACSVIEW Cannot open co

nnection to ACS 5 DBorg.hibernate.exception.GenericJDBCException: Cannot open connection

        at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:91)

        at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:79)

        at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43)

        at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:29)

        at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:318)

        at org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:109)

        at org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement(AbstractBatcher.java:105)

        at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:1561)

        at org.hibernate.loader.Loader.doQuery(Loader.java:661)

        at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:224)

        at org.hibernate.loader.Loader.doList(Loader.java:2150)

        at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2029)

        at org.hibernate.loader.Loader.list(Loader.java:2024)

        at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:369)

        at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:300)

        at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:146)

        at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1093)

        at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)

        at com.cisco.nm.acs.mgmt.db.Db.hql(Db.java:785)

        at com.cisco.nm.acs.mgmt.db.Db.query(Db.java:748)

        at com.cisco.nm.acs.mgmt.db.Db.getAll(Db.java:503)

        at com.cisco.nm.acs.view.dbms.impl.ACS5ManagerDAOImpl.getSecurityGroups(ACS5ManagerDAOImpl.java:1167)

        at com.cisco.nm.acs.view.collector.syslog.SecurityGroups.sync(SecurityGroups.java:32)

        at com.cisco.nm.acs.view.collector.Main$LicenseAndSyncTimerTask.run(Main.java:144)

        at java.util.TimerThread.mainLoop(Unknown Source)

        at java.util.TimerThread.run(Unknown Source)

Caused by: java.sql.SQLException: An attempt by a client to checkout a Connection has timed out.

        at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:106)

        at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:65)

        at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:527)

        at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128)

        at org.hibernate.connection.C3P0ConnectionProvider.getConnection(C3P0ConnectionProvider.java:35)

        at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:315)

        ... 21 more

Caused by: com.mchange.v2.resourcepool.TimeoutException: A client timed out while waiting to acquire a resource from com.mchange.v2.resourcepool.BasicResourcePool@dea76

8 -- timeout at awaitAvailable()

        at com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1317)

        at com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:557)

        at com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:477)

        at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:525)

        ... 24 more

We had checked and foud view-collector is running. can somebody help with a solution?

5 Replies 5

Jatin Katyal
Cisco Employee
Cisco Employee

What ACS patch are you running on?

Looking at the above error I think we see this message when the log processor was not able to store the process status messages in the database, hence this alert is generated.

I've seen these kind of issues getting fixed with REBOOT.

However, if you wish to troubleshoot then please set the logs at debug level for mgmt-acsview and generate the support bundle again.

~BR
Jatin Katyal

**Do rate helpful posts**

~Jatin

Hi Sridharan,

Do you think you can schedule sometime to reload ACS or need help in generating the mgmt-acsview logs for further troubleshooting. let me know.

~BR
Jatin Katyal

**Do rate helpful posts**

~Jatin

version 5.3.0-40

need to check with my customer about. however, a documentation from cisco would be better to go ahead with.

This is a part of troubleshooting process. Unfortubately, I don't have any document to support what we're doing. If you wish, you can open a TAC case.

~BR
Jatin Katyal

**Do rate helpful posts**

~Jatin

Need help in generating the mgmt-acsview logs for further troubleshooting. do these logs can give some clue for resolution?

Regards,

Guarav

Review Cisco Networking for a $25 gift card