09-26-2013 06:03 AM - edited 02-21-2020 04:59 AM
Below are the logs captured from MonitoringAndReportingCollector.log file for the issue (No update received since ... View-collector process may be down)
Sep 20 2013 14:36:51 com.cisco.nm.acs.view.collector.Main$LicenseAndSyncTimerTask.run(Main.java:148) FATAL Main timer Acs.MGMT.ACSVIEW Cannot open connection
org.hibernate.exception.GenericJDBCException: Cannot open connection
at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:91)
at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:79)
at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43)
at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:29)
at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:318)
at org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:109)
at org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement(AbstractBatcher.java:105)
at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:1561)
at org.hibernate.loader.Loader.doQuery(Loader.java:661)
at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:224)
at org.hibernate.loader.Loader.doList(Loader.java:2150)
at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2029)
at org.hibernate.loader.Loader.list(Loader.java:2024)
at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:369)
at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:300)
at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:146)
at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1093)
at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)
at com.cisco.nm.acs.mgmt.db.Db.hql(Db.java:785)
at com.cisco.nm.acs.mgmt.db.Db.query(Db.java:748)
at com.cisco.nm.acs.mgmt.db.Db.getAll(Db.java:503)
at com.cisco.nm.acs.view.collector.AcsServer.sync(AcsServer.java:25)
at com.cisco.nm.acs.view.collector.Main$LicenseAndSyncTimerTask.run(Main.java:145)
at java.util.TimerThread.mainLoop(Unknown Source)
at java.util.TimerThread.run(Unknown Source)
Caused by: java.sql.SQLException: Connections could not be acquired from the underlying database!
at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:106)
at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:529)
at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128)
at org.hibernate.connection.C3P0ConnectionProvider.getConnection(C3P0ConnectionProvider.java:35)
at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:315)
... 20 more
Caused by: com.mchange.v2.resourcepool.CannotAcquireResourceException: A ResourcePool could not acquire a resource from its primary factory or source.
at com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1319)
at com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:557)
at com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:477)
at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:525)
... 23 more
Sep 20 2013 14:37:41 com.cisco.nm.acs.view.dbms.impl.ACS5ManagerDAOImpl.getSecurityGroups(ACS5ManagerDAOImpl.java:1184) ERROR Main timer Acs.MGMT.ACSVIEW Cannot open co
nnection to ACS 5 DBorg.hibernate.exception.GenericJDBCException: Cannot open connection
at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:91)
at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:79)
at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:43)
at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:29)
at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:318)
at org.hibernate.jdbc.ConnectionManager.getConnection(ConnectionManager.java:109)
at org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement(AbstractBatcher.java:105)
at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:1561)
at org.hibernate.loader.Loader.doQuery(Loader.java:661)
at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:224)
at org.hibernate.loader.Loader.doList(Loader.java:2150)
at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2029)
at org.hibernate.loader.Loader.list(Loader.java:2024)
at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:369)
at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:300)
at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:146)
at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1093)
at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)
at com.cisco.nm.acs.mgmt.db.Db.hql(Db.java:785)
at com.cisco.nm.acs.mgmt.db.Db.query(Db.java:748)
at com.cisco.nm.acs.mgmt.db.Db.getAll(Db.java:503)
at com.cisco.nm.acs.view.dbms.impl.ACS5ManagerDAOImpl.getSecurityGroups(ACS5ManagerDAOImpl.java:1167)
at com.cisco.nm.acs.view.collector.syslog.SecurityGroups.sync(SecurityGroups.java:32)
at com.cisco.nm.acs.view.collector.Main$LicenseAndSyncTimerTask.run(Main.java:144)
at java.util.TimerThread.mainLoop(Unknown Source)
at java.util.TimerThread.run(Unknown Source)
Caused by: java.sql.SQLException: An attempt by a client to checkout a Connection has timed out.
at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:106)
at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:65)
at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:527)
at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128)
at org.hibernate.connection.C3P0ConnectionProvider.getConnection(C3P0ConnectionProvider.java:35)
at org.hibernate.jdbc.ConnectionManager.openConnection(ConnectionManager.java:315)
... 21 more
Caused by: com.mchange.v2.resourcepool.TimeoutException: A client timed out while waiting to acquire a resource from com.mchange.v2.resourcepool.BasicResourcePool@dea76
8 -- timeout at awaitAvailable()
at com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable(BasicResourcePool.java:1317)
at com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource(BasicResourcePool.java:557)
at com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource(BasicResourcePool.java:477)
at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:525)
... 24 more
We had checked and foud view-collector is running. can somebody help with a solution?
10-01-2013 05:34 PM
What ACS patch are you running on?
Looking at the above error I think we see this message when the log processor was not able to store the process status messages in the database, hence this alert is generated.
I've seen these kind of issues getting fixed with REBOOT.
However, if you wish to troubleshoot then please set the logs at debug level for mgmt-acsview and generate the support bundle again.
~BR
Jatin Katyal
**Do rate helpful posts**
10-02-2013 09:05 PM
Hi Sridharan,
Do you think you can schedule sometime to reload ACS or need help in generating the mgmt-acsview logs for further troubleshooting. let me know.
~BR
Jatin Katyal
**Do rate helpful posts**
10-02-2013 10:49 PM
version 5.3.0-40
need to check with my customer about. however, a documentation from cisco would be better to go ahead with.
10-04-2013 04:05 PM
This is a part of troubleshooting process. Unfortubately, I don't have any document to support what we're doing. If you wish, you can open a TAC case.
~BR
Jatin Katyal
**Do rate helpful posts**
11-01-2013 02:41 AM
Need help in generating the mgmt-acsview logs for further troubleshooting. do these logs can give some clue for resolution?
Regards,
Guarav
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide