cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
21879
Views
36
Helpful
9
Replies

Firepower Deployment Stuck

Dale Dixon
Visitor

"Deployment failed due to another deployment in progress for this device. Retry deployment," is the error.  I have rebooted firepower manager system but it is still stuck in deployment.  How do I kill the processors for deployment.  Had to re-image SSD drive for SFR module.  Need to delete old device in firepower manager and re-install new device, but cannot because firepower manager is stuck on deployment. 

1 Accepted Solution

Accepted Solutions

Thx so much Dale, i had webex today with Cisco it was some file in database corrupted, its a known bug, the support run script to fix it and the issue resolved, and as you said re image sure will also fix it

CSCuy97856 policy deployment fails if tomcat restarts

View solution in original post

9 Replies 9

Jetsy Mathew
Cisco Employee
Cisco Employee

Hello Dale,

You need to open a service request with the TAC as this needs the removal of peer entries from the firepower manager database and viceversa.

Regards

Jetsy 

I did already and they did it for me.  I will remove this from the discussion. 

Thank you for the reply.

please tell me what was the resolution 

Sorry but that was a little while ago. I think I had to reimage the SFR modules. Sorry I just saw your reply. I hope this helped better yet you already have a fix. 

Thx so much Dale, i had webex today with Cisco it was some file in database corrupted, its a known bug, the support run script to fix it and the issue resolved, and as you said re image sure will also fix it

CSCuy97856 policy deployment fails if tomcat restarts

Glad you got it fixed. 

Know this is old post, but do you have the script to fix the error having the same issue?

SegBorda
Frequent Visitor
Frequent Visitor

>expert

Admin~ sudo su

Root# OmniQuery.pl -db mdb -e "update action_queue set state=4 where state =1;"

Root# OmniQuery.pl -db sdb -e "update jobs_device_status set device_status='FAILED' where device_status='PARTIALLY_SUCCEEDED';"

# OmniQuery.pl -db cfgdb -e "update jobs_device_status set device_status='FAILED' where  device_status='PARTIALLY_SUCCEEDED';"

Root# OmniQuery.pl -db mdb -e 'delete from notification where status=7;'

Root# pmtool Restartbyid Tomcat

craftycry
Community Member

I had this issue too and two times, In first time the recently made backup saved me, I've restored backup the deployment issue gone, then did upgrade, the last time TAC support connected and cleared the queued jobs from db. So here are the commands during the TAC session.

> expert
sudoadmin@FTD1:~$ sudo su
Password:
root@FTD1:/home/admin#
root@FTD1:/home/admin#
root@FTD1:/home/admin# OmniQuery.pl -e "select JOB_ID,DEVICE_NAME,DEVICE_STATUS,DEVICE_DEPLOYMENT_TYPE,DEVICE_ERROR_STRING from JOBS_DEVICE_STATUS;"
************ Applying dynamic update files ************
Dynamic update files directory: /usr/local/sf/etc/dynamic_db_updates
Applying file remove_ref_check_rna_ip_os_map.yaml.
Status: Success.
Applying file rule-comments.yaml.
Status: Success.
************ Applying dynamic update files finished ************
Error: Table 'sfsnort.JOBS_DEVICE_STATUS' doesn't exist
Command returned no results.


root@FTD1:/home/admin# OmniQuery.pl -db mdb -e "select status,category,hex(uuid),body from notification where status=7;"
************ Applying dynamic update files ************
Dynamic update files directory: /usr/local/sf/etc/dynamic_db_updates
Applying file remove_ref_check_rna_ip_os_map.yaml.
Status: Success.
Applying file rule-comments.yaml.
Status: Success.
************ Applying dynamic update files finished ************
+--------+----------+-----------+------+
| status | category | hex(uuid) | body |
+--------+----------+-----------+------+

0 rows in set (0.001204 seconds)

 

root@FTD1:/home/admin# OmniQuery.pl -db mdb -e "select status,category,hex(uuid),body from notification where status=6;"
************ Applying dynamic update files ************
Dynamic update files directory: /usr/local/sf/etc/dynamic_db_updates
Applying file remove_ref_check_rna_ip_os_map.yaml.
Status: Success.
Applying file rule-comments.yaml.
Status: Success.
************ Applying dynamic update files finished ************
+--------+----------+-----------+------+
| status | category | hex(uuid) | body |
+--------+----------+-----------+------+

0 rows in set (0.000812 seconds)

 

root@FTD1:/home/admin#
root@FTD1:/home/admin#
root@FTD1:/home/admin# pmtool status| grep -i down
root@FTD1:/home/admin# DBCheck.pl
running database integrity check with the following options:
- use exception directory /ngfw/usr/local/sf/etc/db_exceptions
- check refererences
- check enterprise objects
- check schema
- check required data
- log to stderr
getting filenames from [/ngfw/usr/local/sf/etc/db_updates/index]
getting filenames from [/ngfw/usr/local/sf/etc/db_updates/base-7.2.5]
no dude file [/ngfw/usr/local/sf/etc/db_updates/7.2.5.1] assume no database updates
************ Applying dynamic update files ************
Dynamic update files directory: /usr/local/sf/etc/dynamic_db_updates
Applying file remove_ref_check_rna_ip_os_map.yaml.
Status: Success.
Applying file rule-comments.yaml.
Status: Success.
************ Applying dynamic update files finished ************
getting exceptions from [/ngfw/usr/local/sf/etc/db_exceptions/db_exceptions.yaml]
getting exceptions from [/ngfw/usr/local/sf/etc/db_exceptions/current_user_ip_map_exception.yaml]
[Thu Aug 13 18:49:24 2026][INFO] [-] DBCheck running with 7.2.5.1 as CURRENT VERSION.
[Thu Aug 13 18:49:25 2026][INFO] [current schema] database [mysql], table [packet_log_template], Checking using current schema.
[Thu Aug 13 18:49:25 2026][INFO] [current schema] database [mysql], table [file_event_template], Checking using current schema.
[Thu Aug 13 18:49:26 2026][INFO] [current schema] database [mysql], table [rna_flow_stats_template], Checking using current schema.
[Thu Aug 13 18:49:26 2026][INFO] [current schema] database [mysql], table [rna_flow_stats_prioritized_template], Checking using current schema.
[Thu Aug 13 18:49:26 2026][INFO] [current schema] database [mysql], table [event_extra_data_template], Checking using current schema.
[Thu Aug 13 18:49:27 2026][INFO] [current schema] database [mysql], table [fireamp_event_template], Checking using current schema.
[Thu Aug 13 18:49:27 2026][INFO] [current schema] database [mysql], table [flow_chunk_template], Checking using current schema.
[Thu Aug 13 18:49:27 2026][INFO] [current schema] database [mysql], table [event_template], Checking using current schema.
[Thu Aug 13 18:49:28 2026][INFO] [current schema] database [mysql], table [rua_event_template], Checking using current schema.
[Thu Aug 13 18:49:28 2026][INFO] [current schema] database [mysql], table [rna_event_template], Checking using current schema.
After Checking DB, Warnings: 0, Fatal Errors: 0
root@FTD1:/home/admin# ps -aux | grep -i deploy
root 41194 0.0 0.0 2800 232 pts/0 S+ 18:49 0:00 grep -i deploy
root@FTD1:/home/admin# pmtool disablebyid tomcat
pmtool status | egrep tomcat.*Dis\|tomcat.*Runroot@FTD1:/home/admin# pmtool status | egrep tomcat.*Dis\|tomcat.*Run
tomcat (normal) - User Disabled
root@FTD1:/home/admin# CLASSPATH=/ngfw/var/cisco/ngfwWebUi/tomcat/webapps/ROOT/WEB-INF/lib/* /ngfw/var/jre/bin/java org.neo4j.shell.StartClient -path /ngfw/var/lib/db/ngfw.db
NOTE: Local Neo4j graph database service at '/ngfw/var/lib/db/ngfw.db'
Welcome to the Neo4j Shell! Enter 'help' for a list of commands. Please note that neo4j-shell is deprecated and to be replaced by cypher-shell.


neo4j-sh (?)$ MATCH (m:DeploymentStatus) return m.uuid, m.state;
+----------------------------------------------------------+
| m.uuid | m.state |
+----------------------------------------------------------+
| "522fecd4-9b9c-11ee-84b0-adab966eedfa" | "QUEUED" |
| "c1f39118-8fdf-11f1-8fbb-23583702c93d" | "DEPLOYED" |
| "d638a2d7-bd94-11ef-b63c-63c2d2835913" | "QUEUED" |
| "f5f5f3ab-81e0-11f1-8989-a3d5a2a329af" | "DEPLOYED" |
| "70a47719-81e0-11f1-8989-6329f98fd7df" | "DEPLOYED" |
| "1554ce5c-8408-11f1-8989-ffc08641ac2f" | "DEPLOYED" |
| "987a0a03-81e3-11f1-8989-69bf11bbddf6" | "DEPLOYED" |
| "d4f38290-81dd-11f1-8989-79d42b5b3867" | "DEPLOYED" |
| "dad7222a-81e2-11f1-8989-2516eed533eb" | "DEPLOYED" |
| "c92af659-81dc-11f1-8989-b5ea06dc4af0" | "DEPLOYED" |
| "1d1ad7d5-81dd-11f1-8989-07757a18fc84" | "DEPLOYED" |
| "8e772049-9024-11f1-8fbb-6d1742a502fa" | "DEPLOYED" |
| "bf777708-81e4-11f1-8989-5bbdd4ad069d" | "DEPLOYED" |
| "32aef909-902a-11f1-8fbb-872706387b50" | "DEPLOYED" |
| "89d7308f-8405-11f1-8989-c17e67e13015" | "DEPLOY_FAILED" |
| "d5fb487f-9029-11f1-8fbb-ff2cde48ba3c" | "DEPLOYED" |
| "fbe1d915-9028-11f1-8fbb-732b79882f61" | "DEPLOYED" |
| "0cf4b206-81e6-11f1-8989-816940a41858" | "DEPLOYED" |
| "b4915a9c-81e3-11f1-8989-4527ddd0a956" | "DEPLOYED" |
| "d9f2792f-81e0-11f1-8989-b570bc0c38db" | "DEPLOYED" |
| "6c87d84f-81e2-11f1-8989-8172989b1492" | "DEPLOYED" |
| "3097e242-81e5-11f1-8989-b9fcf7fdf723" | "DEPLOYED" |
| "eb52773c-81e5-11f1-8989-bb17c86ad1fd" | "DEPLOYED" |
| "33241610-81e6-11f1-8989-13b442064aec" | "DEPLOYED" |
| "4200cf54-81e1-11f1-8989-ddd04b231478" | "DEPLOYED" |
| "32d245dd-8405-11f1-8989-5bd4e7ebf70e" | "DEPLOYED" |
| "8b06ee00-9026-11f1-8fbb-29acf9966dee" | "DEPLOYED" |
| "adc78ed3-81e0-11f1-8989-cb1ba6c72b70" | "DEPLOYED" |
| "795934bd-81e1-11f1-8989-4ff757bafc8c" | "DEPLOYED" |
| "dd28c9cf-902a-11f1-8fbb-5753416eeb6a" | "DEPLOYED" |
| "4ff36013-9027-11f1-8fbb-2de12781f068" | "DEPLOYED" |
| "e36c1826-94a6-11f1-8fbb-796ae4982556" | "DEPLOYED" |
| "1d7cb92c-8fbd-11f1-8fbb-773c4de3e102" | "DEPLOYED" |
| "b418494c-8fe1-11f1-8fbb-19a4a50366f4" | "DEPLOYED" |
| "6205599a-9251-11f1-8fbb-e34a2e41baff" | "DEPLOYED" |
| "2bffb1f4-94a8-11f1-8fbb-eb424d3c1a91" | "DEPLOY_FAILED" |
| "f71d1b6e-9027-11f1-8fbb-ad9236dc581a" | "DEPLOYED" |
| "42674c33-902d-11f1-8fbb-6da7e0adc33f" | "DEPLOYED" |
| "88cb6b3a-9028-11f1-8fbb-b1fc44b66c49" | "DEPLOYED" |
| "63572b87-9026-11f1-8fbb-ad991bd20425" | "DEPLOY_FAILED" |
| "f8fbbe33-9251-11f1-8fbb-5ff98a5c5461" | "DEPLOYED" |
| "a86cc493-8fe1-11f1-8fbb-5339b21eb7f9" | "DEPLOY_FAILED" |
| "2c8b6242-8fe9-11f1-8fbb-f7cb35e26ad2" | "DEPLOYED" |
| "ee212d73-9024-11f1-8fbb-4559aa6aaaae" | "DEPLOY_FAILED" |
| "67d674b3-902a-11f1-8fbb-3ff50b27d5b0" | "DEPLOYED" |
| "f5123297-8fe1-11f1-8fbb-0d9b57808ed8" | "DEPLOYED" |
| "36f484cd-9025-11f1-8fbb-e73d8ed907c8" | "DEPLOY_FAILED" |
| "159ca0be-9022-11f1-8fbb-b1d4cfdc5c16" | "DEPLOYED" |
| "7cbcafca-902b-11f1-8fbb-e1843010ff62" | "DEPLOYED" |
+----------------------------------------------------------+
49 rows
1470 ms
neo4j-sh (?)$ MATCH (m:DeploymentStatus) WHERE m.state CONTAINS "FAILED" RETURN m.uuid,m.startTime, m.endTime;
+------------------------------------------------------------------------+
| m.uuid | m.startTime | m.endTime |
+------------------------------------------------------------------------+
| "89d7308f-8405-11f1-8989-c17e67e13015" | 1784529475945 | 1784529686738 |
| "2bffb1f4-94a8-11f1-8fbb-eb424d3c1a91" | 1786358544959 | -1 |
| "63572b87-9026-11f1-8fbb-ad991bd20425" | 1785862998728 | 1785863006691 |
| "a86cc493-8fe1-11f1-8fbb-5339b21eb7f9" | 1785833479455 | 1785833488775 |
| "ee212d73-9024-11f1-8fbb-4559aa6aaaae" | 1785862372486 | 1785862380416 |
| "36f484cd-9025-11f1-8fbb-e73d8ed907c8" | 1785862494669 | 1785862502534 |
+------------------------------------------------------------------------+
6 rows
214 ms
neo4j-sh (?)$ MATCH (m:DeploymentStatus) WHERE m.deploymentStatusMessages CONTAINS "The previous deployment did not finish properly" RETURN m.uuid;
+--------+
| m.uuid |
+--------+
+--------+
0 row
89 ms
neo4j-sh (?)$ MATCH (m:DeploymentStatus{ uuid:"522fecd4-9b9c-11ee-84b0-adab966eedfa"}) DETACH DELETE m;
+-------------------+
| No data returned. |
+-------------------+
Nodes deleted: 1
261 ms
neo4j-sh (?)$ MATCH (m:DeploymentStatus{ uuid:"d638a2d7-bd94-11ef-b63c-63c2d2835913"}) DETACH DELETE m;
+-------------------+
| No data returned. |
+-------------------+
Nodes deleted: 1
25 ms
neo4j-sh (?)$ root@FTD1:/home/admin#
root@FTD1:/home/admin#
root@FTD1:/home/admin# pmtool enablebyid tomcat
root@FTD1:/home/admin# ^C
root@FTD1:/home/admin# ^C
root@FTD1:/home/admin# CLASSPATH=/ngfw/var/cisco/ngfwWebUi/tomcat/webapps/ROOT/WEB-INF/lib/* /ngfw/var/jre/bin/java org.neo4j.shell.StartClient -path /ngfw/var/lib/db/ngfw.db
ERROR (-v for expanded information):
Error starting org.neo4j.kernel.impl.factory.GraphDatabaseFacadeFactory, /ngfw/var/lib/db/ngfw.db

-host Domain name or IP of host to connect to (default: localhost)
-port Port of host to connect to (default: 1337)
-name RMI name, i.e. rmi://<host>:<port>/<name> (default: shell)
-pid Process ID to connect to
-c Command line to execute. After executing it the shell exits
-file File containing commands to execute, or '-' to read from stdin. After executing it the shell exits
-readonly Connect in readonly mode (only for connecting with -path)
-path Points to a neo4j db path so that a local server can be started there
-config Points to a config file when starting a local server

Example arguments for remote:
-port 1337
-host 192.168.1.234 -port 1337 -name shell
-host localhost -readonly
...or no arguments for default values
Example arguments for local:
-path /path/to/db
-path /path/to/db -config /path/to/neo4j.config
-path /path/to/db -readonly
root@FTD1:/home/admin# pmtool disablebyid tomcat
root@FTD1:/home/admin# pmtool status | egrep tomcat.*Dis\|tomcat.*Run
tomcat (normal) - User Disabled
root@FTD1:/home/admin# CLASSPATH=/ngfw/var/cisco/ngfwWebUi/tomcat/webapps/ROOT/WEB-INF/lib/* /ngfw/var/jre/bin/java org.neo4j.shell.StartClient -path /ngfw/var/lib/db/ngfw.db
NOTE: Local Neo4j graph database service at '/ngfw/var/lib/db/ngfw.db'
Welcome to the Neo4j Shell! Enter 'help' for a list of commands. Please note that neo4j-shell is deprecated and to be replaced by cypher-shell.


neo4j-sh (?)$ MATCH (m:DeploymentStatus) return m.uuid, m.state;
+----------------------------------------------------------+
| m.uuid | m.state |
+----------------------------------------------------------+
| "c1f39118-8fdf-11f1-8fbb-23583702c93d" | "DEPLOYED" |
| "f5f5f3ab-81e0-11f1-8989-a3d5a2a329af" | "DEPLOYED" |
| "70a47719-81e0-11f1-8989-6329f98fd7df" | "DEPLOYED" |
| "1554ce5c-8408-11f1-8989-ffc08641ac2f" | "DEPLOYED" |
| "987a0a03-81e3-11f1-8989-69bf11bbddf6" | "DEPLOYED" |
| "d4f38290-81dd-11f1-8989-79d42b5b3867" | "DEPLOYED" |
| "dad7222a-81e2-11f1-8989-2516eed533eb" | "DEPLOYED" |
| "c92af659-81dc-11f1-8989-b5ea06dc4af0" | "DEPLOYED" |
| "1d1ad7d5-81dd-11f1-8989-07757a18fc84" | "DEPLOYED" |
| "8e772049-9024-11f1-8fbb-6d1742a502fa" | "DEPLOYED" |
| "bf777708-81e4-11f1-8989-5bbdd4ad069d" | "DEPLOYED" |
| "32aef909-902a-11f1-8fbb-872706387b50" | "DEPLOYED" |
| "89d7308f-8405-11f1-8989-c17e67e13015" | "DEPLOY_FAILED" |
| "d5fb487f-9029-11f1-8fbb-ff2cde48ba3c" | "DEPLOYED" |
| "fbe1d915-9028-11f1-8fbb-732b79882f61" | "DEPLOYED" |
| "0cf4b206-81e6-11f1-8989-816940a41858" | "DEPLOYED" |
| "b4915a9c-81e3-11f1-8989-4527ddd0a956" | "DEPLOYED" |
| "d9f2792f-81e0-11f1-8989-b570bc0c38db" | "DEPLOYED" |
| "6c87d84f-81e2-11f1-8989-8172989b1492" | "DEPLOYED" |
| "3097e242-81e5-11f1-8989-b9fcf7fdf723" | "DEPLOYED" |
| "eb52773c-81e5-11f1-8989-bb17c86ad1fd" | "DEPLOYED" |
| "33241610-81e6-11f1-8989-13b442064aec" | "DEPLOYED" |
| "4200cf54-81e1-11f1-8989-ddd04b231478" | "DEPLOYED" |
| "32d245dd-8405-11f1-8989-5bd4e7ebf70e" | "DEPLOYED" |
| "8b06ee00-9026-11f1-8fbb-29acf9966dee" | "DEPLOYED" |
| "adc78ed3-81e0-11f1-8989-cb1ba6c72b70" | "DEPLOYED" |
| "795934bd-81e1-11f1-8989-4ff757bafc8c" | "DEPLOYED" |
| "dd28c9cf-902a-11f1-8fbb-5753416eeb6a" | "DEPLOYED" |
| "4ff36013-9027-11f1-8fbb-2de12781f068" | "DEPLOYED" |
| "e36c1826-94a6-11f1-8fbb-796ae4982556" | "DEPLOYED" |
| "1d7cb92c-8fbd-11f1-8fbb-773c4de3e102" | "DEPLOYED" |
| "b418494c-8fe1-11f1-8fbb-19a4a50366f4" | "DEPLOYED" |
| "6205599a-9251-11f1-8fbb-e34a2e41baff" | "DEPLOYED" |
| "2bffb1f4-94a8-11f1-8fbb-eb424d3c1a91" | "DEPLOY_FAILED" |
| "f71d1b6e-9027-11f1-8fbb-ad9236dc581a" | "DEPLOYED" |
| "42674c33-902d-11f1-8fbb-6da7e0adc33f" | "DEPLOYED" |
| "88cb6b3a-9028-11f1-8fbb-b1fc44b66c49" | "DEPLOYED" |
| "63572b87-9026-11f1-8fbb-ad991bd20425" | "DEPLOY_FAILED" |
| "f8fbbe33-9251-11f1-8fbb-5ff98a5c5461" | "DEPLOYED" |
| "a86cc493-8fe1-11f1-8fbb-5339b21eb7f9" | "DEPLOY_FAILED" |
| "2c8b6242-8fe9-11f1-8fbb-f7cb35e26ad2" | "DEPLOYED" |
| "ee212d73-9024-11f1-8fbb-4559aa6aaaae" | "DEPLOY_FAILED" |
| "67d674b3-902a-11f1-8fbb-3ff50b27d5b0" | "DEPLOYED" |
| "f5123297-8fe1-11f1-8fbb-0d9b57808ed8" | "DEPLOYED" |
| "36f484cd-9025-11f1-8fbb-e73d8ed907c8" | "DEPLOY_FAILED" |
| "159ca0be-9022-11f1-8fbb-b1d4cfdc5c16" | "DEPLOYED" |
| "7cbcafca-902b-11f1-8fbb-e1843010ff62" | "DEPLOYED" |
+----------------------------------------------------------+
47 rows
1692 ms
neo4j-sh (?)$ root@FTD1:/home/admin# pmtool enablebyid tomcat
root@FTD1:/home/admin# pmtool status | egrep tomcat.*Dis\|tomcat.*Run
tomcat (normal) - Running 5345
root@FTD1:/home/admin#

Review Cisco Networking for a $25 gift card