01-25-2018 07:04 AM - edited 02-21-2020 07:12 AM
Hello I'm working on a ASA 5512 ver 9.4(1) that keeps failing over randomly like once every other week.
When the failed firewall is reboot, it comes back like normal. Can you please assist? Last I did was to disable the service-card monitoring and this is still happening.
here's the last messages from the show failover history:
01-25-2018 12:05 PM
01-25-2018 12:33 PM
Here's the config. I checked the inside interface on the switch side and the firewall and they both look good. When we reboot the failed firewall this ifc failure goes away.
ciscoasa/sec/act# sh run fail
failover
failover lan unit secondary
failover lan interface FAILOVER+STATE GigabitEthernet0/5
failover link FAILOVER+STATE GigabitEthernet0/5
failover interface ip FAILOVER+STATE 169.254.255.1 255.255.255.252 standby 169.254.255.2
01-25-2018 01:21 PM
Here's the show failover.
ciscoasa/sec/act# sh fail
Failover On
Failover unit Secondary
Failover LAN Interface: FAILOVER+STATE GigabitEthernet0/5 (up)
Reconnect timeout 0:00:00
Unit Poll frequency 1 seconds, holdtime 15 seconds
Interface Poll frequency 5 seconds, holdtime 25 seconds
Interface Policy 1
Monitored Interfaces 4 of 114 maximum
MAC Address Move Notification Interval not set
Version: Ours 9.4(1), Mate 9.4(1)
Last Failover at: 03:59:44 EST Jan 25 2018
This host: Secondary - Active
Active time: 44302 (sec)
slot 0: ASA5512 hw/sw rev (1.0/9.4(1)) status (Up Sys)
Interface outside (208.75.175.97): Normal (Waiting)
Interface inside (192.168.250.2): Normal (Waiting)
Interface DMZ (192.168.1.1): Normal (Waiting)
Interface PUBLIC_WIFI (172.31.255.1): Normal (Waiting)
Interface BCMSSpec (173.43.121.1): Normal (Not-Monitored)
Interface BCMSStaff (154.43.175.1): Normal (Not-Monitored)
slot 1: SFR5512 hw/sw rev (N/A/5.4.0-764) status (Up/Up)
ASA FirePOWER, 5.4.0-764, Up
Other host: Primary - Failed
Active time: 841905 (sec)
slot 0: ASA5512 hw/sw rev (1.0/9.4(1)) status (Unknown/Unknown)
Interface outside (208.75.175.98): Unknown (Monitored)
Interface inside (192.168.250.3): Unknown (Monitored)
Interface DMZ (192.168.1.253): Unknown (Monitored)
Interface PUBLIC_WIFI (172.31.255.2): Unknown (Monitored)
Interface BCMSSpec (173.43.121.2): Unknown (Not-Monitored)
Interface BCMSStaff (154.43.175.2): Unknown (Not-Monitored)
slot 1: SFR5512 hw/sw rev (N/A/5.4.0-764) status (Unknown/Unknown)
ASA FirePOWER, 5.4.0-764, Unknown
Stateful Failover Logical Update Statistics
Link : FAILOVER+STATE GigabitEthernet0/5 (up)
Stateful Obj xmit xerr rcv rerr
General 1485994 0 338087620 4311
sys cmd 1136394 0 1136391 0
up time 0 0 0 0
RPC services 0 0 0 0
TCP conn 226204 0 207005024 3
UDP conn 113503 0 119573402 4
ARP tbl 9840 0 10303060 0
Xlate_Timeout 0 0 0 0
IPv6 ND tbl 0 0 0 0
VPN IKEv1 SA 10 0 13373 0
VPN IKEv1 P2 16 0 17903 0
VPN IKEv2 SA 0 0 0 0
VPN IKEv2 P2 0 0 0 0
VPN CTCP upd 0 0 0 0
VPN SDI upd 0 0 0 0
VPN DHCP upd 0 0 0 0
SIP Session 0 0 7750 0
SIP Tx 0 0 4401 0
SIP Pinhole 0 0 3123 666
Route Session 1 0 0 3638
Router ID 0 0 0 0
User-Identity 26 0 23193 0
CTS SGTNAME 0 0 0 0
CTS PAC 0 0 0 0
TrustSec-SXP 0 0 0 0
IPv6 Route 0 0 0 0
STS Table 0 0 0 0
Logical Update Queue Information
Cur Max Total
Recv Q: 0 25 365785225
Xmit Q: 0 90 1495942
01-25-2018 09:03 PM
01-25-2018 10:43 PM
DO you mean how the failover link is connected? And do you need the full config?
01-26-2018 02:04 AM
hi,
are the active and standby ASA units directly connected on their G0/5?
kindly post a show int g0/5 output to check for any errors.
01-26-2018 05:46 AM
They seem to be directly connected.
ciscoasa/sec/act# sh fail
Failover On
Failover unit Secondary
Failover LAN Interface: FAILOVER+STATE GigabitEthernet0/5 (up)
Reconnect timeout 0:00:00
Unit Poll frequency 1 seconds, holdtime 15 seconds
Interface Poll frequency 5 seconds, holdtime 25 seconds
Interface Policy 1
Monitored Interfaces 4 of 114 maximum
MAC Address Move Notification Interval not set
Version: Ours 9.4(1), Mate 9.4(1)
Last Failover at: 03:59:44 EST Jan 25 2018
This host: Secondary - Active
Active time: 44302 (sec)
slot 0: ASA5512 hw/sw rev (1.0/9.4(1)) status (Up Sys)
Interface outside (208.75.175.97): Normal (Waiting)
Interface inside (192.168.250.2): Normal (Waiting)
Interface DMZ (192.168.1.1): Normal (Waiting)
Interface PUBLIC_WIFI (172.31.255.1): Normal (Waiting)
Interface BCMSSpec (173.43.121.1): Normal (Not-Monitored)
Interface BCMSStaff (154.43.175.1): Normal (Not-Monitored)
slot 1: SFR5512 hw/sw rev (N/A/5.4.0-764) status (Up/Up)
ASA FirePOWER, 5.4.0-764, Up
Other host: Primary - Failed
Active time: 841905 (sec)
slot 0: ASA5512 hw/sw rev (1.0/9.4(1)) status (Unknown/Unknown)
Interface outside (208.75.175.98): Unknown (Monitored)
Interface inside (192.168.250.3): Unknown (Monitored)
Interface DMZ (192.168.1.253): Unknown (Monitored)
Interface PUBLIC_WIFI (172.31.255.2): Unknown (Monitored)
Interface BCMSSpec (173.43.121.2): Unknown (Not-Monitored)
Interface BCMSStaff (154.43.175.2): Unknown (Not-Monitored)
slot 1: SFR5512 hw/sw rev (N/A/5.4.0-764) status (Unknown/Unknown)
ASA FirePOWER, 5.4.0-764, Unknown
Stateful Failover Logical Update Statistics
Link : FAILOVER+STATE GigabitEthernet0/5 (up)
Stateful Obj xmit xerr rcv rerr
General 1485994 0 338087620 4311
sys cmd 1136394 0 1136391 0
up time 0 0 0 0
RPC services 0 0 0 0
TCP conn 226204 0 207005024 3
UDP conn 113503 0 119573402 4
ARP tbl 9840 0 10303060 0
Xlate_Timeout 0 0 0 0
IPv6 ND tbl 0 0 0 0
VPN IKEv1 SA 10 0 13373 0
VPN IKEv1 P2 16 0 17903 0
VPN IKEv2 SA 0 0 0 0
VPN IKEv2 P2 0 0 0 0
VPN CTCP upd 0 0 0 0
VPN SDI upd 0 0 0 0
VPN DHCP upd 0 0 0 0
SIP Session 0 0 7750 0
SIP Tx 0 0 4401 0
SIP Pinhole 0 0 3123 666
Route Session 1 0 0 3638
Router ID 0 0 0 0
User-Identity 26 0 23193 0
CTS SGTNAME 0 0 0 0
CTS PAC 0 0 0 0
TrustSec-SXP 0 0 0 0
IPv6 Route 0 0 0 0
STS Table 0 0 0 0
Logical Update Queue Information
Cur Max Total
Recv Q: 0 25 365785225
Xmit Q: 0 90 1495942
01-26-2018 07:19 AM
This output says that failover is passing through g0/5 but behind the hood, is it a direct cable or is there a switch or multiple switch transporting a vlan?
The 2nd asa is in failed status and interfaces attached to it are in unknown state.
Can you validate the physical or logical path between them?
01-26-2018 07:28 AM
They just confirmed they’re directly connected.
01-26-2018 07:30 AM
Can you post the output of sh int g0/5?
01-28-2018 03:56 PM
Hi Francesco, anything from that show inter gi0/5?
01-28-2018 04:31 PM
Nothing wrong on this output.
You said when you reboot everything is back normal?
Can you reboot the standby and paste the show failover again?
Do you see something on logs?
01-30-2018 07:11 AM
This is after the reload.
ciscoasa/pri/act# sh fail state
State Last Failure Reason Date/Time
This host - Primary
Active None
Other host - Secondary
Standby Ready None
====Configuration State===
Sync Done - STANDBY
====Communication State===
ciscoasa/pri/act# sh fail
Failover On
Failover unit Primary
Failover LAN Interface: FAILOVER+STATE GigabitEthernet0/5 (up)
Reconnect timeout 0:00:00
Unit Poll frequency 1 seconds, holdtime 15 seconds
Interface Poll frequency 5 seconds, holdtime 25 seconds
Interface Policy 1
Monitored Interfaces 4 of 114 maximum
MAC Address Move Notification Interval not set
Version: Ours 9.4(1), Mate 9.4(1)
Last Failover at: 13:17:10 EST Jan 27 2018
This host: Primary - Active
Active time: 246742 (sec)
slot 0: ASA5512 hw/sw rev (1.0/9.4(1)) status (Up Sys)
Interface outside (208.75.175.97): Normal (Monitored)
Interface inside (192.168.250.2): Normal (Monitored)
Interface DMZ (192.168.1.1): Normal (Monitored)
Interface PUBLIC_WIFI (172.31.255.1): Normal (Monitored)
Interface BCMSSpec (173.43.121.1): Normal (Not-Monitored)
Interface BCMSStaff (154.43.175.1): Normal (Not-Monitored)
slot 1: SFR5512 hw/sw rev (N/A/5.4.0-764) status (Up/Up)
ASA FirePOWER, 5.4.0-764, Up
Other host: Secondary - Standby Ready
Active time: 206229 (sec)
slot 0: ASA5512 hw/sw rev (1.0/9.4(1)) status (Up Sys)
Interface outside (208.75.175.98): Normal (Monitored)
Interface inside (192.168.250.3): Normal (Monitored)
Interface DMZ (192.168.1.253): Normal (Monitored)
Interface PUBLIC_WIFI (172.31.255.2): Normal (Monitored)
Interface BCMSSpec (173.43.121.2): Normal (Not-Monitored)
Interface BCMSStaff (154.43.175.2): Normal (Not-Monitored)
slot 1: SFR5512 hw/sw rev (N/A/5.4.0-764) status (Up/Up)
ASA FirePOWER, 5.4.0-764, Up
Stateful Failover Logical Update Statistics
Link : FAILOVER+STATE GigabitEthernet0/5 (up)
Stateful Obj xmit xerr rcv rerr
General 7634432 0 40390 10
sys cmd 32931 0 32931 0
up time 0 0 0 0
RPC services 0 0 0 0
TCP conn 4861505 0 5132 4
UDP conn 2478582 0 1947 6
ARP tbl 260210 0 359 0
Xlate_Timeout 0 0 0 0
IPv6 ND tbl 0 0 0 0
VPN IKEv1 SA 405 0 5 0
VPN IKEv1 P2 770 0 6 0
VPN IKEv2 SA 0 0 0 0
VPN IKEv2 P2 0 0 0 0
VPN CTCP upd 0 0 0 0
VPN SDI upd 0 0 0 0
VPN DHCP upd 0 0 0 0
SIP Session 0 0 0 0
SIP Tx 0 0 0 0
SIP Pinhole 0 0 0 0
Route Session 16 0 0 0
Router ID 0 0 0 0
User-Identity 14 0 10 0
CTS SGTNAME 0 0 0 0
CTS PAC 0 0 0 0
TrustSec-SXP 0 0 0 0
IPv6 Route 0 0 0 0
STS Table 0 0 0 0
Logical Update Queue Information
Cur Max Total
Recv Q: 0 25 41188
Xmit Q: 0 7 8349280
01-26-2018 08:06 AM
ciscoasa/sec/act# sh int g0/5
Interface GigabitEthernet0/5 "FAILOVER+STATE", is up, line protocol is up
Hardware is i82574L rev00, BW 1000 Mbps, DLY 10 usec
Auto-Duplex(Full-duplex), Auto-Speed(1000 Mbps)
Input flow control is unsupported, output flow control is off
Description: LAN/STATE Failover Interface
MAC address f44e.0522.29f2, MTU 1500
IP address 169.254.255.2, subnet mask 255.255.255.252
215693704 packets input, 222179420058 bytes, 0 no buffer
Received 827 broadcasts, 0 runts, 0 giants
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
0 pause input, 0 resume input
0 L2 decode drops
16934623 packets output, 1701954458 bytes, 0 underruns
0 pause output, 0 resume output
0 output errors, 0 collisions, 10 interface resets
0 late collisions, 0 deferred
3 input reset drops, 0 output reset drops
input queue (blocks free curr/low): hardware (485/444)
output queue (blocks free curr/low): hardware (459/366)
Traffic Statistics for "FAILOVER+STATE":
215693607 packets input, 214542825912 bytes
16934498 packets output, 1340471394 bytes
0 packets dropped
1 minute input rate 0 pkts/sec, 0 bytes/sec
1 minute output rate 0 pkts/sec, 6 bytes/sec
1 minute drop rate, 0 pkts/sec
5 minute input rate 0 pkts/sec, 0 bytes/sec
5 minute output rate 0 pkts/sec, 6 bytes/sec
5 minute drop rate, 0 pkts/sec
ciscoasa/sec/act#
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide