Cisco ASA 5505 to 5506 Site to Site IPsec Tunnel up one side sends other side does not respond

[MedcodataLLC]

Building a simple Site to Site IPsec tunnel between a 5505 and 5506. Tunnel shows up in active sessions with one side sending and other receiving but the receiving side never send traffic back. All packet traces are dying in phase 3. We are using the ASDM to configure both of these and other than the illicit deny there is no ACLs configured to block traffic. LEt me know what you guys can find.

Any help is appreciated!

: Saved

:
: Serial Number: JAD204002ZC
: Hardware: ASA5506, 4096 MB RAM, CPU Atom C2000 series 1250 MHz, 1 CPU (4 cores)
:
ASA Version 9.6(1)
!
hostname ciscoasa
enable password jCbWIKyRy4UpVKjA encrypted
xlate per-session deny tcp any4 any4
xlate per-session deny tcp any4 any6
xlate per-session deny tcp any6 any4
xlate per-session deny tcp any6 any6
xlate per-session deny udp any4 any4 eq domain
xlate per-session deny udp any4 any6 eq domain
xlate per-session deny udp any6 any4 eq domain
xlate per-session deny udp any6 any6 eq domain
passwd 2KFQnbNIdI.2KYOU encrypted
names
name 192.168.11.0 medicalmngr
name 192.168.1.18 Faxserver
name 192.168.1.40 PhoneSystem
name 192.168.1.42 PhoneSystemPort10000
name 192.168.1.11 PremierECW
name 192.168.1.225 DrDavis-All-in-one description DrDavis-All-in-one

!
interface GigabitEthernet1/1
nameif outside
security-level 0
ip address X.X.X.X 255.255.255.0
!
interface GigabitEthernet1/2
nameif inside
security-level 100
ip address 192.168.1.1 255.255.255.0
!
interface GigabitEthernet1/3
shutdown
no nameif
no security-level
no ip address
!
interface GigabitEthernet1/4
shutdown
no nameif
no security-level
no ip address
!
interface GigabitEthernet1/5
shutdown
no nameif
no security-level
no ip address
!
interface GigabitEthernet1/6
shutdown
no nameif
no security-level
no ip address
!
interface GigabitEthernet1/7
shutdown
no nameif
no security-level
no ip address
!
interface GigabitEthernet1/8
shutdown
no nameif
no security-level
no ip address
!
interface Management1/1
management-only
no nameif
no security-level
no ip address
!
boot system disk0:/asa845-k8.bin
ftp mode passive
clock timezone EST -5
clock summer-time EDT recurring
object network obj_any
subnet 0.0.0.0 0.0.0.0
object network medicalmngr
subnet 192.168.11.0 255.255.255.0
object network obj-192.168.1.0
subnet 192.168.1.0 255.255.255.0
object network obj-192.168.5.0
subnet 192.168.5.0 255.255.255.0
object network PremierECW
host 192.168.1.11
object network obj-192.168.160.114
host 192.168.160.114
object network obj-65.199.254.128
subnet 65.199.254.128 255.255.255.128
object network obj-192.168.1.10
host 192.168.1.10
object network Faxserver
host 192.168.1.18
object network obj-192.168.1.124
host 192.168.1.124
object network PhoneSystemPort10000
host 192.168.1.42
object network PhoneSystem
host 192.168.1.40
object network obj-192.168.1.122
host 192.168.1.122
object network obj-192.168.1.5
host 192.168.1.5
object network obj-192.168.1.5-01
host 192.168.1.5
object network obj-192.168.1.110
host 192.168.1.110
object network DrDavis-All-in-one
host 192.168.1.225
object network NETWORK_OBJ_192.168.5.0_24
subnet 192.168.5.0 255.255.255.0
object network NETWORK_OBJ_192.168.1.0_24
subnet 192.168.1.0 255.255.255.0
object network NETWORK_OBJ_192.168.5.1
host 192.168.5.1
object network NETWORK_OBJ_192.168.1.0
host 192.168.1.0
object-group service DM_INLINE_TCP_1 tcp
port-object eq 4000
port-object eq 902
object-group protocol DM_INLINE_PROTOCOL_1
protocol-object ip
object-group protocol TCPUDP
protocol-object udp
protocol-object tcp
access-list inside_nat0_outbound extended permit ip object medicalmngr any
access-list inside_nat0_outbound extended permit ip 192.168.1.0 255.255.255.0 192.168.5.0 255.255.255.0
access-list inside_nat0_outbound extended permit ip object PremierECW host 192.168.160.114
access-list inside_nat0_outbound extended permit ip object PremierECW 65.199.254.128 255.255.255.128
access-list inside_access_in extended permit ip any any
access-list inside_access_in extended permit ip 192.168.1.0 255.255.255.0 192.168.5.0 255.255.255.0
access-list outside_access_in extended permit tcp any host 192.168.1.10 eq 3389
access-list outside_access_in extended permit tcp any object Faxserver eq 3389
access-list outside_access_in extended permit tcp any host 192.168.1.124 eq 3389
access-list outside_access_in extended permit tcp any object PhoneSystem eq 35300
access-list outside_access_in extended permit tcp any object PhoneSystemPort10000 eq 10000
access-list outside_access_in extended permit tcp any host 192.168.1.122 eq 37218
access-list outside_access_in remark Migration, ACE (line 13) expanded: permit tcp any any object-group DM_INLINE_TCP_1
access-list outside_access_in extended permit tcp any host 192.168.1.5 eq https
access-list outside_access_in extended permit tcp any any eq 4000
access-list outside_access_in extended permit tcp any any eq 902
access-list outside_access_in remark Migration: End of expansion
access-list outside_access_in remark Dr. Sporn Desktop
access-list outside_access_in extended permit tcp any host 192.168.1.110 eq 3389
access-list outside_access_in remark Dr. Davis All in one
access-list outside_access_in extended permit tcp any object DrDavis-All-in-one eq 3389
access-list outside_access_in extended permit object-group DM_INLINE_PROTOCOL_1 any any
access-list outside_access_in extended permit ip any any
access-list outside_access_in extended permit ip 192.168.5.0 255.255.255.0 192.168.1.0 255.255.255.0
access-list outside_access_in remark Migration, ACE (line 13) expanded: permit tcp any any object-group DM_INLINE_TCP_1
access-list outside_access_in remark Migration: End of expansion
access-list outside_access_in remark Dr. Sporn Desktop
access-list outside_access_in remark Dr. Davis All in one
access-list outside_cryptomap extended permit ip host 192.168.1.0 192.168.5.0 255.255.255.0
access-list outside_cryptomap_1 extended permit ip 192.168.1.0 255.255.255.0 192.168.5.0 255.255.255.0
pager lines 24
logging enable
logging asdm informational
mtu outside 1500
mtu inside 1500
icmp unreachable rate-limit 1 burst-size 1
asdm image disk0:/asdm-761.bin
no asdm history enable
arp timeout 14400
no arp permit-nonconnected
nat (inside,any) source static medicalmngr medicalmngr no-proxy-arp route-lookup
nat (inside,any) source static obj-192.168.1.0 obj-192.168.1.0 destination static obj-192.168.5.0 obj-192.168.5.0 no-proxy-arp route-lookup
nat (inside,any) source static PremierECW PremierECW destination static obj-192.168.160.114 obj-192.168.160.114 no-proxy-arp route-lookup
nat (inside,any) source static PremierECW PremierECW destination static obj-65.199.254.128 obj-65.199.254.128 no-proxy-arp route-lookup
nat (inside,outside) source static NETWORK_OBJ_192.168.1.0 NETWORK_OBJ_192.168.1.0 destination static NETWORK_OBJ_192.168.5.1 NETWORK_OBJ_192.168.5.1 no-proxy-arp route-lookup
nat (inside,outside) source static NETWORK_OBJ_192.168.5.0_24 NETWORK_OBJ_192.168.5.0_24 destination static NETWORK_OBJ_192.168.1.0_24 NETWORK_OBJ_192.168.1.0_24 no-proxy-arp route-lookup
nat (inside,outside) source static NETWORK_OBJ_192.168.1.0_24 NETWORK_OBJ_192.168.1.0_24 destination static NETWORK_OBJ_192.168.5.0_24 NETWORK_OBJ_192.168.5.0_24 no-proxy-arp route-lookup
nat (inside,outside) source static NETWORK_OBJ_192.168.1.0 NETWORK_OBJ_192.168.1.0 destination static NETWORK_OBJ_192.168.5.0_24 NETWORK_OBJ_192.168.5.0_24 no-proxy-arp route-lookup
!
object network obj_any
nat (inside,outside) dynamic interface
object network obj-192.168.1.10
nat (inside,outside) static interface service tcp 3389 9091
object network Faxserver
nat (inside,outside) static interface service tcp 3389 9092
object network obj-192.168.1.124
nat (inside,outside) static interface service tcp 3389 3390
object network PhoneSystemPort10000
nat (inside,outside) static interface service tcp 10000 10000
object network PhoneSystem
nat (inside,outside) static interface service tcp 35300 35300
object network obj-192.168.1.122
nat (inside,outside) static interface service tcp 37218 37218
object network obj-192.168.1.5
nat (inside,outside) static interface service tcp https 4000
object network obj-192.168.1.5-01
nat (inside,outside) static interface service tcp 902 902
object network obj-192.168.1.110
nat (inside,outside) static interface service tcp 3389 3391
object network DrDavis-All-in-one
nat (inside,outside) static interface service tcp 3389 3392
access-group outside_access_in in interface outside
access-group inside_access_in in interface inside
route outside 0.0.0.0 0.0.0.0 72.91.47.1 1
route outside 0.0.0.0 0.0.0.0 71.122.129.1 5
route outside 0.0.0.0 0.0.0.0 173.65.152.1 5
route outside 192.168.5.0 255.255.255.0 Z.Z.Z.Z 1
timeout xlate 3:00:00
timeout pat-xlate 0:00:30
timeout conn 1:00:00 half-closed 0:10:00 udp 0:02:00 sctp 0:02:00 icmp 0:00:02
timeout sunrpc 0:10:00 h323 0:05:00 h225 1:00:00 mgcp 0:05:00 mgcp-pat 0:05:00
timeout sip 0:30:00 sip_media 0:02:00 sip-invite 0:03:00 sip-disconnect 0:02:00
timeout sip-provisional-media 0:02:00 uauth 0:05:00 absolute
timeout tcp-proxy-reassembly 0:01:00
timeout floating-conn 0:00:00
user-identity default-domain LOCAL
aaa authentication enable console LOCAL
aaa authentication http console LOCAL
aaa authentication ssh console LOCAL
http server enable
http 192.168.1.0 255.255.255.0 inside
http 0.0.0.0 0.0.0.0 outside
http 192.168.0.0 255.255.255.0 inside
no snmp-server location
no snmp-server contact
service sw-reset-button
crypto ipsec ikev1 transform-set ESP-DES-SHA esp-des esp-sha-hmac
crypto ipsec ikev1 transform-set ESP-DES-MD5 esp-des esp-md5-hmac
crypto ipsec ikev1 transform-set ESP-AES-128-SHA esp-aes esp-sha-hmac
crypto ipsec ikev1 transform-set ESP-AES-128-MD5 esp-aes esp-md5-hmac
crypto ipsec ikev1 transform-set ESP-AES-192-SHA esp-aes-192 esp-sha-hmac
crypto ipsec ikev1 transform-set ESP-AES-192-MD5 esp-aes-192 esp-md5-hmac
crypto ipsec ikev1 transform-set ESP-AES-256-SHA esp-aes-256 esp-sha-hmac
crypto ipsec ikev1 transform-set ESP-AES-256-MD5 esp-aes-256 esp-md5-hmac
crypto ipsec ikev1 transform-set ESP-AES-128-SHA-TRANS esp-aes esp-sha-hmac
crypto ipsec ikev1 transform-set ESP-AES-128-SHA-TRANS mode transport
crypto ipsec ikev1 transform-set ESP-AES-128-MD5-TRANS esp-aes esp-md5-hmac
crypto ipsec ikev1 transform-set ESP-AES-128-MD5-TRANS mode transport
crypto ipsec ikev1 transform-set ESP-AES-192-SHA-TRANS esp-aes-192 esp-sha-hmac
crypto ipsec ikev1 transform-set ESP-AES-192-SHA-TRANS mode transport
crypto ipsec ikev1 transform-set ESP-AES-192-MD5-TRANS esp-aes-192 esp-md5-hmac
crypto ipsec ikev1 transform-set ESP-AES-192-MD5-TRANS mode transport
crypto ipsec ikev1 transform-set ESP-AES-256-SHA-TRANS esp-aes-256 esp-sha-hmac
crypto ipsec ikev1 transform-set ESP-AES-256-SHA-TRANS mode transport
crypto ipsec ikev1 transform-set ESP-AES-256-MD5-TRANS esp-aes-256 esp-md5-hmac
crypto ipsec ikev1 transform-set ESP-AES-256-MD5-TRANS mode transport
crypto ipsec ikev1 transform-set ESP-3DES-SHA esp-3des esp-sha-hmac
crypto ipsec ikev1 transform-set ESP-3DES-MD5 esp-3des esp-md5-hmac
crypto ipsec ikev1 transform-set ESP-3DES-SHA-TRANS esp-3des esp-sha-hmac
crypto ipsec ikev1 transform-set ESP-3DES-SHA-TRANS mode transport
crypto ipsec ikev1 transform-set ESP-3DES-MD5-TRANS esp-3des esp-md5-hmac
crypto ipsec ikev1 transform-set ESP-3DES-MD5-TRANS mode transport
crypto ipsec ikev1 transform-set ESP-DES-SHA-TRANS esp-des esp-sha-hmac
crypto ipsec ikev1 transform-set ESP-DES-SHA-TRANS mode transport
crypto ipsec ikev1 transform-set ESP-DES-MD5-TRANS esp-des esp-md5-hmac
crypto ipsec ikev1 transform-set ESP-DES-MD5-TRANS mode transport
crypto ipsec ikev2 ipsec-proposal DES
protocol esp encryption des
protocol esp integrity sha-1 md5
crypto ipsec ikev2 ipsec-proposal 3DES
protocol esp encryption 3des
protocol esp integrity sha-1 md5
crypto ipsec ikev2 ipsec-proposal AES
protocol esp encryption aes
protocol esp integrity sha-1 md5
crypto ipsec ikev2 ipsec-proposal AES192
protocol esp encryption aes-192
protocol esp integrity sha-1 md5
crypto ipsec ikev2 ipsec-proposal AES256
protocol esp encryption aes-256
protocol esp integrity sha-1 md5
crypto ipsec security-association pmtu-aging infinite
crypto map outside_map 1 match address outside_cryptomap_1
crypto map outside_map 1 set peer Z.Z.Z.Z
crypto map outside_map 1 set ikev1 transform-set ESP-AES-192-MD5 ESP-AES-256-SHA ESP-AES-128-SHA ESP-AES-128-MD5 ESP-AES-192-SHA
crypto map outside_map 2 match address outside_cryptomap
crypto map outside_map 2 set peer 192.168.5.1
crypto map outside_map 2 set ikev1 transform-set ESP-AES-128-SHA ESP-AES-128-MD5 ESP-AES-192-SHA ESP-AES-192-MD5 ESP-AES-256-SHA ESP-AES-256-MD5 ESP-3DES-SHA ESP-3DES-MD5 ESP-DES-SHA ESP-DES-MD5
crypto map outside_map interface outside
crypto ca trustpool policy
crypto ikev2 policy 1
encryption aes-256
integrity sha
group 5 2
prf sha
lifetime seconds 86400
crypto ikev2 policy 10
encryption aes-192
integrity sha
group 5 2
prf sha
lifetime seconds 86400
crypto ikev2 policy 20
encryption aes
integrity sha
group 5 2
prf sha
lifetime seconds 86400
crypto ikev2 policy 30
encryption 3des
integrity sha
group 5 2
prf sha
lifetime seconds 86400
crypto ikev2 policy 40
encryption des
integrity sha
group 5 2
prf sha
lifetime seconds 86400
crypto ikev1 enable outside
crypto ikev1 enable inside
crypto ikev1 policy 10
authentication pre-share
encryption 3des
hash sha
group 2
lifetime 86400
crypto ikev1 policy 30
authentication pre-share
encryption 3des
hash md5
group 2
lifetime 86400
telnet 0.0.0.0 0.0.0.0 outside
telnet 192.168.1.0 255.255.255.0 inside
telnet timeout 5
ssh stricthostkeycheck
ssh 0.0.0.0 0.0.0.0 outside
ssh 192.168.1.0 255.255.255.0 inside
ssh timeout 5
ssh key-exchange group dh-group1-sha1
console timeout 0

dhcpd auto_config outside
!
dhcpd address 192.168.1.5-192.168.1.36 inside
dhcpd enable inside
!
ntp server 129.6.15.30 source outside prefer
group-policy DfltGrpPolicy attributes
vpn-tunnel-protocol ikev1 l2tp-ipsec ssl-clientless
group-policy GroupPolicy_Z.Z.Z.Z internal
group-policy GroupPolicy_Z.Z.Z.Z attributes
vpn-tunnel-protocol ikev1
group-policy GroupPolicy_192.168.5.1 internal
group-policy GroupPolicy_192.168.5.1 attributes
vpn-tunnel-protocol ikev1
dynamic-access-policy-record DfltAccessPolicy
username medcoadmin password Nbg.P1Sei82UuCUu encrypted privilege 15
tunnel-group Z.Z.Z.Z type ipsec-l2l
tunnel-group Z.Z.Z.Z general-attributes
default-group-policy GroupPolicy_Z.Z.Z.Z
tunnel-group Z.Z.Z.Z ipsec-attributes
ikev1 pre-shared-key *****
ikev2 remote-authentication pre-shared-key *****
ikev2 local-authentication pre-shared-key *****
tunnel-group 192.168.5.1 type ipsec-l2l
tunnel-group 192.168.5.1 general-attributes
default-group-policy GroupPolicy_192.168.5.1
tunnel-group 192.168.5.1 ipsec-attributes
ikev1 pre-shared-key *****
ikev2 remote-authentication pre-shared-key *****
ikev2 local-authentication pre-shared-key *****
!
class-map inspection_default
match default-inspection-traffic
!
!
policy-map type inspect dns preset_dns_map
parameters
message-length maximum client auto
message-length maximum 512
policy-map global_policy
class inspection_default
inspect dns preset_dns_map
inspect ftp
inspect h323 h225
inspect h323 ras
inspect rsh
inspect rtsp
inspect esmtp
inspect sqlnet
inspect skinny
inspect sunrpc
inspect xdmcp
inspect sip
inspect netbios
inspect tftp
inspect ip-options
inspect icmp
inspect icmp error
!
service-policy global_policy global
prompt hostname context
no call-home reporting anonymous
call-home
profile CiscoTAC-1
no active
destination address http https://tools.cisco.com/its/service/oddce/services/DDCEService
destination address email callhome@cisco.com
destination transport-method http
subscribe-to-alert-group diagnostic
subscribe-to-alert-group environment
subscribe-to-alert-group inventory periodic monthly
subscribe-to-alert-group configuration periodic monthly
subscribe-to-alert-group telemetry periodic daily
Cryptochecksum:24cfab95ce668928534aa3dbbb0af6d8
: end

Here is the other sites config::

:
ASA Version 8.2(1)
!
hostname PremierGunRange
enable password jCbWIKyRy4UpVKjA encrypted
passwd 2KFQnbNIdI.2KYOU encrypted
names
!
interface Vlan1
nameif inside
security-level 100
ip address 192.168.5.1 255.255.255.0
!
interface Vlan2
nameif outside
security-level 0
ip address Z.Z.Z.Z 255.255.255.0
!
interface Ethernet0/0
switchport access vlan 2
!
interface Ethernet0/1
!
interface Ethernet0/2
!
interface Ethernet0/3
!
interface Ethernet0/4
!
interface Ethernet0/5
!
interface Ethernet0/6
!
interface Ethernet0/7
!
ftp mode passive
access-list outside_1_cryptomap extended permit ip 192.168.5.0 255.255.255.0 192.168.1.0 255.255.255.0
access-list inside_nat0_outbound extended permit ip 192.168.5.0 255.255.255.0 192.168.1.0 255.255.255.0
access-list inside_nat0_outbound extended permit ip 192.168.5.0 255.255.255.0 126.2.2.0 255.255.255.0
access-list inside_nat0_outbound extended deny ip 192.168.5.0 255.255.255.0 192.168.1.0 255.255.255.0
access-list outside_2_cryptomap extended permit ip 192.168.5.0 255.255.255.0 126.2.2.0 255.255.255.0
access-list outside_access_in extended permit icmp any any
access-list outside_access_in extended permit ip any any
pager lines 24
logging enable
logging asdm informational
mtu inside 1500
mtu outside 1500
icmp unreachable rate-limit 1 burst-size 1
no asdm history enable
arp timeout 14400
global (outside) 1 interface
nat (inside) 0 access-list inside_nat0_outbound
nat (inside) 1 0.0.0.0 0.0.0.0
access-group outside_access_in in interface outside
route outside 0.0.0.0 0.0.0.0 72.91.227.1 1
timeout xlate 3:00:00
timeout conn 1:00:00 half-closed 0:10:00 udp 0:02:00 icmp 0:00:02
timeout sunrpc 0:10:00 h323 0:05:00 h225 1:00:00 mgcp 0:05:00 mgcp-pat 0:05:00
timeout sip 0:30:00 sip_media 0:02:00 sip-invite 0:03:00 sip-disconnect 0:02:00
timeout sip-provisional-media 0:02:00 uauth 0:05:00 absolute
timeout tcp-proxy-reassembly 0:01:00
dynamic-access-policy-record DfltAccessPolicy
http server enable
http 192.168.5.0 255.255.255.0 inside
http 0.0.0.0 0.0.0.0 outside
no snmp-server location
no snmp-server contact
snmp-server enable traps snmp authentication linkup linkdown coldstart
crypto ipsec transform-set ESP-3DES-SHA esp-3des esp-sha-hmac
crypto ipsec transform-set ESP-3DES-MD5 esp-3des esp-md5-hmac
crypto ipsec security-association lifetime seconds 28800
crypto ipsec security-association lifetime kilobytes 4608000
crypto map outside_map 1 match address outside_1_cryptomap
crypto map outside_map 1 set peer X.X.X.X 72.91.47.57
crypto map outside_map 1 set transform-set ESP-3DES-SHA
crypto map outside_map 2 match address outside_2_cryptomap
crypto map outside_map 2 set peer 24.129.129.52
crypto map outside_map 2 set transform-set ESP-3DES-MD5
crypto map outside_map interface outside
crypto isakmp enable outside
crypto isakmp policy 10
authentication pre-share
encryption 3des
hash sha
group 2
lifetime 86400
crypto isakmp policy 30
authentication pre-share
encryption 3des
hash md5
group 2
lifetime 86400
telnet timeout 5
ssh timeout 5
console timeout 0
dhcpd auto_config outside
dhcpd option 3 ip 192.168.5.1
!
dhcpd address 192.168.5.100-192.168.5.132 inside
dhcpd dns 192.168.1.10 68.238.112.12 interface inside
dhcpd enable inside
!

threat-detection basic-threat
threat-detection statistics access-list
no threat-detection statistics tcp-intercept
webvpn
username medcoadmin password Nbg.P1Sei82UuCUu encrypted privilege 15
tunnel-group 108.9.241.6 type ipsec-l2l
tunnel-group 108.9.241.6 ipsec-attributes
pre-shared-key *
tunnel-group 24.129.129.52 type ipsec-l2l
tunnel-group 24.129.129.52 ipsec-attributes
pre-shared-key *
tunnel-group X.X.X.X type ipsec-l2l
tunnel-group X.X.X.X ipsec-attributes
pre-shared-key *
!
!
!
policy-map type inspect dns preset_dns_map
parameters
message-length maximum 512
!
prompt hostname context
Cryptochecksum:d28bdf75e5102a4eb62cf7d9b65148bb
: end

[Richard Burts]

I have seen situations similar to what is described here in which one side transmits but does not receive encrypted traffic while the other side receives but does not transmit encrypted traffic. In some cases it may be an issue with address translation and in some cases it may be an issue with routing in which either the traffic to the remote peer is not forwarded to the ASA or in which the traffic to the remote peer is not forwarded out the interface with the crypto map. Could you identify which ASA is transmitting the traffic? And could you post the output of show crypto IPsec sa from both ASAs?

HTH

Rick