cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
997
Views
2
Helpful
6
Replies

cisco asa random drop tcp packets send from azure apim

ctamietto
Level 1
Level 1

Hi , I'm in trouble with the communications between Azure API Management and a Cisco ASA Firewall .

At the begin of a get request from apim , randomly some tcp package are dropped from the ASA firewall ( as of picture )

I guess the flow is as follows :

  1. apim send a SYN Packet ( that is dropped because of port number reused , the first) 
  2. apim resend a SYN packet after 3 second  a couple of times ( that is dropped because retrasmission )
  3. after some minutes the communication  resume correctly  ( as of picture , the second )

if I try the same get http request repeatedly without using apim but a rest client like postman or a python script all work without errors 

why apim cause cisco asa to drop package ?

this is an excerpt from the firewall log 

Drop-reason: (tcp-rst-syn-in-win) TCP RST/SYN in window

why the beaviour of apim is different from other rest client ?

any suggestions are welcome 

thank you

RicezioneDaAzure20230331_001.pngRicezioneDaAzure20230331_002.png

 

6 Replies 6

I've tried but the issue is not the case

the log does not show any MSS Exceeded 

instead I get TCP RST/SYN in window

 

show local-host <IP>
it give us some hint why the TCP is failed 

also please share this 

 FW# capture CAPI interface IN match icmp host <IP> host <IP>
FW# capture CAPI interface OUT match icmp host <IP> host <IP>

OK , I'll got it 

meanwhile I'd like to illustrate some test I've done 

The image below is about the tracing of http calls made by a python script (without going through apim and it's working without problem).

RicezioneDaAzure20230401_001.png

I highlighted the start ( SYN ) and end ( FYN ) of TCP sessions (for every HTTP call there is one).

the two images below are about tracing of http call made by apim 

RicezioneDaAzure20230401_002.pngRicezioneDaAzure20230401_003.png

In this case there is only one initial connection opening ( SYN ) after which apim reuses ( at least so it seems to me ) the same session to send another http frame .

Now, if for any reason the apim thinks it has lost the tcp session it will try to open another one and at this point I think will happen what you see in the image below

RicezioneDaAzure20230401_004.png

The firewall assumes that an already open session exists and drops the tcp frame.

So , some question ...

the behavior of apim is correct ? is it right that the firewall drop the tcp frames ?

what does mean this error ? 

Drop-reason: (tcp-rst-syn-in-win) TCP RST/SYN in window

thanks for any answer

I suspect  of asymmetric routing.

Can you confirm you have multi path ??

ctamietto
Level 1
Level 1

Solved ,

It isn't an asa problem .

I try to explain . 

the problem was the keep alive timeout of a proxy that receive the http requests from the apim  ( going through the firewall ) 

this is the sequence that leads to the error

  1. apim open a tcp connection ( SYN frame ) 
  2. proxy answers with a SYN ACK 
  3. firewall asa consider the TCP connection open 
  4. a couple of minutes and the keep alive timeout of nginx proxy expires 
  5. proxy close the connection with a FIN ACK 
  6.  apim answers with a ACK ( not a FIN ACK ) and consider the connection closed 
  7. for the asa firewall the connection is not closed  
  8. apim try to reopen the connection ( SYN frame ) 
  9. the asa firewall consider the connection closed end drop the package
  10. from this point on http calls no longer work

solution : increase the keep alive timeout of the proxy ( greater then the corresponding timeout of apim ) .

in this way the sequence becomes this :

  1. apim open a tcp connection ( SYN frame ) 
  2. proxy answers with a SYN ACK 
  3. firewall asa consider the TCP connection open 
  4.  nginx does not close the tcp session 
  5. the apim's timeout the timeout expires 
  6.  apim emit a FIN ACK  and consider the connection closed 
  7. proxy answers with a FIN ACK and consider the connection closed 
  8. asa firewall consider the tcp connection closed
  9. apim try to reopen the connection ( SYN frame ) 
  10. asa firewall accept the request and send the request to the proxy
  11. all is working , apim make http request to the proxy without problems

thanks for your support

 

 

 

 

Review Cisco Networking for a $25 gift card