If you are dropping connections then I would suggest you start doing packet sniffing.
If you were only having problems with the ASDM connection or just with VPN connections I might say that you could look at idle timeouts, but global timeouts are not timeouts. Those are connections dropping.