Hi Ray,
Since IPSec is only as reliable as your external connection, I would start with looking at a traceroute between the two sites.
Are there drops or very high response times?
If this connection terminates on a router serial interface, does a show interface on either side show a high number of drops or interface resets?
Dave