Try the following:
Turn-on "http cache-authenticated all" configuration in the CE. That should increase the performance to some extent.
Turn-on "http cache-cookies" configuration as well.
check the name server configuration. If there is an invalid name server, that might delay the DNS lookups.