This makes perfect sense depending on the size of the file. Bandwidth is limited to the speeds you stated, no matter what resource is using them--internet or vpn. Also, a large factor is that with asymmetrical bandwidth that when a lot of upload bandwidth is used, the download bandwidth suffers as well.
I bet most of the time when this happens, the file is being transferred from office #2, thereby using up all the available upload bandwidth.
Office #1 won't see the effects from file transfer because the file transfer is using download bandwidth not upload bandwidth.
Huntsville's Premiere Car and Bike e-magazine: www.huntsvillecarscene.com