The FEX upgrade takes about 5 minutes and that is mostly the reboot time after the upgrade. The other thing you can do (if possible) is to connect the FEX ahead of time to the parent switch and let the parent switch upgrade the FEX. Once that is completed, attached your servers, storage, etc... This way you have the least amount of down time.
HTH