Transfer of huge file sizes

[korbenda11as]

                   We have ~1.5 petabytes of data needs to be uploaded from users' machines to a certain destination. This is based on an ave. of 5.5 GB worth of files for 263k users. We are looking for guidance from a network/bandwidth perspective on the deployment schedule/approach in order to avoid negatively impacting the our current network infrastructure and other services.

Users are located geographically and connected via MPLS/internet.

Assuming upload of this huge file will be perform via web, what should be the best approach in achieving this?

What are the things/areas need to consider/check before proceeding on this?

Do we need to analyze first the exact behaviour of the file when upload is performed?

Best Regards,

Oliver Caluag

[Lei Tian]

Hi Oliver,

One thing you want consider is to make sure the file transfer job does not take over the whole bandwidth, and affect other application's performance. If you have QoS build end to end in the network, make sure this file transfer job is classified in BULK data with 20-30 % of the bandwidth. If it is possible, you can also schedule the job out of business hour, so it will less impact to other applications.

HTH,

Lei Tian

[korbenda11as]

Thanks Lei, do you have some kind of strategy/plan as this activity is eventually a one time transfer of very huge file sizes from that will originate from different location geographically. Moving forward, users will continue to transfer file sizes of low volume but again it is still expected of going to high volume.

In terms of scheduling, what do you suggest?

Regards,

Oliver