You will need to perform below:
1. check that you have a valid feature keys for File Analysis and File Reputation (if you don't have these keys, contact your account team to purchase)
2. Enabled the engine in WSA appliance. This is a global setting and can not be perform from M170. Go to Security Services -> Anti-Malware and Reputation -> Click Edit Global Settings -> Enable File Reputation Filtering and File Analysis under "Advanced Malware Protection Services.
3. In M170, make sure the option for "Do your Web Appliances have Advance Malware Protection (File Reputation) enabled?" is ticked (enabled).
To check this go to Web tab -> Utilities -> Security Services Display -> Click Edit Display Settings button -> select your Configuration Master that you are using -> check Do your Web Appliances have Advance Malware Protection (File Reputation) enabled?" is ticked (enabled) -> submit and commit