AFAIK, we cannot use the caller-ID for authentication and/or authorization. But we can use the caller-ID to filter/restrict/allow/deny access based on that information.
If you are using ACS for Windows/ACS SE you can go through following document on how you can use the NAR to accomplish that,