In the Get Call Contact Info step you can also get the called number. Simply add that and an If or switch statement which checks the called number and then has a Set Contact Priority step within the appropriate branch.
The Get Trigger Info step will also get the called number as the Trigger Name.
Please remember to rate helpful responses and identify helpful or correct answers.