'Identity Group' is not included in the conditions of 'Policy Sets', Identity Group' is the condition of 'Authorization and Authentication', it's not applied to the Policy Set condition.
I took example to set 'Identity Group' as condition of Authorization:
Step1: Create Endpoint Identity Group:
Step2: Create Endpoints and assign it to Endpoint Identity Group created in step1:
Step3: configure Identity Group as condition of Authorization Policy: