I think your best option here might be to look into using the Do Not Disturb availability setting (available by clicking your avatar in the app) as well as ensuring that your notication preferences are tuned to your liking (Settings\Preferences... Notifications...)