There is no way to disable dynamic user cache, we can only manually remove the users from time to time when they keep adding on.They actually become a part of the database and stay unless you delete it manually.
To remove dynamic users manually -- in user set up page -- select " Remove Dynamic Users"