There should be a way to lazy update permission caches. If there are a lot of permission nodes for a certain user or a group there could be an issue due to the amount of iterations and permission checks. This may be implemented on the updater level and handled on a case by case basis.