Faster joins: Fix incompatibility with joins into restricted rooms where no local users have the ability to invite.