Fix bug where we resent "limit exceeded" server notices repeatedly