Improve performance of looking up cross-signing keys.