If a cache key is invalidated from under an info call for example, we should try to give a better error than 'doesn't exist'.