The most common objection to auto-routing is that switching models throws away your prompt cache. We measured it across five datasets, including real gateway traffic with the provider’s own cache accounting, and the answer is no.
Prompt Caching Works with Auto Router
calendar_today
July 31, 2026
domain
litellm