How Session-Aware Agentic Routing in vLLM Semantic Router preserves long-horizon agent continuity with session memory, safe model-switch boundaries, prefix-cache-aware switch pricing, and replayable traces.
Session-Aware Agentic Routing: Continuity-Aware Model Selection for Long-Horizon LLM Agents
calendar_today
June 2, 2026
person
Xunzhuo Liu, Bowei He, Huamin Chen, Haichen Zhang (AMD), Andy Luo (AMD), and the vLLM Semantic Router Team
domain
vllm