In May, I published a runnable sample that put Azure API Management in front of an AI agent on Azure App Service . APIM handled token limits, semantic caching, token metrics, and access to the model. The point was simple: keep the agent framework interchangeable and put the production controls at the gateway.