Why “Search” Isn’t Enough Anymore A plain RAG pipeline — embed a query, hit a vector index, stuff the top-k chunks into a prompt — works fine for a single-turn FAQ bot. It falls apart the moment you need: Multi-turn memory (“what about last quarter?” needs to know what “last quarter” refers to) A decision about whether to search at all (some questions are structured lookups, not document retrieval) Citations the caller can verify This post builds a small but complete grounded search agent : Azure OpenAI (via Microsoft Foundry) decides when to call a search tool versus a structured data tool, A