How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Building a Grounded Search Agent With Foundry, Azure AI Search, and Cosmos DB, Containerized With Docker and Observed With Grafana

calendar_today November 12, 2026 person Jubin Soni, FBCS domain dzone

Why “Search” Isn’t Enough Anymore A plain RAG pipeline — embed a query, hit a vector index, stuff the top-k chunks into a prompt — works fine for a single-turn FAQ bot. It falls apart the moment you need: Multi-turn memory (“what about last quarter?” needs to know what “last quarter” refers to) A decision about whether to search at all (some questions are structured lookups, not document retrieval) Citations the caller can verify This post builds a small but complete grounded search agent : Azure OpenAI (via Microsoft Foundry) decides when to call a search tool versus a structured data tool, A

open_in_new Read original post