From Chatbot to Compound AI System: Infrastructure Patterns for Multi-Model, Tool-Using Applications

By Adam Wolf Two years ago, GenAI in production usually meant a single LLM serving a single endpoint. In 2026, it usually means much more. The applications shipping in front of users today are compound AI systems: orchestrated pipelines of retrievers, embedders, dialogue models, classifiers, code interpreters, SQL executors, and tools, with a single user […]