Assume the Model Is Compromised. What Building a Production AI Taught Us About Containing the Model

Introduction When we refactored LuumenAI around code execution, the reason was cost. I wrote about that in a separate paper, but the short version is that loading a pile of tools into every request was burning tokens, and moving the work into a sandbox where the model writes code against our APIs took the bill […]