The New API Contract Is Probabilistic: Building Reliable Systems Around Unreliable Model Outputs

For decades, API design rested on a reassuring assumption: given valid input and a stable dependency, software should return a predictable result. Large language models break that assumption without breaking the API. A request can receive HTTP 200, perfectly valid JSON, and a confidently wrong answer.