Enterprise AI is entering an evaluation gap: Agents are gaining autonomy faster than companies can verify them

Enterprise AI teams are giving agents more freedom at the same moment their confidence in automated testing is collapsing. Half of enterprises have deployed an AI agent or LLM feature that passed internal evaluations and yet still caused a customer-facing failure — one in four more than once — according to the June 2026 VB Pulse survey of 157 qualified enterprise respondents at companies with 100 or more employees. The sample is self-selected rather than a probability sample, so the findings should be read as directional, not precise.