How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

We stopped asking an LLM how much its own work would cost

calendar_today September 24, 2026 person Djo Lopez domain cloudzero

How CloudZero’s model-routing agent stopped asking an LLM to guess a token budget and switched to six bounded signals plus a deterministic formula: why averaging capped accuracy, why some signals dilute the ensemble, and where the v1.0.0 formula still needs calibration. The post We stopped asking an LLM how much its own work would cost appeared first on CloudZero .

open_in_new Read original post