Cost vs. Quality Tradeoff Framework for Agent Models

The cheapest model that clears your quality bar is usually not the model at the top of a leaderboard. This framework sets the bar for one task, measures cost per quality point across a cheap, a mid-tier, and a frontier model on your own examples, and picks the cheapest one that clears the bar with margin. It uses live catalog prices and the cost each OpenRouter response reports.