Introduction As organizations rapidly adopt generative AI, Azure OpenAI usage is growing—and so are the complexities of managing its costs. Unlike traditional cloud services billed per compute hour or gigabyte, Azure OpenAI Service charges based on token usage . This shift introduces a new paradigm for AIOps teams and cloud engineers integrating OpenAI models into Azure: tracking costs by the number of input and output tokens consumed.