Monitor and debug generative AI inference with SageMaker detailed metrics and Insights dashboard on CloudWatch

SageMaker now emits over 100 detailed inference metrics covering GPU health, token latency, and KV cache pressure. A built-in CloudWatch dashboard visualizes fleet performance across three tabs (Performance, Capacity, and Reliability), with PromQL support for external tools.