Slow Image Editing API Responses and Where the Latency Comes From

The dashboard says p50 is fine. Nobody’s complaining about the median. Then someone splits the data by cache status and finds p99 sitting at 4 seconds, hidden in the aggregate because cached and cold requests were averaged together as though they were the same kind of request.