Speculative Decoding's Hidden Cost: The KV Cache Capacity You Give Up, and Where Throughput Turns Negative

Speculative decoding costs KV cache capacity before it serves a request. See the measured slot cost per method and where throughput turns negative.