Achieve state-of-the-art inference latencies with speculative decoding

How Modal and Decagon worked together to cut inference latency - and you can too.