An online-fitted acceptance estimator that lets every draft-model speculator use Adaptive Verification, by predicting the target’s acceptance probability from the drafter’s own logits and refitting continuously during serving.
Need help?
Contact usAn online-fitted acceptance estimator that lets every draft-model speculator use Adaptive Verification, by predicting the target’s acceptance probability from the drafter’s own logits and refitting continuously during serving.