How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Inkling 2 Small on vLLM: Day-0 Support

calendar_today November 12, 2026 person Inferact and Thinking Machines domain vllm

vLLM supports Thinking Machines’ Inkling 2 Small from day 0: attention residuals, a new decode kernel for relative-bias attention, all-reduce fused with the ops around it, and DSpark speculative decoding.

open_in_new Read original post