How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Nemotron on GB10: FP8 experts that would not load, now 64% faster than BF16

calendar_today October 8, 2026 person TurinTech AI domain turintech

TensorRT-LLM refused FP8 block-scale checkpoints with non-gated experts on GB10, the chip inside DGX Spark. Our pull request makes them run: 64.3% more throughput and 44.9% less weight memory than BF16, with accuracy unchanged.

open_in_new Read original post