How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

AWS Neuron 2.31.0 now available with NKI 0.5.0 and UltraServer Operator

calendar_today July 8, 2026 person aws@amazon.com domain amazon-q

AWS Neuron 2.31.0 is now available, introducing NKI 0.5.0 with new MX FP8 scale dtype support, tensor indirection on compute operations for fewer instructions in indexed access patterns, and new NkiTensor view APIs for zero-cost tensor layout transformations. This release also introduces the Neuron UltraServer Operator for Amazon EKS in public beta, automating UltraServer discovery, workload allocation, and resource claim generation for Trainium UltraServer workloads on Amazon EKS. The Neuron Compiler includes a redesigned code generation backend now enabled by default on Trn2 and Trn3, delive

open_in_new Read original post