How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

GPU autoscaling on Kubernetes with KEDA: Building an external scaler

calendar_today May 27, 2026 person Pavan Madduri (Senior Cloud Platform Engineer @ Grainger | CNCF Golden Kubestronaut) domain cncf

If you run GPU workloads on Kubernetes — vLLM, Triton, training jobs, or the newer agentic inference stacks — you’ve probably hit a familiar problem: the default autoscaling path still reasons about CPU and memory, while…

open_in_new Read original post