How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Self-Hosting LLMs on Kubernetes: Securing llm-d and vLLM with Kong AI Gateway (Part 1)

calendar_today November 5, 2026 domain kong

llm-d is an open-source, Kubernetes-native framework for serving large language models at scale. It doesn’t run models itself. It sits in front of inference engines such as vLLM, another open-source, high-throughput serving engine, and decides how…

open_in_new Read original post