How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

How to Run gpt-oss-120b on a Single GPU VPS (96 GB VRAM)

calendar_today November 9, 2026 person Jie Guo domain contabo

gpt-oss-120b is OpenAI’s open-weight reasoning model, and it runs on a single GPU VPS with 96 GB of VRAM. Its mixture-of-experts weights ship natively in 4-bit MXFP4, so OpenAI says the model runs within 80 GB of memory, which leaves room for the KV cache. This guide covers the memory budget, Ollama and vLLM setup, […] The post How to Run gpt-oss-120b on a Single GPU VPS (96 GB VRAM) appeared first on Contabo Blog .

open_in_new Read original post