gpt-oss-120b is OpenAI’s open-weight reasoning model, and it runs on a single GPU VPS with 96 GB of VRAM. Its mixture-of-experts weights ship natively in 4-bit MXFP4, so OpenAI says the model runs within 80 GB of memory, which leaves room for the KV cache. This guide covers the memory budget, Ollama and vLLM setup, […] The post How to Run gpt-oss-120b on a Single GPU VPS (96 GB VRAM) appeared first on Contabo Blog .