How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

Fine-tuning the LLM Ornith 9b on a single H200 GPU Droplet: cost, latency, and serving overhead

calendar_today July 14, 2026 person James Skelton domain digital-ocean

We fine-tuned Ornith-1.0-9B to output structured reasoning summaries instead of raw chain-of-thought, using LLaMA-Factory on a single DigitalOcean H200 GPU Droplet. Full training cost ($84.88), TTFT and throughput benchmarks at 1/5/20 concurrent requests, and a direct comparison against the unmodified base model.

open_in_new Read original post