How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

MiniMax M3 Prompt Caching on SambaCloud: How It Works

calendar_today October 7, 2026 person SambaNova domain sambanova-systems

Prompt caching, first introduced on SambaCloud with MiniMax M2.7 , is now available for MiniMax M3. When requests share a stable prefix of at least 4,096 tokens, SambaCloud can serve that prefix from cache instead of recomputing it, with no code changes required. Cached tokens are billed at 90% below the standard input rate, and across 8k to 192k tokens of context, cache hits cut time to first token (TTFT) by 35% to 88%.

open_in_new Read original post