How AI is applied across API Evangelist and APIs.io. Read my AI disclosure →
API Evangelist API Evangelist
Discovery
Learnings
Guidance
Toolbox
Alignment
API Evangelist LLC

A token is not a message: stop storing AI responses like event logs

calendar_today October 7, 2026 person Madeleine Quinn domain ably

A model streams tokens, but a user reads a message. Store the tokens instead of the message, and every client that joins mid-response has to rebuild the response.

open_in_new Read original post