Real-time customer decisioning has long involved tradeoffs among speed, flexibility, and cost. Large language models can reason over detailed customer profiles, but invoking one for every event adds cost and latency. Traditional ML models offer fast, predictable inference, but typically require training for each decision and a deployed serving endpoint.