Real time-to-first-token numbers from 380 test calls across six models on DigitalOcean Serverless Inference, including two multi-minute delays on one model.
Need help?
Contact usReal time-to-first-token numbers from 380 test calls across six models on DigitalOcean Serverless Inference, including two multi-minute delays on one model.