We ran Langfuse’s new AI Gateway, the LiteLLM proxy and AcruxCore on one machine and measured added latency, 1,000 concurrent streams, memory and features. One Docker setting decided the concurrency result.
Need help?
Contact usWe ran Langfuse’s new AI Gateway, the LiteLLM proxy and AcruxCore on one machine and measured added latency, 1,000 concurrent streams, memory and features. One Docker setting decided the concurrency result.