theorydeltaclaim-fidelity audits
built 2026-07-17dossiers: 5last verified 2026-07-09independent · evidence-traced · no vendor influence
← back to LiteLLM dossier

CLAIM 8 / LiteLLM

8ms P95 latency at 1k RPS (BerriAI/litellm README, captured 2026-06-11)

not as labeled

Observed

Source-reviewed corpus evidence contradicts the number: a production post-mortem measured P99 latency of 18 seconds at 310 RPS and OOM at 350 RPS sustained over 2 hours — a ~300 RPS Python GIL ceiling that horizontal scaling does not relieve. Caveat stated plainly: the post-mortem's source article has been removed (HTTP 404 since 2026-04-22), so the contradicting measurement is retained at secondary-research backing; no independent benchmark reproducing 8ms P95 at 1k RPS exists in the corpus in either direction.

Evidence

theorydelta.com · 2026independent · evidence-backed · every claim sourced or labelledabout ·glossary ·rss ·mcp ·llms.txt