CLAIM 8 / LiteLLM
8ms P95 latency at 1k RPS (BerriAI/litellm README, captured 2026-06-11)
not as labeled
Observed
Source-reviewed corpus evidence contradicts the number: a production post-mortem measured P99 latency of 18 seconds at 310 RPS and OOM at 350 RPS sustained over 2 hours — a ~300 RPS Python GIL ceiling that horizontal scaling does not relieve. Caveat stated plainly: the post-mortem's source article has been removed (HTTP 404 since 2026-04-22), so the contradicting measurement is retained at secondary-research backing; no independent benchmark reproducing 8ms P95 at 1k RPS exists in the corpus in either direction.