# LiteLLM · Python benchmark summary

Overview ·  [History](https://onthebench.ai/gateways/litellm-python/history)  ·  [Evidence](https://onthebench.ai/gateways/litellm-python/evidence)

Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency.  [Methodology and limitations](https://onthebench.ai/gateways/method) .

Selected pair: OpenAI → OpenAI. Other protocol pairs are available through paginated measurements. This summary is not a universal product ranking.

[Compact JSON](https://onthebench.ai/api/v1/summary?gateway=litellm-python)  ·  [Paginated measurements](https://onthebench.ai/api/v1/measurements?gateway=litellm-python&limit=10)  ·  [Markdown](https://onthebench.ai/gateways/litellm-python.md)  ·  [Gateway CSV](https://onthebench.ai/gateways/data.csv?gateway=litellm-python)

| Ingress → upstream | Metric | Value | State / reason | p99 bound (ms) |
| --- | --- | --- | --- | --- |
| openai → openai | added_latency_p50_us | 8512 | valid; gateway_c1_samples=701; direct_c1_samples=267297 | — |
| openai → openai | added_latency_p99_us | 9522 | valid; gateway_c1_samples=701; direct_c1_samples=267297 | — |
| openai → openai | added_ttft_p99_us | 11974 | valid; ttft_gw_samples=100; ttft_direct_samples=100 | — |

**Build**: ghcr.io/berriai/litellm:v1.108.3@sha256:e2bce769eb29b100d53ce90cbf2d6bba00dce82cb894c79d092ef6377523d7e5

**Measured**: 2026-11-10T17:39:41Z

**Published**: 2026-11-14T11:09:23.855Z

**Age**: 3 days old at collection generation

[Immutable run and definitions](https://onthebench.ai/gateways/runs/run-litellm-python-10bb57507b26d310b59f12956034785b615cd5338cdaf5cee0e587c350c53acf)  ·  [Raw evidence (large download)](https://onthebench.ai/api/v1/runs/run-litellm-python-10bb57507b26d310b59f12956034785b615cd5338cdaf5cee0e587c350c53acf/raw.json)

[Complete evidence: all protocol pairs, configuration and history (large page)](https://onthebench.ai/gateways/litellm-python/evidence)  ·  [Paginated historical runs](https://onthebench.ai/api/v1/runs?family=litellm-python)  ·  [Data & API guidance](https://onthebench.ai/gateways/data)
