# LiteLLM · Rust benchmark summary

Overview ·  [History](https://onthebench.ai/gateways/litellm-rust/history)  ·  [Evidence](https://onthebench.ai/gateways/litellm-rust/evidence)

Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency.  [Methodology and limitations](https://onthebench.ai/gateways/method) .

Selected pair: OpenAI → OpenAI. Other protocol pairs are available through paginated measurements. This summary is not a universal product ranking.

[Compact JSON](https://onthebench.ai/api/v1/summary?gateway=litellm-rust)  ·  [Paginated measurements](https://onthebench.ai/api/v1/measurements?gateway=litellm-rust&limit=10)  ·  [Markdown](https://onthebench.ai/gateways/litellm-rust.md)  ·  [Gateway CSV](https://onthebench.ai/gateways/data.csv?gateway=litellm-rust)

| Ingress → upstream | Metric | Value | State / reason | p99 bound (ms) |
| --- | --- | --- | --- | --- |
| openai → openai | added_latency_p50_us | 249 | valid; gateway_c1_samples=22021; direct_c1_samples=267021 | — |
| openai → openai | added_latency_p99_us | 279 | valid; gateway_c1_samples=22021; direct_c1_samples=267021 | — |
| openai → openai | added_ttft_p99_us | not_measured | not_measured | — |

**Build**: src/litellm-rust/target/release/litellm-gateway

**Measured**: 2026-11-10T17:39:51Z

**Published**: 2026-11-14T11:09:23.855Z

**Age**: 3 days old at collection generation

[Immutable run and definitions](https://onthebench.ai/gateways/runs/run-litellm-rust-69d8e6ed325740d9da7f0aaf31b815418c4801eb6549b2e2c68f768a92af3ad4)  ·  [Raw evidence (large download)](https://onthebench.ai/api/v1/runs/run-litellm-rust-69d8e6ed325740d9da7f0aaf31b815418c4801eb6549b2e2c68f768a92af3ad4/raw.json)

[Complete evidence: all protocol pairs, configuration and history (large page)](https://onthebench.ai/gateways/litellm-rust/evidence)  ·  [Paginated historical runs](https://onthebench.ai/api/v1/runs?family=litellm-rust)  ·  [Data & API guidance](https://onthebench.ai/gateways/data)
