# TensorZero benchmark summary

Overview ·  [History](https://onthebench.ai/gateways/tensorzero/history)  ·  [Evidence](https://onthebench.ai/gateways/tensorzero/evidence)

Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency.  [Methodology and limitations](https://onthebench.ai/gateways/method) .

Selected pair: OpenAI → OpenAI. Other protocol pairs are available through paginated measurements. This summary is not a universal product ranking.

[Compact JSON](https://onthebench.ai/api/v1/summary?gateway=tensorzero)  ·  [Paginated measurements](https://onthebench.ai/api/v1/measurements?gateway=tensorzero&limit=10)  ·  [Markdown](https://onthebench.ai/gateways/tensorzero.md)  ·  [Gateway CSV](https://onthebench.ai/gateways/data.csv?gateway=tensorzero)

| Ingress → upstream | Metric | Value | State / reason | p99 bound (ms) |
| --- | --- | --- | --- | --- |
| openai → openai | added_latency_p50_us | 40976 | valid; gateway_c1_samples=150; direct_c1_samples=253662 | — |
| openai → openai | added_latency_p99_us | 41966 | valid; gateway_c1_samples=150; direct_c1_samples=253662 | — |
| openai → openai | added_ttft_p99_us | 746 | valid; ttft_gw_samples=100; ttft_direct_samples=100 | — |

**Build**: tensorzero/gateway:2026.6.0@sha256:9133135ccdaa23c0fffc2965f20b2a89b077ea3ad9a86a6f15b2a641bff67c89

**Measured**: 2026-11-10T17:40:04Z

**Published**: 2026-11-14T11:09:23.855Z

**Age**: 3 days old at collection generation

[Immutable run and definitions](https://onthebench.ai/gateways/runs/run-tensorzero-e1970318de8934076256f5f37dbf5d7fb6019f1dd5bb339bd959ac71a0a1a8e1)  ·  [Raw evidence (large download)](https://onthebench.ai/api/v1/runs/run-tensorzero-e1970318de8934076256f5f37dbf5d7fb6019f1dd5bb339bd959ac71a0a1a8e1/raw.json)

[Complete evidence: all protocol pairs, configuration and history (large page)](https://onthebench.ai/gateways/tensorzero/evidence)  ·  [Paginated historical runs](https://onthebench.ai/api/v1/runs?family=tensorzero)  ·  [Data & API guidance](https://onthebench.ai/gateways/data)
