TensorZero benchmark summary

Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency. Methodology and limitations.

Selected pair: OpenAI → OpenAI. Other protocol pairs are available through paginated measurements. This summary is not a universal product ranking.

Ingress → upstreamMetricValueState / reasonp99 bound (ms)
OpenAI → OpenAIAdded latency p50 (µs)40,976Valid · n=150 gateway / 253,662 direct—
OpenAI → OpenAIAdded latency p99 (µs)41,966Valid · n=150 gateway / 253,662 direct—
OpenAI → OpenAIAdded time to first event p99 (µs)746Valid · n=100 gateway / 100 direct—
Build
tensorzero/gateway:2026.6.0
Measured
Published
Age
3 days when this collection was generated

Immutable run and definitions · Raw evidence (large download)

Complete evidence: all protocol pairs, configuration and history (large page) · Paginated historical runs · Data & API guidance