# AI Gateway Benchmarks: Latency, Throughput & Protocol Support | On the Bench

Published results are available below.  [Browse all data and evidence](https://onthebench.ai/gateways/data) .

Comparison warning: Default rows use each gateway’s representative protocol cell, which can differ between gateways. This is not a like-for-like ranking. Select the same ingress and upstream protocols and check the  [comparison evidence](https://onthebench.ai/gateways/data)  before naming a winner.

   

Every gateway on the board, in alphabetical order. Language, the exact version measured (hover for the build stamp the run recorded: an immutable image digest or a pinned source commit), when it was last benchmarked, project age, stars (snapshot), and each project's own self-description. The other tabs measure how they perform.

 

| Gateway | Language | Version | Last benchmarked | Project age | Stars | Contributors |
| --- | --- | --- | --- | --- | --- | --- |
| [agentgateway](https://github.com/agentgateway/agentgateway)  [agentgateway benchmark evidence](https://onthebench.ai/gateways/agentgateway) | Rust | v1.7.0 | 2026-11-10 | 1+ year | 6.2k | — |
| [AISIX (api7)](https://github.com/api7/aisix)  [aisix benchmark evidence](https://onthebench.ai/gateways/aisix) | Rust | 1.9.0 | 2026-11-10 | 6+ months | 219 | [@moonming](https://github.com/moonming) |
| [APISIX](https://github.com/apache/apisix)  [apisix benchmark evidence](https://onthebench.ai/gateways/apisix) | Other | 3.19.0-debian | 2026-11-10 | 7+ years | 17.3k | [@moonming](https://github.com/moonming) |
| [Bifrost](https://github.com/maximhq/bifrost)  [bifrost benchmark evidence](https://onthebench.ai/gateways/bifrost) | Go | v2.5.0 | 2026-11-11 | 1+ year | 9.6k | — |
| [Busbar](https://github.com/GetBusbar/busbar)  [busbar benchmark evidence](https://onthebench.ai/gateways/busbar) | Rust | 1.5.5 | 2026-11-10 | 5+ months | 221 | [@MattJackson](https://github.com/MattJackson) |
| [GoModel](https://github.com/ENTERPILOT/GOModel)  [gomodel benchmark evidence](https://onthebench.ai/gateways/gomodel) | Go | 0.2.3 | 2026-11-10 | 11+ months | 1.3k | — |
| [Helicone](https://github.com/Helicone/ai-gateway)  [helicone benchmark evidence](https://onthebench.ai/gateways/helicone) | Rust | v0.2.0-beta.30 | 2026-11-10 | 1+ year | 643 | — |
| [Higress](https://github.com/alibaba/higress)  [higress benchmark evidence](https://onthebench.ai/gateways/higress) | Other | 2.2.5 | 2026-11-10 | 4+ years | 9.8k | [@geekspeng](https://github.com/geekspeng) |
| [Kong](https://github.com/Kong/kong)  [kong benchmark evidence](https://onthebench.ai/gateways/kong) | Other | 3.9.4 | 2026-11-10 | 12+ years | 44.4k | — |
| [LiteLLM · Python](https://github.com/BerriAI/litellm)  [litellm-python benchmark evidence](https://onthebench.ai/gateways/litellm-python) | Python | v1.108.3 | 2026-11-10 | 3+ years | 63.2k | — |
| [LiteLLM · Rust](https://github.com/BerriAI/litellm)  [litellm-rust benchmark evidence](https://onthebench.ai/gateways/litellm-rust) | Rust | v1.108.3 | 2026-11-10 | 3+ years | 63.2k | — |
| [One-API](https://github.com/songquanpeng/one-api)  [one-api benchmark evidence](https://onthebench.ai/gateways/one-api) | Go | v0.6.10 | 2026-11-10 | 3+ years | 37.4k | — |
| [Plano](https://github.com/katanemo/plano)  [plano benchmark evidence](https://onthebench.ai/gateways/plano) | Rust | 0.4.39 | 2026-11-10 | 2+ years | 7.1k | — |
| [Portkey](https://github.com/Portkey-AI/gateway)  [portkey benchmark evidence](https://onthebench.ai/gateways/portkey) | Node | 1.15.2 | 2026-11-10 | 3+ years | 13.4k | — |
| [TensorZero](https://github.com/tensorzero/tensorzero)  [tensorzero benchmark evidence](https://onthebench.ai/gateways/tensorzero) | Rust | 2026.6.0 | 2026-11-10 | 2+ years | 11.7k | — |

 

Benchmarks last run 2026-11-11 03:17 UTC.

 

Star counts are a GitHub snapshot as of 2026-11-14, refreshed with the data, not live.
