Helicone benchmark measurements
Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency. Methodology and limitations.
Rust · recorded build: built from source; recorded binary target/release/ai-gateway. Measured: .
JSON · Markdown · CSV · Project source · Interactive dashboard
Each row below names its protocol pair. A representative dashboard cell may differ between gateways; compare an identical pair before interpreting a ranking. Unavailable metrics retain their reason; below-resolution readings are not exact zeroes.
Published measurements
| Ingress → upstream | Metric | Value | State / reason | p99 bound (ms) |
|---|---|---|---|---|
| Bedrock → Cohere | — | — | Not declared: recorded note 1 | — |
| Anthropic → Cohere | — | — | Not declared: recorded note 1 | — |
| Gemini → Cohere | — | — | Not declared: recorded note 1 | — |
| Cohere → Cohere | — | — | Not declared: recorded note 1 | — |
| OpenAI → Cohere | — | — | Not declared: recorded note 1 | — |
| OpenAI Responses → Cohere | — | — | Not declared: recorded note 1 | — |
| Anthropic → OpenAI | — | — | Not declared: recorded note 1 | — |
| OpenAI Responses → OpenAI | — | — | Not declared: recorded note 1 | — |
| OpenAI → OpenAI | Added latency p50 (µs) | 256 | Valid · n=21,418 gateway / 260,967 direct | — |
| OpenAI → OpenAI | Added latency p99 (µs) | 274 | Valid · n=21,418 gateway / 260,967 direct | — |
| OpenAI → OpenAI | Gateway p99 at concurrency 1 (µs) | 302 | Valid · n=21,418 | — |
| OpenAI → OpenAI | Direct-to-mock p99 at concurrency 1 (µs) | 28 | Valid · n=260,967 | — |
| OpenAI → OpenAI | CPU per request (µs) | 259.4 | Valid | — |
| OpenAI → OpenAI | Requests per CPU-second | 3,855.3 | Valid | — |
| OpenAI → OpenAI | Cost window concurrency | 8 | Valid | — |
| OpenAI → OpenAI | Cost window core utilisation | 0.984 | Valid | — |
| OpenAI → OpenAI | Cost window successful requests | 91,294 | Valid | — |
| OpenAI → OpenAI | Cost window throughput (req/s) | 15,213 | Valid | — |
| OpenAI → OpenAI | Cost window threads | 24 | Valid | — |
| OpenAI → OpenAI | Non-voluntary context switches per request | 0 | Valid | — |
| OpenAI → OpenAI | Cost window major page faults | 0 | Valid | — |
| OpenAI → OpenAI | Added time to first event p50 (µs) | 399 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added time to first event p99 (µs) | 493 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p50 (µs) | 0 | Valid · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p99 (µs) | — | Below resolution · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Streams sustained (frames/s) | 21,883.1 | Valid | — |
| OpenAI → OpenAI | Streams sustained | 463 | Valid | — |
| OpenAI → OpenAI | Idle RSS (MiB) | 42.97 | Valid | — |
| OpenAI → OpenAI | Steady-state RSS (MiB) | 56.18 | Valid | — |
| OpenAI → OpenAI | Recovered RSS (MiB) | 53.69 | Valid | — |
| OpenAI → OpenAI | Peak RSS (MiB) | 56.95 | Valid | — |
| OpenAI → OpenAI | Peak RSS high-water mark (MiB) | 56.61 | Valid | — |
| OpenAI → OpenAI | Time to plateau (s) | 126 | Valid | — |
| OpenAI → OpenAI | Memory growth (MiB/min) | 0.5 | Valid | — |
| OpenAI → OpenAI | Memory load duration (s) | 300 | Valid | — |
| OpenAI → OpenAI | Memory shape under load | — | Not measured | — |
| OpenAI → OpenAI | Idle memory shape | — | Not measured | — |
| OpenAI → OpenAI | Idle memory static | 1 | Valid | — |
| OpenAI → OpenAI | Idle memory growth (MiB/min) | 0.124 | Valid | — |
| OpenAI → OpenAI | Throughput (req/s) | 15,405 | concurrency 8; n=92,444 | 1 ms |
| OpenAI → OpenAI | Throughput (req/s) | 16,288 | concurrency 32; n=97,741 | 5 ms |
| OpenAI → OpenAI | Throughput (req/s) | 16,376 | concurrency 64; n=98,266 | 10 ms |
| OpenAI → OpenAI | Throughput (req/s) | 16,376 | concurrency 64; n=98,266 | 50 ms |
| OpenAI → OpenAI | Throughput (req/s) | 16,376 | concurrency 64; n=98,266 | 100 ms |
| OpenAI → OpenAI | Throughput (req/s) | 16,376 | concurrency 64; n=98,266 | Unbounded |
| Cohere → OpenAI | — | — | Not declared: recorded note 1 | — |
| Bedrock → OpenAI | — | — | Not declared: recorded note 1 | — |
| Gemini → OpenAI | — | — | Not declared: recorded note 1 | — |
| OpenAI Responses → Anthropic | — | — | Not declared: recorded note 1 | — |
| Cohere → Anthropic | — | — | Not declared: recorded note 1 | — |
| OpenAI → Anthropic | Added latency p50 (µs) | 259 | Valid · n=21,200 gateway / 264,063 direct | — |
| OpenAI → Anthropic | Added latency p99 (µs) | 278 | Valid · n=21,200 gateway / 264,063 direct | — |
| OpenAI → Anthropic | Gateway p99 at concurrency 1 (µs) | 305 | Valid · n=21,200 | — |
| OpenAI → Anthropic | Direct-to-mock p99 at concurrency 1 (µs) | 27 | Valid · n=264,063 | — |
| OpenAI → Anthropic | CPU per request (µs) | 260.9 | Valid | — |
| OpenAI → Anthropic | Requests per CPU-second | 3,833.2 | Valid | — |
| OpenAI → Anthropic | Cost window concurrency | 8 | Valid | — |
| OpenAI → Anthropic | Cost window core utilisation | 0.983 | Valid | — |
| OpenAI → Anthropic | Cost window successful requests | 90,694 | Valid | — |
| OpenAI → Anthropic | Cost window throughput (req/s) | 15,114 | Valid | — |
| OpenAI → Anthropic | Cost window threads | 26 | Valid | — |
| OpenAI → Anthropic | Non-voluntary context switches per request | 0 | Valid | — |
| OpenAI → Anthropic | Cost window major page faults | 0 | Valid | — |
| OpenAI → Anthropic | Added time to first event p50 (µs) | 400 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → Anthropic | Added time to first event p99 (µs) | 515 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → Anthropic | Added inter-frame gap p50 (µs) | 15 | Valid · n=63 gateway / 63 direct | — |
| OpenAI → Anthropic | Added inter-frame gap p99 (µs) | 20 | Valid · n=63 gateway / 63 direct | — |
| OpenAI → Anthropic | Streams sustained (frames/s) | 22,502.4 | Valid | — |
| OpenAI → Anthropic | Streams sustained | 477 | Valid | — |
| OpenAI → Anthropic | Idle RSS (MiB) | 42.85 | Valid | — |
| OpenAI → Anthropic | Steady-state RSS (MiB) | 56.48 | Valid | — |
| OpenAI → Anthropic | Recovered RSS (MiB) | 53.44 | Valid | — |
| OpenAI → Anthropic | Peak RSS (MiB) | 57.04 | Valid | — |
| OpenAI → Anthropic | Peak RSS high-water mark (MiB) | 56.79 | Valid | — |
| OpenAI → Anthropic | Time to plateau (s) | 168 | Valid | — |
| OpenAI → Anthropic | Memory growth (MiB/min) | 0.11 | Valid | — |
| OpenAI → Anthropic | Memory load duration (s) | 300 | Valid | — |
| OpenAI → Anthropic | Memory shape under load | — | Not measured | — |
| OpenAI → Anthropic | Idle memory shape | — | Not measured | — |
| OpenAI → Anthropic | Idle memory static | 1 | Valid | — |
| OpenAI → Anthropic | Idle memory growth (MiB/min) | 0.124 | Valid | — |
| OpenAI → Anthropic | Throughput (req/s) | 15,212 | concurrency 8; n=91,291 | 1 ms |
| OpenAI → Anthropic | Throughput (req/s) | 16,081 | concurrency 32; n=96,498 | 5 ms |
| OpenAI → Anthropic | Throughput (req/s) | 16,164 | concurrency 64; n=97,003 | 10 ms |
| OpenAI → Anthropic | Throughput (req/s) | 16,164 | concurrency 64; n=97,003 | 50 ms |
| OpenAI → Anthropic | Throughput (req/s) | 16,164 | concurrency 64; n=97,003 | 100 ms |
| OpenAI → Anthropic | Throughput (req/s) | 16,164 | concurrency 64; n=97,003 | Unbounded |
| Bedrock → Anthropic | — | — | Not declared: recorded note 1 | — |
| Anthropic → Anthropic | Added latency p50 (µs) | 175 | Valid · n=30,620 gateway / 260,783 direct | — |
| Anthropic → Anthropic | Added latency p99 (µs) | 192 | Valid · n=30,620 gateway / 260,783 direct | — |
| Anthropic → Anthropic | Gateway p99 at concurrency 1 (µs) | 220 | Valid · n=30,620 | — |
| Anthropic → Anthropic | Direct-to-mock p99 at concurrency 1 (µs) | 28 | Valid · n=260,783 | — |
| Anthropic → Anthropic | CPU per request (µs) | 166.8 | Valid | — |
| Anthropic → Anthropic | Requests per CPU-second | 5,995.3 | Valid | — |
| Anthropic → Anthropic | Cost window concurrency | 8 | Valid | — |
| Anthropic → Anthropic | Cost window core utilisation | 0.983 | Valid | — |
| Anthropic → Anthropic | Cost window successful requests | 141,788 | Valid | — |
| Anthropic → Anthropic | Cost window throughput (req/s) | 23,628 | Valid | — |
| Anthropic → Anthropic | Cost window threads | 5 | Valid | — |
| Anthropic → Anthropic | Non-voluntary context switches per request | 0 | Valid | — |
| Anthropic → Anthropic | Cost window major page faults | 0 | Valid | — |
| Anthropic → Anthropic | Added time to first event p50 (µs) | 270 | Valid · n=100 gateway / 100 direct | — |
| Anthropic → Anthropic | Added time to first event p99 (µs) | 404 | Valid · n=100 gateway / 100 direct | — |
| Anthropic → Anthropic | Added inter-frame gap p50 (µs) | — | Below resolution · n=63 gateway / 63 direct | — |
| Anthropic → Anthropic | Added inter-frame gap p99 (µs) | — | Below resolution · n=63 gateway / 63 direct | — |
| Anthropic → Anthropic | Streams sustained (frames/s) | 51,526.6 | Valid | — |
| Anthropic → Anthropic | Streams sustained | 1,142 | Valid | — |
| Anthropic → Anthropic | Idle RSS (MiB) | 42.95 | Valid | — |
| Anthropic → Anthropic | Steady-state RSS (MiB) | 50.8 | Valid | — |
| Anthropic → Anthropic | Recovered RSS (MiB) | 50.79 | Valid | — |
| Anthropic → Anthropic | Peak RSS (MiB) | 51.33 | Valid | — |
| Anthropic → Anthropic | Peak RSS high-water mark (MiB) | 51.13 | Valid | — |
| Anthropic → Anthropic | Time to plateau (s) | — | Not measured | — |
| Anthropic → Anthropic | Memory growth (MiB/min) | -0.215 | Valid | — |
| Anthropic → Anthropic | Memory load duration (s) | 300 | Valid | — |
| Anthropic → Anthropic | Memory shape under load | 0 | Valid | — |
| Anthropic → Anthropic | Idle memory shape | — | Not measured | — |
| Anthropic → Anthropic | Idle memory static | 1 | Valid | — |
| Anthropic → Anthropic | Idle memory growth (MiB/min) | 0.124 | Valid | — |
| Anthropic → Anthropic | Throughput (req/s) | 24,452 | concurrency 16; n=146,729 | 1 ms |
| Anthropic → Anthropic | Throughput (req/s) | 25,909 | concurrency 64; n=155,481 | 5 ms |
| Anthropic → Anthropic | Throughput (req/s) | 26,217 | concurrency 128; n=157,328 | 10 ms |
| Anthropic → Anthropic | Throughput (req/s) | 26,320 | concurrency 256; n=157,941 | 50 ms |
| Anthropic → Anthropic | Throughput (req/s) | 26,320 | concurrency 256; n=157,941 | 100 ms |
| Anthropic → Anthropic | Throughput (req/s) | 26,320 | concurrency 256; n=157,941 | Unbounded |
| Gemini → Anthropic | — | — | Not declared: recorded note 1 | — |
| OpenAI → Bedrock | Added latency p50 (µs) | 293 | Valid · n=18,960 gateway / 263,027 direct | — |
| OpenAI → Bedrock | Added latency p99 (µs) | 311 | Valid · n=18,960 gateway / 263,027 direct | — |
| OpenAI → Bedrock | Gateway p99 at concurrency 1 (µs) | 338 | Valid · n=18,960 | — |
| OpenAI → Bedrock | Direct-to-mock p99 at concurrency 1 (µs) | 27 | Valid · n=263,027 | — |
| OpenAI → Bedrock | CPU per request (µs) | 295.1 | Valid | — |
| OpenAI → Bedrock | Requests per CPU-second | 3,388.6 | Valid | — |
| OpenAI → Bedrock | Cost window concurrency | 8 | Valid | — |
| OpenAI → Bedrock | Cost window core utilisation | 0.989 | Valid | — |
| OpenAI → Bedrock | Cost window successful requests | 80,614 | Valid | — |
| OpenAI → Bedrock | Cost window throughput (req/s) | 13,433 | Valid | — |
| OpenAI → Bedrock | Cost window threads | 19 | Valid | — |
| OpenAI → Bedrock | Non-voluntary context switches per request | 0 | Valid | — |
| OpenAI → Bedrock | Cost window major page faults | 0 | Valid | — |
| OpenAI → Bedrock | Added time to first event p50 (µs) | — | Untestable | — |
| OpenAI → Bedrock | Added time to first event p99 (µs) | — | Untestable | — |
| OpenAI → Bedrock | Added inter-frame gap p50 (µs) | — | Untestable | — |
| OpenAI → Bedrock | Added inter-frame gap p99 (µs) | — | Untestable | — |
| OpenAI → Bedrock | Streams sustained (frames/s) | — | Untestable | — |
| OpenAI → Bedrock | Streams sustained | — | Untestable | — |
| OpenAI → Bedrock | Idle RSS (MiB) | 42.97 | Valid | — |
| OpenAI → Bedrock | Steady-state RSS (MiB) | 56.49 | Valid | — |
| OpenAI → Bedrock | Recovered RSS (MiB) | 53.67 | Valid | — |
| OpenAI → Bedrock | Peak RSS (MiB) | 56.91 | Valid | — |
| OpenAI → Bedrock | Peak RSS high-water mark (MiB) | 56.73 | Valid | — |
| OpenAI → Bedrock | Time to plateau (s) | 138 | Valid | — |
| OpenAI → Bedrock | Memory growth (MiB/min) | 0.042 | Valid | — |
| OpenAI → Bedrock | Memory load duration (s) | 300 | Valid | — |
| OpenAI → Bedrock | Memory shape under load | — | Not measured | — |
| OpenAI → Bedrock | Idle memory shape | — | Not measured | — |
| OpenAI → Bedrock | Idle memory static | 1 | Valid | — |
| OpenAI → Bedrock | Idle memory growth (MiB/min) | 0.124 | Valid | — |
| OpenAI → Bedrock | Throughput (req/s) | 13,411 | concurrency 8; n=80,477 | 1 ms |
| OpenAI → Bedrock | Throughput (req/s) | 14,128 | concurrency 32; n=84,779 | 5 ms |
| OpenAI → Bedrock | Throughput (req/s) | 14,164 | concurrency 64; n=84,985 | 10 ms |
| OpenAI → Bedrock | Throughput (req/s) | 14,164 | concurrency 64; n=84,985 | 50 ms |
| OpenAI → Bedrock | Throughput (req/s) | 14,164 | concurrency 64; n=84,985 | 100 ms |
| OpenAI → Bedrock | Throughput (req/s) | 14,164 | concurrency 64; n=84,985 | Unbounded |
| Gemini → Bedrock | — | — | Not declared: recorded note 1 | — |
| OpenAI Responses → Bedrock | — | — | Not declared: recorded note 1 | — |
| Cohere → Bedrock | — | — | Not declared: recorded note 1 | — |
| Anthropic → Bedrock | — | — | Not declared: recorded note 1 | — |
| Bedrock → Bedrock | Added latency p50 (µs) | 203 | Valid · n=26,758 gateway / 262,304 direct | — |
| Bedrock → Bedrock | Added latency p99 (µs) | 220 | Valid · n=26,758 gateway / 262,304 direct | — |
| Bedrock → Bedrock | Gateway p99 at concurrency 1 (µs) | 247 | Valid · n=26,758 | — |
| Bedrock → Bedrock | Direct-to-mock p99 at concurrency 1 (µs) | 27 | Valid · n=262,304 | — |
| Bedrock → Bedrock | CPU per request (µs) | 191.5 | Valid | — |
| Bedrock → Bedrock | Requests per CPU-second | 5,222.2 | Valid | — |
| Bedrock → Bedrock | Cost window concurrency | 8 | Valid | — |
| Bedrock → Bedrock | Cost window core utilisation | 0.987 | Valid | — |
| Bedrock → Bedrock | Cost window successful requests | 124,080 | Valid | — |
| Bedrock → Bedrock | Cost window throughput (req/s) | 20,677 | Valid | — |
| Bedrock → Bedrock | Cost window threads | 5 | Valid | — |
| Bedrock → Bedrock | Non-voluntary context switches per request | 0.00000806 | Valid | — |
| Bedrock → Bedrock | Cost window major page faults | 0 | Valid | — |
| Bedrock → Bedrock | Added time to first event p50 (µs) | — | Untestable | — |
| Bedrock → Bedrock | Added time to first event p99 (µs) | — | Untestable | — |
| Bedrock → Bedrock | Added inter-frame gap p50 (µs) | — | Untestable | — |
| Bedrock → Bedrock | Added inter-frame gap p99 (µs) | — | Untestable | — |
| Bedrock → Bedrock | Streams sustained (frames/s) | — | Untestable | — |
| Bedrock → Bedrock | Streams sustained | — | Untestable | — |
| Bedrock → Bedrock | Idle RSS (MiB) | 42.96 | Valid | — |
| Bedrock → Bedrock | Steady-state RSS (MiB) | 50.83 | Valid | — |
| Bedrock → Bedrock | Recovered RSS (MiB) | 51.14 | Valid | — |
| Bedrock → Bedrock | Peak RSS (MiB) | 51.44 | Valid | — |
| Bedrock → Bedrock | Peak RSS high-water mark (MiB) | 51.44 | Valid | — |
| Bedrock → Bedrock | Time to plateau (s) | — | Not measured | — |
| Bedrock → Bedrock | Memory growth (MiB/min) | -0.008 | Valid | — |
| Bedrock → Bedrock | Memory load duration (s) | 300 | Valid | — |
| Bedrock → Bedrock | Memory shape under load | 0 | Valid | — |
| Bedrock → Bedrock | Idle memory shape | — | Not measured | — |
| Bedrock → Bedrock | Idle memory static | 1 | Valid | — |
| Bedrock → Bedrock | Idle memory growth (MiB/min) | 0.124 | Valid | — |
| Bedrock → Bedrock | Throughput (req/s) | 20,749 | concurrency 8; n=124,513 | 1 ms |
| Bedrock → Bedrock | Throughput (req/s) | 22,637 | concurrency 64; n=135,825 | 5 ms |
| Bedrock → Bedrock | Throughput (req/s) | 22,807 | concurrency 128; n=136,867 | 10 ms |
| Bedrock → Bedrock | Throughput (req/s) | 22,894 | concurrency 256; n=137,389 | 50 ms |
| Bedrock → Bedrock | Throughput (req/s) | 22,894 | concurrency 256; n=137,389 | 100 ms |
| Bedrock → Bedrock | Throughput (req/s) | 22,894 | concurrency 256; n=137,389 | Unbounded |
| OpenAI → Gemini | — | — | Not declared: recorded note 1 | — |
| Anthropic → Gemini | — | — | Not declared: recorded note 1 | — |
| Gemini → Gemini | — | — | Not declared: recorded note 1 | — |
| Cohere → Gemini | — | — | Not declared: recorded note 1 | — |
| Bedrock → Gemini | — | — | Not declared: recorded note 1 | — |
| OpenAI Responses → Gemini | — | — | Not declared: recorded note 1 | — |
| Cohere → OpenAI Responses | — | — | Not declared: recorded note 1 | — |
| Bedrock → OpenAI Responses | — | — | Not declared: recorded note 1 | — |
| Anthropic → OpenAI Responses | — | — | Not declared: recorded note 1 | — |
| OpenAI → OpenAI Responses | — | — | Not declared: recorded note 1 | — |
| OpenAI Responses → OpenAI Responses | — | — | Not declared: recorded note 1 | — |
| Gemini → OpenAI Responses | — | — | Not declared: recorded note 1 | — |
Probe evidence and instrument provenance
Historical capability notes may reference an earlier product version. They are not a new probe or a current support claim. Full RSS samples remain in the immutable raw JSON.
| Ingress → upstream | Cell state | Probe HTTP status | Recorded reason | Recorded detail | Evidence scope | Response excerpt | Tested build |
|---|---|---|---|---|---|---|---|
| Bedrock → Cohere | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Anthropic → Cohere | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Gemini → Cohere | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Cohere → Cohere | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| OpenAI → Cohere | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| OpenAI Responses → Cohere | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Anthropic → OpenAI | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| OpenAI Responses → OpenAI | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| OpenAI → OpenAI | Served | — | — | — | Recorded run evidence | — | built from source; recorded binary target/release/ai-gateway |
| Cohere → OpenAI | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Bedrock → OpenAI | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Gemini → OpenAI | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| OpenAI Responses → Anthropic | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Cohere → Anthropic | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| OpenAI → Anthropic | Served | — | — | — | Recorded run evidence | — | built from source; recorded binary target/release/ai-gateway |
| Bedrock → Anthropic | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Anthropic → Anthropic | Served | — | — | — | Recorded run evidence | — | built from source; recorded binary target/release/ai-gateway |
| Gemini → Anthropic | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| OpenAI → Bedrock | Served | — | — | — | Recorded run evidence | — | built from source; recorded binary target/release/ai-gateway |
| Gemini → Bedrock | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| OpenAI Responses → Bedrock | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Cohere → Bedrock | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Anthropic → Bedrock | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Bedrock → Bedrock | Served | — | — | — | Recorded run evidence | — | built from source; recorded binary target/release/ai-gateway |
| OpenAI → Gemini | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Anthropic → Gemini | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Gemini → Gemini | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Cohere → Gemini | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Bedrock → Gemini | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| OpenAI Responses → Gemini | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Cohere → OpenAI Responses | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Bedrock → OpenAI Responses | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Anthropic → OpenAI Responses | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| OpenAI → OpenAI Responses | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| OpenAI Responses → OpenAI Responses | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
| Gemini → OpenAI Responses | Not declared | — | recorded note 1 | recorded note 1 | recorded note 2 | — | built from source; recorded binary target/release/ai-gateway |
- Harness commit
d240badd966933fa19eec0606b2d1f3945f18ad2- Mock SHA-256
99d01f709d8d9c1f49055aa265d5eb7475264d6b513911fe317aee74a71190f8- Load generator SHA-256
not recorded- net.core.somaxconn
- 65,535
- net.ipv4.tcp_max_syn_backlog
- 65,535
- Gateway build receipt
- Binary name
- ai-gateway
- Binary sha256
f401a719a6341a95be9d1f0b7a63ce385241583ee632f5724df3bf54b04a22f1- Cargo lock sha256
d70600602afa1fa8a054251da84622cd764c920e110bf0e3266f0a562473de88- Compiler
- rustc 1.99.1 (58cf8f9c3 2026-10-13) binary: rustc commit-hash: 58cf8f9c35b355199727627d07ae34a4e2846d67 commit-date: 2026-10-13 host: aarch64-unknown-linux-gnu release: 1.99.1 LLVM version: 23.1.1
- Source commit
081f310be779f27122e6038e81e2359c44db4ecb- Source dirty
- No
Stream sweep diagnostics
Per streaming-sweep concurrency, as recorded by the engine: lanes by final HTTP status, and lanes that received no response.
| Ingress → upstream | Concurrency | Lanes by HTTP status | Lanes with no response |
|---|---|---|---|
| OpenAI → OpenAI | 1 | HTTP 200: 1 | 0 |
| OpenAI → OpenAI | 2 | HTTP 200: 2 | 0 |
| OpenAI → OpenAI | 4 | HTTP 200: 4 | 0 |
| OpenAI → OpenAI | 8 | HTTP 200: 8 | 0 |
| OpenAI → OpenAI | 16 | HTTP 200: 16 | 0 |
| OpenAI → OpenAI | 32 | HTTP 200: 32 | 0 |
| OpenAI → OpenAI | 64 | HTTP 200: 64 | 0 |
| OpenAI → OpenAI | 128 | HTTP 200: 128 | 0 |
| OpenAI → OpenAI | 256 | HTTP 200: 256 | 0 |
| OpenAI → OpenAI | 512 | HTTP 200: 460, HTTP 404: 52 | 0 |
| OpenAI → OpenAI | 384 | HTTP 200: 384 | 0 |
| OpenAI → OpenAI | 448 | HTTP 200: 448 | 0 |
| OpenAI → OpenAI | 480 | HTTP 200: 391, HTTP 404: 89 | 0 |
| OpenAI → OpenAI | 464 | HTTP 200: 463, HTTP 404: 1 | 0 |
| OpenAI → OpenAI | 456 | HTTP 200: 456 | 0 |
| OpenAI → OpenAI | 460 | HTTP 200: 460 | 0 |
| OpenAI → OpenAI | 462 | HTTP 200: 462 | 0 |
| OpenAI → OpenAI | 463 | HTTP 200: 463 | 0 |
| OpenAI → OpenAI | 463 | HTTP 200: 463 | 0 |
| OpenAI → OpenAI | 463 | HTTP 200: 463 | 0 |
| OpenAI → Anthropic | 1 | HTTP 200: 1 | 0 |
| OpenAI → Anthropic | 2 | HTTP 200: 2 | 0 |
| OpenAI → Anthropic | 4 | HTTP 200: 4 | 0 |
| OpenAI → Anthropic | 8 | HTTP 200: 8 | 0 |
| OpenAI → Anthropic | 16 | HTTP 200: 16 | 0 |
| OpenAI → Anthropic | 32 | HTTP 200: 32 | 0 |
| OpenAI → Anthropic | 64 | HTTP 200: 64 | 0 |
| OpenAI → Anthropic | 128 | HTTP 200: 128 | 0 |
| OpenAI → Anthropic | 256 | HTTP 200: 256 | 0 |
| OpenAI → Anthropic | 512 | HTTP 200: 511, HTTP 404: 1 | 0 |
| OpenAI → Anthropic | 384 | HTTP 200: 384 | 0 |
| OpenAI → Anthropic | 448 | HTTP 200: 448 | 0 |
| OpenAI → Anthropic | 480 | HTTP 200: 463, HTTP 404: 17 | 0 |
| OpenAI → Anthropic | 464 | HTTP 200: 464 | 0 |
| OpenAI → Anthropic | 472 | HTTP 200: 472 | 0 |
| OpenAI → Anthropic | 476 | HTTP 200: 476 | 0 |
| OpenAI → Anthropic | 478 | HTTP 200: 378, HTTP 404: 100 | 0 |
| OpenAI → Anthropic | 477 | HTTP 200: 477 | 0 |
| OpenAI → Anthropic | 477 | HTTP 200: 477 | 0 |
| OpenAI → Anthropic | 477 | HTTP 200: 477 | 0 |
| Anthropic → Anthropic | 1 | HTTP 200: 1 | 0 |
| Anthropic → Anthropic | 2 | HTTP 200: 2 | 0 |
| Anthropic → Anthropic | 4 | HTTP 200: 4 | 0 |
| Anthropic → Anthropic | 8 | HTTP 200: 8 | 0 |
| Anthropic → Anthropic | 16 | HTTP 200: 16 | 0 |
| Anthropic → Anthropic | 32 | HTTP 200: 32 | 0 |
| Anthropic → Anthropic | 64 | HTTP 200: 64 | 0 |
| Anthropic → Anthropic | 128 | HTTP 200: 128 | 0 |
| Anthropic → Anthropic | 256 | HTTP 200: 256 | 0 |
| Anthropic → Anthropic | 512 | HTTP 200: 512 | 0 |
| Anthropic → Anthropic | 1,024 | HTTP 200: 1,024 | 0 |
| Anthropic → Anthropic | 2,048 | HTTP 200: 2,048 | 0 |
| Anthropic → Anthropic | 1,536 | HTTP 200: 1,536 | 0 |
| Anthropic → Anthropic | 1,280 | HTTP 200: 1,280 | 0 |
| Anthropic → Anthropic | 1,152 | HTTP 200: 1,152 | 0 |
| Anthropic → Anthropic | 1,088 | HTTP 200: 1,088 | 0 |
| Anthropic → Anthropic | 1,120 | HTTP 200: 1,120 | 0 |
| Anthropic → Anthropic | 1,136 | HTTP 200: 1,136 | 0 |
| Anthropic → Anthropic | 1,144 | HTTP 200: 1,144 | 0 |
| Anthropic → Anthropic | 1,140 | HTTP 200: 1,140 | 0 |
| Anthropic → Anthropic | 1,142 | HTTP 200: 1,142 | 0 |
| Anthropic → Anthropic | 1,143 | HTTP 200: 1,143 | 0 |
| Anthropic → Anthropic | 1,142 | HTTP 200: 1,142 | 0 |
| Anthropic → Anthropic | 1,142 | HTTP 200: 1,142 | 0 |
Recorded notes
Text recorded with the cells above. Each note is shown once; rows refer to it by number.
- Pinned v0.2.0-beta.30 source 081f310be779f27122e6038e81e2359c44db4ecb: ai-gateway/src/endpoints defines OpenAI Chat, Anthropic Messages and Bedrock Converse. Google uses v1beta/openai/chat/completions, not native Gemini. router/router_details.rs exposes OpenAI router ingress plus provider-prefixed direct proxy paths. No Responses, native Gemini or Cohere interface is registered; direct proxy does not imply cross-protocol conversion. Five supported exact-wire pairs pass the 36-cell correctness check. Evidence: results/diagnostics/refresh-configuration/helicone-final-config-correctness-preflight.json
- Historical capability research, not a fresh probe of the tested build. Referenced versions may differ from gateway_build; do not infer current capability.
Evidence for the current measurements
- run-helicone-4a55ff2dcc509c5e03f85bd92e36b949ac410653128ccc77d60019bb3aaf2558 · complete raw record including RSS series
Configuration recorded by the run
server:
port: 8787
providers:
openai:
base-url: "http://127.0.0.1:8000/"
anthropic:
base-url: "http://127.0.0.1:8000/"
bedrock:
base-url: "http://127.0.0.1:8000/"
routers:
openai:
load-balance:
chat:
strategy: latency
providers:
- openai
anthropic:
load-balance:
chat:
strategy: latency
providers:
- anthropic
bedrock:
load-balance:
chat:
strategy: latency
providers:
- bedrock
Compare a shared protocol cell
- Helicone vs agentgateway
- Helicone vs AISIX (api7)
- Helicone vs APISIX
- Helicone vs Bifrost
- Helicone vs Busbar
- Helicone vs GoModel
- Helicone vs Higress
- Helicone vs Kong
- Helicone vs LiteLLM · Python
- Helicone vs LiteLLM · Rust
- Helicone vs One-API
- Helicone vs Plano
- Helicone vs Portkey
- Helicone vs TensorZero