Plano vs agentgateway
Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency. Methodology and limitations.
Requested cell: OpenAI → OpenAI. Metric: Added latency p99 (µs).
Comparability: Comparable. Ratios require an identical protocol pair, hardware, architecture, metric definition, clean harness commit, recorded mock digest, and metric-specific workload. Missing evidence never matches missing evidence. These are observed gateway measurements against a local mock, not a claim about model latency or statistical significance.
- Load-generator binary digests were not recorded; instrument equivalence is based on the identical clean harness source commit and mock digest.
- Measurements were made at different times on independently provisioned machines.
Ratio (agentgateway ÷ Plano): 0.001. No statistical significance is asserted.
Comparison JSON · All Plano evidence · All agentgateway evidence
Plano
Build katanemo/plano:0.4.39. Measured . Run evidence
| Ingress → upstream | Metric | Value | State / reason | p99 bound (ms) |
|---|---|---|---|---|
| OpenAI → OpenAI | Added latency p50 (µs) | 198,988 | Valid · n=30 gateway / 266,566 direct | — |
| OpenAI → OpenAI | Added latency p99 (µs) | 205,966 | Valid · n=30 gateway / 266,566 direct | — |
| OpenAI → OpenAI | Gateway p99 at concurrency 1 (µs) | 205,993 | Valid · n=30 | — |
| OpenAI → OpenAI | Direct-to-mock p99 at concurrency 1 (µs) | 27 | Valid · n=266,566 | — |
| OpenAI → OpenAI | CPU per request (µs) | 182,230.8 | Valid | — |
| OpenAI → OpenAI | Requests per CPU-second | 5.49 | Valid | — |
| OpenAI → OpenAI | Cost window concurrency | 8 | Valid | — |
| OpenAI → OpenAI | Cost window core utilisation | 0.965 | Valid | — |
| OpenAI → OpenAI | Cost window successful requests | 130 | Valid | — |
| OpenAI → OpenAI | Cost window throughput (req/s) | 21 | Valid | — |
| OpenAI → OpenAI | Cost window threads | 68 | Valid | — |
| OpenAI → OpenAI | Non-voluntary context switches per request | 6.28 | Valid | — |
| OpenAI → OpenAI | Cost window major page faults | 0 | Valid | — |
| OpenAI → OpenAI | Added time to first event p50 (µs) | 158,773 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added time to first event p99 (µs) | 170,494 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p50 (µs) | 1 | Valid · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p99 (µs) | 38 | Valid · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Streams sustained (frames/s) | 669.7 | Valid | — |
| OpenAI → OpenAI | Streams sustained | 29 | Valid | — |
| OpenAI → OpenAI | Idle RSS (MiB) | 617.2 | Valid | — |
| OpenAI → OpenAI | Steady-state RSS (MiB) | 971.8 | Valid | — |
| OpenAI → OpenAI | Recovered RSS (MiB) | 972.3 | Valid | — |
| OpenAI → OpenAI | Peak RSS (MiB) | 972.4 | Valid | — |
| OpenAI → OpenAI | Peak RSS high-water mark (MiB) | 972.3 | Valid | — |
| OpenAI → OpenAI | Time to plateau (s) | 61 | Valid | — |
| OpenAI → OpenAI | Memory growth (MiB/min) | 0.129 | Valid | — |
| OpenAI → OpenAI | Memory load duration (s) | 305 | Valid | — |
| OpenAI → OpenAI | Memory shape under load | — | Not measured | — |
| OpenAI → OpenAI | Idle memory shape | — | Not measured | — |
| OpenAI → OpenAI | Idle memory static | 1 | Valid | — |
| OpenAI → OpenAI | Idle memory growth (MiB/min) | 0.052 | Valid | — |
| OpenAI → OpenAI | Throughput (req/s) | — | Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 1ms, so this gateway carried no measurable throughput under that bound | 1 ms |
| OpenAI → OpenAI | Throughput (req/s) | — | Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 5ms, so this gateway carried no measurable throughput under that bound | 5 ms |
| OpenAI → OpenAI | Throughput (req/s) | — | Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 10ms, so this gateway carried no measurable throughput under that bound | 10 ms |
| OpenAI → OpenAI | Throughput (req/s) | — | Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 50ms, so this gateway carried no measurable throughput under that bound | 50 ms |
| OpenAI → OpenAI | Throughput (req/s) | — | Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 100ms, so this gateway carried no measurable throughput under that bound | 100 ms |
| OpenAI → OpenAI | Throughput (req/s) | 19 | concurrency 8; n=118 | Unbounded |
agentgateway
Build ghcr.io/agentgateway/agentgateway:v1.7.0. Measured . Run evidence
| Ingress → upstream | Metric | Value | State / reason | p99 bound (ms) |
|---|---|---|---|---|
| OpenAI → OpenAI | Added latency p50 (µs) | 216 | Valid · n=24,618 gateway / 233,879 direct | — |
| OpenAI → OpenAI | Added latency p99 (µs) | 251 | Valid · n=24,618 gateway / 233,879 direct | — |
| OpenAI → OpenAI | Gateway p99 at concurrency 1 (µs) | 282 | Valid · n=24,618 | — |
| OpenAI → OpenAI | Direct-to-mock p99 at concurrency 1 (µs) | 31 | Valid · n=233,879 | — |
| OpenAI → OpenAI | CPU per request (µs) | 188.6 | Valid | — |
| OpenAI → OpenAI | Requests per CPU-second | 5,302.9 | Valid | — |
| OpenAI → OpenAI | Cost window concurrency | 8 | Valid | — |
| OpenAI → OpenAI | Cost window core utilisation | 0.972 | Valid | — |
| OpenAI → OpenAI | Cost window successful requests | 124,088 | Valid | — |
| OpenAI → OpenAI | Cost window throughput (req/s) | 20,679 | Valid | — |
| OpenAI → OpenAI | Cost window threads | 13 | Valid | — |
| OpenAI → OpenAI | Non-voluntary context switches per request | 0 | Valid | — |
| OpenAI → OpenAI | Cost window major page faults | 0 | Valid | — |
| OpenAI → OpenAI | Added time to first event p50 (µs) | 327 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added time to first event p99 (µs) | 360 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p50 (µs) | 10 | Valid · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p99 (µs) | — | Below resolution · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Streams sustained (frames/s) | 32,614.1 | Valid | — |
| OpenAI → OpenAI | Streams sustained | 2,048 | Valid | — |
| OpenAI → OpenAI | Idle RSS (MiB) | 34 | Valid | — |
| OpenAI → OpenAI | Steady-state RSS (MiB) | 53.49 | Valid | — |
| OpenAI → OpenAI | Recovered RSS (MiB) | 50 | Valid | — |
| OpenAI → OpenAI | Peak RSS (MiB) | 54.52 | Valid | — |
| OpenAI → OpenAI | Peak RSS high-water mark (MiB) | 54.23 | Valid | — |
| OpenAI → OpenAI | Time to plateau (s) | — | Not measured | — |
| OpenAI → OpenAI | Memory growth (MiB/min) | -2.07 | Valid | — |
| OpenAI → OpenAI | Memory load duration (s) | 300 | Valid | — |
| OpenAI → OpenAI | Memory shape under load | -1 | Valid | — |
| OpenAI → OpenAI | Idle memory shape | — | Not measured | — |
| OpenAI → OpenAI | Idle memory static | 1 | Valid | — |
| OpenAI → OpenAI | Idle memory growth (MiB/min) | 0.036 | Valid | — |
| OpenAI → OpenAI | Throughput (req/s) | 21,156 | concurrency 8; n=126,952 | 1 ms |
| OpenAI → OpenAI | Throughput (req/s) | 22,239 | concurrency 64; n=133,447 | 5 ms |
| OpenAI → OpenAI | Throughput (req/s) | 22,380 | concurrency 128; n=134,304 | 10 ms |
| OpenAI → OpenAI | Throughput (req/s) | 22,545 | concurrency 256; n=135,283 | 50 ms |
| OpenAI → OpenAI | Throughput (req/s) | 22,545 | concurrency 256; n=135,283 | 100 ms |
| OpenAI → OpenAI | Throughput (req/s) | 22,545 | concurrency 256; n=135,283 | Unbounded |