APISIX vs One-API
Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency. Methodology and limitations.
Requested cell: OpenAI → OpenAI. Metric: Added latency p99 (µs).
Comparability: Comparable. Ratios require an identical protocol pair, hardware, architecture, metric definition, clean harness commit, recorded mock digest, and metric-specific workload. Missing evidence never matches missing evidence. These are observed gateway measurements against a local mock, not a claim about model latency or statistical significance.
- Load-generator binary digests were not recorded; instrument equivalence is based on the identical clean harness source commit and mock digest.
- Measurements were made at different times on independently provisioned machines.
Ratio (One-API ÷ APISIX): 1,734.1. No statistical significance is asserted.
Comparison JSON · All APISIX evidence · All One-API evidence
APISIX
Build apache/apisix:3.19.0-debian. Measured . Run evidence
| Ingress → upstream | Metric | Value | State / reason | p99 bound (ms) |
|---|---|---|---|---|
| OpenAI → OpenAI | Added latency p50 (µs) | 179 | Valid · n=28,247 gateway / 260,315 direct | — |
| OpenAI → OpenAI | Added latency p99 (µs) | 340 | Valid · n=28,247 gateway / 260,315 direct | — |
| OpenAI → OpenAI | Gateway p99 at concurrency 1 (µs) | 368 | Valid · n=28,247 | — |
| OpenAI → OpenAI | Direct-to-mock p99 at concurrency 1 (µs) | 28 | Valid · n=260,315 | — |
| OpenAI → OpenAI | CPU per request (µs) | 185.7 | Valid | — |
| OpenAI → OpenAI | Requests per CPU-second | 5,386.2 | Valid | — |
| OpenAI → OpenAI | Cost window concurrency | 8 | Valid | — |
| OpenAI → OpenAI | Cost window core utilisation | 0.711 | Valid | — |
| OpenAI → OpenAI | Cost window successful requests | 92,266 | Valid | — |
| OpenAI → OpenAI | Cost window throughput (req/s) | 15,375 | Valid | — |
| OpenAI → OpenAI | Cost window threads | 12 | Valid | — |
| OpenAI → OpenAI | Non-voluntary context switches per request | 0.000455 | Valid | — |
| OpenAI → OpenAI | Cost window major page faults | 0 | Valid | — |
| OpenAI → OpenAI | Added time to first event p50 (µs) | 10,584 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added time to first event p99 (µs) | 11,228 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p50 (µs) | — | Below resolution · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p99 (µs) | 8,877 | Valid · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Streams sustained (frames/s) | 63,882.4 | Valid | — |
| OpenAI → OpenAI | Streams sustained | 1,470 | Valid | — |
| OpenAI → OpenAI | Idle RSS (MiB) | 191.2 | Valid | — |
| OpenAI → OpenAI | Steady-state RSS (MiB) | 228.2 | Valid | — |
| OpenAI → OpenAI | Recovered RSS (MiB) | 228.4 | Valid | — |
| OpenAI → OpenAI | Peak RSS (MiB) | 228.4 | Valid | — |
| OpenAI → OpenAI | Peak RSS high-water mark (MiB) | 233.2 | Valid | — |
| OpenAI → OpenAI | Time to plateau (s) | 66 | Valid | — |
| OpenAI → OpenAI | Memory growth (MiB/min) | 0.05 | Valid | — |
| OpenAI → OpenAI | Memory load duration (s) | 300 | Valid | — |
| OpenAI → OpenAI | Memory shape under load | — | Not measured | — |
| OpenAI → OpenAI | Idle memory shape | 0 | Valid | — |
| OpenAI → OpenAI | Idle memory static | 0 | Valid | — |
| OpenAI → OpenAI | Idle memory growth (MiB/min) | -0.464 | Valid | — |
| OpenAI → OpenAI | Throughput (req/s) | 12,187 | concurrency 4; n=73,136 | 1 ms |
| OpenAI → OpenAI | Throughput (req/s) | 23,089 | concurrency 32; n=138,550 | 5 ms |
| OpenAI → OpenAI | Throughput (req/s) | 25,474 | concurrency 64; n=152,851 | 10 ms |
| OpenAI → OpenAI | Throughput (req/s) | 26,590 | concurrency 256; n=159,560 | 50 ms |
| OpenAI → OpenAI | Throughput (req/s) | 26,590 | concurrency 256; n=159,560 | 100 ms |
| OpenAI → OpenAI | Throughput (req/s) | 26,590 | concurrency 256; n=159,560 | Unbounded |
One-API
Build justsong/one-api:v0.6.10. Measured . Run evidence
| Ingress → upstream | Metric | Value | State / reason | p99 bound (ms) |
|---|---|---|---|---|
| OpenAI → OpenAI | Added latency p50 (µs) | 34,017 | Valid · n=102 gateway / 263,027 direct | — |
| OpenAI → OpenAI | Added latency p99 (µs) | 589,609 | Valid · n=102 gateway / 263,027 direct | — |
| OpenAI → OpenAI | Gateway p99 at concurrency 1 (µs) | 589,637 | Valid · n=102 | — |
| OpenAI → OpenAI | Direct-to-mock p99 at concurrency 1 (µs) | 28 | Valid · n=263,027 | — |
| OpenAI → OpenAI | CPU per request (µs) | — | Not measured | — |
| OpenAI → OpenAI | Requests per CPU-second | — | Not measured | — |
| OpenAI → OpenAI | Cost window concurrency | — | Not measured | — |
| OpenAI → OpenAI | Cost window core utilisation | — | Not measured | — |
| OpenAI → OpenAI | Cost window successful requests | — | Not measured | — |
| OpenAI → OpenAI | Cost window throughput (req/s) | — | Not measured | — |
| OpenAI → OpenAI | Cost window threads | — | Not measured | — |
| OpenAI → OpenAI | Non-voluntary context switches per request | — | Not measured | — |
| OpenAI → OpenAI | Cost window major page faults | — | Not measured | — |
| OpenAI → OpenAI | Added time to first event p50 (µs) | 728 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added time to first event p99 (µs) | 770 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p50 (µs) | 12 | Valid · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p99 (µs) | 27 | Valid · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Streams sustained (frames/s) | 7,497.8 | Valid | — |
| OpenAI → OpenAI | Streams sustained | 213 | Valid | — |
| OpenAI → OpenAI | Idle RSS (MiB) | 87.16 | Valid | — |
| OpenAI → OpenAI | Steady-state RSS (MiB) | 141.9 | Valid | — |
| OpenAI → OpenAI | Recovered RSS (MiB) | 136.6 | Valid | — |
| OpenAI → OpenAI | Peak RSS (MiB) | 142.5 | Valid | — |
| OpenAI → OpenAI | Peak RSS high-water mark (MiB) | 142.5 | Valid | — |
| OpenAI → OpenAI | Time to plateau (s) | 134 | Valid | — |
| OpenAI → OpenAI | Memory growth (MiB/min) | 0.116 | Valid | — |
| OpenAI → OpenAI | Memory load duration (s) | 300 | Valid | — |
| OpenAI → OpenAI | Memory shape under load | — | Not measured | — |
| OpenAI → OpenAI | Idle memory shape | — | Not measured | — |
| OpenAI → OpenAI | Idle memory static | 1 | Valid | — |
| OpenAI → OpenAI | Idle memory growth (MiB/min) | -0.115 | Valid | — |
| OpenAI → OpenAI | Throughput (req/s) | — | Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 1ms, so this gateway carried no measurable throughput under that bound | 1 ms |
| OpenAI → OpenAI | Throughput (req/s) | — | Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 5ms, so this gateway carried no measurable throughput under that bound | 5 ms |
| OpenAI → OpenAI | Throughput (req/s) | — | Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 10ms, so this gateway carried no measurable throughput under that bound | 10 ms |
| OpenAI → OpenAI | Throughput (req/s) | 32 | concurrency 1; n=196 | 50 ms |
| OpenAI → OpenAI | Throughput (req/s) | 32 | concurrency 1; n=196 | 100 ms |
| OpenAI → OpenAI | Throughput (req/s) | 38 | concurrency 16; n=229 | Unbounded |