One-API vs AISIX (api7)

Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency. Methodology and limitations.

Requested cell: OpenAI → OpenAI. Metric: Added latency p99 (µs).

Comparability: Comparable. Ratios require an identical protocol pair, hardware, architecture, metric definition, clean harness commit, recorded mock digest, and metric-specific workload. Missing evidence never matches missing evidence. These are observed gateway measurements against a local mock, not a claim about model latency or statistical significance.

Ratio (AISIX (api7) ÷ One-API): 0.000295. No statistical significance is asserted.

Comparison JSON · All One-API evidence · All AISIX (api7) evidence

One-API

Build justsong/one-api:v0.6.10. Measured . Run evidence

Ingress → upstreamMetricValueState / reasonp99 bound (ms)
OpenAI → OpenAIAdded latency p50 (µs)34,017Valid · n=102 gateway / 263,027 direct—
OpenAI → OpenAIAdded latency p99 (µs)589,609Valid · n=102 gateway / 263,027 direct—
OpenAI → OpenAIGateway p99 at concurrency 1 (µs)589,637Valid · n=102—
OpenAI → OpenAIDirect-to-mock p99 at concurrency 1 (µs)28Valid · n=263,027—
OpenAI → OpenAICPU per request (µs)—Not measured—
OpenAI → OpenAIRequests per CPU-second—Not measured—
OpenAI → OpenAICost window concurrency—Not measured—
OpenAI → OpenAICost window core utilisation—Not measured—
OpenAI → OpenAICost window successful requests—Not measured—
OpenAI → OpenAICost window throughput (req/s)—Not measured—
OpenAI → OpenAICost window threads—Not measured—
OpenAI → OpenAINon-voluntary context switches per request—Not measured—
OpenAI → OpenAICost window major page faults—Not measured—
OpenAI → OpenAIAdded time to first event p50 (µs)728Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded time to first event p99 (µs)770Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded inter-frame gap p50 (µs)12Valid · n=63 gateway / 63 direct—
OpenAI → OpenAIAdded inter-frame gap p99 (µs)27Valid · n=63 gateway / 63 direct—
OpenAI → OpenAIStreams sustained (frames/s)7,497.8Valid—
OpenAI → OpenAIStreams sustained213Valid—
OpenAI → OpenAIIdle RSS (MiB)87.16Valid—
OpenAI → OpenAISteady-state RSS (MiB)141.9Valid—
OpenAI → OpenAIRecovered RSS (MiB)136.6Valid—
OpenAI → OpenAIPeak RSS (MiB)142.5Valid—
OpenAI → OpenAIPeak RSS high-water mark (MiB)142.5Valid—
OpenAI → OpenAITime to plateau (s)134Valid—
OpenAI → OpenAIMemory growth (MiB/min)0.116Valid—
OpenAI → OpenAIMemory load duration (s)300Valid—
OpenAI → OpenAIMemory shape under load—Not measured—
OpenAI → OpenAIIdle memory shape—Not measured—
OpenAI → OpenAIIdle memory static1Valid—
OpenAI → OpenAIIdle memory growth (MiB/min)-0.115Valid—
OpenAI → OpenAIThroughput (req/s)—Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 1ms, so this gateway carried no measurable throughput under that bound1 ms
OpenAI → OpenAIThroughput (req/s)—Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 5ms, so this gateway carried no measurable throughput under that bound5 ms
OpenAI → OpenAIThroughput (req/s)—Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 10ms, so this gateway carried no measurable throughput under that bound10 ms
OpenAI → OpenAIThroughput (req/s)32concurrency 1; n=19650 ms
OpenAI → OpenAIThroughput (req/s)32concurrency 1; n=196100 ms
OpenAI → OpenAIThroughput (req/s)38concurrency 16; n=229Unbounded

AISIX (api7)

Build ghcr.io/api7/aisix:1.9.0. Measured . Run evidence

Ingress → upstreamMetricValueState / reasonp99 bound (ms)
OpenAI → OpenAIAdded latency p50 (µs)146Valid · n=35,048 gateway / 262,627 direct—
OpenAI → OpenAIAdded latency p99 (µs)174Valid · n=35,048 gateway / 262,627 direct—
OpenAI → OpenAIGateway p99 at concurrency 1 (µs)202Valid · n=35,048—
OpenAI → OpenAIDirect-to-mock p99 at concurrency 1 (µs)28Valid · n=262,627—
OpenAI → OpenAICPU per request (µs)152.6Valid—
OpenAI → OpenAIRequests per CPU-second6,551.3Valid—
OpenAI → OpenAICost window concurrency8Valid—
OpenAI → OpenAICost window core utilisation0.945Valid—
OpenAI → OpenAICost window successful requests148,977Valid—
OpenAI → OpenAICost window throughput (req/s)24,826Valid—
OpenAI → OpenAICost window threads16Valid—
OpenAI → OpenAINon-voluntary context switches per request0Valid—
OpenAI → OpenAICost window major page faults0Valid—
OpenAI → OpenAIAdded time to first event p50 (µs)277Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded time to first event p99 (µs)366Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded inter-frame gap p50 (µs)2Valid · n=63 gateway / 63 direct—
OpenAI → OpenAIAdded inter-frame gap p99 (µs)—Below resolution · n=63 gateway / 63 direct—
OpenAI → OpenAIStreams sustained (frames/s)30,259.2Valid—
OpenAI → OpenAIStreams sustained645Valid—
OpenAI → OpenAIIdle RSS (MiB)34.29Valid—
OpenAI → OpenAISteady-state RSS (MiB)68.63Valid—
OpenAI → OpenAIRecovered RSS (MiB)52.3Valid—
OpenAI → OpenAIPeak RSS (MiB)70.43Valid—
OpenAI → OpenAIPeak RSS high-water mark (MiB)70.29Valid—
OpenAI → OpenAITime to plateau (s)—Not measured—
OpenAI → OpenAIMemory growth (MiB/min)0.376Valid—
OpenAI → OpenAIMemory load duration (s)300Valid—
OpenAI → OpenAIMemory shape under load0Valid—
OpenAI → OpenAIIdle memory shape-1Valid—
OpenAI → OpenAIIdle memory static0Valid—
OpenAI → OpenAIIdle memory growth (MiB/min)-0.853Valid—
OpenAI → OpenAIThroughput (req/s)28,888concurrency 16; n=173,3461 ms
OpenAI → OpenAIThroughput (req/s)31,374concurrency 64; n=188,2545 ms
OpenAI → OpenAIThroughput (req/s)32,092concurrency 128; n=192,58310 ms
OpenAI → OpenAIThroughput (req/s)32,092concurrency 128; n=192,58350 ms
OpenAI → OpenAIThroughput (req/s)32,092concurrency 128; n=192,583100 ms
OpenAI → OpenAIThroughput (req/s)32,092concurrency 128; n=192,583Unbounded