GoModel vs APISIX

Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency. Methodology and limitations.

Requested cell: OpenAI → OpenAI. Metric: Added latency p99 (µs).

Comparability: Comparable. Ratios require an identical protocol pair, hardware, architecture, metric definition, clean harness commit, recorded mock digest, and metric-specific workload. Missing evidence never matches missing evidence. These are observed gateway measurements against a local mock, not a claim about model latency or statistical significance.

Ratio (APISIX ÷ GoModel): 0.602. No statistical significance is asserted.

Comparison JSON · All GoModel evidence · All APISIX evidence

GoModel

Build enterpilot/gomodel:0.2.3. Measured . Run evidence

Ingress → upstreamMetricValueState / reasonp99 bound (ms)
OpenAI → OpenAIAdded latency p50 (µs)343Valid · n=15,837 gateway / 239,533 direct—
OpenAI → OpenAIAdded latency p99 (µs)565Valid · n=15,837 gateway / 239,533 direct—
OpenAI → OpenAIGateway p99 at concurrency 1 (µs)596Valid · n=15,837—
OpenAI → OpenAIDirect-to-mock p99 at concurrency 1 (µs)31Valid · n=239,533—
OpenAI → OpenAICPU per request (µs)439.2Valid—
OpenAI → OpenAIRequests per CPU-second2,277.1Valid—
OpenAI → OpenAICost window concurrency8Valid—
OpenAI → OpenAICost window core utilisation0.714Valid—
OpenAI → OpenAICost window successful requests39,121Valid—
OpenAI → OpenAICost window throughput (req/s)6,519Valid—
OpenAI → OpenAICost window threads14Valid—
OpenAI → OpenAINon-voluntary context switches per request0Valid—
OpenAI → OpenAICost window major page faults0Valid—
OpenAI → OpenAIAdded time to first event p50 (µs)479Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded time to first event p99 (µs)601Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded inter-frame gap p50 (µs)—Below resolution · n=63 gateway / 63 direct—
OpenAI → OpenAIAdded inter-frame gap p99 (µs)26Valid · n=63 gateway / 63 direct—
OpenAI → OpenAIStreams sustained (frames/s)50,390.1Valid—
OpenAI → OpenAIStreams sustained1,208Valid—
OpenAI → OpenAIIdle RSS (MiB)53Valid—
OpenAI → OpenAISteady-state RSS (MiB)87.26Valid—
OpenAI → OpenAIRecovered RSS (MiB)90.46Valid—
OpenAI → OpenAIPeak RSS (MiB)90.51Valid—
OpenAI → OpenAIPeak RSS high-water mark (MiB)89.02Valid—
OpenAI → OpenAITime to plateau (s)—Not measured—
OpenAI → OpenAIMemory growth (MiB/min)-0.338Valid—
OpenAI → OpenAIMemory load duration (s)300Valid—
OpenAI → OpenAIMemory shape under load0Valid—
OpenAI → OpenAIIdle memory shape—Not measured—
OpenAI → OpenAIIdle memory static1Valid—
OpenAI → OpenAIIdle memory growth (MiB/min)0.411Valid—
OpenAI → OpenAIThroughput (req/s)4,555concurrency 2; n=27,3351 ms
OpenAI → OpenAIThroughput (req/s)6,685concurrency 8; n=40,1175 ms
OpenAI → OpenAIThroughput (req/s)6,862concurrency 16; n=41,18010 ms
OpenAI → OpenAIThroughput (req/s)7,415concurrency 64; n=44,49650 ms
OpenAI → OpenAIThroughput (req/s)7,475concurrency 128; n=44,859100 ms
OpenAI → OpenAIThroughput (req/s)7,475concurrency 128; n=44,859Unbounded

APISIX

Build apache/apisix:3.19.0-debian. Measured . Run evidence

Ingress → upstreamMetricValueState / reasonp99 bound (ms)
OpenAI → OpenAIAdded latency p50 (µs)179Valid · n=28,247 gateway / 260,315 direct—
OpenAI → OpenAIAdded latency p99 (µs)340Valid · n=28,247 gateway / 260,315 direct—
OpenAI → OpenAIGateway p99 at concurrency 1 (µs)368Valid · n=28,247—
OpenAI → OpenAIDirect-to-mock p99 at concurrency 1 (µs)28Valid · n=260,315—
OpenAI → OpenAICPU per request (µs)185.7Valid—
OpenAI → OpenAIRequests per CPU-second5,386.2Valid—
OpenAI → OpenAICost window concurrency8Valid—
OpenAI → OpenAICost window core utilisation0.711Valid—
OpenAI → OpenAICost window successful requests92,266Valid—
OpenAI → OpenAICost window throughput (req/s)15,375Valid—
OpenAI → OpenAICost window threads12Valid—
OpenAI → OpenAINon-voluntary context switches per request0.000455Valid—
OpenAI → OpenAICost window major page faults0Valid—
OpenAI → OpenAIAdded time to first event p50 (µs)10,584Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded time to first event p99 (µs)11,228Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded inter-frame gap p50 (µs)—Below resolution · n=63 gateway / 63 direct—
OpenAI → OpenAIAdded inter-frame gap p99 (µs)8,877Valid · n=63 gateway / 63 direct—
OpenAI → OpenAIStreams sustained (frames/s)63,882.4Valid—
OpenAI → OpenAIStreams sustained1,470Valid—
OpenAI → OpenAIIdle RSS (MiB)191.2Valid—
OpenAI → OpenAISteady-state RSS (MiB)228.2Valid—
OpenAI → OpenAIRecovered RSS (MiB)228.4Valid—
OpenAI → OpenAIPeak RSS (MiB)228.4Valid—
OpenAI → OpenAIPeak RSS high-water mark (MiB)233.2Valid—
OpenAI → OpenAITime to plateau (s)66Valid—
OpenAI → OpenAIMemory growth (MiB/min)0.05Valid—
OpenAI → OpenAIMemory load duration (s)300Valid—
OpenAI → OpenAIMemory shape under load—Not measured—
OpenAI → OpenAIIdle memory shape0Valid—
OpenAI → OpenAIIdle memory static0Valid—
OpenAI → OpenAIIdle memory growth (MiB/min)-0.464Valid—
OpenAI → OpenAIThroughput (req/s)12,187concurrency 4; n=73,1361 ms
OpenAI → OpenAIThroughput (req/s)23,089concurrency 32; n=138,5505 ms
OpenAI → OpenAIThroughput (req/s)25,474concurrency 64; n=152,85110 ms
OpenAI → OpenAIThroughput (req/s)26,590concurrency 256; n=159,56050 ms
OpenAI → OpenAIThroughput (req/s)26,590concurrency 256; n=159,560100 ms
OpenAI → OpenAIThroughput (req/s)26,590concurrency 256; n=159,560Unbounded