# apisix vs kong

Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency.  [Methodology and limitations](https://onthebench.ai/gateways/method) .

Requested cell: openai → openai. Metric: added_latency_p99_us.

Comparability: comparable. Ratios require an identical protocol pair, hardware, architecture, metric definition, clean harness commit, recorded mock digest, and metric-specific workload. Missing evidence never matches missing evidence. These are observed gateway measurements against a local mock, not a claim about model latency or statistical significance.

- Load-generator binary digests were not recorded; instrument equivalence is based on the identical clean harness source commit and mock digest.
- Measurements were made at different times on independently provisioned machines.

Ratio (B ÷ A): 1.2058823529411764. No statistical significance is asserted.

[Comparison JSON](https://onthebench.ai/api/v1/compare?a=apisix&b=kong&ingress=openai&egress=openai&metric=added_latency_p99_us)  ·  [All APISIX evidence](https://onthebench.ai/gateways/apisix)  ·  [All Kong evidence](https://onthebench.ai/gateways/kong)

## apisix

Build apache/apisix:3.19.0-debian@sha256:7401ce7cfd56de1b9dcecfe7d7c7e5a681bc29222767fd28391995a0936eaa38. Measured 2026-11-10T17:39:33Z.  [Run evidence](https://onthebench.ai/gateways/runs/run-apisix-cc145fc7e19bd52b5c47dc4c3db32fb0511f656418b54e198d2b3cf922523d3f)

| Ingress → upstream | Metric | Value | State / reason | p99 bound (ms) |
| --- | --- | --- | --- | --- |
| openai → openai | added_latency_p50_us | 179 | valid; gateway_c1_samples=28247; direct_c1_samples=260315 | — |
| openai → openai | added_latency_p99_us | 340 | valid; gateway_c1_samples=28247; direct_c1_samples=260315 | — |
| openai → openai | gateway_c1_p99_us | 368 | valid; gateway_c1_samples=28247 | — |
| openai → openai | direct_c1_p99_us | 28 | valid; direct_c1_samples=260315 | — |
| openai → openai | cpu_us_per_request | 185.658855916589 | valid | — |
| openai → openai | rps_per_cpu_second | 5386.223000583772 | valid | — |
| openai → openai | cost_window_conc | 8 | valid | — |
| openai → openai | cost_core_utilisation | 0.7114382453326605 | valid | — |
| openai → openai | cost_window_ok | 92266 | valid | — |
| openai → openai | cost_window_rps | 15375 | valid | — |
| openai → openai | cost_threads | 12 | valid | — |
| openai → openai | cost_nonvol_ctxt_per_request | 0.00045520560119654044 | valid | — |
| openai → openai | cost_majflt | 0 | valid | — |
| openai → openai | added_ttft_p50_us | 10584 | valid; ttft_gw_samples=100; ttft_direct_samples=100 | — |
| openai → openai | added_ttft_p99_us | 11228 | valid; ttft_gw_samples=100; ttft_direct_samples=100 | — |
| openai → openai | added_gap_p50_us | below_resolution | below_resolution; gap_gw_samples=63; gap_direct_samples=63 | — |
| openai → openai | added_gap_p99_us | 8877 | valid; gap_gw_samples=63; gap_direct_samples=63 | — |
| openai → openai | streams_sustained_fps | 63882.44005721134 | valid | — |
| openai → openai | streams_sustained | 1470 | valid | — |
| openai → openai | idle_rss_mib | 191.2109375 | valid | — |
| openai → openai | steady_state_rss_mib | 228.22265625 | valid | — |
| openai → openai | recovered_rss_mib | 228.3515625 | valid | — |
| openai → openai | peak_rss_mib | 228.44140625 | valid | — |
| openai → openai | peak_rss_hwm_mib | 233.2109375 | valid | — |
| openai → openai | time_to_plateau_s | 66 | valid | — |
| openai → openai | growth_rate_mib_per_min | 0.050196090921940856 | valid | — |
| openai → openai | load_s | 300 | valid | — |
| openai → openai | shape | not_measured | not_measured | — |
| openai → openai | idle_shape | 0 | valid | — |
| openai → openai | idle_static | 0 | valid | — |
| openai → openai | idle_growth_rate_mib_per_min | -0.46382647366702207 | valid | — |
| openai → openai | throughput_rps | 12187 req/s | concurrency 4; samples 73136 | 1 |
| openai → openai | throughput_rps | 23089 req/s | concurrency 32; samples 138550 | 5 |
| openai → openai | throughput_rps | 25474 req/s | concurrency 64; samples 152851 | 10 |
| openai → openai | throughput_rps | 26590 req/s | concurrency 256; samples 159560 | 50 |
| openai → openai | throughput_rps | 26590 req/s | concurrency 256; samples 159560 | 100 |
| openai → openai | throughput_rps | 26590 req/s | concurrency 256; samples 159560 | unbounded |

## kong

Build kong:3.9.4@sha256:2d572848be6fc58b73ba75edc84f028837bb7be998b3a8b8117fdb44a6892220. Measured 2026-11-10T17:39:46Z.  [Run evidence](https://onthebench.ai/gateways/runs/run-kong-d4b6d413ea59fd281dacf70be5988600ace51a15e8665c6c7dedcc87dd2cd2fb)

| Ingress → upstream | Metric | Value | State / reason | p99 bound (ms) |
| --- | --- | --- | --- | --- |
| openai → openai | added_latency_p50_us | 213 | valid; gateway_c1_samples=23861; direct_c1_samples=246038 | — |
| openai → openai | added_latency_p99_us | 410 | valid; gateway_c1_samples=23861; direct_c1_samples=246038 | — |
| openai → openai | gateway_c1_p99_us | 440 | valid; gateway_c1_samples=23861 | — |
| openai → openai | direct_c1_p99_us | 30 | valid; direct_c1_samples=246038 | — |
| openai → openai | cpu_us_per_request | 220.6875669632459 | valid | — |
| openai → openai | rps_per_cpu_second | 4531.292875989446 | valid | — |
| openai → openai | cost_window_conc | 8 | valid | — |
| openai → openai | cost_core_utilisation | 0.787179337229732 | valid | — |
| openai → openai | cost_window_ok | 85868 | valid | — |
| openai → openai | cost_window_rps | 14309 | valid | — |
| openai → openai | cost_threads | 5 | valid | — |
| openai → openai | cost_nonvol_ctxt_per_request | 0.000733684259561187 | valid | — |
| openai → openai | cost_majflt | 0 | valid | — |
| openai → openai | added_ttft_p50_us | 106009 | valid; ttft_gw_samples=100; ttft_direct_samples=100 | — |
| openai → openai | added_ttft_p99_us | 106433 | valid; ttft_gw_samples=100; ttft_direct_samples=100 | — |
| openai → openai | added_gap_p50_us | below_resolution | below_resolution; gap_gw_samples=63; gap_direct_samples=63 | — |
| openai → openai | added_gap_p99_us | 168648 | valid; gap_gw_samples=63; gap_direct_samples=63 | — |
| openai → openai | streams_sustained_fps | 3731.918948013315 | valid | — |
| openai → openai | streams_sustained | 78 | valid | — |
| openai → openai | idle_rss_mib | 406.2109375 | valid | — |
| openai → openai | steady_state_rss_mib | 617.4296875 | valid | — |
| openai → openai | recovered_rss_mib | 617.546875 | valid | — |
| openai → openai | peak_rss_mib | 617.73828125 | valid | — |
| openai → openai | peak_rss_hwm_mib | 618.64453125 | valid | — |
| openai → openai | time_to_plateau_s | 66 | valid | — |
| openai → openai | growth_rate_mib_per_min | 0.10537884976821829 | valid | — |
| openai → openai | load_s | 300 | valid | — |
| openai → openai | shape | not_measured | not_measured | — |
| openai → openai | idle_shape | not_measured | not_measured | — |
| openai → openai | idle_static | 1 | valid | — |
| openai → openai | idle_growth_rate_mib_per_min | 0.240647810533821 | valid | — |
| openai → openai | throughput_rps | 13315 req/s | concurrency 4; samples 79905 | 1 |
| openai → openai | throughput_rps | 19190 req/s | concurrency 8; samples 115157 | 5 |
| openai → openai | throughput_rps | 21287 req/s | concurrency 64; samples 127725 | 10 |
| openai → openai | throughput_rps | 22171 req/s | concurrency 128; samples 133046 | 50 |
| openai → openai | throughput_rps | 22171 req/s | concurrency 128; samples 133046 | 100 |
| openai → openai | throughput_rps | 22171 req/s | concurrency 128; samples 133046 | unbounded |
