Helicone vs Kong

Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency. Methodology and limitations.

Requested cell: OpenAI → OpenAI. Metric: Added latency p99 (µs).

Comparability: Comparable. Ratios require an identical protocol pair, hardware, architecture, metric definition, clean harness commit, recorded mock digest, and metric-specific workload. Missing evidence never matches missing evidence. These are observed gateway measurements against a local mock, not a claim about model latency or statistical significance.

Ratio (Kong ÷ Helicone): 1.5. No statistical significance is asserted.

Comparison JSON · All Helicone evidence · All Kong evidence

Helicone

Build target/release/ai-gateway. Measured . Run evidence

Ingress → upstreamMetricValueState / reasonp99 bound (ms)
OpenAI → OpenAIAdded latency p50 (µs)256Valid · n=21,418 gateway / 260,967 direct—
OpenAI → OpenAIAdded latency p99 (µs)274Valid · n=21,418 gateway / 260,967 direct—
OpenAI → OpenAIGateway p99 at concurrency 1 (µs)302Valid · n=21,418—
OpenAI → OpenAIDirect-to-mock p99 at concurrency 1 (µs)28Valid · n=260,967—
OpenAI → OpenAICPU per request (µs)259.4Valid—
OpenAI → OpenAIRequests per CPU-second3,855.3Valid—
OpenAI → OpenAICost window concurrency8Valid—
OpenAI → OpenAICost window core utilisation0.984Valid—
OpenAI → OpenAICost window successful requests91,294Valid—
OpenAI → OpenAICost window throughput (req/s)15,213Valid—
OpenAI → OpenAICost window threads24Valid—
OpenAI → OpenAINon-voluntary context switches per request0Valid—
OpenAI → OpenAICost window major page faults0Valid—
OpenAI → OpenAIAdded time to first event p50 (µs)399Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded time to first event p99 (µs)493Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded inter-frame gap p50 (µs)0Valid · n=63 gateway / 63 direct—
OpenAI → OpenAIAdded inter-frame gap p99 (µs)—Below resolution · n=63 gateway / 63 direct—
OpenAI → OpenAIStreams sustained (frames/s)21,883.1Valid—
OpenAI → OpenAIStreams sustained463Valid—
OpenAI → OpenAIIdle RSS (MiB)42.97Valid—
OpenAI → OpenAISteady-state RSS (MiB)56.18Valid—
OpenAI → OpenAIRecovered RSS (MiB)53.69Valid—
OpenAI → OpenAIPeak RSS (MiB)56.95Valid—
OpenAI → OpenAIPeak RSS high-water mark (MiB)56.61Valid—
OpenAI → OpenAITime to plateau (s)126Valid—
OpenAI → OpenAIMemory growth (MiB/min)0.5Valid—
OpenAI → OpenAIMemory load duration (s)300Valid—
OpenAI → OpenAIMemory shape under load—Not measured—
OpenAI → OpenAIIdle memory shape—Not measured—
OpenAI → OpenAIIdle memory static1Valid—
OpenAI → OpenAIIdle memory growth (MiB/min)0.124Valid—
OpenAI → OpenAIThroughput (req/s)15,405concurrency 8; n=92,4441 ms
OpenAI → OpenAIThroughput (req/s)16,288concurrency 32; n=97,7415 ms
OpenAI → OpenAIThroughput (req/s)16,376concurrency 64; n=98,26610 ms
OpenAI → OpenAIThroughput (req/s)16,376concurrency 64; n=98,26650 ms
OpenAI → OpenAIThroughput (req/s)16,376concurrency 64; n=98,266100 ms
OpenAI → OpenAIThroughput (req/s)16,376concurrency 64; n=98,266Unbounded

Kong

Build kong:3.9.4. Measured . Run evidence

Ingress → upstreamMetricValueState / reasonp99 bound (ms)
OpenAI → OpenAIAdded latency p50 (µs)213Valid · n=23,861 gateway / 246,038 direct—
OpenAI → OpenAIAdded latency p99 (µs)410Valid · n=23,861 gateway / 246,038 direct—
OpenAI → OpenAIGateway p99 at concurrency 1 (µs)440Valid · n=23,861—
OpenAI → OpenAIDirect-to-mock p99 at concurrency 1 (µs)30Valid · n=246,038—
OpenAI → OpenAICPU per request (µs)220.7Valid—
OpenAI → OpenAIRequests per CPU-second4,531.3Valid—
OpenAI → OpenAICost window concurrency8Valid—
OpenAI → OpenAICost window core utilisation0.787Valid—
OpenAI → OpenAICost window successful requests85,868Valid—
OpenAI → OpenAICost window throughput (req/s)14,309Valid—
OpenAI → OpenAICost window threads5Valid—
OpenAI → OpenAINon-voluntary context switches per request0.000734Valid—
OpenAI → OpenAICost window major page faults0Valid—
OpenAI → OpenAIAdded time to first event p50 (µs)106,009Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded time to first event p99 (µs)106,433Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded inter-frame gap p50 (µs)—Below resolution · n=63 gateway / 63 direct—
OpenAI → OpenAIAdded inter-frame gap p99 (µs)168,648Valid · n=63 gateway / 63 direct—
OpenAI → OpenAIStreams sustained (frames/s)3,731.9Valid—
OpenAI → OpenAIStreams sustained78Valid—
OpenAI → OpenAIIdle RSS (MiB)406.2Valid—
OpenAI → OpenAISteady-state RSS (MiB)617.4Valid—
OpenAI → OpenAIRecovered RSS (MiB)617.5Valid—
OpenAI → OpenAIPeak RSS (MiB)617.7Valid—
OpenAI → OpenAIPeak RSS high-water mark (MiB)618.6Valid—
OpenAI → OpenAITime to plateau (s)66Valid—
OpenAI → OpenAIMemory growth (MiB/min)0.105Valid—
OpenAI → OpenAIMemory load duration (s)300Valid—
OpenAI → OpenAIMemory shape under load—Not measured—
OpenAI → OpenAIIdle memory shape—Not measured—
OpenAI → OpenAIIdle memory static1Valid—
OpenAI → OpenAIIdle memory growth (MiB/min)0.241Valid—
OpenAI → OpenAIThroughput (req/s)13,315concurrency 4; n=79,9051 ms
OpenAI → OpenAIThroughput (req/s)19,190concurrency 8; n=115,1575 ms
OpenAI → OpenAIThroughput (req/s)21,287concurrency 64; n=127,72510 ms
OpenAI → OpenAIThroughput (req/s)22,171concurrency 128; n=133,04650 ms
OpenAI → OpenAIThroughput (req/s)22,171concurrency 128; n=133,046100 ms
OpenAI → OpenAIThroughput (req/s)22,171concurrency 128; n=133,046Unbounded