Bifrost vs agentgateway

Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency. Methodology and limitations.

Requested cell: OpenAI → OpenAI. Metric: Added latency p99 (µs).

Comparability: Comparable. Ratios require an identical protocol pair, hardware, architecture, metric definition, clean harness commit, recorded mock digest, and metric-specific workload. Missing evidence never matches missing evidence. These are observed gateway measurements against a local mock, not a claim about model latency or statistical significance.

Ratio (agentgateway ÷ Bifrost): 0.237. No statistical significance is asserted.

Comparison JSON · All Bifrost evidence · All agentgateway evidence

Bifrost

Build maximhq/bifrost:v2.5.0. Measured . Run evidence

Ingress → upstreamMetricValueState / reasonp99 bound (ms)
OpenAI → OpenAIAdded latency p50 (µs)658Valid · n=8,543 gateway / 269,310 direct—
OpenAI → OpenAIAdded latency p99 (µs)1,057Valid · n=8,543 gateway / 269,310 direct—
OpenAI → OpenAIGateway p99 at concurrency 1 (µs)1,084Valid · n=8,543—
OpenAI → OpenAIDirect-to-mock p99 at concurrency 1 (µs)27Valid · n=269,310—
OpenAI → OpenAICPU per request (µs)865.1Valid—
OpenAI → OpenAIRequests per CPU-second1,155.9Valid—
OpenAI → OpenAICost window concurrency8Valid—
OpenAI → OpenAICost window core utilisation0.991Valid—
OpenAI → OpenAICost window successful requests27,580Valid—
OpenAI → OpenAICost window throughput (req/s)4,595Valid—
OpenAI → OpenAICost window threads13Valid—
OpenAI → OpenAINon-voluntary context switches per request0.027Valid—
OpenAI → OpenAICost window major page faults0Valid—
OpenAI → OpenAIAdded time to first event p50 (µs)932Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded time to first event p99 (µs)1,417Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded inter-frame gap p50 (µs)3Valid · n=63 gateway / 63 direct—
OpenAI → OpenAIAdded inter-frame gap p99 (µs)—Below resolution · n=63 gateway / 63 direct—
OpenAI → OpenAIStreams sustained (frames/s)25,840.9Valid—
OpenAI → OpenAIStreams sustained580Valid—
OpenAI → OpenAIIdle RSS (MiB)160.3Valid—
OpenAI → OpenAISteady-state RSS (MiB)1,049.5Valid—
OpenAI → OpenAIRecovered RSS (MiB)1,256.6Valid—
OpenAI → OpenAIPeak RSS (MiB)1,257Valid—
OpenAI → OpenAIPeak RSS high-water mark (MiB)1,137.4Valid—
OpenAI → OpenAITime to plateau (s)—Not measured—
OpenAI → OpenAIMemory growth (MiB/min)56.82Valid—
OpenAI → OpenAIMemory load duration (s)300Valid—
OpenAI → OpenAIMemory shape under load1Valid—
OpenAI → OpenAIIdle memory shape—Not measured—
OpenAI → OpenAIIdle memory static1Valid—
OpenAI → OpenAIIdle memory growth (MiB/min)0.48Valid—
OpenAI → OpenAIThroughput (req/s)—Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 1ms, so this gateway carried no measurable throughput under that bound1 ms
OpenAI → OpenAIThroughput (req/s)4,346concurrency 4; n=26,0815 ms
OpenAI → OpenAIThroughput (req/s)4,555concurrency 8; n=27,34010 ms
OpenAI → OpenAIThroughput (req/s)4,624concurrency 16; n=27,74850 ms
OpenAI → OpenAIThroughput (req/s)4,624concurrency 16; n=27,748100 ms
OpenAI → OpenAIThroughput (req/s)4,624concurrency 16; n=27,748Unbounded

agentgateway

Build ghcr.io/agentgateway/agentgateway:v1.7.0. Measured . Run evidence

Ingress → upstreamMetricValueState / reasonp99 bound (ms)
OpenAI → OpenAIAdded latency p50 (µs)216Valid · n=24,618 gateway / 233,879 direct—
OpenAI → OpenAIAdded latency p99 (µs)251Valid · n=24,618 gateway / 233,879 direct—
OpenAI → OpenAIGateway p99 at concurrency 1 (µs)282Valid · n=24,618—
OpenAI → OpenAIDirect-to-mock p99 at concurrency 1 (µs)31Valid · n=233,879—
OpenAI → OpenAICPU per request (µs)188.6Valid—
OpenAI → OpenAIRequests per CPU-second5,302.9Valid—
OpenAI → OpenAICost window concurrency8Valid—
OpenAI → OpenAICost window core utilisation0.972Valid—
OpenAI → OpenAICost window successful requests124,088Valid—
OpenAI → OpenAICost window throughput (req/s)20,679Valid—
OpenAI → OpenAICost window threads13Valid—
OpenAI → OpenAINon-voluntary context switches per request0Valid—
OpenAI → OpenAICost window major page faults0Valid—
OpenAI → OpenAIAdded time to first event p50 (µs)327Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded time to first event p99 (µs)360Valid · n=100 gateway / 100 direct—
OpenAI → OpenAIAdded inter-frame gap p50 (µs)10Valid · n=63 gateway / 63 direct—
OpenAI → OpenAIAdded inter-frame gap p99 (µs)—Below resolution · n=63 gateway / 63 direct—
OpenAI → OpenAIStreams sustained (frames/s)32,614.1Valid—
OpenAI → OpenAIStreams sustained2,048Valid—
OpenAI → OpenAIIdle RSS (MiB)34Valid—
OpenAI → OpenAISteady-state RSS (MiB)53.49Valid—
OpenAI → OpenAIRecovered RSS (MiB)50Valid—
OpenAI → OpenAIPeak RSS (MiB)54.52Valid—
OpenAI → OpenAIPeak RSS high-water mark (MiB)54.23Valid—
OpenAI → OpenAITime to plateau (s)—Not measured—
OpenAI → OpenAIMemory growth (MiB/min)-2.07Valid—
OpenAI → OpenAIMemory load duration (s)300Valid—
OpenAI → OpenAIMemory shape under load-1Valid—
OpenAI → OpenAIIdle memory shape—Not measured—
OpenAI → OpenAIIdle memory static1Valid—
OpenAI → OpenAIIdle memory growth (MiB/min)0.036Valid—
OpenAI → OpenAIThroughput (req/s)21,156concurrency 8; n=126,9521 ms
OpenAI → OpenAIThroughput (req/s)22,239concurrency 64; n=133,4475 ms
OpenAI → OpenAIThroughput (req/s)22,380concurrency 128; n=134,30410 ms
OpenAI → OpenAIThroughput (req/s)22,545concurrency 256; n=135,28350 ms
OpenAI → OpenAIThroughput (req/s)22,545concurrency 256; n=135,283100 ms
OpenAI → OpenAIThroughput (req/s)22,545concurrency 256; n=135,283Unbounded