Bifrost vs GoModel
Operated by the Busbar team; Busbar is also an entrant. Gateway overhead against a local mock is not end-to-end model latency. Methodology and limitations.
Requested cell: OpenAI → OpenAI. Metric: Added latency p99 (µs).
Comparability: Comparable. Ratios require an identical protocol pair, hardware, architecture, metric definition, clean harness commit, recorded mock digest, and metric-specific workload. Missing evidence never matches missing evidence. These are observed gateway measurements against a local mock, not a claim about model latency or statistical significance.
- Load-generator binary digests were not recorded; instrument equivalence is based on the identical clean harness source commit and mock digest.
- Measurements were made at different times on independently provisioned machines.
Ratio (GoModel ÷ Bifrost): 0.535. No statistical significance is asserted.
Comparison JSON · All Bifrost evidence · All GoModel evidence
Bifrost
Build maximhq/bifrost:v2.5.0. Measured . Run evidence
| Ingress → upstream | Metric | Value | State / reason | p99 bound (ms) |
|---|---|---|---|---|
| OpenAI → OpenAI | Added latency p50 (µs) | 658 | Valid · n=8,543 gateway / 269,310 direct | — |
| OpenAI → OpenAI | Added latency p99 (µs) | 1,057 | Valid · n=8,543 gateway / 269,310 direct | — |
| OpenAI → OpenAI | Gateway p99 at concurrency 1 (µs) | 1,084 | Valid · n=8,543 | — |
| OpenAI → OpenAI | Direct-to-mock p99 at concurrency 1 (µs) | 27 | Valid · n=269,310 | — |
| OpenAI → OpenAI | CPU per request (µs) | 865.1 | Valid | — |
| OpenAI → OpenAI | Requests per CPU-second | 1,155.9 | Valid | — |
| OpenAI → OpenAI | Cost window concurrency | 8 | Valid | — |
| OpenAI → OpenAI | Cost window core utilisation | 0.991 | Valid | — |
| OpenAI → OpenAI | Cost window successful requests | 27,580 | Valid | — |
| OpenAI → OpenAI | Cost window throughput (req/s) | 4,595 | Valid | — |
| OpenAI → OpenAI | Cost window threads | 13 | Valid | — |
| OpenAI → OpenAI | Non-voluntary context switches per request | 0.027 | Valid | — |
| OpenAI → OpenAI | Cost window major page faults | 0 | Valid | — |
| OpenAI → OpenAI | Added time to first event p50 (µs) | 932 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added time to first event p99 (µs) | 1,417 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p50 (µs) | 3 | Valid · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p99 (µs) | — | Below resolution · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Streams sustained (frames/s) | 25,840.9 | Valid | — |
| OpenAI → OpenAI | Streams sustained | 580 | Valid | — |
| OpenAI → OpenAI | Idle RSS (MiB) | 160.3 | Valid | — |
| OpenAI → OpenAI | Steady-state RSS (MiB) | 1,049.5 | Valid | — |
| OpenAI → OpenAI | Recovered RSS (MiB) | 1,256.6 | Valid | — |
| OpenAI → OpenAI | Peak RSS (MiB) | 1,257 | Valid | — |
| OpenAI → OpenAI | Peak RSS high-water mark (MiB) | 1,137.4 | Valid | — |
| OpenAI → OpenAI | Time to plateau (s) | — | Not measured | — |
| OpenAI → OpenAI | Memory growth (MiB/min) | 56.82 | Valid | — |
| OpenAI → OpenAI | Memory load duration (s) | 300 | Valid | — |
| OpenAI → OpenAI | Memory shape under load | 1 | Valid | — |
| OpenAI → OpenAI | Idle memory shape | — | Not measured | — |
| OpenAI → OpenAI | Idle memory static | 1 | Valid | — |
| OpenAI → OpenAI | Idle memory growth (MiB/min) | 0.48 | Valid | — |
| OpenAI → OpenAI | Throughput (req/s) | — | Bound not met; concurrency not recorded: every cleanly-served rung that reported a tail had it at or above 1ms, so this gateway carried no measurable throughput under that bound | 1 ms |
| OpenAI → OpenAI | Throughput (req/s) | 4,346 | concurrency 4; n=26,081 | 5 ms |
| OpenAI → OpenAI | Throughput (req/s) | 4,555 | concurrency 8; n=27,340 | 10 ms |
| OpenAI → OpenAI | Throughput (req/s) | 4,624 | concurrency 16; n=27,748 | 50 ms |
| OpenAI → OpenAI | Throughput (req/s) | 4,624 | concurrency 16; n=27,748 | 100 ms |
| OpenAI → OpenAI | Throughput (req/s) | 4,624 | concurrency 16; n=27,748 | Unbounded |
GoModel
Build enterpilot/gomodel:0.2.3. Measured . Run evidence
| Ingress → upstream | Metric | Value | State / reason | p99 bound (ms) |
|---|---|---|---|---|
| OpenAI → OpenAI | Added latency p50 (µs) | 343 | Valid · n=15,837 gateway / 239,533 direct | — |
| OpenAI → OpenAI | Added latency p99 (µs) | 565 | Valid · n=15,837 gateway / 239,533 direct | — |
| OpenAI → OpenAI | Gateway p99 at concurrency 1 (µs) | 596 | Valid · n=15,837 | — |
| OpenAI → OpenAI | Direct-to-mock p99 at concurrency 1 (µs) | 31 | Valid · n=239,533 | — |
| OpenAI → OpenAI | CPU per request (µs) | 439.2 | Valid | — |
| OpenAI → OpenAI | Requests per CPU-second | 2,277.1 | Valid | — |
| OpenAI → OpenAI | Cost window concurrency | 8 | Valid | — |
| OpenAI → OpenAI | Cost window core utilisation | 0.714 | Valid | — |
| OpenAI → OpenAI | Cost window successful requests | 39,121 | Valid | — |
| OpenAI → OpenAI | Cost window throughput (req/s) | 6,519 | Valid | — |
| OpenAI → OpenAI | Cost window threads | 14 | Valid | — |
| OpenAI → OpenAI | Non-voluntary context switches per request | 0 | Valid | — |
| OpenAI → OpenAI | Cost window major page faults | 0 | Valid | — |
| OpenAI → OpenAI | Added time to first event p50 (µs) | 479 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added time to first event p99 (µs) | 601 | Valid · n=100 gateway / 100 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p50 (µs) | — | Below resolution · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Added inter-frame gap p99 (µs) | 26 | Valid · n=63 gateway / 63 direct | — |
| OpenAI → OpenAI | Streams sustained (frames/s) | 50,390.1 | Valid | — |
| OpenAI → OpenAI | Streams sustained | 1,208 | Valid | — |
| OpenAI → OpenAI | Idle RSS (MiB) | 53 | Valid | — |
| OpenAI → OpenAI | Steady-state RSS (MiB) | 87.26 | Valid | — |
| OpenAI → OpenAI | Recovered RSS (MiB) | 90.46 | Valid | — |
| OpenAI → OpenAI | Peak RSS (MiB) | 90.51 | Valid | — |
| OpenAI → OpenAI | Peak RSS high-water mark (MiB) | 89.02 | Valid | — |
| OpenAI → OpenAI | Time to plateau (s) | — | Not measured | — |
| OpenAI → OpenAI | Memory growth (MiB/min) | -0.338 | Valid | — |
| OpenAI → OpenAI | Memory load duration (s) | 300 | Valid | — |
| OpenAI → OpenAI | Memory shape under load | 0 | Valid | — |
| OpenAI → OpenAI | Idle memory shape | — | Not measured | — |
| OpenAI → OpenAI | Idle memory static | 1 | Valid | — |
| OpenAI → OpenAI | Idle memory growth (MiB/min) | 0.411 | Valid | — |
| OpenAI → OpenAI | Throughput (req/s) | 4,555 | concurrency 2; n=27,335 | 1 ms |
| OpenAI → OpenAI | Throughput (req/s) | 6,685 | concurrency 8; n=40,117 | 5 ms |
| OpenAI → OpenAI | Throughput (req/s) | 6,862 | concurrency 16; n=41,180 | 10 ms |
| OpenAI → OpenAI | Throughput (req/s) | 7,415 | concurrency 64; n=44,496 | 50 ms |
| OpenAI → OpenAI | Throughput (req/s) | 7,475 | concurrency 128; n=44,859 | 100 ms |
| OpenAI → OpenAI | Throughput (req/s) | 7,475 | concurrency 128; n=44,859 | Unbounded |