# Helicone history

[Overview](https://onthebench.ai/gateways/helicone)  · History ·  [Evidence](https://onthebench.ai/gateways/helicone/evidence)

 

## Aug 2026 → Nov 2026

openai → openai cell. The engine changed between these runs (`f3adbb1` → `d240bad`), so differences can include instrument changes, not only gateway changes. Changes within ±5% show as roughly unchanged (—); this is a display tolerance, not a statistical margin.

| Reading | Aug 2026 | Nov 2026 | Change | Rank Aug 2026 → Nov 2026 |
| --- | --- | --- | --- | --- |
| Added latency p50 (µs) | 274 µs | 256 µs | ↑ -6.6% | 7 of 14 → 7 of 15 |
| Added latency p99 (µs) | 294 µs | 274 µs | ↑ -6.8% | 5 of 14 → 4 of 15 |
| Throughput, p99 ≤ 1 ms (req/s) | 14073 req/s | 15405 req/s | ↑ +9.5% | 3 of 3 → 2 of 2 |
| Throughput, p99 ≤ 5 ms (req/s) | 14865 req/s | 16288 req/s | ↑ +9.6% | 2 of 2 → 2 of 2 |
| Throughput, p99 ≤ 10 ms (req/s) | 14941 req/s | 16376 req/s | ↑ +9.6% | 5 of 5 → 3 of 3 |
| Throughput, p99 unbounded (req/s) | 14941 req/s | 16376 req/s | ↑ +9.6% | 4 of 5 → 1 of 2 |
| CPU per request (µs) | 276.8166089965398 | 259.381777553837 | ↑ -6.3% | 7 of 14 → 6 of 14 |
| Idle RSS (MiB) | 42.8984375 MiB | 42.97265625 MiB | — +0.2% | — → — |
| Peak RSS (MiB) | 56.6015625 MiB | 56.94921875 MiB | — +0.6% | — → — |

 

## Runs

 Ingress Upstream Metric Throughput p99 bound From Through  

2 published runs · Added latency p99 (µs), openai → openai · values describe the recorded local-mock configuration; a missing reading is never zero. Hover a trend for its comparability details.

 

Added latency p99 (µs), openai → openai
| Measured | Build | Engine | Result | Trend | Field placement | Evidence |
| --- | --- | --- | --- | --- | --- | --- |
| 2026-11-10T17:39:37Z | target/release/ai-gateway | `d240bad` | 274 µs | Engine changed | [4 of 15](https://onthebench.ai/api/v1/fields/field-544fbe116ba2d3a1f676e7d39cc52eed86664dad81ce8ca9f6984eb28ee7149b)  Current field | [Run evidence](https://onthebench.ai/gateways/runs/run-helicone-4a55ff2dcc509c5e03f85bd92e36b949ac410653128ccc77d60019bb3aaf2558) |
| 2026-08-03T21:30:02Z | target/release/ai-gateway | `f3adbb1` | 294 µs | First recorded run | [5 of 14](https://onthebench.ai/api/v1/fields/field-c8ed0c69830337d53ff6949a46780289eff55065dc0549a8463298922364e536)  Aug 2026 field | [Run evidence](https://onthebench.ai/gateways/runs/run-helicone-6ad9b8767fe745f1cf0967cbcfa2719c632a742aa5dc214104cc0affacb51548) |

 

Compare two runs across every recorded metric

Earlier run Later run

 

[History JSON](https://onthebench.ai/api/v1/history?family=helicone)  ·  [All gateways](https://onthebench.ai/gateways/runs)
