# LiteLLM · Rust history

[Overview](https://onthebench.ai/gateways/litellm-rust)  · History ·  [Evidence](https://onthebench.ai/gateways/litellm-rust/evidence)

 

## Aug 2026 → Nov 2026

openai → openai cell. The engine changed between these runs (`f3adbb1` → `d240bad`), so differences can include instrument changes, not only gateway changes. Changes within ±5% show as roughly unchanged (—); this is a display tolerance, not a statistical margin.

| Reading | Aug 2026 | Nov 2026 | Change | Rank Aug 2026 → Nov 2026 |
| --- | --- | --- | --- | --- |
| Added latency p50 (µs) | n/a | 249 µs | · | — → 6 of 15 |
| Added latency p99 (µs) | n/a | 279 µs | · | — → 5 of 15 |
| Throughput, p99 ≤ 1 ms (req/s) | n/a | 8404 req/s | · | — → 3 of 3 |
| Throughput, p99 ≤ 5 ms (req/s) | n/a | 10049 req/s | · | — → 1 of 1 |
| Throughput, p99 ≤ 10 ms (req/s) | n/a | 10049 req/s | · | — → 1 of 2 |
| Throughput, p99 unbounded (req/s) | n/a | 10049 req/s | · | — → 1 of 3 |
| CPU per request (µs) | n/a | 272.6013913681787 | · | — → 7 of 14 |
| Idle RSS (MiB) | n/a | 12.73828125 MiB | · | — → — |
| Peak RSS (MiB) | n/a | 19.875 MiB | · | — → — |

 

## Runs

 Ingress Upstream Metric Throughput p99 bound From Through  

2 published runs · Added latency p99 (µs), openai → openai · values describe the recorded local-mock configuration; a missing reading is never zero. Hover a trend for its comparability details.

 

Added latency p99 (µs), openai → openai
| Measured | Build | Engine | Result | Trend | Field placement | Evidence |
| --- | --- | --- | --- | --- | --- | --- |
| 2026-11-10T17:39:51Z | src/litellm-rust/target/release/litellm-gateway | `d240bad` | 279 µs | Engine changed | [5 of 15](https://onthebench.ai/api/v1/fields/field-544fbe116ba2d3a1f676e7d39cc52eed86664dad81ce8ca9f6984eb28ee7149b)  Current field | [Run evidence](https://onthebench.ai/gateways/runs/run-litellm-rust-69d8e6ed325740d9da7f0aaf31b815418c4801eb6549b2e2c68f768a92af3ad4) |
| 2026-08-03T21:30:01Z | litellm-ai-gateway | `f3adbb1` | not measured | First recorded run | Not ranked | [Run evidence](https://onthebench.ai/gateways/runs/run-litellm-rust-50a1b780253a9655d548618bbcdd0969dd22b4f1a867714256048d1d68820eb9) |

 

Compare two runs across every recorded metric

Earlier run Later run

 

[History JSON](https://onthebench.ai/api/v1/history?family=litellm-rust)  ·  [All gateways](https://onthebench.ai/gateways/runs)
