LiteLLM · Rust history

Aug 2026 → Nov 2026

openai → openai cell. The engine changed between these runs (f3adbb1 → d240bad), so differences can include instrument changes, not only gateway changes. Changes within ±5% show as roughly unchanged (—); this is a display tolerance, not a statistical margin.

ReadingAug 2026Nov 2026ChangeRank Aug 2026 → Nov 2026
Added latency p50 (µs)n/a249 µs·— → 6 of 15
Added latency p99 (µs)n/a279 µs·— → 5 of 15
Throughput, p99 ≤ 1 ms (req/s)n/a8,404 req/s·— → 3 of 3
Throughput, p99 ≤ 5 ms (req/s)n/a10,049 req/s·— → 1 of 1
Throughput, p99 ≤ 10 ms (req/s)n/a10,049 req/s·— → 1 of 2
Throughput, p99 unbounded (req/s)n/a10,049 req/s·— → 1 of 3
CPU per request (µs)n/a272.6·— → 7 of 14
Idle RSS (MiB)n/a12.74 MiB·— → —
Peak RSS (MiB)n/a19.88 MiB·— → —

Runs

2 published runs · Added latency p99 (µs), openai → openai · values describe the recorded local-mock configuration; a missing reading is never zero. Hover a trend for its comparability details.

Added latency p99 (µs), openai → openai
MeasuredBuildEngineResultTrendField placementEvidence
src/litellm-rust/target/release/litellm-gatewayd240bad279 µsEngine changed5 of 15 Current fieldRun evidence
litellm-ai-gatewayf3adbb1Not measuredFirst runNot rankedRun evidence
Compare two runs across every recorded metric

History JSON · All gateways