LiteLLM · Python history

Aug 2026 → Nov 2026

openai → openai cell. The engine changed between these runs (f3adbb1 → d240bad), so differences can include instrument changes, not only gateway changes. Changes within ±5% show as roughly unchanged (—); this is a display tolerance, not a statistical margin.

ReadingAug 2026Nov 2026ChangeRank Aug 2026 → Nov 2026
Added latency p50 (µs)6,453 µs8,512 µs↓ +31.9%11 of 14 → 12 of 15
Added latency p99 (µs)8,143 µs9,522 µs↓ +16.9%11 of 14 → 12 of 15
Throughput, p99 ≤ 10 ms (req/s)163 req/s117 req/s↓ -28.2%1 of 1 → 1 of 1
Throughput, p99 unbounded (req/s)192 req/s119 req/s↓ -38.0%2 of 2 → 1 of 1
CPU per request (µs)6,414.98,644.8↓ +34.8%12 of 14 → 13 of 14
Idle RSS (MiB)744.8 MiB593 MiB↑ -20.4%— → —
Peak RSS (MiB)778.9 MiB628.6 MiB↑ -19.3%— → —

Runs

2 published runs · Added latency p99 (µs), openai → openai · values describe the recorded local-mock configuration; a missing reading is never zero. Hover a trend for its comparability details.

Added latency p99 (µs), openai → openai
MeasuredBuildEngineResultTrendField placementEvidence
ghcr.io/berriai/litellm:v1.108.3d240bad9,522 µsEngine changed12 of 15 Current fieldRun evidence
ghcr.io/berriai/litellm:v1.98.0f3adbb18,143 µsFirst run11 of 14 Aug 2026 fieldRun evidence
Compare two runs across every recorded metric

History JSON · All gateways