# LiteLLM · Python history

[Overview](https://onthebench.ai/gateways/litellm-python)  · History ·  [Evidence](https://onthebench.ai/gateways/litellm-python/evidence)

 

## Aug 2026 → Nov 2026

openai → openai cell. The engine changed between these runs (`f3adbb1` → `d240bad`), so differences can include instrument changes, not only gateway changes. Changes within ±5% show as roughly unchanged (—); this is a display tolerance, not a statistical margin.

| Reading | Aug 2026 | Nov 2026 | Change | Rank Aug 2026 → Nov 2026 |
| --- | --- | --- | --- | --- |
| Added latency p50 (µs) | 6453 µs | 8512 µs | ↓ +31.9% | 11 of 14 → 12 of 15 |
| Added latency p99 (µs) | 8143 µs | 9522 µs | ↓ +16.9% | 11 of 14 → 12 of 15 |
| Throughput, p99 ≤ 10 ms (req/s) | 163 req/s | 117 req/s | ↓ -28.2% | 1 of 1 → 1 of 1 |
| Throughput, p99 unbounded (req/s) | 192 req/s | 119 req/s | ↓ -38.0% | 2 of 2 → 1 of 1 |
| CPU per request (µs) | 6414.893617021276 | 8644.793152639088 | ↓ +34.8% | 12 of 14 → 13 of 14 |
| Idle RSS (MiB) | 744.8125 MiB | 592.95703125 MiB | ↑ -20.4% | — → — |
| Peak RSS (MiB) | 778.91015625 MiB | 628.60546875 MiB | ↑ -19.3% | — → — |

 

## Runs

 Ingress Upstream Metric Throughput p99 bound From Through  

2 published runs · Added latency p99 (µs), openai → openai · values describe the recorded local-mock configuration; a missing reading is never zero. Hover a trend for its comparability details.

 

Added latency p99 (µs), openai → openai
| Measured | Build | Engine | Result | Trend | Field placement | Evidence |
| --- | --- | --- | --- | --- | --- | --- |
| 2026-11-10T17:39:41Z | ghcr.io/berriai/litellm:v1.108.3@sha256:e2bce769eb29b100d53ce90cbf2d6bba00dce82cb894c79d092ef6377523d7e5 | `d240bad` | 9522 µs | Engine changed | [12 of 15](https://onthebench.ai/api/v1/fields/field-544fbe116ba2d3a1f676e7d39cc52eed86664dad81ce8ca9f6984eb28ee7149b)  Current field | [Run evidence](https://onthebench.ai/gateways/runs/run-litellm-python-10bb57507b26d310b59f12956034785b615cd5338cdaf5cee0e587c350c53acf) |
| 2026-08-26T19:08:49Z | ghcr.io/berriai/litellm:v1.98.0 | `f3adbb1` | 8143 µs | First recorded run | [11 of 14](https://onthebench.ai/api/v1/fields/field-c8ed0c69830337d53ff6949a46780289eff55065dc0549a8463298922364e536)  Aug 2026 field | [Run evidence](https://onthebench.ai/gateways/runs/run-litellm-python-f479bedd357f332ad66a2fb412beb3c3ab9dc6e00dcf7c41a019f156c375db90) |

 

Compare two runs across every recorded metric

Earlier run Later run

 

[History JSON](https://onthebench.ai/api/v1/history?family=litellm-python)  ·  [All gateways](https://onthebench.ai/gateways/runs)
