TensorZero history

Aug 2026 → Nov 2026

openai → openai cell. The engine changed between these runs (f3adbb1 → d240bad), so differences can include instrument changes, not only gateway changes. Changes within ±5% show as roughly unchanged (—); this is a display tolerance, not a statistical margin.

ReadingAug 2026Nov 2026ChangeRank Aug 2026 → Nov 2026
Added latency p50 (µs)40,974 µs40,976 µs— +0.0%13 of 14 → 14 of 15
Added latency p99 (µs)40,993 µs41,966 µs— +2.4%12 of 14 → 13 of 15
Throughput, p99 unbounded (req/s)14,265 req/s12,324 req/s↓ -13.6%1 of 1 → 1 of 1
CPU per request (µs)396.7459.1↓ +15.7%8 of 14 → 9 of 14
Idle RSS (MiB)48.73 MiB48.75 MiB— +0.0%— → —
Peak RSS (MiB)69.88 MiB67.62 MiB— -3.2%— → —

Runs

2 published runs · Added latency p99 (µs), openai → openai · values describe the recorded local-mock configuration; a missing reading is never zero. Hover a trend for its comparability details.

Added latency p99 (µs), openai → openai
MeasuredBuildEngineResultTrendField placementEvidence
tensorzero/gateway:2026.6.0d240bad41,966 µsEngine changed13 of 15 Current fieldRun evidence
tensorzero/gateway:2026.6.0f3adbb140,993 µsFirst run12 of 14 Aug 2026 fieldRun evidence
Compare two runs across every recorded metric

History JSON · All gateways