Benchmark Overview
45.80
210.00
3
Jan 2, 2026, 03:03 AM
Key Insights
devstral-small streams at 45.80 tokens/second on average across the last 3 benchmark runs.
Performance fluctuated by 15.80 tokens/second (34.5% coefficient of variation), indicating variable behavior across benchmark runs.
Average time to first token is 210.00 ms (excellent latency), suitable for latency-sensitive workloads.
Latest measurements completed on Jan 2, 2026, 03:03 AM based on 3 total samples.
Performance Distribution
Distribution of throughput measurements showing performance consistency across benchmark runs.
Performance Over Time
Historical performance trends showing how throughput has changed over the benchmarking period.
devstral-small
Benchmark Samples
| Provider | Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|---|
| deepinfra | devstral-small | 45.80 | 40.40 | 56.20 | 210.00 |
Frequently Asked Questions
The latest rolling average throughput is 45.80 tokens per second with an average time to first token of 210.00 ms across 3 recent runs.
Benchmarks refresh automatically whenever the monitoring cron runs. The most recent run completed on Jan 2, 2026, 03:03 AM.