Benchmark Overview
55.80
0.00
2
Jun 8, 2026, 07:33 PM
Key Insights
phi-4 streams at 55.80 tokens/second on average across the last 2 benchmark runs.
Performance fluctuated by 5.40 tokens/second (9.7% coefficient of variation), indicating consistent behavior across benchmark runs.
Latest measurements completed on Jun 8, 2026, 07:33 PM based on 2 total samples.
Performance Distribution
Distribution of throughput measurements showing performance consistency across benchmark runs.
Performance Over Time
Historical performance trends showing how throughput has changed over the benchmarking period.
phi-4
Benchmark Samples
| Provider | Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|---|
| deepinfra | phi-4 | 55.80 | 53.10 | 58.50 | 0.00 |
Frequently Asked Questions
The latest rolling average throughput is 55.80 tokens per second with an average time to first token of 0.00 ms across 2 recent runs.
Benchmarks refresh automatically whenever the monitoring cron runs. The most recent run completed on Jun 8, 2026, 07:33 PM.