Benchmark Overview
18.70
0.00
4
Jun 9, 2026, 04:34 AM
Key Insights
gemma-4-31b-it streams at 18.70 tokens/second on average across the last 4 benchmark runs.
Performance fluctuated by 31.79 tokens/second (170.0% coefficient of variation), indicating variable behavior across benchmark runs.
Latest measurements completed on Jun 9, 2026, 04:34 AM based on 4 total samples.
Performance Distribution
Distribution of throughput measurements showing performance consistency across benchmark runs.
Performance Over Time
Historical performance trends showing how throughput has changed over the benchmarking period.
gemma-4-31b-it
Benchmark Samples
| Provider | Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|---|
| together | gemma-4-31b-it | 18.70 | 8.51 | 40.30 | 0.00 |
Frequently Asked Questions
The latest rolling average throughput is 18.70 tokens per second with an average time to first token of 0.00 ms across 4 recent runs.
Benchmarks refresh automatically whenever the monitoring cron runs. The most recent run completed on Jun 9, 2026, 04:34 AM.