Measured over the last 30 days
- Models Tracked
- 6
- Avg Tokens / Second
- 195.83
- Avg Time to First Token (ms)
- 0.00
- Last Updated
- Aug 9, 2026
| Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|
| GPT-oss-safeguard-20b | 293.00 | 28.10 | 684.00 | 0.00 |
| llama-3.1-8b | 219.00 | 74.40 | 363.00 | 0.00 |
| Qwen3.6-27B | 218.00 | 11.20 | 326.00 | 0.00 |
| qwen-3-32b | 174.00 | 61.90 | 241.00 | 0.00 |
| llama-3.3-70b | 150.00 | 19.20 | 252.00 | 0.00 |
| llama-4-scout | 121.00 | 19.80 | 198.00 | 0.00 |
Frequently Asked Questions
Which groq model is fastest?
Based on recent tests, GPT-oss-safeguard-20b shows the highest average throughput among tracked groq models.
How many recent measurements feed this dashboard?
This provider summary aggregates 2830 individual prompts measured across 2435 monitoring runs over the past month.