Measured over the last 30 days
- Models Tracked
- 6
- Avg Tokens / Second
- 70.77
- Avg Time to First Token (ms)
- 1003.33
- Last Updated
- Oct 16, 2026
All groq models
6 live · one row per model · fastest first · 1 folded behind their current lane| Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|
| Llama 3.1 8B Instruct | 117.00 | 117.00 | 117.00 | 430.00 |
| Llama 3.3 70B Instruct | 81.00 | 30.60 | 111.00 | 610.00 |
| gpt-oss-20b | 69.80 | 35.40 | 93.70 | 940.00 |
| gpt-oss-120b | 69.50 | 48.00 | 90.40 | 810.00 |
| gpt-oss-safeguard-20b | 58.00 | 34.30 | 86.80 | 1110.00 |
| MiniMax M2.7 | 29.30 | 18.90 | 40.90 | 2120.00 |
Frequently Asked Questions
Which groq model is fastest?
Based on recent tests, Llama 3.1 8B Instruct shows the highest average throughput among tracked groq models.
How many recent measurements feed this dashboard?
This provider summary aggregates 713 individual prompts measured across 692 monitoring runs over the past month.