Measured over the last 30 days
- Models Tracked
- 23
- Avg Tokens / Second
- 61.33
- Avg Time to First Token (ms)
- 761.74
- Last Updated
- Nov 7, 2026
All bedrock models
23 live · one row per model · fastest first · 1 retired lanes not listed · 5 folded behind their current lane| Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|
| Nova Micro 1.0 | 117.00 | 40.30 | 165.00 | 290.00 |
| Nova Lite 1.0 | 108.00 | 22.90 | 147.00 | 330.00 |
| Llama 4 Maverick | 106.00 | 22.70 | 134.00 | 300.00 |
| Llama 4 Scout | 95.70 | 25.50 | 125.00 | 300.00 |
| Llama 3.1 8B Instruct | 95.00 | 4.54 | 113.00 | 400.00 |
| Llama 3.3 70B Instruct | 87.30 | 5.04 | 128.00 | 310.00 |
| mistral-7b | 81.10 | 6.72 | 87.20 | 200.00 |
| llama-3-8b | 77.90 | 1.05 | 84.10 | 270.00 |
| Nova Pro 1.0 | 77.50 | 27.20 | 125.00 | 410.00 |
| mixtral-8x7b | 73.50 | 13.10 | 81.00 | 220.00 |
| Llama 3.1 70B Instruct | 61.50 | 18.50 | 74.20 | 420.00 |
| Claude Haiku 4.5 | 59.80 | 12.90 | 86.60 | 550.00 |
| mistral-small | 56.30 | 12.00 | 60.20 | 220.00 |
| Nova 2 Lite | 49.70 | 39.20 | 58.90 | 880.00 |
| Mistral Large | 42.30 | 12.40 | 46.20 | 270.00 |
| llama-3-70b | 38.90 | 12.10 | 41.90 | 280.00 |
| Claude Sonnet 4.6 | 38.80 | 5.42 | 47.10 | 770.00 |
| Claude Opus 4.7 | 35.00 | 9.99 | 46.20 | 970.00 |
| Palmyra X5 | 34.30 | 9.34 | 44.40 | 1880.00 |
| Claude Opus 4.6 | 23.50 | 1.00 | 32.40 | 1580.00 |
| Claude Sonnet 4.5 | 21.80 | 5.42 | 25.60 | 1400.00 |
| Claude Opus 4.5 | 21.30 | 6.53 | 24.70 | 1530.00 |
| Claude Opus 4.1 | 8.32 | 1.22 | 17.60 | 3740.00 |
Frequently Asked Questions
Which bedrock model is fastest?
Based on recent tests, Nova Micro 1.0 shows the highest average throughput among tracked bedrock models.
How many recent measurements feed this dashboard?
This provider summary aggregates 29600 individual prompts measured across 26657 monitoring runs over the past month.