Measured over the last 30 days
- Models Tracked
- 26
- Avg Tokens / Second
- 59.34
- Avg Time to First Token (ms)
- 735.77
- Last Updated
- Sep 23, 2026
All bedrock models
26 live · one row per model · fastest first · 2 retired lanes not listed · 7 folded behind their current lane| Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|
| Nova Micro 1.0 | 117.00 | 11.20 | 169.00 | 320.00 |
| Nova Lite 1.0 | 106.00 | 13.70 | 146.00 | 330.00 |
| Llama 4 Maverick | 106.00 | 23.70 | 131.00 | 290.00 |
| Llama 3.1 8B Instruct | 95.80 | 8.97 | 110.00 | 400.00 |
| Llama 4 Scout | 95.60 | 1.05 | 120.00 | 340.00 |
| Llama 3.3 70B Instruct | 89.40 | 5.38 | 127.00 | 300.00 |
| Nova Pro 1.0 | 86.90 | 1.76 | 131.00 | 410.00 |
| mistral-7b | 82.10 | 25.00 | 89.80 | 200.00 |
| llama-3-8b | 77.80 | 10.90 | 86.00 | 230.00 |
| mixtral-8x7b | 75.00 | 21.50 | 80.90 | 220.00 |
| Kimi K2.5 | 71.00 | 69.00 | 72.90 | 500.00 |
| Llama 3.1 70B Instruct | 60.30 | 1.95 | 73.80 | 440.00 |
| mistral-small | 56.70 | 15.10 | 60.00 | 210.00 |
| Nova 2 Lite | 53.30 | 43.20 | 58.70 | 710.00 |
| Claude Haiku 4.5 | 48.70 | 2.88 | 64.60 | 790.00 |
| Palmyra X5 | 43.80 | 34.90 | 50.20 | 720.00 |
| Mistral Large | 42.80 | 5.11 | 46.80 | 260.00 |
| llama-3-70b | 38.80 | 4.95 | 41.70 | 300.00 |
| Claude Haiku Latest | 38.40 | 37.40 | 39.90 | 900.00 |
| Claude Opus 4.7 | 28.60 | 4.64 | 37.50 | 1390.00 |
| Claude Sonnet 4.6 | 28.40 | 1.03 | 34.80 | 1000.00 |
| Nova Premier 1.0 | 27.10 | 26.30 | 27.70 | 670.00 |
| Claude Opus 4.6 | 22.00 | 6.42 | 26.80 | 1570.00 |
| Claude Sonnet 4.5 | 21.90 | 2.28 | 26.10 | 1410.00 |
| Claude Opus 4.5 | 20.90 | 1.22 | 25.30 | 1640.00 |
| Claude Opus 4.1 | 8.46 | 1.13 | 15.80 | 3580.00 |
Frequently Asked Questions
Which bedrock model is fastest?
Based on recent tests, Nova Micro 1.0 shows the highest average throughput among tracked bedrock models.
How many recent measurements feed this dashboard?
This provider summary aggregates 29713 individual prompts measured across 26600 monitoring runs over the past month.