Measured over the last 30 days
- Models Tracked
- 22
- Avg Tokens / Second
- 60.06
- Avg Time to First Token (ms)
- 776.36
- Last Updated
- Aug 14, 2026
All bedrock models
22 tracked · fastest first| Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|
| nova-micro | 117.00 | 27.20 | 188.00 | 320.00 |
| llama-4-maverick | 107.00 | 23.10 | 135.00 | 290.00 |
| llama-3.1-8b | 95.80 | 7.07 | 112.00 | 400.00 |
| llama-4-scout | 95.70 | 43.50 | 130.00 | 290.00 |
| nova-lite | 91.00 | 1.05 | 132.00 | 380.00 |
| nova-pro | 89.10 | 10.80 | 128.00 | 390.00 |
| llama-3.3-70b | 83.90 | 1.72 | 122.00 | 580.00 |
| mistral-7b | 81.90 | 25.10 | 86.70 | 190.00 |
| llama-3-8b | 77.80 | 1.05 | 86.70 | 260.00 |
| mixtral-8x7b | 73.40 | 19.30 | 80.60 | 230.00 |
| llama-3.1-70b | 58.50 | 11.10 | 73.60 | 430.00 |
| mistral-small | 56.10 | 23.00 | 60.60 | 210.00 |
| llama-3.2-90b | 46.30 | 39.50 | 49.00 | 350.00 |
| claude-haiku-4.5 | 43.60 | 1.04 | 59.00 | 920.00 |
| mistral-large | 42.30 | 5.75 | 46.60 | 260.00 |
| llama-3-70b | 36.30 | 1.04 | 41.50 | 580.00 |
| claude-opus-4-7 | 28.10 | 1.03 | 37.50 | 1540.00 |
| claude-sonnet-4.6 | 26.50 | 6.36 | 32.60 | 1010.00 |
| claude-sonnet-4.5 | 21.70 | 1.00 | 29.30 | 1550.00 |
| claude-opus-4.6 | 20.90 | 3.58 | 24.80 | 1710.00 |
| claude-opus-4.5 | 19.90 | 1.05 | 23.30 | 1680.00 |
| Claude Opus 4.1 | 8.44 | 1.14 | 15.70 | 3510.00 |
Frequently Asked Questions
Which bedrock model is fastest?
Based on recent tests, nova-micro shows the highest average throughput among tracked bedrock models.
How many recent measurements feed this dashboard?
This provider summary aggregates 28470 individual prompts measured across 25980 monitoring runs over the past month.