Provider Snapshot
2
64.15
970.00
Mar 26, 2026
Key Takeaways
2 fireworks models are actively benchmarked with 400 total measurements across 392 benchmark runs.
mixtral-8x22b leads the fleet with 73.60 tokens/second, while llama-3.3-70b delivers 54.70 tok/s.
Performance varies by 34.6% across the fireworks model lineup, indicating diverse optimization strategies for different use cases.
Avg time to first token across the fleet is 970.00 ms, showing good responsiveness for interactive applications.
Fastest Models
| Provider | Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|---|
| fireworks | mixtral-8x22b | 73.60 | 29.90 | 111.00 | 340.00 |
| fireworks | llama-3.3-70b | 54.70 | 1.33 | 108.00 | 1600.00 |
All Models
Complete list of all fireworks models tracked in the benchmark system. Click any model name to view detailed performance data.
| Provider | Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|---|
| fireworks | llama-3.3-70b | 54.70 | 1.33 | 108.00 | 1600.00 |
| fireworks | mixtral-8x22b | 73.60 | 29.90 | 111.00 | 340.00 |
Featured Models
Frequently Asked Questions
Based on recent tests, mixtral-8x22b shows the highest average throughput among tracked fireworks models.
This provider summary aggregates 400 individual prompts measured across 392 monitoring runs over the past month.