Provider Snapshot
6
64.23
0.63
Dec 25, 2025
Key Takeaways
6 fireworks models are actively benchmarked with 2093 total measurements across 2081 benchmark runs.
llama-3.1-8b leads the fleet with 101.00 tokens/second, while kimi-k2 delivers 27.00 tok/s.
Performance varies by 274.1% across the fireworks model lineup, indicating diverse optimization strategies for different use cases.
Median time to first token across the fleet is 0.63 ms, showing excellent responsiveness for interactive applications.
The fireworks model fleet shows varied performance characteristics (37.4% variation coefficient), reflecting diverse model architectures.
Fastest Models
| Provider | Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|---|
| fireworks | llama-3.1-8b | 101.00 | 45.90 | 154.00 | 0.44 |
| fireworks | mixtral-8x22b | 78.10 | 32.10 | 107.00 | 0.34 |
| fireworks | llama-3.3-70b | 68.90 | 9.60 | 132.00 | 0.54 |
| fireworks | llama-3.1-70b | 68.40 | 21.60 | 96.80 | 0.48 |
| fireworks | llama-3.1-405b | 42.00 | 20.30 | 55.90 | 0.56 |
| fireworks | kimi-k2 | 27.00 | 6.16 | 44.60 | 1.42 |
All Models
Complete list of all fireworks models tracked in the benchmark system. Click any model name to view detailed performance data.
| Provider | Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|---|
| fireworks | llama-3.1-8b | 101.00 | 45.90 | 154.00 | 0.44 |
| fireworks | llama-3.1-70b | 68.40 | 21.60 | 96.80 | 0.48 |
| fireworks | llama-3.1-405b | 42.00 | 20.30 | 55.90 | 0.56 |
| fireworks | mixtral-8x22b | 78.10 | 32.10 | 107.00 | 0.34 |
| fireworks | llama-3.3-70b | 68.90 | 9.60 | 132.00 | 0.54 |
| fireworks | kimi-k2 | 27.00 | 6.16 | 44.60 | 1.42 |
Featured Models
Frequently Asked Questions
Based on recent tests, llama-3.1-8b shows the highest average throughput among tracked fireworks models.
This provider summary aggregates 2093 individual prompts measured across 2081 monitoring runs over the past month.