- Avg Tokens / Second
- 16.10
- Avg Time to First Token (ms)
- 0.00
- Runs Analysed
- 2
- Last Updated
- Aug 5, 2026, 04:48 PM
Throughput distribution
- deepseek-ai/DeepSeek-R1-Distill-Llama-70B deepinfra16 tok/s
Visible-token throughput, same basis as the table · curves normalised per model
Throughput over time
Generated throughput, including reasoning tokens — so a thinking model's line does not collapse; the table ranks on visible tokens · one cell per model, showing its best-covered provider · shared vertical scale, 0 to 1 tok/s (99th percentile) · dashed rule is the model's own mean · 1 samples above the ceiling drawn at it
Every provider serving this model
1 measured| Provider | Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|---|
| deepinfra | deepseek-ai/DeepSeek-R1-Distill-Llama-70B | 16.10 | 11.80 | 20.40 | 0.00 |
Frequently Asked Questions
How fast is deepseek-ai/DeepSeek-R1-Distill-Llama-70B?
The latest rolling average throughput is 16.10 tokens per second with an average time to first token of 0.00 ms across 2 recent runs.
How often are these benchmarks updated?
Benchmarks refresh automatically whenever the monitoring cron runs. The most recent run completed on Aug 5, 2026, 04:48 PM.