Benchmark Overview
17.70
0.00
6
Aug 4, 2026, 02:14 PM
Key Insights
qwen-3.5-4b streams at 17.70 tokens/second on average across the last 6 benchmark runs.
Performance fluctuated by 30.48 tokens/second (172.2% coefficient of variation), indicating variable behavior across benchmark runs.
Latest measurements completed on Aug 4, 2026, 02:14 PM based on 6 total samples.
Performance Distribution
Distribution of throughput measurements showing performance consistency across benchmark runs.
Performance Over Time
Historical performance trends showing how throughput has changed over the benchmarking period.
qwen-3.5-4b
Benchmark Samples
| Provider | Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|---|
| deepinfra | qwen-3.5-4b | 17.70 | 8.92 | 39.40 | 0.00 |
Frequently Asked Questions
The latest rolling average throughput is 17.70 tokens per second with an average time to first token of 0.00 ms across 6 recent runs.
Benchmarks refresh automatically whenever the monitoring cron runs. The most recent run completed on Aug 4, 2026, 02:14 PM.