Benchmark Overview
3.27
0.00
6
Aug 4, 2026, 02:08 PM
Key Insights
Llama-Guard-4-12B streams at 3.27 tokens/second on average across the last 6 benchmark runs.
Performance fluctuated by 1.10 tokens/second (33.6% coefficient of variation), indicating variable behavior across benchmark runs.
Latest measurements completed on Aug 4, 2026, 02:08 PM based on 6 total samples.
Performance Distribution
Distribution of throughput measurements showing performance consistency across benchmark runs.
Performance Over Time
Historical performance trends showing how throughput has changed over the benchmarking period.
Llama-Guard-4-12B
Benchmark Samples
| Provider | Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|---|
| together | Llama-Guard-4-12B | 3.27 | 2.71 | 3.81 | 0.00 |
Frequently Asked Questions
The latest rolling average throughput is 3.27 tokens per second with an average time to first token of 0.00 ms across 6 recent runs.
Benchmarks refresh automatically whenever the monitoring cron runs. The most recent run completed on Aug 4, 2026, 02:08 PM.