llm-benchmarks
githubdrose.io

Auto Router (Beta) Benchmarks


Measured on coreweave

30 runs
Avg Tokens / Second
9.19
Avg Time to First Token (ms)
6660.00
Runs Analysed
30
Last Updated
Aug 17, 2026, 06:18 PM

Throughput distribution

Throughput over time

Auto Router (Beta)google1tok/s

Generated throughput, including reasoning tokens — so a thinking model's line does not collapse; the table ranks on visible tokens · one cell per model, showing its best-covered provider · shared vertical scale, 0 to 31 tok/s (99th percentile) · dashed rule is the model's own mean · 1 samples above the ceiling drawn at it

Every provider serving this model

1 measured
ProviderModelAvg Toks/SecMinMaxAvg TTF (ms)
coreweaveAuto Router (Beta)9.199.199.196660.00

Frequently Asked Questions

How fast is Auto Router (Beta)?
The latest rolling average throughput is 9.19 tokens per second with an average time to first token of 6660.00 ms across 30 recent runs.
How often are these benchmarks updated?
Benchmarks refresh automatically whenever the monitoring cron runs. The most recent run completed on Aug 17, 2026, 06:18 PM.

Related models