llm-benchmarks
githubdrose.io

baseten Provider Benchmarks


Measured over the last 30 days

Models Tracked
9
Avg Tokens / Second
40.40
Avg Time to First Token (ms)
1946.67
Last Updated
Oct 17, 2026

All baseten models

9 live · one row per model · fastest first · 3 folded behind their current lane
ModelAvg Toks/SecMinMaxAvg TTF (ms)
Kimi K2.7 Code69.2069.2069.20540.00
Beam 1.0 501B A23B60.0060.0060.00880.00
GLM 5.347.6015.5055.901130.00
gpt-oss-120b44.0021.8071.601260.00
GLM 5.243.806.7164.101650.00
Nemotron 3 Ultra33.1033.1033.101610.00
DeepSeek V4 Flash 073126.4026.4026.402160.00
Muse Spark Open22.8010.5043.103670.00
DeepSeek V4.1 Flash16.709.3324.004620.00

Frequently Asked Questions

Which baseten model is fastest?
Based on recent tests, Kimi K2.7 Code shows the highest average throughput among tracked baseten models.
How many recent measurements feed this dashboard?
This provider summary aggregates 1279 individual prompts measured across 1185 monitoring runs over the past month.