llm-benchmarks
githubdrose.io

baseten Provider Benchmarks


Measured over the last 30 days

Models Tracked
8
Avg Tokens / Second
36.56
Avg Time to First Token (ms)
2222.50
Last Updated
Oct 16, 2026

All baseten models

8 live · one row per model · fastest first · 1 folded behind their current lane
ModelAvg Toks/SecMinMaxAvg TTF (ms)
Kimi K2.7 Code69.2069.2069.20540.00
GLM 5.347.5015.5055.901140.00
gpt-oss-120b44.4021.8071.601240.00
GLM 5.242.806.7164.101700.00
Nemotron 3 Ultra33.1033.1033.101610.00
DeepSeek V4 Flash 073126.4026.4026.402160.00
DeepSeek V4.1 Flash16.709.3324.004620.00
Muse Spark Open12.4012.4012.404770.00

Frequently Asked Questions

Which baseten model is fastest?
Based on recent tests, Kimi K2.7 Code shows the highest average throughput among tracked baseten models.
How many recent measurements feed this dashboard?
This provider summary aggregates 1268 individual prompts measured across 1169 monitoring runs over the past month.