llm-benchmarks
githubdrose.io

openinference Provider Benchmarks


Measured over the last 30 days

Models Tracked
2
Avg Tokens / Second
7.66
Avg Time to First Token (ms)
16120.00
Last Updated
Oct 14, 2026

All openinference models

2 live · one row per model · fastest first · 2 folded behind their current lane
ModelAvg Toks/SecMinMaxAvg TTF (ms)
DeepSeek V4 Flash 042313.000.6230.205340.00
DeepSeek V4 Flash 07312.322.322.3226900.00

Frequently Asked Questions

Which openinference model is fastest?
Based on recent tests, DeepSeek V4 Flash 0423 shows the highest average throughput among tracked openinference models.
How many recent measurements feed this dashboard?
This provider summary aggregates 710 individual prompts measured across 680 monitoring runs over the past month.