Cloud BenchmarksLocal Benchmarks

☁️ Cloud Benchmarks ☁️

I run cron jobs to periodically test the token generation speed of different cloud LLM providers. The chart helps visualize the distributions of different speeds, as they can vary somewhat depending on the loads. For readability not all models are shown, but you can see the full results in the table below.

Every provider and model now has a dedicated landing page with narrative insights, SEO-friendly metadata, and structured data for search engines. Click any provider or model in the table to explore performance in depth.

I am working daily to add more providers and models, looking anywhere that does not require purchasing dedicated endpoints for hosting (why some models may appear to be missing). If you have any more suggestions let me know on GitHub!! 😊

Fastest Models Right Now (updated <24h)

#ModelProviderSpeed
1llama-3.1-8bgroq324 tok/s
2qwen-3-32bgroq247 tok/s
3llama-4-scoutgroq215 tok/s
4llama-3.1-8bcerebras211 tok/s
5llama-3.3-70bgroq204 tok/s

📊 Speed Distribution 📊

📚 Full Results 📚

Showing 83 of 83 modelsFlagged statuses: likely_deprecated, deprecated, failing, stale, never_succeeded, disabled
Status
groqllama-3.1-8bActive2h ago324.008747190.00
cerebrasqwen-3-32bActive12d ago251.004444350.00
groqqwen-3-32bActive2h ago247.002391270.00
groqllama-4-scoutActive2h ago215.0023335210.00
cerebrasllama-3.1-8bActive2h ago211.0012350440.00
groqllama-3.3-70bActive2h ago204.0068322120.00
cerebrasgpt-oss-120bActive2h ago199.0011378800.00
cerebrasllama-3.3-70bActive12d ago187.0017338430.00
groqllama-4-maverickActive2h ago172.0012310480.00
togetherllama-3.1-8bActive2h ago151.002232460.00
groqkimi-k2Active2h ago146.0019212240.00
cerebrasqwen-3-235b-instructActive24d ago131.0082521060.00
bedrocknova-microActive30m ago123.0065147270.00
openaio3 MiniNever Succeeded(Medium)2h ago109.00211600.00
bedrockllama-4-maverickActive30m ago108.003135260.00
bedrockllama-4-scoutActive30m ago102.004132270.00
bedrocknova-liteActive30m ago100.0039131300.00
bedrockllama-3.3-70bActive30m ago100.003137260.00
togetherqwen-2.5-7bActive2h ago92.5011145230.00
bedrocknova-proActive30m ago92.3013124350.00
openaigpt-3.5-turboActive2h ago79.6013126450.00
googleActive2h ago75.6034132520.00
openaiGPT-5.1-codex-maxActive2h ago74.6021181540.00
togetherllama-3.1-70bActive2d ago72.507144390.00
togethermistral-7bActive2d ago70.602149530.00
openaigpt-4.1-nanoActive2h ago70.209149430.00
openaigpt-4oActive2h ago68.4071731340.00
googlegemini-2.5-flashNever Succeeded(Medium)2h ago67.1051011070.00
fireworksmixtral-8x22bActive2h ago66.7035112460.00
togetherllama-3.2-3bActive2h ago62.7051211370.00
googlegemini-2.0-flashActive24d ago62.302988520.00
deepinframistral-7bStale(Medium)2h ago58.205136600.00
googlegemini-2.0-flash-liteActive24d ago57.301173760.00
deepinframixtral-8x22bStale(Medium)10d ago57.201478370.00
togethermixtral-8x7bActive2h ago56.6013114180.00
deepinfrallama-3.1-8bStale(Medium)2h ago56.507102410.00
togetherqwen-2.5-72bActive21d ago55.00471420.00
togetherllama-3.3-70bActive2h ago52.9021461410.00
deepinfradevstral-smallNever Succeeded(Medium)2h ago52.203131640.00
openaigpt-4.1-miniActive2h ago50.101597500.00
anthropicclaude-haiku-4.5Active3h ago49.401674640.00
openaio4 MiniNever Succeeded(Medium)2h ago48.9014760.00
fireworksllama-3.3-70bActive2h ago48.104941220.00
bedrockllama-3.2-90bActive30m ago47.40651350.00
deepinfrallama-3-8bStale(Medium)2h ago44.50771310.00
togetherdeepseek-r1Active2h ago43.30169990.00
openaigpt-4o-miniActive2h ago43.00895390.00
bedrockmistral-largeActive30m ago42.90347310.00
bedrockclaude-haiku-4.5Active30m ago42.304631060.00
googlegemini-2.5-proNever Succeeded(Medium)2h ago41.2011721570.00
openaigpt-4.1Active2h ago37.40682460.00
deepinfrallama-3.2-90bStale(Medium)2h ago35.50376810.00
deepinfrallama-2-70bStale(Medium)2h ago35.00357400.00
deepinfrallama-3-70bStale(Medium)2h ago34.80455520.00
deepinfrallama-3.2-3bStale(Medium)2h ago34.10190790.00
deepinfrallama-3.2-1bStale(Medium)2h ago33.80190630.00
deepinfraQwen 2.5 Coder 32BNever Succeeded(Medium)2h ago33.601671500.00
bedrockclaude-3-7-sonnetActive30m ago33.40544740.00
deepinfraqwen-2.5-72bStale(Medium)2h ago32.50250660.00
openaigpt-4-turboActive2h ago32.20252530.00
bedrockclaude-3-5-sonnetActive30m ago31.80244650.00
openaiGPT-5.1Active2h ago30.40357970.00
bedrockclaude-3-5-haikuActive31m ago29.90138800.00
openaigpt-4Active2h ago26.90246670.00
openaiGPT-5.2Active2h ago26.70940940.00
openaiGPT-5.1-codexActive2h ago25.703491320.00
openaiGPT-5.1-codex-miniActive2h ago23.601551320.00
deepinfrallama-3.1-405bStale(Medium)2h ago23.001341140.00
bedrockclaude-sonnet-4.5Active30m ago22.405291600.00
deepinfrallama-3.1-70bStale(Medium)2h ago22.30346650.00
togetherllama-3.1-405bActive22d ago21.90629910.00
deepinfrallama-3.3-70bNever Succeeded(Medium)2h ago20.401491880.00
anthropicclaude-opus-4.5Active3h ago19.706321780.00
anthropicclaude-4-sonnetActive6h ago19.601302020.00
bedrockclaude-3-opusActive9d ago19.00422860.00
bedrockclaude-opus-4.5Active30m ago18.204232000.00
anthropicClaude Opus 4.1Active3h ago18.108251450.00
anthropicclaude-4-opusActive2h ago17.709241270.00
deepinfrallama-3.2-11bStale(Medium)2h ago17.101622430.00
deepinfraqwen-3-235bNever Succeeded(Medium)2h ago14.201384360.00
openaiActive2h ago12.702221880.00
openaio1-proLikely Deprecated(Medium)2h ago8.80118580.00
openaiGPT-5.2-proActive2h ago7.831135440.00
Lifecycle snapshot
Loading status summary…

📈 Time Series 📈

llama-3.3-70b

llama-3.1-8b

claude-3-5-sonnet

claude-haiku-4.5

claude-opus-4.5

llama-3.1-70b

llama-3.2-3b

llama-3.2-90b

llama-4-maverick

llama-4-scout

mistral-7b

mixtral-8x22b

qwen-3-32b

undefined

Claude Opus 4.1

claude-3-5-haiku

claude-3-7-sonnet

claude-3-opus

claude-4-opus

claude-4-sonnet

claude-sonnet-4.5

deepseek-r1

devstral-small

gemini-2.5-flash

gemini-2.5-pro

gpt-3.5-turbo

gpt-4

gpt-4-turbo

gpt-4.1

gpt-4.1-mini

gpt-4.1-nano

gpt-4o

gpt-4o-mini

GPT-5.1

GPT-5.1-codex

GPT-5.1-codex-max

GPT-5.1-codex-mini

GPT-5.2

GPT-5.2-pro

gpt-oss-120b

kimi-k2

llama-2-70b

llama-3-70b

llama-3-8b

llama-3.1-405b

llama-3.2-11b

llama-3.2-1b

mistral-large

mixtral-8x7b

nova-lite

nova-micro

nova-pro

o1-pro

o3 Mini

o4 Mini

Qwen 2.5 Coder 32B

qwen-2.5-72b

qwen-2.5-7b

qwen-3-235b