Cloud BenchmarksLocal Benchmarks

☁️ Cloud Benchmarks ☁️

I run cron jobs to periodically test the token generation speed of different cloud LLM providers. The chart helps visualize the distributions of different speeds, as they can vary somewhat depending on the loads. For readability not all models are shown, but you can see the full results in the table below.

Every provider and model now has a dedicated landing page with narrative insights, SEO-friendly metadata, and structured data for search engines. Click any provider or model in the table to explore performance in depth.

I am working daily to add more providers and models, looking anywhere that does not require purchasing dedicated endpoints for hosting (why some models may appear to be missing). If you have any more suggestions let me know on GitHub!! 😊

Fastest Models Right Now (updated <24h)

#ModelProviderSpeed
1llama-3.1-8bgroq294 tok/s
2qwen-3-32bcerebras256 tok/s
3qwen-3-32bgroq249 tok/s
4llama-3.1-8bcerebras227 tok/s
5llama-3.3-70bcerebras209 tok/s

📊 Speed Distribution 📊

📚 Full Results 📚

Showing 86 of 86 modelsFlagged statuses: likely_deprecated, deprecated, failing, stale, never_succeeded, disabled
Status
groqllama-3.1-8bActive2h ago294.0095447120.00
cerebrasqwen-3-32bActive2h ago256.004444290.00
groqqwen-3-32bActive2h ago249.0046391140.00
cerebrasllama-3.1-8bActive2h ago227.006365470.00
cerebrasllama-3.3-70bActive2h ago209.0017338360.00
groqllama-4-scoutActive2h ago208.0023328220.00
groqllama-3.3-70bActive2h ago207.0094322120.00
cerebrasgpt-oss-120bActive2h ago207.004346740.00
groqllama-4-maverickActive2h ago171.0019310490.00
cerebrasqwen-3-235b-instructActive12d ago161.002264940.00
togetherllama-3.1-8bActive2h ago152.002232540.00
groqkimi-k2Active2h ago144.0021203220.00
bedrocknova-microActive51m ago126.0069151260.00
bedrockllama-4-maverickActive50m ago109.0039142250.00
openaio3 MiniNever Succeeded(Medium)2h ago106.00201590.00
bedrockllama-4-scoutActive50m ago102.001140350.00
bedrocknova-liteActive51m ago101.0044135290.00
bedrockllama-3.3-70bActive50m ago101.0015137240.00
togethermistral-7bActive2h ago93.402165510.00
togetherqwen-2.5-7bActive2h ago92.603146300.00
bedrocknova-proActive51m ago88.1010124380.00
googleActive2h ago81.4034132490.00
openaigpt-3.5-turboActive2h ago78.8012125440.00
openaigpt-4.1-nanoActive2h ago74.1013131400.00
togetherllama-3.1-70bActive2h ago72.807147400.00
togetherllama-3.2-3bActive2h ago70.3051451160.00
googleclaude-3-haikuActive28d ago69.706279500.00
googlegemini-2.5-flashNever Succeeded(Medium)2h ago65.3051001150.00
openaigpt-4oActive2h ago65.1071541390.00
fireworksmixtral-8x22bActive2h ago63.5037112530.00
googlegemini-2.0-flashActive12d ago60.801588590.00
openaiGPT-5.1-codex-maxActive2h ago60.2011061860.00
googlegemini-2.0-flash-liteActive12d ago58.801180670.00
deepinframixtral-8x22bStale(Medium)2h ago55.202980320.00
togetherllama-3.3-70bActive2h ago54.0021361520.00
togetherqwen-2.5-72bActive9d ago52.70471390.00
togethermixtral-8x7bActive2h ago52.6013110210.00
openaio4 MiniNever Succeeded(Medium)2h ago49.7015750.00
anthropicclaude-haiku-4.5Active2h ago49.201580680.00
deepinframistral-7bStale(Medium)2h ago48.803124570.00
openaigpt-4.1-miniActive2h ago48.301597500.00
bedrockllama-3.2-90bActive51m ago47.502951340.00
deepinfrallama-3.1-8bStale(Medium)2h ago46.1011021140.00
deepinfrallama-3-8bStale(Medium)2h ago44.80771300.00
bedrockclaude-haiku-4.5Active51m ago44.20463960.00
deepinfradevstral-smallNever Succeeded(Medium)2h ago43.803114550.00
bedrockmistral-largeActive50m ago43.70747250.00
fireworksllama-3.3-70bActive2h ago43.607841180.00
googlegemini-2.5-proNever Succeeded(Medium)2h ago42.6011721520.00
openaigpt-4o-miniActive2h ago41.90895410.00
togetherdeepseek-r1Active2h ago38.101691870.00
deepinfrallama-3.2-90bStale(Medium)2h ago37.00288960.00
googleclaude-3-5-sonnetActive28d ago34.503142700.00
openaigpt-4.1Active2h ago34.20670470.00
bedrockclaude-3-7-sonnetActive51m ago33.70644730.00
openaigpt-4-turboActive2h ago33.20251570.00
deepinfrallama-3-70bStale(Medium)2h ago32.60448520.00
deepinfrallama-2-70bStale(Medium)2h ago32.50349420.00
bedrockclaude-3-5-sonnetActive51m ago32.40643580.00
deepinfraqwen-2.5-72bStale(Medium)2h ago31.90247680.00
deepinfraQwen 2.5 Coder 32BNever Succeeded(Medium)2h ago30.301673780.00
bedrockclaude-3-5-haikuActive51m ago29.30138900.00
openaiGPT-5.1Active2h ago29.003561040.00
openaiGPT-5.2Active2h ago27.10942980.00
deepinfrallama-3.2-3bStale(Medium)2h ago27.00190730.00
deepinfrallama-3.2-1bStale(Medium)2h ago26.80290530.00
openaigpt-4Active2h ago26.30252670.00
togetherdeepseek-v3Active23d ago26.201672210.00
openaiGPT-5.1-codexActive2h ago25.803491270.00
deepinfrallama-3.3-70bNever Succeeded(Medium)2h ago22.501591060.00
bedrockclaude-sonnet-4.5Active51m ago21.802291690.00
togetherllama-3.1-405bActive10d ago21.702301220.00
openaiGPT-5.1-codex-miniActive2h ago21.501551380.00
deepinfrallama-3.1-70bStale(Medium)2h ago20.80346610.00
deepinfrallama-3.1-405bStale(Medium)2h ago20.401341620.00
deepinfraqwen-3-235bNever Succeeded(Medium)2h ago19.801431590.00
anthropicclaude-opus-4.5Active2h ago19.807301720.00
anthropicclaude-4-sonnetActive2h ago19.701301930.00
bedrockclaude-3-opusActive51m ago19.10422850.00
anthropicClaude Opus 4.1Active2h ago18.605251390.00
bedrockclaude-opus-4.5Active51m ago18.003232100.00
anthropicclaude-4-opusActive2h ago18.009241200.00
deepinfrallama-3.2-11bStale(Medium)2h ago17.701681980.00
openaiActive5h ago11.902202050.00
openaio1-proLikely Deprecated(Medium)5h ago9.76119150.00
openaiGPT-5.2-proActive2h ago6.421136230.00
Lifecycle snapshot
Loading status summary…

📈 Time Series 📈

llama-3.3-70b

llama-3.1-8b

claude-3-5-sonnet

claude-haiku-4.5

claude-opus-4.5

llama-3.1-405b

llama-3.1-70b

llama-3.2-3b

llama-3.2-90b

llama-4-maverick

llama-4-scout

mistral-7b

mixtral-8x22b

qwen-2.5-72b

qwen-3-32b

undefined

Claude Opus 4.1

claude-3-5-haiku

claude-3-7-sonnet

claude-3-opus

claude-4-opus

claude-4-sonnet

claude-sonnet-4.5

deepseek-r1

devstral-small

gemini-2.0-flash

gemini-2.0-flash-lite

gemini-2.5-flash

gemini-2.5-pro

gpt-3.5-turbo

gpt-4

gpt-4-turbo

gpt-4.1

gpt-4.1-mini

gpt-4.1-nano

gpt-4o

gpt-4o-mini

GPT-5.1

GPT-5.1-codex

GPT-5.1-codex-max

GPT-5.1-codex-mini

GPT-5.2

GPT-5.2-pro

gpt-oss-120b

kimi-k2

llama-2-70b

llama-3-70b

llama-3-8b

llama-3.2-11b

llama-3.2-1b

mistral-large

mixtral-8x7b

nova-lite

nova-micro

nova-pro

o1-pro

o3 Mini

o4 Mini

Qwen 2.5 Coder 32B

qwen-2.5-7b

qwen-3-235b

qwen-3-235b-instruct