llm-benchmarks
githubdrose.io

openrouter Provider Benchmarks


Measured over the last 30 days

Models Tracked
202
Avg Tokens / Second
32.27
Avg Time to First Token (ms)
3375.54
Last Updated
Aug 16, 2026

All openrouter models

202 tracked · fastest first
ModelAvg Toks/SecMinMaxAvg TTF (ms)
google/gemini-2.5-flash-image107.0039.20191.00960.00
qwen/qwen3-vl-8b-instruct87.4033.30141.001140.00
qwen/qwen3-vl-30b-a3b-instruct84.1047.10121.00770.00
amazon/nova-micro-v183.9048.10167.00890.00
google/gemini-2.5-flash-lite83.5047.40160.00910.00
amazon/nova-lite-v180.6036.50178.001020.00
qwen/qwen3-coder-30b-a3b-instruct68.1026.60110.001640.00
amazon/nova-2-lite-v167.0044.60125.00990.00
google/gemini-3.1-flash-lite-2026050762.6032.60138.001320.00
relace/relace-search-2025120862.2059.8064.60840.00
ibm-granite/granite-4.1-8b-2026042962.1056.7072.80500.00
mistralai/voxtral-small-24b-250761.9059.8065.80660.00
google/gemini-3.1-flash-lite-image-2026063060.9052.4072.201170.00
anthropic/claude-4.8-opus-fast-2026052859.5026.30137.001560.00
google/gemini-3.1-flash-image-2026052859.0033.20119.001650.00
mistralai/mistral-medium-3.5-2026043058.8055.6060.90650.00
google/gemini-2.5-flash58.2034.60104.001050.00
qwen/qwen3-vl-30b-a3b-thinking57.9012.30104.004570.00
qwen/qwen3-coder-flash56.7030.60108.001300.00
google/gemini-3.1-flash-image-preview-2026022656.2029.00108.001520.00
deepcogito/cogito-v2.1-671b-2025111855.7040.8088.80710.00
meta-llama/llama-3.2-1b-instruct55.6040.2074.00810.00
google/gemini-3-flash-preview-2025121754.6038.5083.501130.00
openai/gpt-4o-2024-11-2054.4041.5072.10960.00
mistralai/ministral-3b-251254.4052.4055.90890.00
poolside/laguna-s-2.1-2026072053.3041.8064.80680.00
thedrummer/unslopnemo-12b53.0043.5059.10700.00
mistralai/ministral-14b-251252.6048.6055.10700.00
google/gemini-3.5-flash-lite-2026072152.6041.2059.301050.00
openai/gpt-3.5-turbo52.0030.2068.501090.00
amazon/nova-pro-v151.7033.9087.30890.00
openai/gpt-3.5-turbo-16k51.5045.5060.90970.00
deepseek/deepseek-v3.1-terminus51.0028.2092.501060.00
mistralai/ministral-8b-251250.9045.2054.20770.00
mistralai/codestral-250850.9042.3060.80910.00
openai/gpt-5.4-nano-2026031749.2042.6056.80900.00
google/gemini-3.1-flash-lite-preview-2026030348.9036.8056.901060.00
writer/palmyra-x5-2025042848.6044.0051.10570.00
venice/uncensored48.2032.8087.701150.00
bytedance/ui-tars-1.5-7b47.5028.8082.10900.00
qwen/qwen3-vl-8b-thinking47.3013.30113.004030.00
anthropic/claude-3-haiku47.0033.0082.90780.00
qwen/qwen3-vl-32b-instruct46.9028.7065.001060.00
qwen/qwen3-coder-480b-a35b-07-2546.5041.1054.501080.00
qwen/qwen-2.5-7b-instruct45.6037.7051.50670.00
cohere/command-r7b-12-202445.5031.9073.50870.00
qwen/qwen3-coder-next-2025-02-0345.5041.4049.701040.00
openai/gpt-4o-mini-2024-07-1844.6029.7051.80890.00
mistralai/mistral-medium-3.144.6039.5048.10630.00
sao10k/l3-lunaris-8b44.3040.6048.10650.00
qwen/qwen3-next-80b-a3b-instruct-250944.3027.8060.80710.00
openai/gpt-4.1-nano-2025-04-1444.2042.3046.50930.00
openai/gpt-4o-2024-08-0644.1037.1051.201250.00
mistralai/mistral-saba-250243.9033.3050.50920.00
anthropic/claude-4.5-haiku-2025100143.4027.4077.301360.00
mistralai/mistral-small-260342.6033.0058.601180.00
qwen/qwen-plus-2025-01-2542.6031.2054.00850.00
openai/gpt-3.5-turbo-instruct42.2030.7059.101150.00
google/lyria-3-clip-preview-2026033042.1029.1055.103620.00
openai/gpt-5.4-mini-2026031741.9036.7045.80910.00
meta-llama/llama-4-maverick-17b-128e-instruct41.5038.8043.60920.00
undi95/remm-slerp-l2-13b41.4036.5044.70760.00
nousresearch/hermes-4-70b40.5032.0046.50620.00
~openai/gpt-mini-latest40.5038.6042.40760.00
mistralai/mixtral-8x22b-instruct39.9034.8044.001270.00
cohere/command-a-03-202539.6032.1057.40800.00
amazon/nova-premier-v139.3026.0056.80690.00
openai/gpt-3.5-turbo-061339.1027.8046.701340.00
sao10k/l3.1-euryale-70b38.8038.7039.00650.00
openai/gpt-4.1-2025-04-1438.6034.9041.80990.00
anthropic/claude-4-sonnet-2025052238.6023.5063.001300.00
qwen/qwen-plus-2025-07-2838.3025.9058.501150.00
morph/morph-v3-large37.9026.8056.80890.00
thedrummer/cydonia-24b-v4.136.9032.0045.80870.00
rekaai/reka-edge-260336.7033.9039.501380.00
mistralai/mistral-small-24b-instruct-250136.5030.8039.90990.00
meta-llama/llama-3.2-3b-instruct36.4028.5054.101070.00
meta-llama/llama-4-scout-17b-16e-instruct35.4027.9046.20820.00
x-ai/grok-4.20-2026030935.4032.2038.40770.00
qwen/qwen3-30b-a3b-instruct-250735.4014.2056.602360.00
qwen/qwen3.5-flash-2026022435.1014.1046.402080.00
openai/gpt-4o35.0030.9037.901240.00
minimax/minimax-m2-her-2026012334.9031.2040.701410.00
google/gemma-3n-e4b-it34.8033.0036.40660.00
openai/gpt-5.1-2025111334.5027.7038.801070.00
upstage/solar-pro-334.1026.9042.901430.00
thedrummer/rocinante-12b34.0027.5042.90820.00
inclusionai/ling-2.6-1t-2026042333.5028.2038.701260.00
kwaipilot/kat-coder-pro-v2-2026032733.2032.4034.601330.00
openai/gpt-5.1-codex-2025111332.7028.6036.301720.00
google/gemma-3-4b-it32.7031.9033.60880.00
perplexity/sonar-pro-search32.5030.1034.901220.00
openai/gpt-5.4-2026030532.2029.8034.701010.00
openai/gpt-4.1-mini-2025-04-1432.1028.0035.801270.00
openai/gpt-chat-latest-2026050532.1027.4035.701210.00
qwen/qwen3-30b-a3b-thinking-250731.7011.7071.504870.00
mistralai/mistral-medium-331.4016.7040.50770.00
openai/gpt-4o-mini31.2026.7033.301650.00
meta-llama/llama-3.1-8b-instruct31.1019.2051.50850.00
google/gemma-3-12b-it31.1029.7033.90760.00
mistralai/mistral-large31.0028.0033.80850.00
~anthropic/claude-haiku-latest30.9017.5045.801820.00
qwen/qwen3-vl-235b-a22b-instruct30.9027.0034.701140.00
kwaipilot/kat-coder-air-v2.5-2026071030.5010.4041.301300.00
google/gemma-2-27b-it29.6025.3033.601310.00
perceptron/perceptron-mk1-2026051229.4027.2031.70900.00
anthropic/claude-4.8-opus-2026052829.3016.7045.501770.00
anthropic/claude-sonnet-5-2026063028.8017.4056.802070.00
qwen/qwen3.5-122b-a10b-2026022428.506.8050.104900.00
tencent/hunyuan-a13b-instruct28.3024.6030.601440.00
openai/gpt-5.6-terra-pro-2026070928.006.1649.9020700.00
mistralai/mistral-large-240727.9013.9039.301450.00
nousresearch/hermes-3-llama-3.1-70b27.3024.8031.30750.00
qwen/qwen2.5-vl-72b-instruct27.2023.6033.10640.00
thedrummer/skyfall-36b-v227.2015.7043.00790.00
anthropic/claude-4.6-sonnet-2026021727.1022.8036.801140.00
microsoft/phi-427.1023.5031.50590.00
anthropic/claude-4.7-opus-2026041626.6020.6039.401660.00
meta-llama/llama-3.1-70b-instruct26.1019.6032.00930.00
gryphe/mythomax-l2-13b26.0022.1032.901380.00
upstage/solar-pro4-2026081025.9012.9033.501450.00
qwen/qwen3-max-thinking-2026012325.8025.5026.001330.00
openai/gpt-5.4-image-2-2026042125.7020.7028.801660.00
nousresearch/hermes-4-405b25.6015.2032.70600.00
aion-labs/aion-rp-llama-3.1-8b25.6014.5037.201650.00
openrouter/auto-beta25.6019.1029.502410.00
qwen/qwen3-vl-235b-a22b-thinking25.606.2444.9012500.00
ibm-granite/granite-4.0-h-micro25.5021.1028.50900.00
qwen/qwen-2.5-coder-32b-instruct25.1022.4026.50680.00
nvidia/nemotron-3-ultra-550b-a55b-2026060424.9013.3040.202950.00
inclusionai/ling-2.6-flash-2026042124.9021.8028.80800.00
google/gemma-4-26b-a4b-it-2026040324.5020.6032.00920.00
qwen/qwen-2.5-72b-instruct24.4021.0026.40690.00
anthropic/claude-4.5-sonnet-2025092924.1017.1038.301790.00
anthropic/claude-4.5-opus-2025112423.7016.7035.401870.00
minimax/minimax-0123.5018.9026.301050.00
qwen/qwen3-coder-plus23.3020.1026.901420.00
google/gemma-3-27b-it22.5017.3025.401250.00
mistralai/mistral-large-251222.3013.6033.901770.00
anthropic/claude-4.6-opus-2026020522.3017.3031.501790.00
mistralai/mistral-nemo22.0011.4030.201860.00
mistralai/mistral-small-3.1-24b-instruct-250321.6014.6030.801630.00
mistralai/mistral-small-3.2-24b-instruct-250621.306.8834.301350.00
deepseek/deepseek-chat-v321.2011.2034.701860.00
qwen/qwen3-max21.1018.8022.501670.00
deepseek/deepseek-v3.2-exp21.0018.3025.801530.00
perplexity/sonar-pro20.9012.9032.302430.00
~anthropic/claude-sonnet-latest20.8020.1021.602080.00
deepseek/deepseek-chat-v3-032420.2017.1024.401600.00
nousresearch/hermes-3-llama-3.1-405b19.8013.5024.401150.00
deepseek/deepseek-v3.2-2025120119.7015.2027.601880.00
openai/gpt-419.4018.5020.701430.00
openai/gpt-4o-2024-05-1319.3010.8036.304420.00
openai/gpt-4-turbo19.2018.5020.401630.00
google/gemma-4-31b-it-2026040219.209.5236.30690.00
perplexity/sonar19.0012.7023.102730.00
aion-labs/aion-3.0-2026070718.008.4129.904580.00
morph/morph-v3-fast16.9011.0024.30910.00
anthropic/claude-4-opus-2025052216.4010.9026.202010.00
qwen/qwen3-235b-a22b-04-2816.105.0321.7012200.00
baidu/ernie-4.5-vl-424b-a47b15.8012.3024.002240.00
anthracite-org/magnum-v4-72b15.7014.8018.20960.00
qwen/qwen3.5-plus-2026021615.503.9123.006750.00
openai/gpt-5.2-pro-2025121115.401.2729.6036400.00
aion-labs/aion-2.0-2026022315.107.7422.505990.00
z-ai/glm-5.1-2026040614.505.0525.501820.00
cohere/command-r-08-202413.708.2319.101030.00
qwen/qwen3-235b-a22b-07-2512.909.3316.503310.00
meta-llama/llama-3.3-70b-instruct12.708.4019.703920.00
x-ai/grok-4.20-multi-agent-2026030912.302.0632.5031400.00
aion-labs/aion-3.0-mini-2026070711.102.3820.3013400.00
microsoft/wizardlm-2-8x22b11.008.6714.702050.00
openai/gpt-5.5-2026042310.703.4822.102910.00
qwen/qwen3-8b-04-2810.709.8711.305350.00
openai/gpt-5.6-terra-2026070910.202.1820.602930.00
z-ai/glm-5.2-2026061610.205.2113.804760.00
x-ai/grok-4.3-202604309.928.5410.805650.00
openrouter/pareto-code9.872.2018.703080.00
deepseek/deepseek-chat-v3.19.134.4612.001120.00
anthropic/claude-4.1-opus-202508058.667.5710.503330.00
openrouter/bodybuilder7.767.358.1710400.00
openai/gpt-5.6-luna-pro-202607097.327.327.323930.00
sao10k/l3.3-euryale-70b-v2.36.216.216.217590.00
x-ai/grok-4.5-202607085.765.436.049120.00
x-ai/grok-build-0.1-202605205.494.646.0210800.00
~google/gemini-flash-latest5.341.778.915200.00
google/gemini-3.7-flash-202608135.130.617.716540.00
google/gemini-3.5-flash-202605194.912.256.618030.00
google/gemini-3.6-flash-202607214.761.278.264950.00
cohere/command-r-plus-08-20244.232.678.231690.00
google/gemini-2.5-pro-preview-03-254.191.376.7711100.00
google/gemini-3.1-pro-preview-customtools-202602194.061.156.999460.00
google/gemini-3.1-pro-preview-202602193.780.955.599790.00
qwen/qwen3.5-27b-202602243.371.444.5724000.00
x-ai/grok-4.6-202608103.172.075.0421500.00
google/gemini-2.5-pro2.760.473.6412800.00
google/gemini-2.5-pro-preview-06-052.650.354.9412800.00
meta-llama/llama-guard-4-12b2.491.633.441110.00
~x-ai/grok-latest2.442.062.8225000.00
z-ai/glm-4.52.222.012.3830300.00
moonshotai/kimi-k2.5-01272.092.082.1128100.00
qwen/qwen3.6-max-preview-202604201.781.741.8237100.00

Frequently Asked Questions

Which openrouter model is fastest?
Based on recent tests, google/gemini-2.5-flash-image shows the highest average throughput among tracked openrouter models.
How many recent measurements feed this dashboard?
This provider summary aggregates 648 individual prompts measured across 379 monitoring runs over the past month.