Measured over the last 30 days
- Models Tracked
- 52
- Avg Tokens / Second
- 17.92
- Avg Time to First Token (ms)
- 9176.15
- Last Updated
- Oct 17, 2026
All novita models
52 live · one row per model · fastest first · 2 retired lanes not listed · 5 folded behind their current lane| Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|
| Nemotron 3 Nano 30B A3B | 56.50 | 56.50 | 56.50 | 760.00 |
| Llama 3.1 8B Instruct | 51.30 | 51.30 | 51.30 | 920.00 |
| Llama 3 8B Lunaris | 48.90 | 48.90 | 48.90 | 570.00 |
| Qwen3 VL 30B A3B Instruct | 41.90 | 34.00 | 49.70 | 870.00 |
| Qwen3 Next 80B A3B Instruct | 39.90 | 39.90 | 39.90 | 1300.00 |
| Qwen3 235B A22B Thinking 2507 | 38.90 | 38.90 | 38.90 | 730.00 |
| Qwen3 Coder Next | 35.20 | 35.20 | 35.20 | 1430.00 |
| Gemma 4 26B A4B | 34.60 | 3.33 | 58.70 | 2090.00 |
| Qwen3 Coder 30B A3B Instruct | 33.70 | 33.70 | 33.70 | 1370.00 |
| Llama 3.1 Euryale 70B v2.2 | 33.10 | 33.10 | 33.10 | 650.00 |
| Qwen3 VL 235B A22B Instruct | 32.80 | 32.80 | 32.80 | 950.00 |
| Kimi K2 0711 | 32.40 | 32.40 | 32.40 | 740.00 |
| Llama 4 Maverick | 31.40 | 17.70 | 45.00 | 1470.00 |
| Llama 3.3 70B Instruct | 26.90 | 22.40 | 30.60 | 1030.00 |
| gpt-oss-20b | 22.70 | 8.70 | 55.00 | 2940.00 |
| gpt-oss-120b | 22.50 | 3.10 | 33.10 | 7270.00 |
| DeepSeek V3.1 Terminus | 21.70 | 21.70 | 21.70 | 1210.00 |
| MiniMax M3 | 20.40 | 6.41 | 51.60 | 3660.00 |
| GLM 5.1 | 20.00 | 20.00 | 20.00 | 2450.00 |
| DeepSeek V3.2 | 19.70 | 9.78 | 24.80 | 1780.00 |
| Kimi K2 0905 | 19.10 | 19.10 | 19.10 | 2070.00 |
| MiMo-V2.5-Pro | 19.00 | 19.00 | 19.00 | 2390.00 |
| GLM 5.2 | 18.40 | 14.40 | 23.20 | 2600.00 |
| Qwen3 235B A22B Instruct 2507 | 17.00 | 7.26 | 27.10 | 1350.00 |
| Gemma 4 31B | 15.00 | 12.60 | 17.30 | 1220.00 |
| MiniMax M1 | 15.00 | 15.00 | 15.00 | 5200.00 |
| DeepSeek V4 Flash 0731 | 14.80 | 2.87 | 24.00 | 4630.00 |
| WizardLM-2 8x22B | 14.60 | 14.60 | 14.60 | 710.00 |
| MiMo-V2.5 | 13.90 | 13.90 | 13.90 | 2810.00 |
| Kimi K2.7 Code | 10.90 | 7.09 | 17.00 | 5160.00 |
| Ling 3.1 Flash | 10.30 | 6.88 | 13.80 | 5660.00 |
| GLM 4.5 Air | 10.30 | 8.22 | 12.60 | 5560.00 |
| DeepSeek V4 Flash 0423 | 9.44 | 3.94 | 23.10 | 7650.00 |
| Qwen3.5-122B-A10B | 7.61 | 7.61 | 7.61 | 8010.00 |
| Qwen3 Coder 480B A35B | 7.54 | 7.54 | 7.54 | 6640.00 |
| MiMo-V2.6-Pro | 7.36 | 4.56 | 9.91 | 6910.00 |
| MiMo-V2.6-Flash | 6.61 | 1.43 | 11.80 | 23900.00 |
| Qwen3.5-27B | 5.25 | 5.25 | 5.25 | 11500.00 |
| MiniMax M2.5 | 5.07 | 3.90 | 7.83 | 13300.00 |
| MiniMax M2.7 | 5.04 | 2.94 | 6.91 | 16900.00 |
| MiniMax M2 | 4.88 | 4.88 | 4.88 | 13600.00 |
| Kimi K2.6 | 4.29 | 2.22 | 6.70 | 15600.00 |
| Kimi K2.5 | 4.03 | 3.75 | 4.31 | 14400.00 |
| Kimi K2 Thinking | 3.86 | 3.86 | 3.86 | 15500.00 |
| Step 5 Preview | 3.04 | 3.04 | 3.04 | 19800.00 |
| Qwen3.5 397B A17B | 3.03 | 2.30 | 4.46 | 21200.00 |
| R1 | 2.76 | 2.76 | 2.76 | 20100.00 |
| GLM 5 | 2.64 | 2.64 | 2.64 | 23200.00 |
| GLM 4.5V | 2.45 | 2.45 | 2.45 | 24700.00 |
| GLM 4.6 | 1.91 | 1.45 | 2.37 | 33800.00 |
| GLM 4.7 | 1.45 | 1.39 | 1.51 | 42200.00 |
| GLM 4.6V | 0.96 | 0.96 | 0.96 | 64700.00 |
Frequently Asked Questions
Which novita model is fastest?
Based on recent tests, Nemotron 3 Nano 30B A3B shows the highest average throughput among tracked novita models.
How many recent measurements feed this dashboard?
This provider summary aggregates 3620 individual prompts measured across 3107 monitoring runs over the past month.