Provider Snapshot
35
42.04
1911.71
May 10, 2026
Key Takeaways
35 openai models are actively benchmarked with 8207 total measurements across 7980 benchmark runs.
o3 Mini leads the fleet with 96.70 tokens/second, while GPT-5.4-nano delivers 64.70 tok/s.
Performance varies by 49.5% across the openai model lineup, indicating diverse optimization strategies for different use cases.
Avg time to first token across the fleet is 1911.71 ms, showing moderate responsiveness for interactive applications.
The openai model fleet shows varied performance characteristics (57.2% variation coefficient), reflecting diverse model architectures.
Fastest Models
| Provider | Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|---|
| openai | o3 Mini | 96.70 | 33.20 | 161.00 | 140.00 |
| openai | gpt-4.1-nano | 83.30 | 7.30 | 153.00 | 420.00 |
| openai | GPT-5.1-codex-max | 78.50 | 20.70 | 111.00 | 1390.00 |
| openai | o1 | 78.20 | 10.30 | 146.00 | 280.00 |
| openai | GPT-5 Nano | 76.80 | 22.10 | 158.00 | 290.00 |
| openai | GPT-5.4-nano | 64.70 | 8.03 | 114.00 | 640.00 |
All Models
Complete list of all openai models tracked in the benchmark system. Click any model name to view detailed performance data.
| Provider | Model | Avg Toks/Sec | Min | Max | Avg TTF (ms) |
|---|---|---|---|---|---|
| openai | gpt-3.5-turbo | 64.60 | 13.80 | 119.00 | 630.00 |
| openai | gpt-4 | 24.60 | 1.96 | 46.30 | 750.00 |
| openai | gpt-4.1 | 50.00 | 9.33 | 92.20 | 530.00 |
| openai | gpt-4.1-mini | 51.10 | 4.10 | 89.40 | 650.00 |
| openai | gpt-4.1-nano | 83.30 | 7.30 | 153.00 | 420.00 |
| openai | gpt-4o | 46.70 | 10.60 | 107.00 | 590.00 |
| openai | gpt-4o-mini | 39.60 | 8.84 | 65.00 | 550.00 |
| openai | GPT-5 | 40.10 | 2.49 | 71.40 | 380.00 |
| openai | GPT-5-chat-latest | 62.60 | 23.80 | 104.00 | 590.00 |
| openai | GPT-5-codex | 45.50 | 7.06 | 86.60 | 440.00 |
| openai | GPT-5 Mini | 49.30 | 10.30 | 108.00 | 1240.00 |
| openai | GPT-5 Nano | 76.80 | 22.10 | 158.00 | 290.00 |
| openai | GPT-5-pro | 4.29 | 1.64 | 7.99 | 340.00 |
| openai | GPT-5.1 | 42.40 | 10.50 | 75.70 | 710.00 |
| openai | GPT-5.1-chat-latest | 31.20 | 1.91 | 60.50 | 1010.00 |
| openai | GPT-5.1-codex | 47.20 | 14.30 | 66.00 | 1050.00 |
| openai | GPT-5.1-codex-max | 78.50 | 20.70 | 111.00 | 1390.00 |
| openai | GPT-5.1-codex-mini | 55.50 | 12.80 | 103.00 | 980.00 |
| openai | GPT-5.2 | 29.80 | 16.00 | 45.50 | 710.00 |
| openai | GPT-5.2-chat-latest | 13.60 | 1.21 | 45.80 | 1530.00 |
| openai | gpt-5.2-codex | 36.20 | 6.02 | 67.70 | 1160.00 |
| openai | GPT-5.2-pro | 9.41 | 4.52 | 16.80 | 7030.00 |
| openai | GPT-5.3-codex | 27.60 | 8.55 | 42.40 | 800.00 |
| openai | GPT-5.4 | 28.50 | 9.95 | 40.90 | 820.00 |
| openai | GPT-5.4-mini | 61.20 | 25.80 | 91.40 | 570.00 |
| openai | GPT-5.4-nano | 64.70 | 8.03 | 114.00 | 640.00 |
| openai | GPT-5.4-pro | 7.29 | 1.72 | 10.90 | 2460.00 |
| openai | GPT-5.5 | 17.10 | 10.20 | 22.30 | 3310.00 |
| openai | GPT-5.5-pro | 8.85 | 3.53 | 17.20 | 31500.00 |
| openai | o1 | 78.20 | 10.30 | 146.00 | 280.00 |
| openai | o1-pro | 9.93 | 2.46 | 16.50 | 330.00 |
| openai | o3 | 37.20 | 1.96 | 71.00 | 230.00 |
| openai | o3 Mini | 96.70 | 33.20 | 161.00 | 140.00 |
| openai | o3-pro | 8.42 | 2.68 | 21.80 | 2700.00 |
| openai | o4 Mini | 43.30 | 12.70 | 70.10 | 160.00 |
Featured Models
Frequently Asked Questions
Based on recent tests, o3 Mini shows the highest average throughput among tracked openai models.
This provider summary aggregates 8207 individual prompts measured across 7980 monitoring runs over the past month.