API Status

gemma-4-31B-it Benchmarks

Provider: together

Explore real-world latency and throughput results for gemma-4-31B-it. These measurements come from automated benchmarking runs against the provider APIs using the same harness that powers the public cloud dashboard.

Want a broader view of this vendor? Visit the together provider hub to compare every tracked model side-by-side.

Visit together Official Website

Benchmark Overview

Avg Tokens / Second

73.80

Avg Time to First Token (ms)

0.00

Runs Analysed

2

Last Updated

Aug 4, 2026, 02:08 PM

Key Insights

  • gemma-4-31B-it streams at 73.80 tokens/second on average across the last 2 benchmark runs.

  • Performance fluctuated by 9.20 tokens/second (12.5% coefficient of variation), indicating consistent behavior across benchmark runs.

  • Latest measurements completed on Aug 4, 2026, 02:08 PM based on 2 total samples.

Performance Distribution

Distribution of throughput measurements showing performance consistency across benchmark runs.

Performance Over Time

Historical performance trends showing how throughput has changed over the benchmarking period.

gemma-4-31B-it

Benchmark Samples

ProviderModelAvg Toks/SecMinMaxAvg TTF (ms)
togethergemma-4-31B-it73.8069.2078.400.00

Frequently Asked Questions

The latest rolling average throughput is 73.80 tokens per second with an average time to first token of 0.00 ms across 2 recent runs.

Benchmarks refresh automatically whenever the monitoring cron runs. The most recent run completed on Aug 4, 2026, 02:08 PM.

Related Links