API Status

llama-3.3-70b Benchmarks

Provider: fireworks

Explore real-world latency and throughput results for llama-3.3-70b. These measurements come from automated benchmarking runs against the provider APIs using the same harness that powers the public cloud dashboard.

Want a broader view of this vendor? Visit the fireworks provider hub to compare every tracked model side-by-side.

Visit fireworks Official Website

Benchmark Overview

Avg Tokens / Second

44.10

Avg Time to First Token (ms)

0.00

Runs Analysed

7

Last Updated

May 15, 2026, 12:25 AM

Key Insights

  • llama-3.3-70b streams at 44.10 tokens/second on average across the last 7 benchmark runs.

  • Performance fluctuated by 27.90 tokens/second (63.3% coefficient of variation), indicating variable behavior across benchmark runs.

  • Latest measurements completed on May 15, 2026, 12:25 AM based on 7 total samples.

Performance Distribution

Distribution of throughput measurements showing performance consistency across benchmark runs.

Performance Over Time

Historical performance trends showing how throughput has changed over the benchmarking period.

llama-3.3-70b

Benchmark Samples

ProviderModelAvg Toks/SecMinMaxAvg TTF (ms)
fireworksllama-3.3-70b44.1030.9058.800.00

Frequently Asked Questions

The latest rolling average throughput is 44.10 tokens per second with an average time to first token of 0.00 ms across 7 recent runs.

Benchmarks refresh automatically whenever the monitoring cron runs. The most recent run completed on May 15, 2026, 12:25 AM.

Related Links