Skip to content
llmwaves

Llama 3.1 70B Instruct

Meta · released Jul 23, 2024

Open weightsTool useStructured output

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Specification

Context window
131K
Max output
16K
Knowledge cutoff
Dec 31, 2023
Parameters
70.6B
Licence
llama3.1
Serving providers
3
Moderated
No
Uptime
100.0%

Intelligence

Not benchmarked

Coding

Coding Index

Agentic

Agentic Index

Output speed

23 t/s

Median across providers

Latency

365ms

Time to first token

Cost per task

$0.03

Estimated

Benchmarks

Where the score comes from

The Intelligence Index is a composite. These are the underlying evaluations this model was actually measured on.

Evaluation scores

This model has not been put through the benchmark suite. Its speed, latency and pricing figures below are still measured.

Against its peers

Intelligence Index · this model highlighted, nearest peers in grey

Peers are the models sitting closest on the Intelligence Index — the set you would realistically choose between.

View as table
ModelIntelligence
Claude Opus 563.1
Claude Fable 562.1
GPT-5.6 Sol60.9
Kimi K359.7
Qwen3.8 Max58.1
Claude Opus 4.857.3
Muse Spark 1.256.8

Pricing

What it costs to run

List prices per million tokens, plus what one representative task works out to.

List price

Input / 1M tokens
$0.4
Output / 1M tokens
$0.4
Cached input / 1M
Not offered
Blended 3:1
$0.4

One task, estimated

$0.03

Input tokens
50,000
Output tokens
25,000
Profile
Standard

Estimated from list pricing: 50K input tokens plus 80K output tokens for reasoning models (25K for non-reasoning).

Serving providers

Speed and latency figures are medians across these providers, so a widely-served model reports a blend rather than any single endpoint.