Claude Sonnet 4
Anthropic · released May 22, 2025
Claude Sonnet 4 significantly enhances the capabilities of its predecessor, Sonnet 3.7, excelling in both coding and reasoning tasks with improved precision and controllability. Achieving state-of-the-art performance on SWE-bench (72.7%),...
Specification
- Context window
- 1M
- Max output
- 64K
- Knowledge cutoff
- Jan 31, 2025
- Parameters
- Undisclosed
- Licence
- Proprietary
- Serving providers
- 2
- Moderated
- Yes
- Uptime
- 100.0%
Intelligence
26.0
69th percentile
Coding
—
Coding Index
Agentic
17.6
Agentic Index
Output speed
41 t/s
Median across providers
Latency
863ms
Time to first token
Cost per task
$1.35
Estimated
Benchmarks
Where the score comes from
The Intelligence Index is a composite. These are the underlying evaluations this model was actually measured on.
Evaluation scores
Percentage correct · higher is better
- MMLU-Pro83.7%
- GPQA Diamond68.3%
- τ²-bench (Telecom)52.3%
- AA-LCR (long context)45.7%
- IFBench45.4%
- LiveCodeBench44.9%
- AIME 202538.0%
- SciCode37.3%
- Terminal-Bench Hard27.3%
- Humanity's Last Exam4.3%
An evaluation missing from this list was not run for this model — it is not a zero.
View as table
| Evaluation | Score |
|---|---|
| MMLU-Pro | 83.7% |
| GPQA Diamond | 68.3% |
| τ²-bench (Telecom) | 52.3% |
| AA-LCR (long context) | 45.7% |
| IFBench | 45.4% |
| LiveCodeBench | 44.9% |
| AIME 2025 | 38.0% |
| SciCode | 37.3% |
| Terminal-Bench Hard | 27.3% |
| Humanity's Last Exam | 4.3% |
Against its peers
Intelligence Index · this model highlighted, nearest peers in grey
- o4 Mini HighOpenAI26.1
- o4 MiniOpenAI26.1
- Claude Sonnet 4Anthropic26.0
- Claude Opus 4Anthropic26.0
- Gemini 2.5 ProGoogle25.9
- GPT-5 MiniOpenAI25.8
- Gemini 3.1 Flash LiteGoogle25.6
- 25.6
Peers are the models sitting closest on the Intelligence Index — the set you would realistically choose between.
View as table
| Model | Intelligence |
|---|---|
| o4 Mini High | 26.1 |
| o4 Mini | 26.1 |
| Claude Sonnet 4 | 26.0 |
| Claude Opus 4 | 26.0 |
| Gemini 2.5 Pro | 25.9 |
| GPT-5 Mini | 25.8 |
| Gemini 3.1 Flash Lite | 25.6 |
| Gemini 3.1 Flash Lite Preview | 25.6 |
Percentile among all indexed models
Pricing
What it costs to run
List prices per million tokens, plus what one representative task works out to.
List price
- Input / 1M tokens
- $3
- Output / 1M tokens
- $15
- Cached input / 1M
- $0.3
- Blended 3:1
- $6
One task, estimated
$1.35
- Input tokens
- 50,000
- Output tokens
- 80,000
- Profile
- Reasoning
Estimated from list pricing: 50K input tokens plus 80K output tokens for reasoning models (25K for non-reasoning).
Serving providers
Speed and latency figures are medians across these providers, so a widely-served model reports a blend rather than any single endpoint.
Arena
Head-to-head generation quality
Elo from pairwise judgements, broken out by the kind of thing the model was asked to build.
- Overall Elo
- 1,195
- Win rate
- 57.8%
- Strongest at
- 3D scenes
- Tournaments
- 1,573
Elo by category
Dot position on a 1,125–1,200 scale · Elo has no meaningful zero
- 1,195
- 1,180
- 1,179
- 1,168
- 1,164
- 1,125
Agent categories (full-stack apps, mobile apps) are only scored for models tested in agent harnesses.
View as table
| Category | Elo | Win rate |
|---|---|---|
| 3D scenes | 1195 | 57.8% |
| Game development | 1180 | 54.8% |
| Data visualisation | 1179 | 55.8% |
| Websites | 1168 | 52.4% |
| UI components | 1164 | 58.0% |
| SVG | 1125 | 51.1% |