GPT-4o (2024-08-06)
OpenAI · released Aug 6, 2024
The 2024-08-06 version of GPT-4o offers improved performance in structured outputs, with the ability to supply a JSON schema in the respone_format. Read more [here](https://openai.com/index/introducing-structured-outputs-in-the-api/). GPT-4o ("o" for "omni") is...
Specification
- Context window
- 128K
- Max output
- 16K
- Knowledge cutoff
- Oct 31, 2023
- Parameters
- Undisclosed
- Licence
- Proprietary
- Serving providers
- 2
- Moderated
- Yes
- Uptime
- 100.0%
Intelligence
7.7
29th percentile
Coding
—
Coding Index
Agentic
—
Agentic Index
Output speed
70 t/s
Median across providers
Latency
517ms
Time to first token
Cost per task
$0.38
Estimated
Benchmarks
Where the score comes from
The Intelligence Index is a composite. These are the underlying evaluations this model was actually measured on.
Evaluation scores
Percentage correct · higher is better
- GPQA Diamond52.1%
- AA-LCR (long context)41.0%
- IFBench36.0%
- LiveCodeBench31.7%
- τ²-bench (Telecom)28.9%
- AIME 202511.7%
- Terminal-Bench Hard8.3%
- Humanity's Last Exam2.3%
An evaluation missing from this list was not run for this model — it is not a zero.
View as table
| Evaluation | Score |
|---|---|
| GPQA Diamond | 52.1% |
| AA-LCR (long context) | 41.0% |
| IFBench | 36.0% |
| LiveCodeBench | 31.7% |
| τ²-bench (Telecom) | 28.9% |
| AIME 2025 | 11.7% |
| Terminal-Bench Hard | 8.3% |
| Humanity's Last Exam | 2.3% |
Against its peers
Intelligence Index · this model highlighted, nearest peers in grey
- 7.9
- Solar Pro 3Upstage7.8
- GPT-4.1 NanoOpenAI7.8
- GPT-4o (2024-08-06)OpenAI7.7
- SonarPerplexity7.7
- 7.7
- Sonar ProPerplexity7.6
- 7.3
Peers are the models sitting closest on the Intelligence Index — the set you would realistically choose between.
View as table
| Model | Intelligence |
|---|---|
| Qwen3 VL 30B A3B Instruct | 7.9 |
| Solar Pro 3 | 7.8 |
| GPT-4.1 Nano | 7.8 |
| GPT-4o (2024-08-06) | 7.7 |
| Sonar | 7.7 |
| Qwen2.5 72B Instruct | 7.7 |
| Sonar Pro | 7.6 |
| Qwen3 VL 8B Instruct | 7.3 |
Percentile among all indexed models
Pricing
What it costs to run
List prices per million tokens, plus what one representative task works out to.
List price
- Input / 1M tokens
- $2.5
- Output / 1M tokens
- $10
- Cached input / 1M
- $1.25
- Blended 3:1
- $4.38
One task, estimated
$0.38
- Input tokens
- 50,000
- Output tokens
- 25,000
- Profile
- Standard
Estimated from list pricing: 50K input tokens plus 80K output tokens for reasoning models (25K for non-reasoning).
Arena
Head-to-head generation quality
Elo from pairwise judgements, broken out by the kind of thing the model was asked to build.
- Overall Elo
- 909
- Win rate
- 42.3%
- Strongest at
- Game development
- Tournaments
- 241
Elo by category
Dot position on a 825–925 scale · Elo has no meaningful zero
- 909
- 887
- 869
- 833
Agent categories (full-stack apps, mobile apps) are only scored for models tested in agent harnesses.
View as table
| Category | Elo | Win rate |
|---|---|---|
| Game development | 909 | 42.3% |
| UI components | 887 | 38.1% |
| 3D scenes | 869 | 39.2% |
| Websites | 833 | 31.5% |