GPT-4o (2024-11-20)
OpenAI · released Nov 20, 2024
The 2024-11-20 version of GPT-4o offers a leveled-up creative writing ability with more natural, engaging, and tailored writing to improve relevance & readability. It’s also better at working with uploaded...
Specification
- Context window
- 128K
- Max output
- 16K
- Knowledge cutoff
- Oct 31, 2023
- Parameters
- Undisclosed
- Licence
- Proprietary
- Serving providers
- 1
- Moderated
- Yes
- Uptime
- 100.0%
Intelligence
8.4
33th percentile
Coding
—
Coding Index
Agentic
—
Agentic Index
Output speed
54 t/s
Median across providers
Latency
928ms
Time to first token
Cost per task
$0.38
Estimated
Benchmarks
Where the score comes from
The Intelligence Index is a composite. These are the underlying evaluations this model was actually measured on.
Evaluation scores
Percentage correct · higher is better
- MMLU-Pro74.8%
- GPQA Diamond54.3%
- AA-LCR (long context)49.3%
- IFBench34.3%
- LiveCodeBench30.9%
- τ²-bench (Telecom)25.1%
- Terminal-Bench Hard8.3%
- AIME 20256.0%
- Humanity's Last Exam2.4%
An evaluation missing from this list was not run for this model — it is not a zero.
View as table
| Evaluation | Score |
|---|---|
| MMLU-Pro | 74.8% |
| GPQA Diamond | 54.3% |
| AA-LCR (long context) | 49.3% |
| IFBench | 34.3% |
| LiveCodeBench | 30.9% |
| τ²-bench (Telecom) | 25.1% |
| Terminal-Bench Hard | 8.3% |
| AIME 2025 | 6.0% |
| Humanity's Last Exam | 2.4% |
Against its peers
Intelligence Index · this model highlighted, nearest peers in grey
- gpt-oss-20bOpenAI9.0
- Mistral Medium 3Mistral AI9.0
- GPT-4o (2024-11-20)OpenAI8.4
- LFM2.5-2.6B (free)Liquid8.4
- GLM 4.6VZ.ai8.4
- GPT-4oOpenAI8.4
- 7.9
- Solar Pro 3Upstage7.8
Peers are the models sitting closest on the Intelligence Index — the set you would realistically choose between.
View as table
| Model | Intelligence |
|---|---|
| gpt-oss-20b | 9.0 |
| Mistral Medium 3 | 9.0 |
| GPT-4o (2024-11-20) | 8.4 |
| LFM2.5-2.6B (free) | 8.4 |
| GLM 4.6V | 8.4 |
| GPT-4o | 8.4 |
| Qwen3 VL 30B A3B Instruct | 7.9 |
| Solar Pro 3 | 7.8 |
Percentile among all indexed models
Pricing
What it costs to run
List prices per million tokens, plus what one representative task works out to.
List price
- Input / 1M tokens
- $2.5
- Output / 1M tokens
- $10
- Cached input / 1M
- $1.25
- Blended 3:1
- $4.38
One task, estimated
$0.38
- Input tokens
- 50,000
- Output tokens
- 25,000
- Profile
- Standard
Estimated from list pricing: 50K input tokens plus 80K output tokens for reasoning models (25K for non-reasoning).
Serving providers
Speed and latency figures are medians across these providers, so a widely-served model reports a blend rather than any single endpoint.
Arena
Head-to-head generation quality
Elo from pairwise judgements, broken out by the kind of thing the model was asked to build.
- Overall Elo
- 909
- Win rate
- 42.3%
- Strongest at
- Game development
- Tournaments
- 241
Elo by category
Dot position on a 825–925 scale · Elo has no meaningful zero
- 909
- 887
- 869
- 833
Agent categories (full-stack apps, mobile apps) are only scored for models tested in agent harnesses.
View as table
| Category | Elo | Win rate |
|---|---|---|
| Game development | 909 | 42.3% |
| UI components | 887 | 38.1% |
| 3D scenes | 869 | 39.2% |
| Websites | 833 | 31.5% |