Skip to content
llmwaves

GPT-4o (2024-11-20)

OpenAI · released Nov 20, 2024

ProprietaryTool useStructured outputVision

The 2024-11-20 version of GPT-4o offers a leveled-up creative writing ability with more natural, engaging, and tailored writing to improve relevance & readability. It’s also better at working with uploaded...

Specification

Context window
128K
Max output
16K
Knowledge cutoff
Oct 31, 2023
Parameters
Undisclosed
Licence
Proprietary
Serving providers
1
Moderated
Yes
Uptime
100.0%

Intelligence

8.4

33th percentile

Coding

—

Coding Index

Agentic

—

Agentic Index

Output speed

54 t/s

Median across providers

Latency

928ms

Time to first token

Cost per task

$0.38

Estimated

Benchmarks

Where the score comes from

The Intelligence Index is a composite. These are the underlying evaluations this model was actually measured on.

Evaluation scores

Percentage correct · higher is better

  • MMLU-Pro
    74.8%
  • GPQA Diamond
    54.3%
  • AA-LCR (long context)
    49.3%
  • IFBench
    34.3%
  • LiveCodeBench
    30.9%
  • τ²-bench (Telecom)
    25.1%
  • Terminal-Bench Hard
    8.3%
  • AIME 2025
    6.0%
  • Humanity's Last Exam
    2.4%

An evaluation missing from this list was not run for this model — it is not a zero.

View as table
EvaluationScore
MMLU-Pro74.8%
GPQA Diamond54.3%
AA-LCR (long context)49.3%
IFBench34.3%
LiveCodeBench30.9%
τ²-bench (Telecom)25.1%
Terminal-Bench Hard8.3%
AIME 20256.0%
Humanity's Last Exam2.4%

Against its peers

Intelligence Index · this model highlighted, nearest peers in grey

Peers are the models sitting closest on the Intelligence Index — the set you would realistically choose between.

View as table
ModelIntelligence
gpt-oss-20b9.0
Mistral Medium 39.0
GPT-4o (2024-11-20)8.4
LFM2.5-2.6B (free)8.4
GLM 4.6V8.4
GPT-4o8.4
Qwen3 VL 30B A3B Instruct7.9
Solar Pro 37.8

Percentile among all indexed models

Intelligence33th
Mathematics8th
Terminal work41th
Arena Elo5th

Pricing

What it costs to run

List prices per million tokens, plus what one representative task works out to.

List price

Input / 1M tokens
$2.5
Output / 1M tokens
$10
Cached input / 1M
$1.25
Blended 3:1
$4.38

One task, estimated

$0.38

Input tokens
50,000
Output tokens
25,000
Profile
Standard

Estimated from list pricing: 50K input tokens plus 80K output tokens for reasoning models (25K for non-reasoning).

Serving providers

Speed and latency figures are medians across these providers, so a widely-served model reports a blend rather than any single endpoint.

Arena

Head-to-head generation quality

Elo from pairwise judgements, broken out by the kind of thing the model was asked to build.

Overall Elo
909
Win rate
42.3%
Strongest at
Game development
Tournaments
241

Elo by category

Dot position on a 825–925 scale · Elo has no meaningful zero

Agent categories (full-stack apps, mobile apps) are only scored for models tested in agent harnesses.

View as table
CategoryEloWin rate
Game development90942.3%
UI components88738.1%
3D scenes86939.2%
Websites83331.5%