Skip to content
llmwaves

GPT-4o (2024-08-06)

OpenAI · released Aug 6, 2024

ProprietaryTool useStructured outputVision

The 2024-08-06 version of GPT-4o offers improved performance in structured outputs, with the ability to supply a JSON schema in the respone_format. Read more [here](https://openai.com/index/introducing-structured-outputs-in-the-api/). GPT-4o ("o" for "omni") is...

Compare this modelSource listing

Specification

Context window
128K
Max output
16K
Knowledge cutoff
Oct 31, 2023
Parameters
Undisclosed
Licence
Proprietary
Serving providers
2
Moderated
Yes
Uptime
100.0%

Intelligence

9.4

34th percentile

Coding

—

Coding Index

Agentic

—

Agentic Index

Output speed

21 t/s

Median across providers

Latency

569ms

Time to first token

Cost per task

$0.38

Estimated

Benchmarks

Where the score comes from

The Intelligence Index is a composite. These are the underlying evaluations this model was actually measured on.

Evaluation scores

Percentage correct · higher is better

  • GPQA Diamond
    52.1%
  • AA-LCR (long context)
    39.3%
  • IFBench
    36.0%
  • SciCode
    33.1%
  • LiveCodeBench
    31.7%
  • τ²-bench (Telecom)
    28.9%
  • AIME 2025
    11.7%
  • Terminal-Bench Hard
    8.3%
  • Humanity's Last Exam
    2.3%

An evaluation missing from this list was not run for this model — it is not a zero.

View as table
EvaluationScore
GPQA Diamond52.1%
AA-LCR (long context)39.3%
IFBench36.0%
SciCode33.1%
LiveCodeBench31.7%
τ²-bench (Telecom)28.9%
AIME 202511.7%
Terminal-Bench Hard8.3%
Humanity's Last Exam2.3%

Against its peers

Intelligence Index · this model highlighted, nearest peers in grey

Peers are the models sitting closest on the Intelligence Index — the set you would realistically choose between.

View as table
ModelIntelligence
Llama 4 Scout10.3
Qwen3 VL 30B A3B Instruct9.9
R1 Distill Llama 70B9.8
GPT-4.1 Nano9.6
GPT-4o (2024-08-06)9.4
Sonar9.4
Qwen2.5 72B Instruct9.4
Sonar Pro9.1

Percentile among all indexed models

Intelligence34th
Terminal work41th
Arena Elo5th

Pricing

What it costs to run

List prices per million tokens, plus what one representative task works out to.

List price

Input / 1M tokens
$2.5
Output / 1M tokens
$10
Cached input / 1M
$1.25
Blended 3:1
$4.38

One task, estimated

$0.38

Input tokens
50,000
Output tokens
25,000
Profile
Standard

Estimated from list pricing: 50K input tokens plus 80K output tokens for reasoning models (25K for non-reasoning).

Serving providers

Speed and latency figures are medians across these providers, so a widely-served model reports a blend rather than any single endpoint.

Arena

Head-to-head generation quality

Elo from pairwise judgements, broken out by the kind of thing the model was asked to build.

Overall Elo
947
Win rate
42.3%
Strongest at
Game development
Tournaments
241

Elo by category

Dot position on a 850–950 scale · Elo has no meaningful zero

Agent categories (full-stack apps, mobile apps) are only scored for models tested in agent harnesses.

View as table
CategoryEloWin rate
Game development94742.3%
3D scenes92439.2%
UI components92038.1%
Data visualisation88436.0%
Websites85431.5%

Same creator

More from OpenAI

GPT-5.6 Sol

Intelligence
60.9
Speed
46 t/s
Cost per task
$2.65

GPT-5.6 Terra

Intelligence
56.6
Speed
56 t/s
Cost per task
$0.53

GPT-5.5

Intelligence
56.3
Speed
85 t/s
Cost per task
$2.65

GPT-5.4

Intelligence
53.1
Speed
120 t/s
Cost per task
$1.32

GPT-5.6 Luna

Intelligence
52.3
Speed
88 t/s
Cost per task
$0.05

GPT-5.3-Codex

Intelligence
45.5
Speed
61 t/s
Cost per task
$1.21