Skip to content
llmwaves

GPT-3.5 Turbo (batch)

OpenAI · released May 28, 2023

ProprietaryTool useStructured outputBatch endpoint

GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks. Training data up to Sep 2021.

Specification

Context window
16K
Max output
4K
Knowledge cutoff
Sep 30, 2021
Parameters
Undisclosed
Licence
Proprietary
Serving providers
1
Moderated
Yes

Intelligence

3.2

9th percentile

Coding

10.7

Coding Index

Agentic

Agentic Index

Output speed

Median across providers

Latency

Time to first token

Cost per task

$0.03

Estimated

Benchmarks

Where the score comes from

The Intelligence Index is a composite. These are the underlying evaluations this model was actually measured on.

Evaluation scores

Percentage correct · higher is better

  • MMLU-Pro
    46.2%
  • GPQA Diamond
    29.7%

An evaluation missing from this list was not run for this model — it is not a zero.

View as table
EvaluationScore
MMLU-Pro46.2%
GPQA Diamond29.7%

Against its peers

Intelligence Index · this model highlighted, nearest peers in grey

Peers are the models sitting closest on the Intelligence Index — the set you would realistically choose between.

View as table
ModelIntelligence
Hermes 3 70B Instruct4.8
Phi 44.6
Mistral Large4.1
Mixtral 8x22B Instruct4.0
Reka Flash 33.7
Claude 3 Haiku3.5
GPT-3.5 Turbo (batch)3.2
GPT-3.5 Turbo3.2

Percentile among all indexed models

Intelligence9th
Coding12th

Pricing

What it costs to run

List prices per million tokens, plus what one representative task works out to.

List price

Input / 1M tokens
$0.25
Output / 1M tokens
$0.75
Cached input / 1M
Not offered
Blended 3:1
$0.375

One task, estimated

$0.03

Input tokens
50,000
Output tokens
25,000
Profile
Standard

Estimated from list pricing: 50K input tokens plus 80K output tokens for reasoning models (25K for non-reasoning).

Serving providers

Speed and latency figures are medians across these providers, so a widely-served model reports a blend rather than any single endpoint.