Inference provider
Groq
6 models served. Speed, latency and price below are medians across this provider's catalogue, not per-endpoint measurements.
Models served
6
Median output speed
436 t/s
Median latency
201ms
Median price / 1M
$0.197
Catalogue
Strongest and fastest on this provider
What the catalogue looks like at the top end, on the two axes that usually decide the choice.
Highest Intelligence Index
Among models this provider serves
- M2.7MiniMax22.8
- gpt-oss-120bOpenAI11.6
- gpt-oss-20bOpenAI9.0
View as table
| Model | Intelligence |
|---|---|
| M2.7 (MiniMax) | 22.8 |
| gpt-oss-120b (OpenAI) | 11.6 |
| gpt-oss-20b (OpenAI) | 9.0 |
Fastest output
Median tokens per second
- gpt-oss-120bOpenAI641 t/s
- gpt-oss-safeguard-20bOpenAI537 t/s
- 461 t/s
- gpt-oss-20bOpenAI410 t/s
- M2.7MiniMax252 t/s
- 190 t/s
View as table
| Model | Tokens/s |
|---|---|
| gpt-oss-120b (OpenAI) | 641 |
| gpt-oss-safeguard-20b (OpenAI) | 537 |
| Llama 3.1 8B Instruct (Meta) | 461 |
| gpt-oss-20b (OpenAI) | 410 |
| M2.7 (MiniMax) | 252 |
| Llama 3.3 70B Instruct (Meta) | 190 |
Full catalogue
All 6 models on Groq
Filter by creator
6 of 6 models| M2.7 MiniMaxopen | 22.8 | $0.11 |
| gpt-oss-120b OpenAIopen | 11.6 | $0.06 |
| gpt-oss-20b OpenAIopen | 9.0 | $0.008 |
| gpt-oss-safeguard-20b OpenAIopen | — | $0.03 |
| Llama 3.3 70B Instruct Metaopen | — | $0.05 |
| Llama 3.1 8B Instruct Metaopen | — | $0.005 |