Groq Provider

Groq's ultra-fast LPU inference with various models

Visit company

Supported Models

GPT OSS 120B

openai

gpt-oss-120b

Context131,072 tokens

Providers1

Input$14.70/M

Output$58.80/M

Streaming

Tools

Reasoning

JSON Output

GPT OSS 20B

openai

gpt-oss-20b

Context131,072 tokens

Providers1

Input$7.35/M

Output$29.40/M

Streaming

Tools

Reasoning

JSON Output

Whisper Large V3

openai

whisper-large-v3

Context0 tokens

Providers1

Audio$0.181/min

Whisper Large V3 Turbo

openai

whisper-large-v3-turbo

Context0 tokens

Providers1

Audio$0.065/min

Llama 3.1 8B Instruct

meta

llama-3.1-8b-instruct

Context131,072 tokens

Providers1

Input$4.90/M

Output$7.84/M

Streaming

Tools

JSON Output

Llama 3.3 70B Instruct

meta

llama-3.3-70b-instruct

Context131,072 tokens

Providers1

Input$57.82/M

Output$77.42/M

Streaming

Tools

JSON Output

Loading providers...

Groq Provider

Groq's ultra-fast LPU inference with various models

Visit company

Supported Models

GPT OSS 120B

openai

gpt-oss-120b

Context131,072 tokens

Providers1

Input$14.70/M

Output$58.80/M

Streaming

Tools

Reasoning

JSON Output

GPT OSS 20B

openai

gpt-oss-20b

Context131,072 tokens

Providers1

Input$7.35/M

Output$29.40/M

Streaming

Tools

Reasoning

JSON Output

Whisper Large V3

openai

whisper-large-v3

Context0 tokens

Providers1

Audio$0.181/min

Whisper Large V3 Turbo

openai

whisper-large-v3-turbo

Context0 tokens

Providers1

Audio$0.065/min

Llama 3.1 8B Instruct

meta

llama-3.1-8b-instruct

Context131,072 tokens

Providers1

Input$4.90/M

Output$7.84/M

Streaming

Tools

JSON Output

Llama 3.3 70B Instruct

meta

llama-3.3-70b-instruct

Context131,072 tokens

Providers1

Input$57.82/M

Output$77.42/M

Streaming

Tools

JSON Output