Meta: Llama 3.1 8B Instruct
meta-llama/llama-3.1-8b-instruct
Llama 3.1 8B Instruct (Meta) is a compact 8B open-weight model priced near the bottom of the board, at $0.05/$0.08 per million input/output tokens, served by 5 independent hosts. For the money it delivers #256 of 260 on the TryAii Score. It's among the fastest models we track, at roughly 32-140 tokens/sec.
Prompt $/1M
$0.050
Completion $/1M
$0.080
Context
131,072 tok
Best provider
318 tok/s · Groq
Specs
- Model id
- meta-llama/llama-3.1-8b-instruct
- Display name
- Meta: Llama 3.1 8B Instruct
- Modality
- text->text
- Tokenizer
- Llama3
- Instruct type
- llama3
- Context length
- 131,072
- Max completion
- 117,964
- Prompt $/1M
- $0.050
- Completion $/1M
- $0.080
- Free tier
- no
Capabilities
- Function callingno
- JSON modeno
- System promptyes
- Visionno
- Moderatedno
Benchmark scores
Each axis is one benchmark, normalized to the best model in the field.
No benchmark data for this model.
Speed by provider
| Provider | tok/s |
|---|---|
| Groqfastest | 318 |
| CoreWeave | 140 |
| Novita | 113 |
| DeepInfra | 32 |
| Cloudflare | 18 |