Bedrock
100.00%Context128K
Max output8.2K
p50 latency212 ms
Throughput241.0 t/s
Input price$0.22
Output price$0.22
Zero retentionNo training
Model directory
Baseer model profileLanguage model
meta/llama-3.1-8b
Llama 3.1 8B Instruct
An update to Meta Llama 3 8B Instruct that includes an expanded 128K context length, multilinguality and improved reasoning capabilities.
Input / 1M tokens$0.02
Output / 1M tokens$0.05
Maximum context131.1K
Inference providers3
Price comparison
USD per one million tokens, using current provider data.
Provider latency
Last-hour p50 in milliseconds; lower is better.
Provider uptime
Reported availability over the last 24 hours; not a contractual SLA.
Inference providers
Compare current pricing, performance, and privacy across every available provider.
Deepinfra
99.77%Context131.1K
Max output16.4K
p50 latency425 ms
Throughput20.5 t/s
Input price$0.03
Output price$0.05
Zero retentionNo training
Novita
100.00%Context16.4K
Max output16.4K
p50 latency423 ms
Throughput165.5 t/s
Input price$0.02
Output price$0.05
No training
| Provider | Maximum context | Max output | p50 latency | p50 throughput | 24h uptime | Input / 1M tokens | Output / 1M tokens | Privacy |
|---|---|---|---|---|---|---|---|---|
Bedrock | 128K | 8.2K | 212 ms | 241.0 t/s | 100.000% | $0.22 | $0.22 | |
Deepinfra | 131.1K | 16.4K | 425 ms | 20.5 t/s | 99.770% | $0.03 | $0.05 | |
Novita | 16.4K | 16.4K | 423 ms | 165.5 t/s | 100.000% | $0.02 | $0.05 |
What can this model do?
Available modalities and capabilities across inference providers.
TextTool useTools
Technical profile
- Model type
- Language model
- Release date
- Jul 23, 2024
- Knowledge cutoff
- 2023-12
- Regions
- —
- API specifications
- V2, V3, V4
- Temperature control
- Supported
Model identifier
meta/llama-3.1-8bModel profile updated: Sep 12, 2026, 1:46 PM
Related models
More options from the same creator or model category.