Bedrock
100.00%Context128K
Max output8.2K
p50 latency269 ms
Throughput151.0 t/s
Input price$0.72
Output price$0.72
Zero retentionNo training
Model directory
Baseer model profileLanguage model
meta/llama-3.1-70b
Llama 3.1 70B Instruct
An update to Meta Llama 3 70B Instruct that includes an expanded 128K context length, multilinguality and improved reasoning capabilities.
Input / 1M tokens$0.4
Output / 1M tokens$0.4
Maximum context131.1K
Inference providers2
Price comparison
USD per one million tokens, using current provider data.
Provider latency
Last-hour p50 in milliseconds; lower is better.
Provider uptime
Reported availability over the last 24 hours; not a contractual SLA.
Inference providers
Compare current pricing, performance, and privacy across every available provider.
Deepinfra
99.86%Context131.1K
Max output16.4K
p50 latency458 ms
Throughput32.0 t/s
Input price$0.4
Output price$0.4
Zero retentionNo training
| Provider | Maximum context | Max output | p50 latency | p50 throughput | 24h uptime | Input / 1M tokens | Output / 1M tokens | Privacy |
|---|---|---|---|---|---|---|---|---|
Bedrock | 128K | 8.2K | 269 ms | 151.0 t/s | 100.000% | $0.72 | $0.72 | |
Deepinfra | 131.1K | 16.4K | 458 ms | 32.0 t/s | 99.863% | $0.4 | $0.4 |
What can this model do?
Available modalities and capabilities across inference providers.
TextTool useTools
Technical profile
- Model type
- Language model
- Release date
- Jul 23, 2024
- Knowledge cutoff
- 2023-12
- Regions
- —
- API specifications
- V2, V3, V4
- Temperature control
- Supported
Model identifier
meta/llama-3.1-70bModel profile updated: Sep 12, 2026, 1:46 PM
Related models
More options from the same creator or model category.