
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient.
It has demonstrated strong performance compared to leading closed-source models in human evaluations.
To read more about the model release, click hereOpens in new tab. Usage of this model is subject to Meta's Acceptable Use PolicyOpens in new tab.
Modalities
In / Out Price
$0.02 / $0.04per 1M
Context
131K
Released
Jul 23, 2024
Knowledge Cutoff
Dec 2023
Different companies host the same model. OpenRouter routes your request to one of them based on the routing mode you pick — Balanced (price + speed), Nitro (fastest), or Exacto (highest tool-calling accuracy).
The average price customers actually pay for this model, next to the prices providers post. Caching and discounts mean the price actually paid is often well below the listed one.
Throughput is how fast the model writes (tokens per second — higher is better). Latency is total round-trip time (lower is better). TTFT is time-to-first-token — how long before you see anything appear (lower is better).
Uptime is the percentage of the past 3 days that at least one provider was responding to requests. Availability is the percentage of time that inference was successfully served. OpenRouter continuously monitors and uses the next-best provider when one returns an error.
Scores on standardized evaluations. Higher percentages are better — and rank percentile shows where this model lands among all models on OpenRouter.
| Source | Benchmark | Score |
|---|---|---|
| Artificial Analysis | Llama 3.1 Instruct 8B Coding Index | 5.4 |
| Artificial Analysis | Llama 3.1 Instruct 8B GPQA Diamond | 25.9% |
| Artificial Analysis | Llama 3.1 Instruct 8B HLE | 5.3% |
| Artificial Analysis | Llama 3.1 Instruct 8B IFBench | 28.6% |
| Artificial Analysis | Llama 3.1 Instruct 8B τ²-Bench Telecom | 16.4% |
| Artificial Analysis | Llama 3.1 Instruct 8B AA-LCR | 18.0% |
| Artificial Analysis | Llama 3.1 Instruct 8B GDPval-AA | 0.0% |
| Artificial Analysis | Llama 3.1 Instruct 8B CritPt | 0.0% |
| Artificial Analysis | Llama 3.1 Instruct 8B Terminal-Bench Hard | 0.8% |
| Artificial Analysis | Llama 3.1 Instruct 8B AA-Omniscience Accuracy | 8.5% |
| Artificial Analysis | Llama 3.1 Instruct 8B AA-Omniscience Non-Hallucination Rate | 57.0% |
Public apps that send the most traffic to this model. Good signal for what real production workloads look like — and a hint at which use cases this model is best suited for.
Token volume and request traffic to this model over time.
Drop-in code to call this model. OpenRouter's API is OpenAI-compatible — most SDKs work by just swapping the base URL. The only thing that changes between models is the model slug below.
| $0.02 | $0.04 | -- | 0.60s | 23 tps | ||
| $0.02 | $0.05 | -- | 0.52s | 33 tps | ||
| $0.05 | $0.08 | $0.025 | 0.60s | 46 tps | ||
| $0.152 | $0.287 | -- | 0.48s | 15 tps | ||
| $0.22 | $0.22 | $0.22 | 0.27s | 80 tps |
Throughput
80tok/s
P50, best across providers
Latency
0.27s
P50, best provider
100.00%
99.93%
When an error occurs in an upstream provider, we can recover by routing to another healthy provider, if your request filters allow it. You can access per-provider uptime data programmatically through the Endpoints API. Learn more about our load balancing and customization options.
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.
Llama 3.1 8B Instruct costs $0.02/M input tokens and $0.04/M output tokens.
Llama 3.1 8B Instruct has a 131,072 token context window. It supports up to 16,384 completion tokens.
The Llama 3.1 8B Instruct endpoint shown on this page does not accept tools, so function calling is unavailable there. It supports response_format for JSON output, without JSON-schema enforcement.
Llama 3.1 8B Instruct is served by 5 providers on OpenRouter: DeepInfra, NovitaAI, Groq, Cloudflare and CoreWeave. Requests are routed to the best available provider, with automatic failover to the others, and you can pin or exclude providers with provider routing.
Llama 3.1 8B Instruct was released on July 23, 2024. Its knowledge cutoff is December 31, 2023.