Llama 3.1 8B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).

ChatMeta131k tokens$0.0545 / $0.0872 · 1M

meta-llama/llama-3.1-8b-instruct

Context
131k tokens
Completion cap
131,072
Tools
Yes
JSON
Yes
Released
2024-07-23

Call it from Geek Hub

Same OpenAI SDK. Change the base URL and the model id.

curl https://api.geekhub.mx/v1/chat/completions \
  -H "Authorization: Bearer $GEEKHUB_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.1-8b-instruct",
    "messages": [{"role": "user", "content": "Hola"}]
  }'
Get an API key

Frequently asked questions

What is Llama 3.1 8B Instruct?
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/). Llama 3.1 8B Instruct runs on the Geek Hub API (OpenAI-compatible). Model id: meta-llama/llama-3.1-8b-instruct.
Is Llama 3.1 8B Instruct free?
No. Input is $0.0545 per 1M tokens and output is $0.0872 per 1M tokens on Geek Hub (markup included).
What is the context length of Llama 3.1 8B Instruct?
Llama 3.1 8B Instruct has a 131k tokens context window. It supports up to 131,072 completion tokens.
Does Llama 3.1 8B Instruct support tool calling and structured outputs?
Llama 3.1 8B Instruct accepts tools and tool_choice for function calling. It also supports structured outputs via a JSON schema in response_format.
When was Llama 3.1 8B Instruct released?
Llama 3.1 8B Instruct was released on 2024-07-23.

More models from Meta