Llama 3.1 70B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
meta-llama/llama-3.1-70b-instruct
- Context
- 131k tokens
- Completion cap
- 16,384
- Tools
- Yes
- JSON
- Yes
- Released
- 2024-07-23
Call it from Geek Hub
Same OpenAI SDK. Change the base URL and the model id.
curl https://api.geekhub.mx/v1/chat/completions \
-H "Authorization: Bearer $GEEKHUB_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "meta-llama/llama-3.1-70b-instruct",
"messages": [{"role": "user", "content": "Hola"}]
}'Frequently asked questions
- What is Llama 3.1 70B Instruct?
- Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/). Llama 3.1 70B Instruct runs on the Geek Hub API (OpenAI-compatible). Model id: meta-llama/llama-3.1-70b-instruct.
- Is Llama 3.1 70B Instruct free?
- No. Input is $0.436 per 1M tokens and output is $0.436 per 1M tokens on Geek Hub (markup included).
- What is the context length of Llama 3.1 70B Instruct?
- Llama 3.1 70B Instruct has a 131k tokens context window. It supports up to 16,384 completion tokens.
- Does Llama 3.1 70B Instruct support tool calling and structured outputs?
- Llama 3.1 70B Instruct accepts tools and tool_choice for function calling. It also supports structured outputs via a JSON schema in response_format.
- When was Llama 3.1 70B Instruct released?
- Llama 3.1 70B Instruct was released on 2024-07-23.
More models from Meta
- Llama 3.1 8B InstructMeta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance co
- Llama 3.2 1B InstructLlama 3.2 1B is a 1-billion-parameter language model focused on efficiently performing natural language tasks, such as summarization, dialogue, and multilingual text analysis. Its
- Llama 3.2 3B InstructLlama 3.2 3B is a 3-billion-parameter multilingual large language model, optimized for advanced natural language processing tasks like dialogue generation, reasoning, and summariza
- Llama 3.3 70B InstructThe Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text on
- Llama 4 MaverickLlama 4 Maverick 17B Instruct (128E) is a high-capacity multimodal language model from Meta, built on a mixture-of-experts (MoE) architecture with 128 experts and 17 billion active
- Llama 4 ScoutLlama 4 Scout 17B Instruct (16E) is a mixture-of-experts (MoE) language model developed by Meta, activating 17 billion parameters out of a total of 109B. It supports native multimo