n4nAI
Open console →
← Models
M

Llama 3.1 70B Instruct

meta-llamaReleased Jul 2024Hugging Face ↗

meta-llama/llama-3.1-70b-instruct

About

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Context
131,072
Max output
16,384
Tokenizer
Llama3
Knowledge cutoff
Dec 2023
Input
text
Output
text

Pricing

per 1M tokens
Input
$0.80
Output
$0.80

Use this model

curl https://api.n4n.ai/v1/chat/completions \
  -H "Authorization: Bearer $N4N_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.1-70b-instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Authenticate with an API key from your console; prices above are per 1M tokens.

Providers

max context 131,072
ProviderInput $/1MOutput $/1M
Wandb wandb$0.80$0.80
Yuwu yuwu$0.80$0.80

Supported parameters

frequency_penaltylogit_biaslogprobsmax_tokensmin_ppresence_penaltyrepetition_penaltyresponse_formatseedstopstructured_outputstemperaturetool_choicetoolstop_ktop_logprobstop_p