Llama 3.1 70B Instruct

by Meta

Zero data retention
meta-llama/llama-3.1-70b-instruct
Input
$0.56/1M tokens
Output
$0.56/1M tokens
Context
131Ktokens
Max output
16Ktokens
Knows to
December 2023
Released
23 Jul 2024

About

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases.

Pricing

Input$0.56per 1M prompt tokens
Output$0.56per 1M generated tokens, reasoning included

What a request costs

Typical requestEachPer 1,000
Short chat reply1,500 in · 400 out$0.0011$1.06
Question over a long document40,000 in · 800 out$0.023$22.85
Agent tool step20,000 in · 1,200 out$0.012$11.87

At the developer-API rate, before any provider promotion or prompt-cache saving. In the app, the model picker shows what a message costs on your plan before you send it.

Benchmarks

Intelligence6.6#266 of 285

Scores from Artificial Analysis; bars are scaled to the best model on our list. Published by OpenRouter alongside its catalogue.

Call it from code

OpenAI-compatible: point any OpenAI SDK at https://api.privateer.pro/v1 and set model. Keys are created in the app under Settings.

cURL
curl https://api.privateer.pro/v1/chat/completions \
  -H "Authorization: Bearer $PRIVATEER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.1-70b-instruct",
    "messages": [{ "role": "user", "content": "Hello" }]
  }'
Python
import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.privateer.pro/v1",
    api_key=os.environ["PRIVATEER_API_KEY"],
)
reply = client.chat.completions.create(
    model="meta-llama/llama-3.1-70b-instruct",
    messages=[{"role": "user", "content": "Hello"}],
)
print(reply.choices[0].message.content)
JavaScript
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.privateer.pro/v1",
  apiKey: process.env.PRIVATEER_API_KEY,
});
const reply = await client.chat.completions.create({
  model: "meta-llama/llama-3.1-70b-instruct",
  messages: [{ role: "user", content: "Hello" }],
});
console.log(reply.choices[0].message.content);

Parameters this model accepts

frequency_penaltylogit_biasmax_tokensmin_ppresence_penaltyrepetition_penaltyresponse_formatseedstopstructured_outputstemperaturetool_choicetoolstop_ktop_p

API reference → · How API billing works →

Prices are USD at the developer-API rate, as of 16 Oct 2026, rebuilt daily from the providers’ live catalogues. ← All models