meta/llama-3-70b-instruct

8 000 tokens context

Model ID

meta/llama-3-70b-instruct

Use It in Python

from openai import OpenAI

client = OpenAI(
    base_url="https://api.replicate.com/v1",
    api_key="YOUR_API_KEY",
)

response = client.chat.completions.create(
    model="meta/llama-3-70b-instruct",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)

Don't have a key yet? See how to get one — quick registration required.

Free Tier Limits (Replicate)

Rate Limit
Varies by model
Daily Limit
Credit-based
Monthly Limit
One-time trial
Get Your API Key View Replicate