Llama 3.1 Nemotron Ultra 253B

128 000 context

Model ID

nvidia/llama-3.1-nemotron-ultra-253b-v1

Use It in Python

from openai import OpenAI

client = OpenAI(
    base_url="https://integrate.api.nvidia.com/v1",
    api_key="YOUR_API_KEY",
)

response = client.chat.completions.create(
    model="nvidia/llama-3.1-nemotron-ultra-253b-v1",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)

Other free options: see every provider serving this model. Don't have a key yet? See how to get one — quick registration required.

Free Tier Limits (NVIDIA NIM)

Rate Limit
~40 Requests per minute (varies per model, not published)
Daily Limit
-
Monthly Limit
-