koboldcpp/Llama-3.2-1B-Instruct
from openai import OpenAI
client = OpenAI(
base_url="https://oai.aihorde.net/v1",
api_key="YOUR_API_KEY",
)
response = client.chat.completions.create(
model="koboldcpp/Llama-3.2-1B-Instruct",
messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)Other free options: see every provider serving this model. Don't have a key yet? See how to get one — no credit card needed for AI Horde (OpenAI-compatible front).