Overview
Provider Type
LocalAPI Endpoint
http://localhost:1337/v1
Free Tier Highlights
Why Choose Jan.ai?
Jan is an open-source, offline ChatGPT alternative for the desktop, with a local OpenAI-compatible server, MCP tool support and a bundled llama.cpp engine.
Best for: people who want a polished, private chat app that also serves an API to other tools.
Watch out: speed and model size depend entirely on your hardware.
Quick Start Guide
Download Jan from https://jan.ai/
Install and Open
Go to Hub -> Download Model
Start Chatting
Enable Local Server in settings
Available Models
9 free models| Model Name | ID | Context | |
|---|---|---|---|
| GPT-OSS 20B (GGUF) Free |
gpt-oss-20b
|
- | |
| LFM3 1.7B (GGUF) Free |
lfm3-1.7b
|
- | |
| Flint 40B (GGUF) Free |
flint-40b
|
- | |
| Ternary Bonsai 2 27B (GGUF) Free |
prism-ml/Ternary-Bonsai-2-27B-gguf
|
- | |
| Gemma 4 12B Free |
gemma-4-12b-it
|
- | |
| Qwen3.8 27B (GGUF) Free |
unsloth/Qwen3.8-27B-GGUF
|
- | |
| Llama 3 (Local) Free |
llama3-8b-instruct
|
System RAM dependent |
|
| Mistral (Local) Free |
mistral-7b-instruct
|
System RAM dependent |
|
| Gemma 2 (Local) Free |
gemma-2-9b-it
|
System RAM dependent |
Integration Examples
Ready-to-use code snippets for your applications.
Select Model
Free Tier Pricing & Limits
Rate Limit
Requests per minute
Daily Quota
Requests per day
Token Limit
Tokens per minute
Monthly Quota
Per month limit
Use Cases
Privacy-critical work
Offline coding/writing
Testing local models
Personal AI assistant
Limitations & Considerations
Requires decent hardware (RAM/GPU)
Battery drain on laptops
Local model quality vs GPT-4
Download sizes (GBs)
Community Hub
LiveJoin the discussion, share tips, and rate Jan.ai.
Quick Reactions
Add Discussion
Comments are moderated. Be helpful and respectful.