Overview
Provider Type
LocalAPI Endpoint
http://localhost:8080/v1
Free Tier Highlights
Why Choose llamafile?
llamafile packs an LLM and llama.cpp into one executable that runs on Windows, macOS and Linux, with nothing to install.
Best for: sharing a model as a single file, or running one on a machine you don't control.
Watch out: the bundled example models are old; pick a recent GGUF.
Quick Start Guide
Download a .llamafile from HuggingFace
Open terminal
Run ./model.llamafile
Open browser at localhost:8080
Available Models
3 free models| Model Name | ID | Context | Capabilities | |
|---|---|---|---|---|
| LLaVA 1.5 Free |
llava-1.5-7b-q4
|
Local |
Vision
|
|
| Mistral 7B Free |
mistral-7b-instruct-v0.2.Q4_K_M
|
Local |
- | |
| TinyLlama Free |
tinyllama-1.1b-chat-v1.0.Q8_0
|
Local |
- |
Integration Examples
Ready-to-use code snippets for your applications.
Select Model
Free Tier Pricing & Limits
Rate Limit
Requests per minute
Daily Quota
Requests per day
Token Limit
Tokens per minute
Monthly Quota
Per month limit
Use Cases
Sharing models easily
Archiving models
Quick local testing
Education/Demos
Limitations & Considerations
File sizes are large (contain weights)
CLI usage often required
Windows requires appending .exe
Beta software
Community Hub
LiveJoin the discussion, share tips, and rate llamafile.
Quick Reactions
Add Discussion
Comments are moderated. Be helpful and respectful.