Overview
Provider Type
LocalAPI Endpoint
http://localhost:5000/v1
Free Tier Highlights
Why Choose Text Generation WebUI?
Text Generation WebUI (now TextGen) is a highly customizable interface for running local models with several back ends (llama.cpp, ExLlama, Transformers) and an OpenAI-compatible API.
Best for: tinkerers who want to compare back ends and tune every setting.
Watch out: development has slowed in 2026 (last release in May).
Quick Start Guide
Clone repo or use One-Click Installer
Run start script
Download models via UI
Load model
Enable OpenAI extension
Available Models
1 free model| Model Name | ID | Context | |
|---|---|---|---|
| Any Local Model Free |
local-model
|
Varies |
Integration Examples
Ready-to-use code snippets for your applications.
Select Model
Free Tier Pricing & Limits
Rate Limit
Requests per minute
Daily Quota
Requests per day
Token Limit
Tokens per minute
Monthly Quota
Per month limit
Use Cases
Power user inference
Testing new quantization formats
Fine-tuning LoRAs locally
Complex character cards
Limitations & Considerations
Complex for beginners
Updates can break things
Resource heavy
Requires driver setup
Community Hub
LiveJoin the discussion, share tips, and rate Text Generation WebUI.
Quick Reactions
Add Discussion
Comments are moderated. Be helpful and respectful.