Overview

Provider Type

Local

API Endpoint


                                                        http://localhost:5000/v1

Free Tier Highlights

Hardware dependent

Why Choose Text Generation WebUI?

Text Generation WebUI stands out for its unique features and capabilities. With a developer-friendly API and comprehensive documentation, you can integrate AI capabilities into your applications within minutes.

Quick Start Guide

Clone repo or use One-Click Installer

Run start script

Download models via UI

Load model

Enable OpenAI extension

Available Models

Model Name	ID	Context	Capabilities
Any Local Model Free	`local-model`	Varies	-

Integration Examples

Ready-to-use code snippets for your applications.

Select a Model

Select Model

main.py

from openai import OpenAI

# Enable OpenAI extension in text-generation-webui
client = OpenAI(
    api_key="textgen",
    base_url="http://localhost:5000/v1"
)

response = client.chat.completions.create(
    model="local-model",
    messages=[
        {"role": "user", "content": "Tell me about text generation"}
    ]
)

print(response.choices[0].message.content)

index.js

// Enable OpenAI extension first
const response = await fetch('http://localhost:5000/v1/chat/completions', {
  method: 'POST',
  headers: { 'Content-Type': 'application/json' },
  body: JSON.stringify({
    model: 'local-model',
    messages: [
      { role: 'user', content: 'Tell me about text generation' }
    ]
  })
});

const data = await response.json();
console.log(data.choices[0].message.content);

terminal

# Enable OpenAI extension in text-generation-webui
curl http://localhost:5000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "local-model",
    "messages": [
      {
        "role": "user",
        "content": "Tell me about text generation"
      }
    ]
  }'

example.php

<?php
$apiKey = 'YOUR_API_KEY';
$url = "http://localhost:5000/v1/models/local-model:generateContent?key=$apiKey";

$data = [
    "contents" => [
        ["parts" => [["text" => "Explain quantum mechanics"]]]
    ]
];

$ch = curl_init($url);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_POST, true);
curl_setopt($ch, CURLOPT_POSTFIELDS, json_encode($data));
curl_setopt($ch, CURLOPT_HTTPHEADER, ['Content-Type: application/json']);

$response = curl_exec($ch);
curl_close($ch);

echo $response;
?>

main.go

package main

import (
    "context"
    "fmt"
    "log"
    "github.com/google/generative-ai-go/genai"
    "google.golang.org/api/option"
)

func main() {
    ctx := context.Background()
    client, err := genai.NewClient(ctx, option.WithAPIKey("YOUR_API_KEY"))
    if err != nil { log.Fatal(err) }
    defer client.Close()

    model := client.GenerativeModel("local-model")
    resp, err := model.GenerateContent(ctx, genai.Text("Explain quantum mechanics"))
    if err != nil { log.Fatal(err) }
    
    // ...
}

Free Tier Pricing & Limits

Rate Limit

Requests per minute

Hardware dependent

Daily Quota

Requests per day

Unlimited

Token Limit

Tokens per minute

Unlimited

Monthly Quota

Per month limit

Free Open Source

Use Cases

Power user inference

Testing new quantization formats

Fine-tuning LoRAs locally

Complex character cards

Limitations & Considerations

Complex for beginners

Updates can break things

Resource heavy

Requires driver setup

Community Hub

Live

Join the discussion, share tips, and rate Text Generation WebUI.

Quick Reactions

Add Discussion

Display Name

Comment

Comments are moderated. Be helpful and respectful.

Recent Activity

0 comments

Cookie Consent

Text Generation WebUI

Overview

Provider Type

API Endpoint

Free Tier Highlights

Why Choose Text Generation WebUI?

Quick Start Guide

Clone repo or use One-Click Installer

Run start script

Download models via UI

Load model

Enable OpenAI extension

Available Models

Integration Examples

Select Model

Free Tier Pricing & Limits

Rate Limit

Daily Quota

Token Limit

Monthly Quota

Use Cases

Limitations & Considerations

Community Hub

Quick Reactions

Add Discussion

Recent Activity

Ready to Get Started?

Cookie Consent

Text Generation WebUI

Overview

Provider Type

API Endpoint

Free Tier Highlights

Why Choose Text Generation WebUI?

Quick Start Guide

Clone repo or use One-Click Installer

Run start script

Download models via UI

Load model

Enable OpenAI extension

Available Models

Integration Examples

Select Model

Free Tier Pricing & Limits

Rate Limit

Daily Quota

Token Limit

Monthly Quota

Use Cases

Limitations & Considerations

Community Hub

Quick Reactions

Add Discussion

Recent Activity

Suggest an Edit

Ready to Get Started?