GitHub Models
Free QuotasFree access to GPT-4o, Llama, Mistral and more through GitHub's model marketplace. Requires a GitHub account. Limits vary by Copilot tier.
Rate Limit
Max Context
Cost
$0
.00
Quick Start
API Endpoint
https://models.inference.ai.azure.com
Why Choose GitHub Models?
-
Free Quotas - No hidden costs or credit card required
-
Instant Access - Get started in seconds with API key
-
Generous Limits - Perfect for development & production
-
10 Models - Choose the perfect model for your task
Example: Making Your First Request
from openai import OpenAI
client = OpenAI(
api_key="YOUR_GITHUB_TOKEN",
base_url="https://models.inference.ai.azure.com"
)
response = client.chat.completions.create(
model="gpt-4o",
messages=[
{"role": "user", "content": "Explain how GitHub Models works"}
]
)
print(response.choices[0].message.content)
Free Models
| Model Name | ID | Context | Capabilities |
|---|---|---|---|
| GPT-4o |
gpt-4o
|
128,000 |
Reasoning
|
| Llama 3.3 70B Instruct |
Meta-Llama-3.3-70B-Instruct
|
128,000 |
|
| Phi-4 |
Phi-4
|
128,000 |
Reasoning
|
| Mistral Large (24.11) |
Mistral-large-2411
|
128,000 |
Reasoning
Multilingual
|
| Cohere Command R+ |
Cohere-command-r-plus-08-2024
|
128,000 |
|
| AI21 Jamba 1.5 Large |
AI21-Jamba-1.5-Large
|
256,000 |
|
| GPT-5 Chat |
gpt-5-chat
|
128,000 |
|
| GPT-5 Mini |
gpt-5-mini
|
128,000 |
|
| Llama 4 Scout |
Llama-4-Scout-17B-16E-Instruct
|
128,000 |
|
| Llama 4 Maverick |
Llama-4-Maverick-17B-128E-Instruct-FP8
|
1,000,000 |
|
Current Limits
Request Limits
-
Rate Limit10 Requests / min (high-tier) / higher for mini-tier
-
Daily Limit50 Requests / day (high-tier models) / 150 Requests / day (mini-tier models)
Token Limits
Throughput
Monthly Cap
Key Features
Known Limitations
- Restrictive limits
- Requires GitHub account
- Rate limits vary by Copilot tier
Frequently Asked Questions
How do I get an API key?
Getting your GitHub Models API key is simple:
- Visit the official GitHub Models website
- Sign up for a free account (no credit card required)
- Navigate to the API section in your dashboard
- Generate your API key and start using it immediately
Are there free quotas?
Yes! GitHub Models offers a generous free tier with no credit card required. Check the provider's website for current terms and conditions regarding free tier availability and duration.
What happens if I exceed the free limits?
If you reach the rate limit, your requests will be temporarily throttled. The limits reset automatically after the specified time period. You can always monitor your usage in the provider's dashboard.
Is my data secure?
GitHub Models takes security seriously. All API communications are encrypted via HTTPS. Check their privacy policy and terms of service for detailed information about data handling and retention policies.
Start Building with GitHub Models Today
Join thousands of developers using GitHub Models to build amazing AI-powered applications. Get started in less than 2 minutes.