Models Github Docs

Find and experiment with AI models for free. GitHub Models is a suite of developer tools that take you from AI idea to ship, including a model catalog, prompt management, and quantitative evaluations. Run your first model with GitHub Models in minutes. GitHub Models helps you go from prompt to production by testing, comparing, evaluating, and integrating AI directly in your repository. Manage GitHub Models in your enterprise and organizations. You can now use the GitHub Models REST API to programmatically explore and run inference with models hosted on GitHub.

This includes: These endpoints support streaming and non-streaming completions, as well as advanced options like temperature, stop sequences, and deterministic sampling via seed. Check out the Models API reference docs to get started, or join the conversation in community discussions. The rise of the AI engineer with GitHub Models–bringing the power of industry leading large and small language models to GitHub's more than 100 million users directly on GitHub. The software development landscape is evolving with the introduction of GitHub Models, a groundbreaking platform that opens the doors for over 100 million developers to engage with and leverage advanced AI models. Traditionally, developers wrote code to build and deploy software, but now, they can easily integrate machine learning models into their workflows, fostering the rise of "AI engineers."

GitHub Models is a platform that provides seamless access to cutting-edge AI models like Llama 3.1, GPT-4o, Phi 3, and Mistral Large 2. Through a built-in playground, developers can test prompts, tweak model parameters, and compare outputs, all within the familiar GitHub environment. This eliminates the barrier to entry for experimenting with machine learning and generative AI, democratizing access to powerful tools that were once limited to large organizations or specialized teams. Model Playground: The interactive model playground allows developers, students, and hobbyists to explore AI without diving into complex infrastructures. It promotes learning through experimentation, letting users compare models and understand their unique capabilities. Whether it’s low-latency models like Mistral or multimodal GPT-4o, users can explore how each model performs across different use cases, from generating text to working with audio and vision.

Integration with Codespaces: GitHub provides an easy transition from experimentation to implementation with Codespaces. Developers can spin up code environments with sample inference code for various frameworks, allowing them to test AI models without worrying about compatibility issues. Once they’re ready, users can integrate the models directly into their projects, ensuring a smooth transition from prototype to production. GitHub Models helps you go from prompt to production by testing, comparing, evaluating, and integrating AI directly in your repository. GitHub Models are AI capabilities built directly into GitHub, acting like an “AI lab” within your repository. They let you experiment, compare, and run models seamlessly as part of your existing workflow – no switching tools required.

This makes it much easier to move from experimentation to production AI without context switching or security headaches. In simple terms, inference is running a trained AI model against new input to get an output. In your workflows, inference means you can feed code, text, or structured data into a model—and instantly use the results to drive automation. The actions/ai-inference GitHub Action gives you a standard way to run inference in a workflow job. Fascinated by software development since his childhood in Germany, Thomas Dohmke has built a career building tools to accelerate developer happiness. Previously, Thomas was the Chief Executive Officer of GitHub (2021-2025) where he oversaw the rise of the world’s most widely adopted AI developer tools—including the launches of GitHub Copilot, Copilot Workspace, and GitHub Models.

Thomas has also been a celebrated TED speaker and holds a PhD in mechanical engineering from University of Glasgow, UK. Learn how one of GitHub’s fastest-growing open source projects is redefining smart homes without the cloud. Learn how to write effective agents.md files for GitHub Copilot with practical tips, real examples, and templates from analyzing 2,500+ repositories. Finding the perfect gift for your favorite developer is easy with our top tips. Discover how Python changed developer culture—and see why it keeps evolving. Access to this page requires authorization.

You can try signing in or changing directories. Access to this page requires authorization. You can try changing directories. This document refers to the Microsoft Foundry (classic) portal. 🔍 View the Microsoft Foundry (new) documentation to learn about the new portal. In this article, you learn to develop a generative AI application by starting from GitHub Models and then upgrade your experience by deploying a Foundry Tools resource with Microsoft Foundry Models.

Run your first model with GitHub Models in minutes. GitHub Models is an AI inference API from GitHub that lets you run AI models using just your GitHub credentials. You can choose from many different models—including from OpenAI, Meta, and DeepSeek—and use them in scripts, apps, or even GitHub Actions, with no separate authentication process. This guide helps you try out models quickly in the playground, then shows you how to run your first model via API or workflow. Go to https://github.com/marketplace/models. In the playground, select at least one model from the dropdown menu.

GitHub Models has entered public preview! GitHub Models provides every GitHub developer with access to top AI models via a playground, API, and more. Since the announcement of GitHub Models almost three months ago, we’ve shipped a number of enhancements and new models. To learn more about GitHub Models, check out the docs. Join our dedicated Community Discussions to discuss this update, swap tips, and share feedback. GitHub Models is a workspace built into GitHub for working with large language models (LLMs).

It supports prompt design, model comparison, evaluation, and integration—directly within your repository. GitHub Models is currently in public preview for organizations and repositories. GitHub Models enables teams to build and evaluate AI-powered features without leaving their development workflow. It allows for: To start, visit the GitHub Models Marketplace. Use the Select a Model dropdown to:

The Playground allows for prompt development and testing.

People Also Search

• GitHub Models - GitHub Docs
• GitHub Models API now available
• Introducing GitHub Models
• Use GitHub Models - GitHub Docs
• Using GitHub Models with your GitHub Workflows
• Introducing GitHub Models: A new generation of AI ... - The GitHub Blog
• Upgrade from GitHub Models to Microsoft Foundry Models
• Quickstart for GitHub Models - GitHub Docs
• GitHub Models is now available in public preview
• GitHub Models | Christos Galanopoulos