Model providers
Genkit talks to models through provider plugins. You configure a plugin once, then call any model it exposes through the same generate API. Because the interface is the same across providers, you can swap one model for another, or combine several in one app, without rewriting your application code.
Available providers
Section titled “Available providers”- Google Generative AI: Gemini models through the Google AI Studio API. This is the fastest way to start, using a single API key.
- Google Vertex AI: Gemini and other models through Google Cloud, with IAM-based auth for production workloads.
- Anthropic (Claude): Claude models through the Anthropic API.
- OpenAI: GPT models and embedders through the OpenAI API.
- Azure AI Foundry: Models hosted on Azure.
- AWS Bedrock: Models hosted on AWS.
- xAI (Grok): Grok models through the xAI API.
- DeepSeek: DeepSeek models.
Local models
Section titled “Local models”- Ollama: Run open models such as Gemma and Llama locally, with no API key.
OpenAI-compatible APIs
Section titled “OpenAI-compatible APIs”- OpenAI-compatible APIs: Connect to any provider that exposes an OpenAI-compatible endpoint.