Skip to content

Model providers

Genkit talks to models through provider plugins. You configure a plugin once, then call any model it exposes through the same generate API. Because the interface is the same across providers, you can swap one model for another, or combine several in one app, without rewriting your application code.

Available providers

Section titled “Available providers”
  • Google Generative AI: Gemini models through the Google AI Studio API. This is the fastest way to start, using a single API key.
  • Gemini Enterprise: Gemini and other models via the Gemini Enterprise API, with IAM-based auth for production workloads.
  • AWS Bedrock: Foundation models (Claude, Amazon Nova, Titan, Mistral, Cohere) hosted on Amazon Bedrock.
  • Anthropic (Claude): Claude models through the Anthropic API.
  • OpenAI: GPT models and embedders through the OpenAI API.
  • xAI (Grok): Grok models through the xAI API.
  • DeepSeek: DeepSeek models.

Local models

Section titled “Local models”
  • Ollama: Run open models such as Gemma and Llama locally, with no API key.

OpenAI-compatible APIs

Section titled “OpenAI-compatible APIs”