# Supported Models

This page provides a list of all supported language models and embedding models.

## Language Models (LMs)

LMs are used to generate natural language responses, either directly from user prompts or based on retrieved context in a RAG pipeline. Use one of the model IDs below to configure the language model component.

### **Anthropic**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>anthropic/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>anthropic/claude-sonnet-4-0</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><code>ANTHROPIC_API_KEY</code></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><a href="https://console.anthropic.com/settings/keys">Create Anthropic API Key</a></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://docs.anthropic.com/en/docs/about-claude/models/overview">Anthropic Models</a></td></tr></tbody></table>

### **Azure OpenAI**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>azure-openai/azure-endpoint:azure-deployment</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>azure-openai/https://my-resource.openai.azure.com:my-deployment</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><code>AZURE_OPENAI_API_KEY</code></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><p><a href="https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/create-resource?pivots=web-portal#create-a-resource">Create Resource</a> </p><p><a href="https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/create-resource?pivots=web-portal#deploy-a-model">Deploy Model</a></p></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/models?tabs=global-standard%2Cstandard-chat-completions">Azure OpenAI Models</a></td></tr></tbody></table>

### **Bedrock**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>bedrock/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>bedrock/us.anthropic.claude-sonnet-4-20250514-v1:0</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><p><code>AWS_ACCESS_KEY_ID</code> </p><p><code>AWS_SECRET_ACCESS_KEY</code></p></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><p><a href="https://docs.aws.amazon.com/bedrock/latest/userguide/getting-started.html">Create AWS Account</a> </p><p><a href="https://docs.aws.amazon.com/keyspaces/latest/devguide/create.keypair.html">Create Access Keys</a></p></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://docs.aws.amazon.com/bedrock/latest/userguide/inference-profiles-support.html">AWS Bedrock Models</a></td></tr></tbody></table>

### **Google Gen AI**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>google/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>google/gemini-2.5-flash-lite</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><code>GOOGLE_API_KEY</code></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><a href="https://aistudio.google.com/app/apikey">Create Gemini API Key</a></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://ai.google.dev/gemini-api/docs/models">Google Models</a></td></tr></tbody></table>

### **Google Vertex AI**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>google/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>google/gemini-2.5-flash-lite</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td>Not supported</td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><p><a href="https://developers.google.com/workspace/guides/create-credentials#create_a_service_account">Create Google Service Account</a> </p><p><a href="https://developers.google.com/workspace/guides/create-credentials#create_credentials_for_a_service_account">Create JSON Credentials</a></p></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://ai.google.dev/gemini-api/docs/models">Google Models</a></td></tr></tbody></table>

### **LangChain**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>langchain/&#x3C;package>.&#x3C;class>:model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>langchain/langchain_openai.ChatOpenAI:gpt-5-nano</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td>Varies depending on the package and class.</td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td>Varies depending on the package and class.</td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://python.langchain.com/docs/integrations/chat/#featured-providers">LangChain Providers</a></td></tr></tbody></table>

### **LiteLLM**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>litellm/provider/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>litellm/openai/gpt-4o-mini</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td>Varies depending on the provider.</td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td>Varies depending on the provider.</td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://docs.litellm.ai/docs/providers/">LiteLLM Providers</a></td></tr></tbody></table>

### **OpenAI**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>openai/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>openai/gpt-5-nano</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><code>OPENAI_API_KEY</code></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><a href="https://platform.openai.com/api-keys">Create OpenAI API Key</a></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://platform.openai.com/docs/pricing">OpenAI Models</a></td></tr></tbody></table>

### OpenAI Chat Completions

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>openai-chat-completions/base-url:model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>openai-chat-completions/https://api.groq.com/openai/v1:llama3-8b-819</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td>Varies depending on the provider.</td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td>Varies depending on the provider.</td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><p>Compatible endpoints include but are not limited to:</p><ol><li><a href="https://deepinfra.com/">DeepInfra</a> </li><li><a href="https://deepseek.com/">DeepSeek</a> </li><li><a href="https://groq.com/">Groq</a> </li><li><a href="https://openrouter.ai/">OpenRouter</a> </li><li><a href="https://github.com/huggingface/text-generation-inference">Text Generation Inference</a> </li><li><a href="https://together.ai/">Together.ai</a> </li><li><a href="https://vllm.ai/">vLLM</a> </li></ol></td></tr></tbody></table>

### OpenAI Compatible

{% hint style="danger" %}
This class is deprecated and will be removed in v0.6. Please use OpenAI Chat Completions instead.
{% endhint %}

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>openai-compatible/base-url:model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>openai-compatible/https://api.groq.com/openai/v1:llama3-8b-819</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td>Varies depending on the provider.</td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td>Varies depending on the provider.</td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><p>Compatible endpoints include but are not limited to:</p><ol><li><a href="https://deepinfra.com/">DeepInfra</a> </li><li><a href="https://deepseek.com/">DeepSeek</a> </li><li><a href="https://groq.com/">Groq</a> </li><li><a href="https://openrouter.ai/">OpenRouter</a> </li><li><a href="https://github.com/huggingface/text-generation-inference">Text Generation Inference</a> </li><li><a href="https://together.ai/">Together.ai</a> </li><li><a href="https://vllm.ai/">vLLM</a> </li></ol></td></tr></tbody></table>

### xAI

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>xai/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>xai/grok-3</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><code>XAI_API_KEY</code></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><a href="https://console.anthropic.com/settings/keys">Create xAI API Key</a></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://docs.anthropic.com/en/docs/about-claude/models/overview">xAI Models</a></td></tr></tbody></table>

## Embedding Models (EMs)

Embedding models are used to convert text into vector representations, enabling similarity search and document retrieval. Use one of the model IDs below to configure the embedding model component.

### **Azure OpenAI**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>azure-openai/azure-endpoint:azure-deployment</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>azure-openai/https://my-resource.openai.azure.com:my-deployment</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><code>AZURE_OPENAI_API_KEY</code></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><p><a href="https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/create-resource?pivots=web-portal#create-a-resource">Create Resource</a> </p><p><a href="https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/create-resource?pivots=web-portal#deploy-a-model">Deploy Model</a></p></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/models?tabs=global-standard%2Cstandard-chat-completions">Azure OpenAI Models</a></td></tr></tbody></table>

### **Cohere**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>cohere/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>cohere/embed-english-v3.0</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><code>COHERE_API_KEY</code></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><a href="https://dashboard.cohere.com/welcome/login">Create Cohere API Key</a></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://docs.cohere.com/reference/list-models">Cohere Models</a></td></tr></tbody></table>

### **Google Gen AI**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>google/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>google/text-embedding-004</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><code>GOOGLE_API_KEY</code></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><a href="https://aistudio.google.com/app/apikey">Create Gemini API Key</a></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://cloud.google.com/vertex-ai/generative-ai/docs/embeddings/get-text-embeddings">Google Models</a></td></tr></tbody></table>

### **Google Vertex AI**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>google/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>google/text-embedding-004</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td>Not supported</td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><p><a href="https://developers.google.com/workspace/guides/create-credentials#create_a_service_account">Create Google Service Account</a> </p><p><a href="https://developers.google.com/workspace/guides/create-credentials#create_credentials_for_a_service_account">Create JSON Credentials</a></p></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://cloud.google.com/vertex-ai/generative-ai/docs/embeddings/get-text-embeddings">Google Models</a></td></tr></tbody></table>

### **Jina**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>jina/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>jina/embed-english-v3.0</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><code>JINA_API_KEY</code></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><a href="https://jina.ai/api-dashboard">Create Jina API Key</a></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://jina.ai/models">Jina Models</a></td></tr></tbody></table>

### **LangChain**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>langchain/&#x3C;package>.&#x3C;class>:model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>langchain/langchain_openai.OpenAIEmbeddings:text-embedding-3-small</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td>Varies depending on the package and class.</td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td>Varies depending on the package and class.</td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://python.langchain.com/docs/integrations/text_embedding/">LangChain Providers</a></td></tr></tbody></table>

### **OpenAI**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>openai/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>openai/text-embedding-3-small</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><code>OPENAI_API_KEY</code></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><a href="https://platform.openai.com/api-keys">Create OpenAI API Key</a></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://platform.openai.com/docs/pricing">OpenAI Models</a></td></tr></tbody></table>

### **OpenAI Compatible**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>openai-compatible/base-url:model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>openai-compatible/https://my-tei-endpoint.com:model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td>Varies depending on the provider.</td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td>Varies depending on the provider.</td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><p>Compatible endpoints include but are not limited to:</p><ol><li><a href="https://github.com/huggingface/text-embeddings-inference">Text Embeddings Inference</a> </li><li><a href="https://vllm.ai/">vLLM</a> </li></ol></td></tr></tbody></table>

### **TwelveLabs**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>twelvelabs/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>twelvelabs/Marengo-retrieval-2.7</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><code>TWELVELABS_API_KEY</code></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><a href="https://docs.twelvelabs.io/api-reference/authentication">Create TwelveLabs API Key</a></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://docs.twelvelabs.io/docs/concepts/models">TwelveLabs Models</a></td></tr></tbody></table>

### **Voyage**

<table data-header-hidden><thead><tr><th width="197.0390625"> </th><th> </th></tr></thead><tbody><tr><td><mark style="color:$primary;"><strong>Model ID Format</strong></mark></td><td><code>voyage/model-name</code></td></tr><tr><td><mark style="color:$primary;"><strong>Model ID Example</strong></mark></td><td><code>voyage/voyage-3.5-lite</code></td></tr><tr><td><mark style="color:$primary;"><strong>Credentials Default Environment Variables</strong></mark></td><td><code>VOYAGE_API_KEY</code></td></tr><tr><td><mark style="color:$primary;"><strong>Setup Guide</strong></mark></td><td><a href="https://docs.voyageai.com/docs/api-key-and-installation">Create Voyage API Key</a></td></tr><tr><td><mark style="color:$primary;"><strong>Available Models</strong></mark></td><td><a href="https://docs.voyageai.com/docs/pricing">Voyage Models</a></td></tr></tbody></table>