Supported Models

This page provides a list of all supported language models and embedding models.

Language Models (LMs)

LMs are used to generate natural language responses, either directly from user prompts or based on retrieved context in a RAG pipeline. Use one of the model IDs below to configure the language model component.

Anthropic

Model ID Format	anthropic/model-name
Model ID Example	anthropic/claude-sonnet-4-0
Credentials Default Environment Variables	ANTHROPIC_API_KEY
Setup Guide	Create Anthropic API Key
Available Models	Anthropic Models

Azure OpenAI

Model ID Format	azure-openai/azure-endpoint:azure-deployment
Model ID Example	azure-openai/https://my-resource.openai.azure.com:my-deployment
Credentials Default Environment Variables	AZURE_OPENAI_API_KEY
Setup Guide	Create Resource Deploy Model
Available Models	Azure OpenAI Models

Bedrock

Model ID Format	bedrock/model-name
Model ID Example	bedrock/us.anthropic.claude-sonnet-4-20250514-v1:0
Credentials Default Environment Variables	AWS_ACCESS_KEY_ID AWS_SECRET_ACCESS_KEY
Setup Guide	Create AWS Account Create Access Keys
Available Models	AWS Bedrock Models

Google Gen AI

Model ID Format	google/model-name
Model ID Example	google/gemini-2.5-flash-lite
Credentials Default Environment Variables	GOOGLE_API_KEY
Setup Guide	Create Gemini API Key
Available Models	Google Models

Google Vertex AI

Model ID Format	google/model-name
Model ID Example	google/gemini-2.5-flash-lite
Credentials Default Environment Variables	Not supported
Setup Guide	Create Google Service Account Create JSON Credentials
Available Models	Google Models

LangChain

Model ID Format	langchain/<package>.<class>:model-name
Model ID Example	langchain/langchain_openai.ChatOpenAI:gpt-5-nano
Credentials Default Environment Variables	Varies depending on the package and class.
Setup Guide	Varies depending on the package and class.
Available Models	LangChain Providers

LiteLLM

Model ID Format	litellm/provider/model-name
Model ID Example	litellm/openai/gpt-4o-mini
Credentials Default Environment Variables	Varies depending on the provider.
Setup Guide	Varies depending on the provider.
Available Models	LiteLLM Providers

OpenAI

Model ID Format	openai/model-name
Model ID Example	openai/gpt-5-nano
Credentials Default Environment Variables	OPENAI_API_KEY
Setup Guide	Create OpenAI API Key
Available Models	OpenAI Models

OpenAI Chat Completions

Model ID Format	openai-chat-completions/base-url:model-name
Model ID Example	openai-chat-completions/https://api.groq.com/openai/v1:llama3-8b-819
Credentials Default Environment Variables	Varies depending on the provider.
Setup Guide	Varies depending on the provider.
Available Models	Compatible endpoints include but are not limited to: DeepInfra DeepSeek Groq OpenRouter Text Generation Inference Together.ai vLLM

OpenAI Compatible

This class is deprecated and will be removed in v0.6. Please use OpenAI Chat Completions instead.

Model ID Format	openai-compatible/base-url:model-name
Model ID Example	openai-compatible/https://api.groq.com/openai/v1:llama3-8b-819
Credentials Default Environment Variables	Varies depending on the provider.
Setup Guide	Varies depending on the provider.
Available Models	Compatible endpoints include but are not limited to: DeepInfra DeepSeek Groq OpenRouter Text Generation Inference Together.ai vLLM

xAI

Model ID Format	xai/model-name
Model ID Example	xai/grok-3
Credentials Default Environment Variables	XAI_API_KEY
Setup Guide	Create xAI API Key
Available Models	xAI Models

Embedding Models (EMs)

Embedding models are used to convert text into vector representations, enabling similarity search and document retrieval. Use one of the model IDs below to configure the embedding model component.

Azure OpenAI

Model ID Format	azure-openai/azure-endpoint:azure-deployment
Model ID Example	azure-openai/https://my-resource.openai.azure.com:my-deployment
Credentials Default Environment Variables	AZURE_OPENAI_API_KEY
Setup Guide	Create Resource Deploy Model
Available Models	Azure OpenAI Models

Cohere

Model ID Format	cohere/model-name
Model ID Example	cohere/embed-english-v3.0
Credentials Default Environment Variables	COHERE_API_KEY
Setup Guide	Create Cohere API Key
Available Models	Cohere Models

Google Gen AI

Model ID Format	google/model-name
Model ID Example	google/text-embedding-004
Credentials Default Environment Variables	GOOGLE_API_KEY
Setup Guide	Create Gemini API Key
Available Models	Google Models

Google Vertex AI

Model ID Format	google/model-name
Model ID Example	google/text-embedding-004
Credentials Default Environment Variables	Not supported
Setup Guide	Create Google Service Account Create JSON Credentials
Available Models	Google Models

Jina

Model ID Format	jina/model-name
Model ID Example	jina/embed-english-v3.0
Credentials Default Environment Variables	JINA_API_KEY
Setup Guide	Create Jina API Key
Available Models	Jina Models

LangChain

Model ID Format	langchain/<package>.<class>:model-name
Model ID Example	langchain/langchain_openai.OpenAIEmbeddings:text-embedding-3-small
Credentials Default Environment Variables	Varies depending on the package and class.
Setup Guide	Varies depending on the package and class.
Available Models	LangChain Providers

OpenAI

Model ID Format	openai/model-name
Model ID Example	openai/text-embedding-3-small
Credentials Default Environment Variables	OPENAI_API_KEY
Setup Guide	Create OpenAI API Key
Available Models	OpenAI Models

OpenAI Compatible

Model ID Format	openai-compatible/base-url:model-name
Model ID Example	openai-compatible/https://my-tei-endpoint.com:model-name
Credentials Default Environment Variables	Varies depending on the provider.
Setup Guide	Varies depending on the provider.
Available Models	Compatible endpoints include but are not limited to: Text Embeddings Inference vLLM

TwelveLabs

Model ID Format	twelvelabs/model-name
Model ID Example	twelvelabs/Marengo-retrieval-2.7
Credentials Default Environment Variables	TWELVELABS_API_KEY
Setup Guide	Create TwelveLabs API Key
Available Models	TwelveLabs Models

Voyage

Model ID Format	voyage/model-name
Model ID Example	voyage/voyage-3.5-lite
Credentials Default Environment Variables	VOYAGE_API_KEY
Setup Guide	Create Voyage API Key
Available Models	Voyage Models