Model
To access this menu, go to the sidebar and select LLM Model > Model.
You can manage all LLM (Large Language Model) configurations from this menu. This includes adding new models, editing details, searching for models, and deleting models that are no longer in use.
Add New LLM
To register a new LLM model you can click the ‘New LLM Model’ button.
Fill in the required fields in the form:
LLM Icon Upload an icon to visually represent the model.
Model Provider Name Select the registered LLM provider (from the Provider) that supplies this model.
LLM Name Enter the LLM model name based on the selected provider. The model name must be valid and recognized by the provider.
LLM Display Name Enter the name that will be visible to users in the interface.
LLM Description Provide a brief explanation describing the model’s purpose or functionality.
Template Group Select a prompt template group that can be used with this model. This allows the model to be applied to any templates within that group.
Supported Attachments Specify the types of file attachments (if any) that the model can process.
Model Kwargs Add any additional configuration parameters for the model using plain key-value pairs.
Model Env Kwargs Add configuration parameters using environment variables as key-value pairs.
Status Set the model’s availability:
Active – The model is enabled and available for use.
Inactive – The model is disabled and cannot be used.
Click Save to store your configuration or Cancel to discard changes.
View and Edit LLM Details
To view or edit a model, click the Edit icon in the LLM Model List page.
After making changes, click Save to apply updates or Cancel to discard them
Search LLM
Use the Search field to find specific LLM models by typing the model’s name.
Delete LLM
To delete an LLM model, click the Trash icon in the Action column.
A confirmation pop-up will appear — click Delete to confirm or Cancel to cancel the action.
Last updated