Model
To access this menu, go to the sidebar and select LLM Model > Model
You can manage all LLM (Large Language Model) configurations from this menu. This includes adding new models, editing details, searching for models, and deleting models that are no longer in use.
Add New LLM
To register a new LLM model, click the "New LLM Model" button and complete the required fields in the form.
LLM Icon Upload an icon to visually represent the model.
Model Provider Name Select the registered LLM provider (from the Provider) that supplies this model.
LLM Name Enter the LLM model name based on the selected provider. The model name must be valid and recognized by the provider.
LLM Display Name Enter the name that will be visible to users in the interface.
LLM Description Provide a brief explanation describing the model’s purpose or functionality.
Template Group Select a prompt template group that can be used with this model. This allows the model to be applied to any templates within that group.
Supported Attachments Specify the types of file attachments (if any) that the model can process.
Model Kwargs Add any additional configuration parameters for the model using plain key-value pairs.
Model Env Kwargs Add configuration parameters using environment variables as key-value pairs.
Status Set the model’s availability:
Active – The model is enabled and available for use.
Inactive – The model is disabled and cannot be used.
Click Save to store your configuration or Cancel to discard changes.
View and Edit LLM Details
To view or edit a model, click the Edit icon in the LLM Model List page.
After making changes, click Save to apply updates or Cancel to discard them
Search LLM
Use the Search field to find specific LLM models by typing the model’s name.
Delete LLM
To delete an LLM model, click the Trash icon in the Action column. A confirmation pop-up will appear, click Delete to confirm or Cancel to abort the action.
You cannot delete a LLM Model that still has assigned project. Remove all assigned LLM Model first before attempting deletion.
You can manage all LMRP (Language Model Request Processor) configurations from this menu. This includes adding new models, editing existing ones, searching for models, and deleting models that are no longer in use.
Add New LMRP
To register a new LMRP model, click New LMRP Model.
Fill in the required fields in the form as described below:
Model Provider Name Select the LLM provider (previously registered in the system) that this LMRP model will use.
LMRP Model Name Enter the LMRP model name as listed under the selected provider. The name must be valid to function correctly.
LMRP Model Display Name Enter a user-friendly name for the LMRP model. This name will appear in the project interface.
LMRP Model Description Provide a brief description explaining the model’s purpose and how it should be used.
Model Kwargs Add additional configuration settings for the model using plain key-value pairs.
Model Env Kwargs Add additional configuration settings for the model using environment variables as key-value pairs.
Active Status Set the model’s status:
Active – Enabled and available for use.
Inactive – Disabled and not in use.
Click Save to store the configuration or Cancel to discard changes.
View and Edit LMRP Details
To view or edit a model, click the Edit icon in the LMRP Model List page.
After making changes, click Save to apply updates or Cancel to discard them.
Search LMRP
Use the Search field to find specific LMRP models by typing the model’s name.
Delete LMRP
To delete an LMRP model, click the Trash icon in the Action column. A confirmation pop-up will appear, click Delete to confirm or Cancel to abort the action.
You cannot delete a LMRP Model that still has assigned project. Remove all assigned LMRP Model first before attempting deletion.
Last updated