Templates: Custom LLM Chatbot

To use this template, you'll need a Trained Model. If you haven't created one yet, you can

  1. Start by creating a new Canvas and drag the LLM Chat element onto the Canvas.

  2. Open the LLM Chat Element setting and and make the following adjustments:

  3.  

    1. Model Dropdown: Select a model you have trained yourself. If you haven't trained a model, download a pre-made one at the link above and add it to the Model Adapter Folder Path.
    2. Model Storage Path: Using the “Select Directory” button, choose the folder where you want the base model to be saved.
    3. Model Adapter Folder Path: Use this to upload trained models from us, or models shared by others.
  4. Leave all other settings as the default

  5. You can now hit run.

    NOTE: Dependencies will be installed the first time this flow is run and may take a while.

If you want a deeper dive into all of the settings to really customize your Custom Chatbot, read our guide here.

Related to