Local Expert

To use this template, you'll need a Trained Model. If you haven't created one yet, you can:

Download a pre-made one

Create your own using this guide

1. Start by creating a new Canvas and drag the LLM Chat element onto the Canvas.
2. Open the LLM Chat Element setting and make the following adjustments:
   1. Model Dropdown: Select a model you have trained yourself. If you haven't trained a model, download a pre-made one at the link above and add it to the Model Adapter Folder Path.
   2. Model Storage Path: Using the "Select Directory" button, choose the folder where you want the base model to be saved.
   3. Model Adapter Folder Path: Use this to upload trained models from us, or models shared by others.
3. Leave all other settings as the default.
4. You can now hit run.

Dependencies will be installed the first time this flow is run, so it may take a while for them to install.