Skip to main content

Enable Local Models

To enable the use of local LLM models, set the BASE_URL in your .env file:
example

Available Models

You can find the list of models available to use here. By default, the Llava model will be used. However, you can specify a different model in your code:
Local models may not always provide optimal results. We are continually working to improve performance and add support for newer models.