Open-Source
Local Models
Enable Local Models
To enable the use of local LLM models, set the BASE_URL
in your .env
file:
example
Available Models
You can find the list of models available to use here.
By default, the Llava model will be used. However, you can specify a different model in your code:
Local models may not always provide optimal results. We are continually working to improve performance and add support for newer models.