Guides
Local LLM Models
Using Local Models
To enable the use of local LLM models, set the BASE_URL
in your .env
file:
example
Available Models
You can choose from the following models:
- Llava
- Llama3.2-vision
By default, the Llava model will be used. However, you can specify a different model in your code:
Local models may not always provide optimal results. We are continually working to improve performance and add support for newer models.