Using Ollama
Learn how to set up and configure Ollama as a local AI backend for Arcania
You can find the full Ollama documentation here.
Installation Steps
Linux and WSL2
curl https://ollama.ai/install.sh | sh
Mac OSX
Windows
Not yet supported
Setup Process
-
Start the server:
ollama serve -
Download a model: For example, we will use Mistral 7B. There are many models to choose from listed in the library.
ollama run mistral -
Enable the server in the client:
settings -> ChatBot -> ChatBot Backend -> Ollama