open-webui#
Open WebUI is an extensible, feature-rich, and user-friendly self-hosted AI platform designed to run completely offline. It supports Ollama services and other compatible OpenAI API services, and comes with a built-in RAG reasoning engine, making it a powerful AI deployment solution.
You can start an API service with LMDeploy, or launch the service with ollama.
Follow the guidance to install Open WebUI, and start the webui service with open-webui serve. Open the webui in your browser.
Refer to the documentation. Inside the opened page, find the settings, configure the OpenAI-like services or ollama services. Once configured, you can choose a model to engage in conversation.