Set up a Local AI like ChatGPT on your own machine!
What makes us different from other similar websites? › Forums › Tech › Set up a Local AI like ChatGPT on your own machine!
Tagged: AI model, artificial intelligence, Installation, Linux, Ollama, Software setup, WebUI
- This topic has 1 reply, 1 voice, and was last updated 5 days, 23 hours ago by thumbtak.
- AuthorPosts
- September 24, 2024 at 3:55 pm #7623thumbtakKeymaster
Install on Linux
$ sudo apt install python3.11-venv
$ python3.11 -m venv myenv
$ source myenv/bin/activate
$ pip install open-webui
$ pip install async_timeout
$ sudo docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main
$ ollama pull llama3.1:latest
$ open-webui serve
Run on Linux, (after the above has been closed):
$ cd ~/myenv
$ source myenv/bin/activate
$ open-webui serve
Allow other on your network to use this:
Script that can be run each time you want to start the Web UI:
#!/bin/sh # Navigate to the home directory, or the directory where your virtual environment is cd ~/myenv || exit # If this fails, exit the script # Activate the virtual environment if [ -f "bin/activate" ]; then . bin/activate # Use '.' (dot) instead of 'source' in sh else echo "Virtual environment not found. Exiting." exit 1 fi # Run open-webui open-webui serve # Notify user the server is up echo "Activated, open at http://localhost:8080"
Save as a sh file and run with
$ sh file.sh
command.More Information:
https://github.com/open-webui/open-webui
- This topic was modified 5 days, 23 hours ago by thumbtak. Reason: Removed sudo from the pip commands as "Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager."
- This topic was modified 1 day, 18 hours ago by thumbtak. Reason: I removed s command by putting a strickthrough
- This topic was modified 1 day, 18 hours ago by thumbtak. Reason: Removed repeated command
September 25, 2024 at 3:45 pm #7624 - AuthorPosts
- You must be logged in to reply to this topic.