Get Started with AI on Debian

Hey Debian newcomers! Welcome to the exciting world of AI on your system! We've got some tools to help you get started, whether you're using an AMD or NVIDIA graphics card. Let's break it down:

For NVIDIA Users (Super Simple!)

If you're using an NVIDIA card, you're in luck! We've made it really easy with a single script called aisetup.sh. Think of it as your AI setup helper!

  • Download aisetup.sh
  • Run aisetup.sh: Just open your terminal and run this script.
    ./aisetup.sh
  • Choose the Options: The script will give you a list of options. Run each one to install:
    • Ollama framework: This is the engine that powers a lot of AI stuff.
    • OpenWebUI: This gives you a nice web interface to interact with your AI.
    • Stable Diffusion: This lets you generate amazing images with AI.

That's it! You're all set for AI on your NVIDIA system.

For AMD Users (A Little More Detail, But Still Easy!)

AMD users, we've got you covered too! It's a bit more involved, but we've made it as simple as possible.

  1. Download rmwebui.sh. Grab the rmwebui.sh script and put it in your "Documents" folder.
  2. Download Rocm Upgrade Script
  3. If AI is your main focus, run rm631.sh: This script will update your AMD graphics drivers (ROCm) to the latest version and install some extra libraries. This will give you the best possible AI experience.
    ./rm631.sh
  4. You can use wget or your browser to download it.

  5. Make it Executable: Open your terminal, navigate to your "Documents" folder, and type chmod +x rmwebui.sh. This tells your computer that it's okay to run the script.
    cd Documents
    chmod +x rmwebui.sh
  6. Create a Virtual Environment: Type python3 -m venv venv and press Enter. This creates a special space for your AI tools, keeping them separate from the rest of your system.
    python3 -m venv venv
  7. Activate the Virtual Environment: Type source venv/bin/activate and press Enter. You'll see your terminal prompt change slightly, indicating that you're now working inside the virtual environment.
    source venv/bin/activate
  8. Run the Script: Finally, type bash rmwebui.sh and press Enter. This will start the installation of OpenWebUI and the needed dependancies.
    bash rmwebui.sh

And that's it! You're now ready to explore the world of AI on your AMD system.

Important Notes:

We hope you enjoy your AI adventures on Debian!