Get Started with AI on Xkaliber

Welcome to the utterly mundane world of runing Artificial Intelligence on your Xkaliber system!
Setting up AI tools depends on your graphics card: NVIDIA or AMD.
Let's break it down:

For NVIDIA Users (Super Simple!)

If you're using an NVIDIA card, you're in luck! We've made it really easy with a single script called aisetup.sh. Think of it as your AI setup helper!

  • Download aisetup.sh
  • Run aisetup.sh: Just open your terminal and run this script.
    ./aisetup.sh
  • Choose the Options: The script will give you a list of options. Run each one to install:
    • Ollama framework: This is the engine that powers a lot of AI stuff.
    • OpenWebUI: This gives you a nice web interface to interact with your AI.
    • Stable Diffusion: This lets you generate amazing images with AI.

That's it! You're all set for AI on your NVIDIA system.

For AMD Users (A Little More Detail, But Still Easy!)

AMD users, we've got you covered too! It's a bit more involved, but we've made it as simple as possible.

Things to Do After Installing (AMD users only)

  1. Download rmwebui.sh. Grab the rmwebui.sh script and put it in your "Documents" folder.
  2. Download Rocm Upgrade Script
  3. If AI is your main focus, run rm631.sh: This script will update your AMD graphics drivers (ROCm) to the latest version and install some extra libraries. This will give you the best possible AI experience.
    ./rm631.sh
  4. You can use wget or your browser to download it.

  5. Make it Executable: Open your terminal, navigate to your "Documents" folder, and type chmod +x rmwebui.sh. This tells your computer that it's okay to run the script.
    cd Documents
    chmod +x rmwebui.sh
  6. Create a Virtual Environment: Type python3 -m venv venv and press Enter. This creates a special space for your AI tools, keeping them separate from the rest of your system.
    python3 -m venv venv
  7. Activate the Virtual Environment: Type source venv/bin/activate and press Enter. You'll see your terminal prompt change slightly, indicating that you're now working inside the virtual environment.
    source venv/bin/activate
  8. Run the Script: Finally, type bash rmwebui.sh and press Enter. This will start the installation of OpenWebUI and the needed dependancies.
    bash rmwebui.sh

And that's it! You're now ready to explore the world of AI on your AMD system.

Important Notes:

We hope you enjoy your AI adventures on Xkaliber!

Why You Should Be Running AI Locally on Xkaliber

Artificial intelligence is revolutionizing how we work and create. While cloud AI is accessible, running AI locally on your Xkaliber system offers distinct advantages in privacy, control, and performance. Here’s why harnessing AI directly on your machine matters:

  • Safeguard Your Private & Proprietary Data

    Your data, projects, and unique knowledge are valuable assets – "inherently private and proprietary." As this information's value grows, you naturally want to protect it while still leveraging its potential. Running AI locally on Xkaliber achieves this balance: utilize powerful AI while ensuring sensitive data stays securely under your control. With potential external data barriers rising, having capable tools inside your own environment is increasingly vital.

  • Augment Your Workflow, Build an AI-First Environment

    AI agents are set to "absolutely augment how we're working." Integrating AI locally allows you to craft an "AI-first" workflow within Xkaliber. Instead of relying solely on external services, embed intelligence directly into your tasks, boosting efficiency and capability right where you operate.

  • Accelerate Learning and Bridge Skill Gaps

    Ramp-up time is a significant "tax on productivity." Local AI dramatically "accelerates that learning curve." Imagine navigating complex codebases or grasping organizational "best practices" ten times faster. AI on Xkaliber acts as your personal accelerator, bridging the "productivity gap" and making you more effective, faster – regardless of experience level.

  • Leverage AI as a Technology for Acceleration

    Consider the time spent "waiting on some other interdependent part" – for approvals, specs, or feedback. AI is fundamentally a "technology for acceleration." By running it locally on Xkaliber, you speed through these bottlenecks. This isn't about reducing headcount; it's about enabling you and your organization to simply do more – ship faster, innovate further, serve users better. Efficiency gains can then be "reinvested back into the business to go and drive more growth."

Ready to get started? Xkaliber provides a robust and flexible platform for running AI models locally. Follow our guides and install the necessary tools and begin your journey.