How to Run Ollama on Linux with AMD MI50
How to Run Ollama on Linux with AMD MI50 Tested Environment: Ubuntu 22.04 Quick Start Summary # 1. Install ROCm driver (ROCm 5.7.1 for MI50) sudo mkdir -p /etc/apt/keyrings wget https://repo.radeon.com/rocm/rocm.gpg.key -O - | gpg --dearmor | sudo tee /etc/apt/keyrings/rocm.gpg > /dev/null sudo tee /etc/apt/sources.list.d/amdgpu.list <<'EOF' deb [arch=amd64 signed-by=/etc/apt/keyrings/rocm.gpg] https://repo.radeon.com/amdgpu/5.7.1/ubuntu jammy main EOF sudo tee /etc/apt/sources.list.d/rocm.list <<'EOF' deb [arch=amd64 signed-by=/etc/apt/keyrings/rocm.gpg] https://repo.radeon.com/rocm/apt/5.7.1 jammy main EOF echo -e 'Package: *\nPin: release o=repo.radeon.com\nPin-Priority: 600' | sudo tee /etc/apt/preferences.d/rocm-pin-600 sudo apt update sudo apt install amdgpu-dkms rocm-hip-libraries sudo reboot # 2. Install Ollama curl -LO https://ollama.com/download/ollama-linux-amd64.tgz sudo tar -C /usr -xzf ollama-linux-amd64.tgz # 3. Install ROCm package for Ollama curl -L https://ollama.com/download/ollama-linux-amd64-rocm.tgz -o ollama-linux-amd64-rocm.tgz sudo tar -C /usr -xzf ollama-linux-amd64-rocm.tgz # 4. Run Ollama ollama serve Install ROCm Driver If you want to run Ollama on Linux with an AMD MI50 GPU, you need to install the AMD graphics driver first. ...