compiling ollama from source by using a docker container with a prebuilt rocm 6.1 dev environment:
rocm/dev-ubuntu-22.04:6.1-complete
Install these packages first
apt install cmake git
apt install software-properties-common
add-apt-repository ppa:longsleep/golang-backports
apt install golang-go
Clone the repo
git clone https://github.com/ollama/ollama /rtt/o........
In this quick tutorial we will deploy various AI models and compare the differences. We will be using smaller models so that most users should be able to follow this guide as long as they have at least 16G of memory and no other applications using much memory.
In this tutorial we recommend that you use Docker to deploy ollama.........