The default version is CPU only, which usually is not what we want if we have a GPU:
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121
Now cuda enabled pytorch apps like whisper etc... can take advantage of CUDA finally!
Check it is enabled
False means it is not working, or at least your cuda/nvidia driver setup is installed and True means good.
python3 -c........
The issue is that Docker images are stripped down, so many tools and even python3 is missing, so you'll have to build or update the actual image yourself.
I assume you have started an image with something like this and that you have the Nvidia Toolkit installed (assuming you are using GPUs). If you're not using nvidia just remove --runtime=nvidia --gpus all.
docker run -it --runtime=nvidia --gpus all ubuntu bash
These works for most images li........