Description
AMD ROCm acceleration can improve local LLM inference on supported GPUs.
This package is useful for users with compatible AMD hardware who want a llama.cpp build tuned for ROCm. It is an inference backend variant, not a model download.
ROCm support depends on GPU, kernel, and driver compatibility. Check the stack before using it for long sessions.