Description
Local language models can run with ROCm support patched for AMD GPUs. This helps users test AI inference on AMD hardware when the standard build does not fit their setup.
It is an Ollama variant for GPU acceleration. Check ROCm compatibility, GPU memory, model licenses, and prompt privacy before production use.