Description
Machine-learning tensor operations can use the Git version of ggml with Vulkan GPU acceleration. It is useful for local AI workloads on systems where Vulkan-supported GPUs are preferred over CUDA.
GPU acceleration depends on Vulkan drivers, hardware support, and workload size. Users should test model compatibility, power use, and thermal behavior before relying on it for long-running inference.