Description
Current LocalAI server code can use CUDA acceleration for self-hosted AI workflows.
This Git package is useful for developers with compatible NVIDIA GPUs who need the CUDA-enabled LocalAI variant. It provides server infrastructure, not models.
CUDA AI servers can consume large VRAM and expose local APIs. Verify drivers, restrict ports, and protect prompts.