Description
Local AI chat can run as a systemd service through KoboldCpp with a Gemma language model. It is useful for users who want private, offline-style chat on their own PC instead of sending prompts to a cloud service.
Language models can be wrong, biased, or resource-heavy. Review generated answers before acting on them and ensure the machine has enough CPU, GPU, memory, and disk space.