Description
Local LLM models can be served through a simple terminal user interface.
This binary package is useful for users who want to choose a model and backend without manually composing server commands. It is a serving helper, not a model collection.
Serving models can expose prompts and API ports. Restrict network access and monitor CPU, GPU, and memory use.