Description
Local model servers can swap models automatically for llama.cpp or OpenAPI-compatible workflows.
This binary package is useful for developers and local-AI users who run multiple models but want to keep resource use under control. It coordinates model availability; it is not a model itself.
Model swapping can expose local API endpoints and consume significant disk, memory, or GPU resources. Secure ports and review model sources.