Description
Requests to large language models can be routed through a gateway with observability and MCP integration. It is useful for teams that need one control point for model traffic, tracing, and tool access.
LLM gateways can handle API keys, prompts, user data, and network traffic. Configure logging, redaction, access control, and provider limits before production use.