Using the ToolHive Kubernetes Operator
Introduction
The ToolHive Kubernetes operator manages MCP servers in Kubernetes clusters. It provides a way to deploy, manage, and scale MCP servers in multi-user environments. By defining MCP servers as Kubernetes resources, the operator automates their deployment and management, making it easier to run MCP servers in multi-user environments.
The Kubernetes operator is still under active development and isn't recommended
for production use cases yet. Specifically, the MCPServer
Custom Resource
Definition (CRD) is still in an alpha state so breaking changes to the spec and
its capabilities are possible.
Contents
📄️ Overview
How to manage MCP servers in Kubernetes with the ToolHive operator
📄️ Deploy the operator
How to deploy the ToolHive operator in a Kubernetes cluster using Helm
📄️ Run MCP servers in Kubernetes
How to deploy MCP servers in Kubernetes using the ToolHive operator
📄️ Customize tools
Filter and rename MCP server tools using the MCPToolConfig CRD and toolConfigRef.
📄️ Telemetry and metrics
How to enable OpenTelemetry (metrics and traces) and Prometheus instrumentation for ToolHive MCP servers inside of Kubernetes using the ToolHive Operator
📄️ Set up logging
Configure and manage logging for ToolHive in Kubernetes environments
📄️ CRD Reference
ToolHive Kubernetes Operator Custom Resource Definitions (CRDs) reference.