How to run MCP server on Kubernetes remotely

You can code and run your MCP server remotely on Kubernetes. Here's how: 1. Write code which conforms to the MCP standards. What does this mean? it means, it should work with JSON RPC 2.0 and can process standard MCP methods such as tools/list should send the name and description of the tools, tools/call should be able to invoke the tools etc. These standards are defined by Anthropic 2. You can either code the methods for MCP yourself, which can be tedious. Or use MCP implementation with library like FastMCP 3. Run Dockerfile to create a container and save it in ECR 4. Deploy to the Kubernetes cluster such as in Amazon EKS, and expose it using a ALB via service or ingress. ALB and container support streamable HTTP out of the box, and works nicely 5. Invoke your MCP Server using the ALB Url. For Streamable HTTP, you need to initialize a session, and then use the sessionID for subsequent calls to do tool discovery, and tool calls Check out detailed step by step demo, along with related codes, and pros-cons of local vs remote MCP server: https://lnkd.in/eXKENy6R --- Get byte sized system design, behavioral, Gen AI, and other interview and career switch tips in weekly newsletter : https://lnkd.in/eG7XdHmN #genai #ai #systemdesign