Agent Router

Agent Router is an open source control plane for agentic traffic, built on the Envoy proxy. It gives an AI agent one OpenAI compatible API for every model and one router for every MCP tool, so a team integrates once and switches models by changing the model name rather than rewriting code. Agent Router turns a description of providers, credentials, tools and limits into Envoy configuration, and Envoy handles each request. It is aimed at platform teams that run agents in production and want provider access governed centrally. It routes to seventeen providers out of the box, including Anthropic, Bedrock, Vertex, Azure and self hosted vLLM. Traffic management covers provider fallback, model name virtualisation and token limits per team, app or model. Agents authenticate only to the router, while provider API keys and AWS, GCP and Azure credentials stay with the router and rotate in one place. A single tool catalog aggregates many MCP servers and filters it by caller, Kubernetes InferencePool support enables inference aware routing to self managed models, and observability follows OpenTelemetry GenAI conventions with no instrumentation in the agent. The project is free and open source under the Apache 2.0 licence. It runs on a laptop with one command, and the same configuration ships to a dedicated gateway or a Kubernetes cluster. A hosted service run by Tetrate is offered for teams that prefer not to operate it; its pricing is not published on the project site. Agent Router was formerly Envoy AI Gateway and is now an Agentic AI Foundation project, with the same code and maintainers.