Aisix

AISIX is an open source AI gateway for LLMs and AI agents from API7.ai, the company founded by the original creators of Apache APISIX. It places one OpenAI compatible API in front of more than 100 model providers, so applications and agents send requests through a single policy point using a caller key and a model alias, while provider credentials and routing policy stay at the gateway. It is aimed at engineering and platform teams running AI features in production across several services and models. The gateway supports chat, streaming, embeddings, rerank, audio and images, plus an Anthropic compatible messages endpoint. Virtual routing models let one model name fan out across providers and regions, including AWS Bedrock, Azure OpenAI and Google Vertex AI alongside direct APIs from OpenAI, Anthropic, Gemini, DeepSeek, Mistral, Groq, Cohere, Qwen, Together and Fireworks. Teams get organization wide limits and budgets, token limits, guardrails, retries and failover, centrally encrypted keys, and logging of every call. The core is written in Rust, licensed under Apache 2.0, and the vendor cites sub millisecond proxy overhead. The managed cloud has three published tiers. Developer is free at $0 per month and records 100,000 requests a month; beyond that traffic keeps flowing but extra requests are not recorded. Team is $149 per month with 1 million recorded requests and 90 day metrics retention, and automatically adds $100 for each additional million rather than blocking traffic. Enterprise pricing is custom.