BricksLLM

BricksLLM is an open source AI gateway, written in Go, that sits between applications and model providers to control and monitor how LLMs are used in production. It was built by Bricks, a Y Combinator company, and is released under the MIT license. Teams route requests through the gateway instead of calling providers directly, and it issues its own API keys with rate limits and spending caps attached. It suits engineering teams that need per user and per organization control over LLM usage, for example to set usage limits for customers on different pricing tiers, distribute keys to internal developers or students, or track spend across environments. Features include rate limiting, cost limits and cost analytics, request analytics, caching, retries and failover between providers, model and endpoint access control, PII detection and masking, logging with privacy controls and a Datadog integration. It supports all OpenAI endpoints, Anthropic, Azure OpenAI, vLLM and Deepinfra, plus custom deployments and custom models. The quickest setup is a Docker Compose bundle with PostgreSQL and Redis. The self hosted gateway is free. A managed version with a dashboard was previously offered, but no current price is published for it. The company has since moved on: the former Bricks website now redirects to White Circle, which sells an AI safety and control platform for testing, enforcing and analyzing model and user behavior, sold through demos and sales contact. The BricksLLM repository remains public but was last updated in January 2025.