Loading...
Loading...
Llm D: Achieve state of the art inference performance with modern accelerators on Kubernetes. It is listed under Development & Code on AI Registry as a free tool.
The tools below are approved listings in the same category, ordered by how closely their tags match Llm D. This is an automatic list. We have not written a researched verdict for Llm D yet, so treat it as a shortlist and check each vendor's pricing page before switching.
Built from each tool's listing. Vendors can update their own listing after claiming it.
Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API.
TurboLLM is a local runner for open language models that works on the user's own computer with no cloud, no account and no internet connection needed. It starts with a single npx turbollm command or a standalone app for Windows, macOS, Linux and Android, and serves a browser interface on localhost that phones, tablets ...
Manages Unified Access to Generative AI Services built on Envoy Gateway
Agent Router is an open source control plane for agentic traffic, built on the Envoy proxy. It gives an AI agent one OpenAI compatible API for every model and one router for every MCP tool, so a team integrates once and switches models by changing the model name rather than rewriting code. Agent Router turns a descript...
GPU accelerated terminal for agentic workflows
Attyx is a terminal emulator designed for running, watching and coordinating AI coding agents from one window. It is GPU accelerated, written in Zig with Metal and OpenGL rendering, weighs under 5 MB and runs on macOS on Apple Silicon and Intel and on Linux for x64 and ARM64. It installs through Homebrew. It is for de...
Provider-pluggable orchestration runtime for multi-model AI inference.
Dot Loom is the open source orchestration component of Dot, a private and anonymous AI platform at usedot.xyz. Loom passes a request through a router, a drafter, a critic and a finalizer to produce one finished answer, and it underpins Dot's developer and agent features. The wider Dot service offers chat, code, image a...
Cloud Native Agentic AI | Discord: https://bit.ly/kagentdiscord
Kagent is an open source framework that runs AI agents inside Kubernetes clusters. It treats agents as another workload on the cluster, so platform and DevOps teams can deploy, observe and govern them with the tools they already use. The project is a CNCF Sandbox project, and its site states it was built by the founder...
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.
Lemonade is a local AI runtime that lets a computer run text, image and speech models on its own hardware. Installation provides an AI runtime, a graphical interface, a command line tool and API endpoints, so a user can chat with models directly, connect them to agents, or build them into an application. It is aimed a...