Loading...
Loading...
Pegainfer: Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2. It is listed under Development & Code on AI Registry as a free tool.
The tools below are approved listings in the same category, ordered by how closely their tags match Pegainfer. This is an automatic list. We have not written a researched verdict for Pegainfer yet, so treat it as a shortlist and check each vendor's pricing page before switching.
Built from each tool's listing. Vendors can update their own listing after claiming it.
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
GPUStack is an AI infrastructure platform for deploying, managing and scaling large language models and GPU compute on hardware you control. It runs on premise, in the cloud or in hybrid setups, and presents one control plane for two jobs: model as a service for serving inference, and GPU as a service for handing out r...
Achieve state of the art inference performance with modern accelerators on Kubernetes
This platform is an open source, Kubernetes native stack for distributed large language model inference. It takes inference engines such as vLLM and SGLang and runs them across a cluster, turning single node engines into production serving on hardware an organization already has. It is aimed at platform and infrastruct...
Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API.
TurboLLM is a local runner for open language models that works on the user's own computer with no cloud, no account and no internet connection needed. It starts with a single npx turbollm command or a standalone app for Windows, macOS, Linux and Android, and serves a browser interface on localhost that phones, tablets ...
Manages Unified Access to Generative AI Services built on Envoy Gateway
Agent Router is an open source control plane for agentic traffic, built on the Envoy proxy. It gives an AI agent one OpenAI compatible API for every model and one router for every MCP tool, so a team integrates once and switches models by changing the model name rather than rewriting code. Agent Router turns a descript...
AG2 Visualized - Build Multi-Agentic Apps with Drag-and-Drop.
Agentok Studio is an open source visual builder for multi agent applications on AG2, the agent framework previously known as AutoGen. Users design agent workflows on a drag and drop canvas and the studio generates self contained Python code that runs anywhere as a normal program. It is aimed at developers who want to ...
Local AI app and inference engine for agents.
Atomic Chat is a free, open source app for chatting with AI models that run entirely on the user's own device. It downloads and runs open models locally, so conversations never leave the machine, work fully offline and carry no rate limits or subscription. Desktop builds are available for macOS 13 and later on Apple Si...