Loading...
Loading...
Gpustack: A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances. It is listed under Development & Code on AI Registry as a free tool.
The tools below are approved listings in the same category, ordered by how closely their tags match Gpustack. This is an automatic list. We have not written a researched verdict for Gpustack yet, so treat it as a shortlist and check each vendor's pricing page before switching.
Built from each tool's listing. Vendors can update their own listing after claiming it.
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
pegainfer is a from scratch large language model inference engine written in pure Rust and CUDA. It serves models through an OpenAI compatible API, so any existing SDK can be pointed at a local endpoint, and it has no Python in the serving path, with no PyTorch, ONNX or other framework at runtime. The supported model ...
Agent Cloud is like having your own GPT builder with a bunch extra goodies.
Agent Cloud is an open source platform for building chat apps and agents that talk to a company's own data through retrieval augmented generation. Its core is a built in data pipeline that syncs, splits, chunks, embeds and stores data from a large catalogue of sources in a vector database, then keeps that data fresh on...
agentevals is a framework-agnostic evaluations solution based on OpenTelemetry traces
AgentEvals is an open source tool for benchmarking AI agents by scoring their behaviour from OpenTelemetry traces. Rather than replaying expensive LLM calls or re executing an agent, it parses OTLP streams and Jaeger JSON traces captured from production or test runs and evaluates what the agent actually did, so teams c...
AG2 Visualized - Build Multi-Agentic Apps with Drag-and-Drop.
Agentok Studio is an open source visual builder for multi agent applications on AG2, the agent framework previously known as AutoGen. Users design agent workflows on a drag and drop canvas and the studio generates self contained Python code that runs anywhere as a normal program. It is aimed at developers who want to ...
Local AI app and inference engine for agents.
Atomic Chat is a free, open source app for chatting with AI models that run entirely on the user's own device. It downloads and runs open models locally, so conversations never leave the machine, work fully offline and carry no rate limits or subscription. Desktop builds are available for macOS 13 and later on Apple Si...
Ultrafast serverless GPU inference, sandboxes, and background jobs
Beta9 is the open source runtime behind Beam, a serverless platform for running AI workloads on GPUs and CPUs without managing servers. Developers decorate ordinary Python functions to turn them into autoscaling inference endpoints, task queues or isolated sandboxes, then ship them with a single deploy command. The run...