Loading...
Loading...
Vllm: A high-throughput and memory-efficient inference and serving engine for LLMs. It is listed under Data & Analytics on AI Registry as a free tool.
The tools below are approved listings in the same category, ordered by how closely their tags match Vllm. This is an automatic list. We have not written a researched verdict for Vllm yet, so treat it as a shortlist and check each vendor's pricing page before switching.
Built from each tool's listing. Vendors can update their own listing after claiming it.
SGLang is a high-performance serving framework for large language models and multimodal models.
SGLang is an open source serving framework for large language models and multimodal models. It runs inference at scale, from a single GPU to distributed clusters, and exposes standard OpenAI compatible endpoints so existing client code can talk to a self hosted model. The project highlights production oriented optimiz...
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
LMCache is open source infrastructure software for large language model inference that treats the KV cache as reusable memory. The KV cache holds the intermediate attention state a model computes while reading a prompt. LMCache stores, compresses, searches and reuses that state across an entire cluster, so repeated or ...
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
LoRAX, short for LoRA eXchange, is an inference server for serving many fine tuned language models from a single GPU. Instead of deploying one model copy per fine tune, it loads one shared base model and swaps in lightweight LoRA adapters per request, which lowers the cost of serving large numbers of custom models. Th...
AI-powered tool for efficient abstract and PDF screening in systematic reviews.
MetaScreener is a web tool that uses large language models to screen literature for systematic reviews and meta analyses. A researcher defines inclusion criteria, loads a set of references, and the tool applies those criteria across the abstracts or full texts, producing include or exclude decisions that the researcher...
AI Search & RAG Without Moving Your Data.
SWIRL is an enterprise search and answer platform that returns cited AI answers by searching a company's existing systems live, as the signed in user, without copying content into a central index. Version 5 is positioned at regulated organizations such as law firms, government bodies, pharma companies and universities....
Chat with your data - with memory, rules, and observability built in.
Bag of words is an open source AI analyst that connects a language model of your choice to the data your company already stores, then answers questions and builds reports from it. Rather than a chat box bolted onto a warehouse, it combines structured planning, observations and explicit logic so an analysis can be trace...