Loading...
Loading...
Llmaz: Easy, advanced inference platform for large language models on Kubernetes. It is listed under Development & Code on AI Registry as a free tool.
The tools below are approved listings in the same category, ordered by how closely their tags match Llmaz. This is an automatic list. We have not written a researched verdict for Llmaz yet, so treat it as a shortlist and check each vendor's pricing page before switching.
Built from each tool's listing. Vendors can update their own listing after claiming it.
IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
Iris App, also presented as Iris Offline GPT, is an Android AI chat application from Nervesparks that runs language models entirely on the device with no internet connection. The listing points at the Nervesparks company home page, and the product itself is described on its own page under the company's Products menu, w...
An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance.
MatrixHub is an open source, self hosted registry for AI models, built for enterprise inference at large scale. It is positioned as a drop in private replacement for Hugging Face, and the site compares its relationship to Hugging Face with the one between Harbor and Docker Hub. It is designed to speed up vLLM and SGLan...
Yet another operator for running large language models on Kubernetes with ease.
Ollama Operator is a Kubernetes operator for running large language models on a cluster, powered by Ollama. It extends the Ollama experience to any Kubernetes environment, whether edge hardware or a cloud provider, using the same specification everywhere. A model is deployed by declaring a custom resource of kind Mode...
Bonsai Demo
Bonsai is the family of compressed language models from PrismML, and the demo is the hosted way to try them before downloading. PrismML builds what it calls ultra dense intelligence: models quantized to ternary or one bit weights so that capable reasoning fits on phones, laptops and edge hardware instead of a datacente...
Provider-pluggable orchestration runtime for multi-model AI inference.
Dot Loom is the open source orchestration component of Dot, a private and anonymous AI platform at usedot.xyz. Loom passes a request through a router, a drafter, a critic and a finalizer to produce one finished answer, and it underpins Dot's developer and agent features. The wider Dot service offers chat, code, image a...
Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.
Griptape is a generative AI platform with three layers that serve different audiences: Griptape Nodes, Griptape Cloud and the Griptape Framework. Together they let a team orchestrate multiple AI models and agents inside secure, professional workflows, whether the person building them is an artist or a backend developer...