Loading...
Loading...
Bonsai Demo: Bonsai Demo. It is listed under Development & Code on AI Registry as a free tool.
The tools below are approved listings in the same category, ordered by how closely their tags match Bonsai Demo. This is an automatic list. We have not written a researched verdict for Bonsai Demo yet, so treat it as a shortlist and check each vendor's pricing page before switching.
Built from each tool's listing. Vendors can update their own listing after claiming it.
JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME.
JANG is an open source quantization method for running larger AI models on Apple Silicon Macs. It is built around the MLX framework and shrinks model files so that bigger, more capable models fit in the memory of a laptop or desktop Mac while keeping output quality higher than uniform quantization at the same size. St...
IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
Iris App, also presented as Iris Offline GPT, is an Android AI chat application from Nervesparks that runs language models entirely on the device with no internet connection. The listing points at the Nervesparks company home page, and the product itself is described on its own page under the company's Products menu, w...
Easy, advanced inference platform for large language models on Kubernetes.
llmaz is an open source inference platform for running large language models on Kubernetes. It aims to let a team stand up a model serving endpoint with minimal configuration, handling model loading, scaling and routing inside an existing cluster. The project documents a broad set of capabilities. It supports several ...
Yet another operator for running large language models on Kubernetes with ease.
Ollama Operator is a Kubernetes operator for running large language models on a cluster, powered by Ollama. It extends the Ollama experience to any Kubernetes environment, whether edge hardware or a cloud provider, using the same specification everywhere. A model is deployed by declaring a custom resource of kind Mode...
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
oMLX is a native macOS inference server built on Apple's MLX framework, designed to run local language models on Apple Silicon Macs. It targets the slow first response that coding agents suffer when a local model has to reprocess a long prompt, and it does so with a paged key value cache that is persisted to SSD, so pr...
Never give AI companies your secrets!
PromptMask is a local first privacy layer for large language model users. It redacts sensitive data from prompts before they leave the user's machine and restores the original values in the response, so only anonymized text reaches a third party AI service. The masking itself is done by a trusted language model, typica...