Loading...
Loading...
Ollama Operator: Yet another operator for running large language models on Kubernetes with ease. It is listed under Development & Code on AI Registry as a free tool.
The tools below are approved listings in the same category, ordered by how closely their tags match Ollama Operator. This is an automatic list. We have not written a researched verdict for Ollama Operator yet, so treat it as a shortlist and check each vendor's pricing page before switching.
Built from each tool's listing. Vendors can update their own listing after claiming it.
IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
Iris App, also presented as Iris Offline GPT, is an Android AI chat application from Nervesparks that runs language models entirely on the device with no internet connection. The listing points at the Nervesparks company home page, and the product itself is described on its own page under the company's Products menu, w...
Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser
BrowserAI is an open source JavaScript library for running small language models locally inside a web browser. It uses WebGPU and WebAssembly to load and run models on the user's own device, so an application can generate text, hold a chat or process speech without calling a cloud API, holding API keys or maintaining s...
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.
Lemonade is a local AI runtime that lets a computer run text, image and speech models on its own hardware. Installation provides an AI runtime, a graphical interface, a command line tool and API endpoints, so a user can chat with models directly, connect them to agents, or build them into an application. It is aimed a...
Easy, advanced inference platform for large language models on Kubernetes.
llmaz is an open source inference platform for running large language models on Kubernetes. It aims to let a team stand up a model serving endpoint with minimal configuration, handling model loading, scaling and routing inside an existing cluster. The project documents a broad set of capabilities. It supports several ...
Never give AI companies your secrets!
PromptMask is a local first privacy layer for large language model users. It redacts sensitive data from prompts before they leave the user's machine and restores the original values in the response, so only anonymized text reaches a third party AI service. The masking itself is done by a trusted language model, typica...
Next Generation Agentic Proxy for AI Agents and MCP servers
Agentgateway is an open source gateway that handles traditional application traffic and AI native protocols in a single data plane. One binary routes, secures, observes and governs HTTP, gRPC and TCP services, LLM provider traffic, Model Context Protocol tool calls and agent to agent communication, so platform teams do...