MetaScreener Alternatives

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

LMCache is open source infrastructure software for large language model inference that treats the KV cache as reusable memory. The KV cache holds the intermediate attention state a model computes while reading a prompt. LMCache stores, compresses, searches and reuses that state across an entire cluster, so repeated or ...

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

LoRAX, short for LoRA eXchange, is an inference server for serving many fine tuned language models from a single GPU. Instead of deploying one model copy per fine tune, it loads one shared base model and swaps in lightweight LoRA adapters per request, which lowers the cost of serving large numbers of custom models. Th...

Minecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)

MineBench is a public benchmark that compares large language models by asking them to build things in a Minecraft style voxel world. Each model receives a plain language prompt, such as a wooden cabin beside a pond with a stone chimney and a small dock, and responds with raw block coordinates and block types in JSON. T...

Cell type annotation for single-cell RNA-seq using multi-LLM consensus

mLLMCelltype is an open source tool for annotating cell types in single cell RNA sequencing data. Instead of relying on one model, it sends the data to several large language models and combines their answers into a consensus, with configurable thresholds and discussion rounds to resolve disagreements between models. I...

A @ClickHouse fork that supports high-performance vector search and full-text search.

MyScale is a cloud database that combines vector search with SQL analytics. It is built on the open source ClickHouse database and handles structured data and vector embeddings in one system, so a single SQL query can mix vector similarity, filters, full text search and joins. The vendor says its proprietary MSTG vecto...

OpenEverest is an open-source platform for automated database, storage and LLMs provisioning and management.

OpenEverest is an open source platform for provisioning and managing databases on Kubernetes. It gives teams a self service database platform, in effect an internal database as a service, that runs on any Kubernetes cluster, whether in a public cloud, a private cloud or on premises. The project describes itself as cove...