Haystack

Haystack is an open source AI orchestration framework from deepset for building production ready, LLM powered agents and applications. It is installed through pip and gives developers modular, customizable building blocks for retrieval, reasoning, memory and tool use. It targets engineering teams moving from prototype to production. Pipelines can branch and loop, which supports advanced retrieval augmented generation, agents with standardized tool calling, and multimodal applications that handle images and audio as well as text. The framework integrates with providers and stores including OpenAI, Anthropic, Mistral, Hugging Face, Weaviate, Pinecone and Elasticsearch, so you can mix components without vendor lock in. Pipelines are serializable, cloud agnostic and Kubernetes ready, with logging, monitoring and deployment guides, and you can inspect and debug each decision your system makes. The core framework is open source and supported by the community. deepset also sells Haystack Enterprise Support, with private engineering support, deployment templates and flexible services, and a Haystack Enterprise Platform for visual pipeline design, testing workflows, access controls and cloud or on premises deployment. The site says enterprise support is priced flexibly by company size and publishes no amounts.