Promptfoo

Promptfoo is an AI security and testing platform for teams building LLM applications, agents and RAG systems. It started as an open source command line tool and is now also sold as an enterprise product. Developers use it to test prompts and models, configure tests in YAML and view results locally. Its main capability is automated red teaming. Promptfoo generates attacks tailored to a target application, including direct and indirect prompt injection, jailbreaks aimed at the target's guardrails, data and PII leaks, business rule violations, insecure tool use by agents and toxic content. Related areas on the site cover evaluations, code scanning, model security, guardrails and MCP. It plugs into CI/CD pipelines such as GitHub, GitLab and Jenkins, can run on premises or in the cloud, and reports findings with remediation guidance in pull requests. Industry pages describe scenarios for areas such as financial services, with tests mapped to regulatory requirements. Pricing is published in three tiers. Community is free forever, covers all evaluation features, model providers and integrations, includes 10k red teaming probes per month, and can run locally or be self hosted, with community support. Enterprise is custom priced and adds custom red teaming limits, team sharing, continuous monitoring, a compliance dashboard, SSO, API access, managed cloud deployment and priority support with SLAs. On Premise is also custom priced and adds deployment on the customer's own infrastructure, complete data isolation, a dedicated runner and an assigned deployment engineer.