DevDocs

DevDocs by CyberAGI is an open source documentation crawler that turns technical documentation websites into material an AI coding assistant can query. Point it at a documentation URL and it discovers the related pages, extracts the useful content, organises it logically, and serves it through an MCP server so a language model can answer questions about a technology from its current docs rather than outdated training data. It is aimed at developers adopting unfamiliar frameworks, teams that want to make internal documentation queryable, and people who need to scrape a whole documentation site. Crawl depth is adjustable from one to five levels, with automatic discovery and mapping of child URLs and selective crawling of the pages that matter. It processes pages in parallel, caches to avoid duplicate work, handles lazy loaded web apps and rate limits itself to avoid overloading servers. Output is available as Markdown or JSON, including for fine tuning, and the project documents use alongside Claude and the Cline extension for VS Code. It is designed to be self hosted. The software is free under the Apache 2.0 licence, and the project describes itself as free forever with unlimited pages when self hosted. It mentions a custom enterprise plan but publishes no price for it, and API access is listed as coming soon. Buyers should note the status of the project. The most recent commits to its GitHub repository date from April 2025, and the CyberAGI website no longer mentions DevDocs; it now sells Excalibur, an on premises AI security platform priced at $80,000 a year. DevDocs remains available on GitHub but appears to be unmaintained.