Loading...
Loading...
Scrapfly Scrapers: Scalable Python web scraping scripts for +40 popular domains. It is listed under Data & Analytics on AI Registry as a free tool.
The tools below are approved listings in the same category, ordered by how closely their tags match Scrapfly Scrapers. This is an automatic list. We have not written a researched verdict for Scrapfly Scrapers yet, so treat it as a shortlist and check each vendor's pricing page before switching.
Built from each tool's listing. Vendors can update their own listing after claiming it.
Automated web scraping spider generation using Browser Use and LLMs.
SpiderCreator is an open source library that uses large language models to help generate web scraping spiders built on Playwright. Its approach is to apply an LLM only while the spider is being created. The resulting spider then runs on ordinary browser automation, so repeated scraping runs avoid per page model costs, ...
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Prefect is a workflow orchestration platform for data pipelines, machine learning and AI agents. Developers annotate ordinary Python functions with flow and task decorators and gain state tracking, logging, scheduling and automatic retries without adopting a new framework. A single interface shows every run and flags w...
Open source web infrastructure for AI.
Reader is an open source web scraping engine that converts web pages into clean markdown for language models and AI agents. It is distributed as a TypeScript package and a command line tool, and it exposes two primitives: a scrape call for a list of URLs and a crawl call for whole websites. Under the hood it is built ...
Python scraper based on AI
ScrapeGraphAI is a web scraping API built for AI workloads. It extracts structured data from websites using natural language prompts, without the user maintaining proxies or page selectors. The vendor has introduced a second version of its APIs, described as better, faster and cheaper. The API covers several operation...
ScraperAI is an open-source, AI-powered tool designed to simplify web scraping for users of all skill levels.
ScraperAI is an open source Python tool that uses large language models to simplify web scraping. Instead of the user inspecting pages in developer consoles and hand writing selectors, the tool analyzes a web page, detects the data to collect and generates a reusable scraping configuration that can be saved and shared....
Turns Data and AI algorithms into production-ready web applications in no time.
Taipy is a Python library and platform for building data and business intelligence web applications, including applications that put machine learning models in front of end users. Developers write the interface in Python, Markdown or HTML without a separate front end stack, and Taipy handles the back end as well, inclu...