Maxun
lastmod 2026-11-15created 2026-11-151 edits
Open-source web data platform that turns any website into a structured API
About
- Open-source platform for web scraping, crawling, monitoring, and AI data extraction, where you build robots that collect the data you want from websites and run them repeatedly
- Extract
- Recorder Mode: click the parts you want in the browser to record your actions, and a reusable extraction robot is created. Use Capture List to pick repeating items (product name, price, stock, etc.) and collect multi-page lists via a Next button or scrolling, with no code
- AI Mode: describe what to fetch in natural language and the AI finds and extracts it. Self-hosted instances need to connect a model provider such as Anthropic, or Ollama
.env with values generated by openssl rand -hex 32. On a personal PC, prefix the ports in the Compose file with 127.0.0.1: to avoid exposing them externally See also
- Web Scraping
- Crawl4AI - Open-source crawler that turns web pages into AI-friendly Markdown
- Firecrawl
- Scraperr - Self-hosted web scraper