Firecrawl

lastmod 2024-11-18created 2024-11-181 edits

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

A tool that makes entire websites usable by LLMs

Features

• Crawls websites and converts them into markdown or structured data usable by LLMs
• Send a URL to the API and it crawls all subpages, providing clean data for each subpage
• Provides Python, Node, Go, and Rust SDKs
• Supports integration with LangChain, Llama Index,Dify, Langflow, Zapier, and more

See also

• LLM

Favorite site

• Github - mendableai/firecrawl
• Home - Firecrawl