Firecrawl
Turns websites into clean Markdown or structured data for AI, through a hosted API or a self-hosted copy.
Open the source (opens github.com) https://github.com/firecrawl/firecrawl
Before you use it
- The hosted API needs an API key. Self-hosting under AGPL-3.0 has obligations if you offer it to others as a service.
What it is
Public APIs from Firecrawl. Good for:
- Feed a company's whole site into a research prompt
- Keep an eye on pages for changes
Level: builder
How to get it
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
Crawl4AI
Public APIsAn open-source crawler that turns websites into Markdown ready for an AI model.
pip install -U crawl4ai -
SnoopScan
Public APIsScrape, crawl, map and search the web as clean markdown or JSON, with a free monthly tier
-
Webclaw
Public APIsWeb content extraction for LLMs with scrape, crawl, search, and summarize
-
GcrawlAI
Public APIsWeb scraping, SERP API, screenshots, URL to Markdown and prebuilt extractors
-
ProxyCrawl
Public APIsScraping and crawling anticaptcha service
-
crawlbrulee
Public APIsEU-native web scraping for AI agents & developers: turn any page into markdown, screenshots and more