InnerVault

Scrapegraph-ai

Stale GitHub, ScrapeGraphAI

Python scraper based on AI

Open the source (opens github.com) https://github.com/scrapegraphai/scrapegraph-ai

What it is

AI repositories from ScrapeGraphAI.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/ScrapeGraphAI/Scrapegraph-ai.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. AnyCrawl

    AI repositories

    AnyCrawl ๐Ÿš€: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

    Indexed GitHub, any4ai 3,528 โ˜…MITUpdated 4 days ago

    git clone https://github.com/any4ai/AnyCrawl.git
  2. fess

    AI repositories

    Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.

    Indexed GitHub, codelibs 1,151 โ˜…Apache-2.0Updated yesterday

    git clone https://github.com/codelibs/fess.git
  3. Scrapegraph-demo

    AI repositories

    Streamlit demo of Scrapegraph-ai for GPT4-hackaton

    Indexed GitHub, ScrapeGraphAI 120 โ˜…MITUpdated yesterday

    git clone https://github.com/ScrapeGraphAI/Scrapegraph-demo.git
  4. MindSearch

    AI repositories

    ๐Ÿ” An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)

    Stale GitHub, InternLM 6,943 โ˜…Apache-2.0Updated 16 months ago

    git clone https://github.com/InternLM/MindSearch.git
  5. trafilatura

    AI repositories

    Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

    Indexed GitHub, adbar 7,128 โ˜…Apache-2.0Updated 3 days ago

    git clone https://github.com/adbar/trafilatura.git
  6. rag-search

    AI repositories

    RAG Search API

    Stale GitHub, thinkany-ai 1,178 โ˜…Apache-2.0Updated 2 years ago

    git clone https://github.com/thinkany-ai/rag-search.git