InnerVault

awesome-ai-web-scraping

Stale GitHub, h4ckf0r0day

A curated list of AI-powered web scraping tools, LLM-friendly crawlers, MCP servers, and infrastructure for turning the web into data.

Open the source (opens github.com) https://github.com/h4ckf0r0day/awesome-ai-web-scraping

What it is

Docs & tutorials from h4ckf0r0day.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/h4ckf0r0day/awesome-ai-web-scraping.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. awesome-langchain

    Docs & tutorials

    ๐Ÿ˜Ž Awesome list of tools and projects with the awesome LangChain framework

    Indexed GitHub, kyrolabs 9,596 โ˜…CC0-1.0Updated 5 days ago

    git clone https://github.com/kyrolabs/awesome-langchain.git
  2. awesome-free-llm-apis

    Docs & tutorials

    List of Permanent Free LLM API (API Keys)

    Indexed GitHub, mnfst 13.4k โ˜…CC0-1.0Updated yesterday

    git clone https://github.com/mnfst/awesome-free-llm-apis.git
  3. awesome-harness-engineering

    Docs & tutorials

    ๐Ÿ› ๏ธ Awesome tools & guides for harness engineering.

    Stale GitHub, walkinglabs 4,692 โ˜…CC0-1.0Updated 7 days ago

    git clone https://github.com/walkinglabs/awesome-harness-engineering.git
  4. awesome-llm

    Docs & tutorials

    A curated list of awesome LLM frameworks, libraries and software.

    Stale GitHub, uhub 864 โ˜…Updated 25 days ago

    git clone https://github.com/uhub/awesome-llm.git
  5. awesome-llm-services

    Docs & tutorials

    A list of self-hostable LLM services

    Indexed GitHub, av 281 โ˜…MITUpdated today

    git clone https://github.com/av/awesome-llm-services.git
  6. awesome-local-llm

    Docs & tutorials

    A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

    Indexed GitHub, rafska 3,073 โ˜…MITUpdated 3 days ago

    git clone https://github.com/rafska/awesome-local-llm.git