InnerVault

Atalaya AI crawler check

Stale Official MCP Registry, com.atalaya-ai

Which AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why.

Open the source (opens atalaya-ai.com) https://atalaya-ai.com/mcp-server

Before you use it

  • Runs on someone else's server: what you send it leaves your machine.

What it is

MCP servers from com.atalaya-ai.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Remote endpoint (streamable-http)

https://atalaya-ai.com/mcp

From the server's entry in the official MCP Registry

Related

  1. Riesgos en vivo en Colombia: lluvia, inundaciones, incendios, sismos y reportes ciudadanos.

    Stale Official MCP Registry, city.atalaya Updated 6 days ago 1 note

  2. Atalaya

    MCP servers

    Work management with Spec-Driven Development: tasks, sprints and SDD approvals for coding agents.

    Stale Official MCP Registry, io.atalayahq Updated 18 days ago 1 note

  3. Riesgos en vivo en Colombia: lluvia, inundaciones, incendios, sismos y reportes ciudadanos.

    Stale Official MCP Registry, io.lapoliza Updated 6 days ago 1 note

  4. Apify MCP Server

    MCP servers

    Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡

    Indexed Official MCP Registry, com.apify 16.0k ★Updated today 1 note

  5. doc-scraper

    MCP servers

    Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)

    Indexed GitHub, Sriram-PR 109 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/Sriram-PR/doc-scraper.git
  6. Crawlerpeek

    MCP servers

    Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.

    Stale Official MCP Registry, io.github.crawlerpeek Updated 18 days ago 1 note

    crawlerpeek@0.3.1