Atalaya AI crawler check
Which AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why.
Open the source (opens atalaya-ai.com) https://atalaya-ai.com/mcp-server
Before you use it
- Runs on someone else's server: what you send it leaves your machine.
What it is
MCP servers from com.atalaya-ai.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Remote endpoint (streamable-http)
https://atalaya-ai.com/mcp
From the server's entry in the official MCP Registry
Related
-
Atalaya · Los riesgos de tu ciudad
MCP serversRiesgos en vivo en Colombia: lluvia, inundaciones, incendios, sismos y reportes ciudadanos.
-
Atalaya
MCP serversWork management with Spec-Driven Development: tasks, sprints and SDD approvals for coding agents.
-
Atalaya · Los riesgos de tu ciudad
MCP serversRiesgos en vivo en Colombia: lluvia, inundaciones, incendios, sismos y reportes ciudadanos.
-
Apify MCP Server
MCP serversExtract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡
-
doc-scraper
MCP serversGo web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)
git clone https://github.com/Sriram-PR/doc-scraper.git -
Crawlerpeek
MCP serversCheck whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.
crawlerpeek@0.3.1