Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
xiaobei
Agents & frameworks为OPC/中小微企业量身打造的自媒体获客智能体
git clone https://github.com/TeamWiseFlow/xiaobei.git -
Abrasio
MCP serversStealth browser for AI agents: navigate, click, type and extract on bot-protected sites.
abrasio-mcp@0.1.1 -
Act as a Node.js Automation Script Developer. You are an expert in creating automated scripts using Node.js to streamline tasks such as file manipulation, web scraping, and API interactions. Your task is to: - Write…
-
create the landing page the i want build and this my project topic name :Development of a Real-time Airfare Price Index for India through Automated Web Scraping of Airline and Online Travel Aggregator Portals for…
-
Leaked-GPTs
Docs & tutorialsLeaked GPTs Prompts Bypass the 25 message limit or to try out GPTs without a Plus subscription.
git clone https://github.com/friuns2/Leaked-GPTs.git -
llm-scraper
AI repositoriesTurn any webpage into structured data using LLMs
git clone https://github.com/mishushakov/llm-scraper.git -
ai-crawler-policy
MCP serversCloudflare Workers MCP server: ai-crawler-policy
-
Open SEO Crawler
MCP serversSelf-hosted SEO crawler: run site audits and AI crawler checks, then read the issues and pages.
https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb@1.0.0 -
tiktok-mcp
SkillsTikTok MCP server for Claude, ChatGPT, Cursor and Codex. Publish and schedule TikTok videos and photo slideshows, or send drafts to your TikTok inbox, through TikTok's official API. No scraping, no developer app.
git clone https://github.com/postoncehq/tiktok-mcp.git -
polite-crawler
MCP serversA polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.
polite-crawler-mcp@0.7.6 -
Agent Crawl Readiness
MCP serversBounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.
-
Unrendered: AI Crawler Checker
MCP serversAI crawler checker: shows which page content GPTBot and ClaudeBot can't read without JavaScript.
unrendered-mcp@0.1.4 -
Atalaya AI crawler check
MCP serversWhich AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why.
-
ai-crawler-readiness
MCP serversCan AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
-
Enrichment Crawlers MCP by InsightfulPipe
MCP serversHosted Enrichment Crawlers MCP server, with each action switched on or off per account.
-
ActableSite AI Crawler Monitor
MCP serversCheck AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.
-
ActableSite AI Crawler Monitor
MCP serversCheck AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.
-
NM Signals: AI crawler audit
MCP serversAudit webpage access for AI crawlers. API key and Premium or Partner plan required.
-
GenPark Bloom Filter URL Dedup Crawler
MCP serversIn-memory Bloom filter for URL and document hash deduplication preventing redundant web crawler inge
https://github.com/Alpha-Park/genpark-bloom-filter-url-dedup-crawler-skill/releases/download/v1.0.1/genpark-bloom-filter-url-dedup-crawler-skill-v1.0.1.mcpb -
Site SEO & AI Crawler Audit
MCP serversCheck public pages for SEO tags, AI crawler rules, AI citation signals and landing page conversion.
-
robots-txt-ai-crawler-audit
MCP serversChecks robots.txt line by line and says what each AI crawler token actually controls - training, AI
@readystack/robots-txt-ai-crawler-audit@0.1.3 -
Robots.txt & AI Crawler Checker
MCP serversrobots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.
-
Web Crawler MCP by InsightfulPipe
MCP serversHosted Web Crawler MCP server for Claude, ChatGPT and Cursor, with each action switched per account.
-
AI Crawler Access Checker
MCP serversShows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.