Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
Curator
AI repositoriesScalable data pre processing and curation toolkit for LLMs
git clone https://github.com/NVIDIA-NeMo/Curator.git -
layerfs
AI repositoriesEphemeral Workspaces, durable shared history. LayerFS gives every agent a complete, writable filesystem Workspace over shared committed history, without copying the base. Agents work in parallel, commit what changed as deduplicated checkpoints, then branch, rewind or merge. Try it with LayerFS × DSH.
git clone https://github.com/Ephemeral-AI-Lab/layerfs.git -
api-request-deduplicator
MCP serversCloudflare Workers MCP server: api-request-deduplicator
-
Execute context-deduplicator-oracle-mcp
MCP serversPremium agentic endpoint for context-deduplicator-oracle-mcp.
-
High-dimensional vector embedding semantic SimHash deduplication sentinel with LRU cache simulation
https://github.com/Alpha-Park/genpark-vector-embedding-cache-deduplication-sentinel-skill/releases/download/v1.0.1/genpark-vector-embedding-cache-deduplication-sentinel-skill.mcpb -
Merge and deduplicate caller-supplied JSON datasets, keep stable row order and export CSV.
-
Merge & Deduplicate Datasets (Ctrio Lab)
MCP serversMerge Apify datasets and remove duplicates by any fields, keeping the first or the newest copy.
-
Firmcomb: clean company names, legal forms, casual names and duplicate groups.
-
Ultra-FineWeb-L1
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/Ultra-FineWeb-L1 -
Glyd
Datasets & benchmarksLossless AI compression: 33% less GPU memory, bit for bit.
git clone https://github.com/surya-koritala/Glyd.git -
Zengram
MCP serversA Multi Agent Memory MCP That Connect Agents Across Systems and Machines
git clone https://github.com/ZenSystemAI/Zengram.git -
RankFabrik Jobs
Public APIsAggregated job postings search, deduplicated on identifier, with coverage per segment
-
Scoopkit
Public APIsAI-industry news deduplicated into structured events with a versioned category taxonomy
-
Newsflash
Public APIsDeduplicated news events from 260+ sources with corroboration/confidence scores for AI agents
-
RankFabrik Places
Public APIsSearch businesses and points of interest by city, deduplicated with a coverage report
-
JobsRadar
MCP serversJob search across Greenhouse, Lever, Ashby, SmartRecruiters, Personio and Pinpoint, deduplicated.
-
librarian-nexus
MCP serversKnowledge synthesis MCP server with vector-deduplicated lessons and x402 micropayments.
-
memora
AI repositoriesGive your AI agents persistent, collective memory — with deduplicating absorb, supersession lineage, semantic search, and a graph UI. Speaks MCP.
git clone https://github.com/agentic-box/memora.git -
signals
MCP serversDeduplicated, entity-resolved funding rounds, acquisitions, and exec moves as MCP tools.
-
JobScout MCP
MCP serversMulti-source job discovery, deduplication and AI/Web3 classification for AI agents.
@sarutobi-sasuke/jobscout-mcp@0.2.1 -
pmll-memory-mcp
MCP serversPMLL Memory MCP — persistent KV context memory and Q-promise deduplication.
pmll-memory-mcp@0.1.1 -
telemem
AI repositoriesTeleMem is a high-performance drop-in replacement for Mem0, featuring semantic deduplication, long-term dialogue memory, and multimodal video reasoning.
git clone https://github.com/TeleAI-UAGI/telemem.git -
NewsMCP
MCP serversLive world news deduplicated into story events, with corroboration counts and source links.
-
Agent Commons
MCP serversFree citation deduplication, JSON checks, agent discovery, shared tasks and evidence review.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.