InnerVault

lasagna

IndexedGitHub, dolev31

Swap one RAG pipeline stage, hold the rest fixed, and measure whether the gain survives composition. The framework behind "Retrieval Augmented Generation Compositionality": 450 configurations, eight benchmarks, corpora from 5K to 200K documents.

Open the source (opens github.com) https://github.com/dolev31/lasagna

What it is

Datasets & benchmarks from dolev31.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/dolev31/lasagna.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. ollama-benchmark

    Datasets & benchmarks

    LLM Benchmark for Throughput via Ollama (Local LLMs)

    Stale GitHub, aidatatools 397 ★MITUpdated 20 days ago

    git clone https://github.com/aidatatools/ollama-benchmark.git
  2. TheAgentCompany

    Datasets & benchmarks

    An agent benchmark with tasks in a simulated software company.

    Stale GitHub, TheAgentCompany 795 ★MITUpdated 12 months ago

    git clone https://github.com/TheAgentCompany/TheAgentCompany.git
  3. AI_Diplomacy

    Datasets & benchmarks

    Frontier Models playing the board game Diplomacy.

    Stale GitHub, GoodStartLabs 708 ★Custom licence (see repository)Updated 5 months ago

    git clone https://github.com/GoodStartLabs/AI_Diplomacy.git
  4. ClawBench

    Datasets & benchmarks

    Open-source benchmark for browser AI agents on daily tasks.

    Stale GitHub, TIGER-AI-Lab 1,229 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/TIGER-AI-Lab/ClawBench.git
  5. swe-sweep

    Datasets & benchmarks

    How many bugs can LMs find & fix in large codebases?

    Indexed GitHub, facebookresearch 240 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/facebookresearch/swe-sweep.git
  6. tau2-bench

    Datasets & benchmarks

    τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

    Indexed GitHub, sierra-research 2,442 ★MITUpdated 6 days ago

    git clone https://github.com/sierra-research/tau2-bench.git