InnerVault

benchmarks

Stale GitHub, coval-ai

Reproducible voice-AI benchmarking — TTS / STT / S2S latency and accuracy.

Open the source (opens github.com) https://github.com/coval-ai/benchmarks

What it is

Agents & frameworks from coval-ai.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/coval-ai/benchmarks.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. future-agi

    Agents & frameworks

    Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

    Indexed GitHub, future-agi 2,267 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/future-agi/future-agi.git
  2. Awesome-CUA

    Agents & frameworks

    Open, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.

    Stale GitHub, reacher-z 659 ★Custom licence (see repository)Updated 6 days ago

    git clone https://github.com/reacher-z/Awesome-CUA.git
  3. awesome-auditable-ai

    Agents & frameworks

    Auditing AI agents: a curated list of papers, tools, datasets, benchmarks, and standards covering reliability, monitoring, failure attribution, and decision records.

    Stale GitHub, yzhao062 154 ★CC0-1.0Updated 28 days ago

    git clone https://github.com/yzhao062/awesome-auditable-ai.git
  4. trulens

    Agents & frameworks

    Evaluation and Tracking for LLM Experiments and AI Agents

    Stale GitHub, truera 3,601 ★MITUpdated 34 days ago

    git clone https://github.com/truera/trulens.git
  5. nemo-helix

    Agents & frameworks

    NeMo Helix: Make the agents you ship faster, more accurate, and safer.

    Indexed GitHub, NVIDIA-NeMo 145 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/NVIDIA-NeMo/nemo-helix.git
  6. ai-agents-tutorial

    Agents & frameworks

    Learn AI Agents step by step, from scratch - from function calling to agent loops to multi-agent systems, orchestration, and evaluation.

    Indexed GitHub, amitshekhariitbhu 212 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/amitshekhariitbhu/ai-agents-tutorial.git