InnerVault

One-Eval

Stale GitHub, OpenDCAI

Automated system for LLM evaluation via agents. Doc as below:

Open the source (opens github.com) https://github.com/opendcai/one-eval

What it is

Datasets & benchmarks from OpenDCAI.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/OpenDCAI/One-Eval.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. sec-code-bench

    Datasets & benchmarks

    SecCodeBench is a benchmark suite focusing on evaluating the security of code generated by large language models (LLMs).

    Stale GitHub, alibaba 135 ★Apache-2.0Updated 35 days ago

    git clone https://github.com/alibaba/sec-code-bench.git
  2. LLM-eval-survey

    Datasets & benchmarks

    The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

    Stale GitHub, MLGroupJLU 1,615 ★Updated 7 days ago

    git clone https://github.com/MLGroupJLU/LLM-eval-survey.git
  3. TraderHarness

    Datasets & benchmarks

    面向 LLM 交易 Agent 的抗污染回测、确定性回放与训练轨迹生成,支持 A 股研究|Leakage-resistant backtesting, deterministic replay & training trajectory generation for LLM trading agents, with A-share data

    Indexed GitHub, HephaestLab 43 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/HephaestLab/TraderHarness.git
  4. ClawBench

    Datasets & benchmarks

    Open-source benchmark for browser AI agents on daily tasks.

    Stale GitHub, TIGER-AI-Lab 1,229 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/TIGER-AI-Lab/ClawBench.git
  5. agents-last-exam

    Datasets & benchmarks

    Hugging Face dataset by agents-last-exam

    Stale Hugging Face Hub, agents-last-exam 225 ♥cc-by-4.0Updated 33 days ago

    agents-last-exam/agents-last-exam
  6. tau2-bench

    Datasets & benchmarks

    τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

    Indexed GitHub, sierra-research 2,442 ★MITUpdated 6 days ago

    git clone https://github.com/sierra-research/tau2-bench.git