One-Eval
Automated system for LLM evaluation via agents. Doc as below:
Open the source (opens github.com) https://github.com/opendcai/one-eval
What it is
Datasets & benchmarks from OpenDCAI.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/OpenDCAI/One-Eval.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
sec-code-bench
Datasets & benchmarksSecCodeBench is a benchmark suite focusing on evaluating the security of code generated by large language models (LLMs).
git clone https://github.com/alibaba/sec-code-bench.git -
LLM-eval-survey
Datasets & benchmarksThe official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".
git clone https://github.com/MLGroupJLU/LLM-eval-survey.git -
TraderHarness
Datasets & benchmarks面向 LLM 交易 Agent 的抗污染回测、确定性回放与训练轨迹生成,支持 A 股研究|Leakage-resistant backtesting, deterministic replay & training trajectory generation for LLM trading agents, with A-share data
git clone https://github.com/HephaestLab/TraderHarness.git -
ClawBench
Datasets & benchmarksOpen-source benchmark for browser AI agents on daily tasks.
git clone https://github.com/TIGER-AI-Lab/ClawBench.git -
agents-last-exam
Datasets & benchmarksHugging Face dataset by agents-last-exam
agents-last-exam/agents-last-exam -
tau2-bench
Datasets & benchmarksτ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
git clone https://github.com/sierra-research/tau2-bench.git