InnerVault

evalscope

IndexedGitHub, modelscope

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

Open the source (opens github.com) https://github.com/modelscope/evalscope

What it is

AI repositories from modelscope.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/modelscope/evalscope.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. giskard-oss

    AI repositories

    🐢 Open-Source Evaluation & Testing library for LLM Agents

    Indexed GitHub, Giskard-AI 5,954 ★Apache-2.0Updated today

    git clone https://github.com/Giskard-AI/giskard-oss.git
  2. EnterpriseRAG-Bench

    AI repositories

    Dataset and benchmark for RAG on company internal documents.

    Stale GitHub, onyx-dot-app 592 ★MITUpdated 2 months ago

    git clone https://github.com/onyx-dot-app/EnterpriseRAG-Bench.git
  3. LLM-Engineers-Handbook

    AI repositories

    The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices

    Stale GitHub, PacktPublishing 5,377 ★MITUpdated 6 months ago

    git clone https://github.com/PacktPublishing/LLM-Engineers-Handbook.git
  4. XRAG

    AI repositories

    XRAG: eXamining the Core - Benchmarking Foundational Component Modules in Advanced Retrieval-Augmented Generation

    Stale GitHub, DocAILab 611 ★Apache-2.0Updated 15 days ago

    git clone https://github.com/DocAILab/XRAG.git
  5. Adaptive-rag

    AI repositories

    按问题复杂度自动分流的电商客服 RAG:简单问题直接回答;复杂问题经过多跳检索并自我纠错;查单、退改通过工具调用完成,且高风险写操作必须先经人工确认。基于 FastAPI 和 LangGraph,混合检索并附带引用,内置离线评测与 Prometheus 指标。涵盖简历写法和项目面试拷打

    Stale GitHub, JEen-wang 137 ★MITUpdated 25 days ago

    git clone https://github.com/JEen-wang/Adaptive-rag.git
  6. EvalForge

    AI repositories

    Evaluator-neutral AI evaluation evidence, baseline regression gates, and JSON, JUnit, and SARIF reports for CI.

    Indexed GitHub, jsdhwfmax 194 ★MITUpdated today

    git clone https://github.com/jsdhwfmax/EvalForge.git