InnerVault

MedXpertQA

Stale GitHub, TsinghuaC3I

[ICML 2025] MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding

Open the source (opens github.com) https://github.com/tsinghuac3i/medxpertqa

What it is

Datasets & benchmarks from TsinghuaC3I.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/TsinghuaC3I/MedXpertQA.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. PyHealth

    Datasets & benchmarks

    A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.

    Indexed GitHub, sunlabuiuc 1,699 ★MITUpdated today

    git clone https://github.com/sunlabuiuc/PyHealth.git
  2. Awesome-Datasets-Hub

    Datasets & benchmarks

    A curated collection of datasets for Large Language Models (LLMs), covering medical AI, NLP, multimodal learning, instruction tuning, reasoning, code generation, and evaluation benchmarks.

    Stale GitHub, ahammadmejbah 149 ★Updated 4 months ago

    git clone https://github.com/ahammadmejbah/Awesome-Datasets-Hub.git
  3. tmmluplus

    Datasets & benchmarks

    Hugging Face dataset by ikala

    Indexed Hugging Face Hub, ikala 242 ♥mitUpdated 54 days ago

    ikala/tmmluplus
  4. ollama-benchmark

    Datasets & benchmarks

    LLM Benchmark for Throughput via Ollama (Local LLMs)

    Stale GitHub, aidatatools 397 ★MITUpdated 20 days ago

    git clone https://github.com/aidatatools/ollama-benchmark.git
  5. swe-sweep

    Datasets & benchmarks

    How many bugs can LMs find & fix in large codebases?

    Indexed GitHub, facebookresearch 240 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/facebookresearch/swe-sweep.git
  6. llm-colosseum

    Datasets & benchmarks

    Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

    Stale GitHub, OpenGenerativeAI 1,483 ★MITUpdated 20 months ago

    git clone https://github.com/OpenGenerativeAI/llm-colosseum.git