InnerVault

evaluation-guidebook

Stale GitHub, huggingface

Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!

Open the source (opens github.com) https://github.com/huggingface/evaluation-guidebook

What it is

Docs & tutorials from huggingface.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/huggingface/evaluation-guidebook.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. An 18 notebook course that isolates and measures each component of agentic loop engineering on real, industry standard software datasets.

    Stale GitHub, FareedKhan-dev 59 ★MITUpdated 4 months ago

    git clone https://github.com/FareedKhan-dev/agentic-loop-engineering-course.git
  2. awesome-llm

    Docs & tutorials

    A curated list of awesome LLM frameworks, libraries and software.

    Stale GitHub, uhub 864 ★Updated 25 days ago

    git clone https://github.com/uhub/awesome-llm.git
  3. Awesome-llm-role-playing-with-persona: a curated list of resources for large language models for role-playing with assigned personas

    Stale GitHub, Neph0s 1,077 ★Updated 5 months ago

    git clone https://github.com/Neph0s/awesome-llm-role-playing-with-persona.git
  4. awesome-llms-fine-tuning

    Docs & tutorials

    Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs). Perfect for ML practitioners and researchers!

    Stale GitHub, Curated-Awesome-Lists 533 ★Updated 2 months ago

    git clone https://github.com/Curated-Awesome-Lists/awesome-llms-fine-tuning.git
  5. NamiGPT

    Docs & tutorials

    零基础入门大模型(LLM)的基础教程:从零手写 GPT-2,一行行看懂大模型是怎么工作的 | Build GPT-2 from scratch in PyTorch, step by step

    Stale GitHub, aa1143 146 ★MITUpdated 19 days ago

    git clone https://github.com/aa1143/NamiGPT.git
  6. llm-api-starterkit

    Docs & tutorials

    Beginner-friendly repository for launching your first LLM API with Python, LangChain and FastAPI, using local models or the OpenAI API.

    Stale GitHub, tleers 105 ★Updated 3 years ago

    git clone https://github.com/tleers/llm-api-starterkit.git