evaluation-guidebook
Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!
Open the source (opens github.com) https://github.com/huggingface/evaluation-guidebook
What it is
Docs & tutorials from huggingface.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/huggingface/evaluation-guidebook.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
agentic-loop-engineering-course
Docs & tutorialsAn 18 notebook course that isolates and measures each component of agentic loop engineering on real, industry standard software datasets.
git clone https://github.com/FareedKhan-dev/agentic-loop-engineering-course.git -
awesome-llm
Docs & tutorialsA curated list of awesome LLM frameworks, libraries and software.
git clone https://github.com/uhub/awesome-llm.git -
awesome-llm-role-playing-with-persona
Docs & tutorialsAwesome-llm-role-playing-with-persona: a curated list of resources for large language models for role-playing with assigned personas
git clone https://github.com/Neph0s/awesome-llm-role-playing-with-persona.git -
awesome-llms-fine-tuning
Docs & tutorialsExplore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs). Perfect for ML practitioners and researchers!
git clone https://github.com/Curated-Awesome-Lists/awesome-llms-fine-tuning.git -
NamiGPT
Docs & tutorials零基础入门大模型(LLM)的基础教程:从零手写 GPT-2,一行行看懂大模型是怎么工作的 | Build GPT-2 from scratch in PyTorch, step by step
git clone https://github.com/aa1143/NamiGPT.git -
llm-api-starterkit
Docs & tutorialsBeginner-friendly repository for launching your first LLM API with Python, LangChain and FastAPI, using local models or the OpenAI API.
git clone https://github.com/tleers/llm-api-starterkit.git