lm-evaluation-harness

Aus der README

git clone --depth 1 https://github.com/EleutherAI/lm-evaluation-harness
cd lm-evaluation-harness
pip install -e .

• [2025/12] Lighter install: Base package no longer includes transformers/torch. Install model backends separately: pip install lmeval[hf], lmeval[vllm], etc.
• [2025/07] Added thinkendtoken arg to hf (token/str), vllm and sglang (str) for stripping CoT reasoning traces from models that support it.
• [2025/03] Added support for steering HF models!
• [2025/02] Added SGLang support!

Auszüge aus der Projekt-README zu GitHub. Das Urheberrecht und die Lizenzen verbleiben bei den jeweiligen Autoren.