evaluation-framework
12 projects share this GitHub topic
Lines connect members that are measurably related to each other. Dot size reflects stars.
🧬 Members
promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare…
★ 23.7k
deepeval
The LLM Evaluation Framework
★ 17.3k
lm-evaluation-harness
A framework for few-shot evaluation of language models.
★ 13.5k
Kiln
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data…
★ 5k
EvalAI
:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
★ 2k
future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications.…
★ 1.5k
ai-agents-the-definitive-guide
Repo for AI Agents The Definitive Guide
★ 900
AgentLab
AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks,…
★ 610
continuous-eval
Data-Driven Evaluation for LLM-Powered Applications
★ 515
tonic_validate
Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
★ 327
athina-evals
Python SDK for running evaluations on LLM generated responses
★ 301
coder_eval
Evaluate & benchmark AI coding agents and Claude Code skills — sandboxed, reproducible YAML eval suites for…
★ 107
🔗 Related families
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.