evaluation-framework

9 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare…

The LLM Evaluation Framework

lm-evaluation-harness

A framework for few-shot evaluation of language models.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications.…

ai-agents-the-definitive-guide

Repo for AI Agents The Definitive Guide

AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks,…

continuous-eval

Data-Driven Evaluation for LLM-Powered Applications

Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.

Python SDK for running evaluations on LLM generated responses

🔗 Related families

llm-evaluation 52 evaluation-metrics 12 llm-eval 7 ci 5 cicd 11 pentesting 25 prompts 30 red-teaming 15

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.