evaluation-framework

9 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare…

The LLM Evaluation Framework

lm-evaluation-harness

A framework for few-shot evaluation of language models.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications.…

ai-agents-the-definitive-guide

Repo for AI Agents The Definitive Guide

AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks,…

continuous-eval

Data-Driven Evaluation for LLM-Powered Applications

Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.

Python SDK for running evaluations on LLM generated responses

🔗 Familias relacionadas

llm-evaluation 52 evaluation-metrics 12 llm-eval 7 ci 5 cicd 11 pentesting 25 prompts 30 red-teaming 15

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.