evals
25 projetos partilham este topic do GitHub
Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.
🧬 Membros
mastra
Mastra is the modern TypeScript framework for AI-powered applications and agents.
★ 29.1k
phoenix
AI Observability & Evaluation
★ 11.2k
failproofai
Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy…
★ 6.9k
agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and…
★ 5.9k
logfire
AI observability platform for production LLM and agent systems.
★ 4.5k
ai-system-design-guide
AI system design guide for engineers building production AI systems and evals.
★ 3.9k
trulens
Evaluation and Tracking for LLM Experiments and AI Agents
★ 3.6k
lmnr
Laminar - open-source observability platform purpose-built for AI agents. YC S24.
★ 3.4k
agent-skill-creator
Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery,…
★ 2.4k
future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications.…
★ 2.2k
waku-agent
Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all…
★ 2.1k
simba
OpenSource Production ready Customer service with built in Evals and monitoring
★ 1.5k
Tracely-ai
Trace-native CI/CD for AI agents — production failures become regression tests that block the PR.…
★ 1.5k
heym
Build agentic systems. Run them with confidence. Orchestrate agents, automate business processes, inspect…
★ 1.3k
raglite
🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
★ 1.2k
awesome-evals
A curated, non-BS library of the best resources for building and evaluating AI agents — papers, blogs,…
★ 1k
Tracely
Trace-native CI/CD for AI agents — production failures become regression tests that block the PR.…
★ 833
ai-engineer-notebooks
Hands-on, framework-free Colab notebooks for the AI Engineer / Forward Deployed Engineer (FDE) skill set —…
★ 712
overmind
The platform for continuously improving AI agents.
★ 673 · GitHub ↗
agent-safety-eval-lab
Agent trace and tool-use safety evaluation lab.
★ 323
hello-agent-system
👋 Hello Agent System — learn enterprise AI agent system design by building every production layer from…
★ 306 · GitHub ↗
buywise-agent
A langGraph-powered multi-agent RAG assistant for warranty, return, and consumer decision workflow.
★ 117 · GitHub ↗
inferock-bench
Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage,…
★ 110
jevals
Agent evals and guardrails as Jev decisions: one request per trace, a fraction of a cent, fast enough for the…
★ 107 · GitHub ↗
aludel
Phoenix-native LLM evaluation, prompt testing, model comparison, red teaming, and observability for Elixir
★ 41 · GitHub ↗
🔗 Familias relacionadas
Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.