llm-observability

29 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

langfuse

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open…

★ 35.3k

opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive…

★ 22.3k

voltagent

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

★ 10.7k

bifrost

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode,…

★ 8.5k

llm-gateway

Connect Your Agents And Harnesses With Any Provider 🦚

★ 7.6k · GitHub ↗

helicone

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23…

★ 6.2k

coze-loop

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by…

★ 5.8k

failproofai

Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy…

★ 5.2k

latitude-llm

Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it,…

★ 4.7k

logfire

AI observability platform for production LLM and agent systems.

★ 4.5k

Acontext

Agent Skills as a Memory Layer

★ 3.7k

lmnr

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

★ 3.3k

future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications.…

★ 2.1k

Tracely-ai

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR.…

★ 1.4k

judgeval

The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and…

★ 1.1k

Tracely

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR.…

★ 833

ThinkWatch

Enterprise AI bastion host for secure AI API and MCP access, with unified proxying, RBAC, audit logs, rate…

★ 813

opik-openclaw

🦞 Official plugin for OpenClaw that exports agent traces to Opik. See and monitor agent behaviour, cost,…

★ 724

clawmetry

See your agent think. Zero-config observability & governance for 26 AI agent runtimes: Claude Code, Cursor,…

★ 402

agent-prism

React components for visualizing traces from AI agents

★ 386

Aegis

Runtime policy enforcement for AI agents. Cryptographic audit trail, human-in-the-loop approvals, kill…

★ 343

1flowbase

Open-source AI gateway for local agent clients: publish fusion-style multi-model workflows as…

★ 219

Gozar

Self-hosted, Docker-first OpenAI-compatible LLM gateway with provider routing, fallbacks, API keys, and usage…

★ 130

inferock-bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage,…

★ 122

tma1

Local-first observability your agent reads back. TMA1 records every LLM call, then routes what it sees into…

★ 119

heron

Agent and LLM API performance monitoring via network packet probe. Measures performance of OpenClaw, Claude,…

★ 103

continuum

Continuum — the agent runtime by ShyftLabs. Build, orchestrate, ship.

★ 84

langfuse-workshop

End-to-end Langfuse workshop using a TypeScript Agent to teach the AI engineering loop: tracing, prompt…

★ 48 · GitHub ↗

llm-firewall

AI Firewall & LLM security toolkit - protect your AI applications from prompt injection, jailbreaks, PII…

★ 45

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.