llm-observability
32 projects share this GitHub topic
Lines connect members that are measurably related to each other. Dot size reflects stars.
🧬 Members
langfuse
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open…
★ 36.6k
opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive…
★ 23k
voltagent
AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework
★ 10.9k
bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One…
★ 9.1k
llm-gateway
Open Source LLM Gateway 🦚
★ 7.6k · GitHub ↗
failproofai
Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy…
★ 6.9k
helicone
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23…
★ 6.2k
coze-loop
Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by…
★ 5.8k
latitude-llm
Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it,…
★ 4.7k
logfire
AI observability platform for production LLM and agent systems.
★ 4.5k
Acontext
Agent Skills as a Memory Layer
★ 3.7k
lmnr
Laminar - open-source observability platform purpose-built for AI agents. YC S24.
★ 3.4k
future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications.…
★ 2.2k
Tracely-ai
Trace-native CI/CD for AI agents — production failures become regression tests that block the PR.…
★ 1.5k
Tracely-ai
Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable…
★ 1.2k · GitHub ↗
judgeval
The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and…
★ 1.1k
Tracely
Trace-native CI/CD for AI agents — production failures become regression tests that block the PR.…
★ 833
ThinkWatch
Enterprise AI bastion host for secure AI API and MCP access, with unified proxying, RBAC, audit logs, rate…
★ 813
opik-openclaw
🦞 Official plugin for OpenClaw that exports agent traces to Opik. See and monitor agent behaviour, cost,…
★ 724
clawmetry
See your agent think. Zero-config observability & governance for 26 AI agent runtimes: Claude Code, Cursor,…
★ 402
agent-prism
React components for visualizing traces from AI agents
★ 386
Aegis
Runtime policy enforcement for AI agents. Cryptographic audit trail, human-in-the-loop approvals, kill…
★ 343
1flowbase
Open-source AI gateway for local agent clients: publish fusion-style multi-model workflows as…
★ 219
token-meter
Open-source, local-first AI coding agent usage and cost dashboard for Claude Code, Codex, Cursor, OpenCode,…
★ 137 · GitHub ↗
Gozar
Self-hosted, Docker-first OpenAI-compatible LLM gateway with provider routing, fallbacks, API keys, and usage…
★ 129
tma1
Local-first observability your agent reads back. TMA1 records every LLM call, then routes what it sees into…
★ 119
inferock-bench
Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage,…
★ 110
heron
Agent and LLM API performance monitoring via network packet probe. Measures performance of OpenClaw, Claude,…
★ 103
continuum
Continuum — the agent runtime by ShyftLabs. Build, orchestrate, ship.
★ 84
langfuse-workshop
End-to-end Langfuse workshop using a TypeScript Agent to teach the AI engineering loop: tracing, prompt…
★ 57 · GitHub ↗
llm-firewall
AI Firewall & LLM security toolkit - protect your AI applications from prompt injection, jailbreaks, PII…
★ 47
aludel
Phoenix-native LLM evaluation, prompt testing, model comparison, red teaming, and observability for Elixir
★ 41 · GitHub ↗
🔗 Related families
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.