ai-safety
26 Projekte teilen dieses GitHub-Topic
Linien verbinden Mitglieder, die messbar miteinander verwandt sind. Die Punktgröße spiegelt die Sterne wider.
🧬 Mitglieder
iFixAi
Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in…
★ 34.4k
AI-Infra-Guard
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra…
★ 7.1k
agent-governance-toolkit
AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and…
★ 6.5k
awesome-machine-learning-interpretability
A curated list of awesome responsible machine learning resources.
★ 4k
Formal-Verification-RSI
Formal verification for AI: a Lean 4 + Dafny proof checker that catches fake AI proofs (reward hacking), and…
★ 2.9k · GitHub ↗
safe-rlhf
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
★ 1.6k
cc-safety-net
A pre-execution guard for AI coding agents. It blocks destructive Git and file system commands, plus common…
★ 1.5k
awesome-gpt-6-astra
Evidence-backed use cases, prompts, integrations, evaluations, and safety notes for OpenAI GPT-6 Astra.
★ 1.2k · GitHub ↗
AgentLens
Agentlens is a trusted agent trading platform. Here, you can quickly find the Agent that meets your needs,…
★ 1k
keystone-bench
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's…
★ 953 · GitHub ↗
langtest
Deliver safe & effective language models
★ 561
PromptInject
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of…
★ 528
box
Run AI agents in a sandbox that restricts what they can execute, read, write, and reach on the network. Box…
★ 484 · GitHub ↗
floe-guard
The spend meter, cost/margin, & budget gate for AI voice agents. Meters STT + TTS + LLM + telephony per call,…
★ 410
tiger
Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding,…
★ 405
martin-loop
Run coding agents without babysitting them. Keep jobs focused, bounded, checked and accountable from start to…
★ 394
prismor
Self-hosted runtime control plane for AI agents. Observe or HITL approve or Block rogue tool calls before it…
★ 347
Aegis
Runtime policy enforcement for AI agents. Cryptographic audit trail, human-in-the-loop approvals, kill…
★ 343
orbit
Self-hosted, OpenAI-compatible AI gateway for private RAG, natural-language data access, and tool-calling…
★ 310
wrench-board
A senior microsoldering technician, available to every repair shop from the seasoned pro to the apprentice.…
★ 250
AgentGuard
AgentGuard: Zero-Trust Security Foundation for AI Agents
★ 154 · GitHub ↗
orloj
An orchestration runtime for multi-agent AI systems. Declare agents, tools, and policies as YAML; Orloj…
★ 123
guardian-sdk
Ethicore Engine® is an AI safety, ethics, and compliance platform. This repo consists of the open-source…
★ 121
awesome-llm-agent-papers
LLM agents: curated papers on planning, memory, tool use, multi-agent systems, evaluation, and safety.
★ 103 · GitHub ↗
llm-firewall
AI Firewall & LLM security toolkit - protect your AI applications from prompt injection, jailbreaks, PII…
★ 47
TeaLeaves
End-to-end pipeline for seeing how LLMs actually process your prompts. Capture attention across every layer,…
★ 44
🔗 Verwandte Familien
Gemessen anhand der von beiden Projekten geteilten GitHub-Themen, gewichtet nach der Seltenheit jedes Themas.