llm-security

38 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

Open-source AI penetration testing tool to find and fix your app’s vulnerabilities.

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data.…

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in…

the LLM vulnerability scanner

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based…

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra…

🐢 Open-Source Evaluation & Testing library for LLM Agents

secure multiplexed execution paths for agents - zero trust, zero setup, zero latency.

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source…

AI-Engineer-Headquarters

A collection of scientific methods, processes, algorithms, and systems to build stories & models.

A secure low code deception runtime framework, leveraging AI for System Virtualization.

Open-source AI-powered offensive security harness for automated penetration testing.

ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed…

A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers…

www-project-top-10-for-large-language-model-applications

OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)

A security scanner for your LLM agentic workflows

CLI security scanner built for the agentic era. Detects CI/CD misconfigs, agent permission risks, MCP tool…

Open-source AI agent firewall for MCP security and agent egress. Scans mediated HTTP, MCP, A2A, and WebSocket…

api-relay-audit

Local security audit for AI API relays and LLM proxies: detects prompt injection, model substitution,…

Enterprise AI bastion host for secure AI API and MCP access, with unified proxying, RBAC, audit logs, rate…

Runtime security for AI apps and agents: prompt injection detection, tool-call authorization, sensitive-data…

Open-source runtime AI agent security tool - monitors and controls AI agents, catching malicious tool use,…

Open-source adversary emulation for AI agents and MCP servers.

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM)…

awesome-MLSecOps

A curated list of MLSecOps tools and resources for securing machine learning and AI systems - adversarial ML…

SecureClaw - Security Plugin and Skill for OpenClaw OWASP-Aligned

Self-hosted runtime control plane for AI agents. Observe or HITL approve or Block rogue tool calls before it…

An intentionally vulnerable OWASP LLM Top 10 training platform for AI Security, Prompt Injection, RAG…

Security toolkit for AI agents. Scan your machine for dangerous skills and MCP configs, monitor for supply…

cyberful-public

Cyberful is an open-source AI Red Team for discovering, exploiting, verifying, and remediating…

★ 138 · GitHub ↗

Cyberful is an open-source AI Red Team for discovering, exploiting, verifying, and remediating…

★ 135 · GitHub ↗

Find and govern AI attack surfaces in application code at PR time. Free, OSS, runs offline.

Ethicore Engine® is an AI safety, ethics, and compliance platform. This repo consists of the open-source…

AI-ML Companion: an interactive platform to learn AI & ML by watching it work - 28 tracks, 400+ modules, live…

AI red-teaming tool and LLM security framework to evaluate agentic AI applications. Tests prompt injections,…

★ 63 · GitHub ↗

Zero-code LLM security & observability proxy. Real-time prompt injection detection, PII scanning, and cost…

AI Firewall & LLM security toolkit - protect your AI applications from prompt injection, jailbreaks, PII…

awesome-llm-observability

50+ curated LLM observability tools PLUS 26 Agent Skills (several with runnable, unit-tested scripts) to…

★ 43 · GitHub ↗

🔗 Related families

ai-security 57 security 114 prompt-injection 27 agent-security 23 llm-evaluation 52 owasp 10 cybersecurity 51 red-teaming 15

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.