safety

9 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based…

destructive_command_guard

The Destructive Command Guard (dcg) is for blocking dangerous git and shell commands from being executed by…

A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

Awesome-Jailbreak-on-LLMs

Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It…

[EMNLP 2024 Demo] MarkLLM: An Open-Source Toolkit for LLM Watermarking

ClawKeeper: Comprehensive Safety Protection for OpenClaw Agents Through Skills, Plugins, and Watchers (aka…

Awesome-LLM-Uncertainty-Reliability-Robustness

Awesome-LLM-Robustness: a curated list of Uncertainty, Reliability and Robustness in Large Language Models

AutoHarness: Automated Harness Engineering for AI Agents

🔗 Related families

security 99 jailbreak 10 privacy 49 vlm 47 guardrails 20 llm-security 32 nvidia 19 git 23

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.