Home Projects safe-rlhf
safe-rlhf
Python

safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

by PKU-Alignment · GitHub
Stars
Forks
Trending
License
Created
Last commit
Category
Language
Likely
Self-hostable
ai-safetyalpacabeaverApache-2.0PythonSelf-hostable
View on GitHub
In plain words

Train AI models using human feedback while ensuring safety and alignment with human values.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
safe-rlhf — GitHub preview card
📈 Star history
1 6131 611
2026-07-202026-08-31
📈 Track safe-rlhf

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

safe-rlhf has 1.6k stars on GitHub. It has been forked 134 times. safe-rlhf is written mainly in Python. It has been in active development since 2023. safe-rlhf is available under the Apache-2.0 license. Its main topics are ai-safety, alpaca, beaver, datasets.

Frequently asked questions

What is safe-rlhf?

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

Is safe-rlhf open source?

safe-rlhf is an open-source project. It is released under the Apache-2.0 license.

Is safe-rlhf free?

Yes. safe-rlhf is free and open source — you can use, modify and self-host it.

What license does safe-rlhf use?

safe-rlhf is available under the Apache-2.0 license.

What language is safe-rlhf written in?

safe-rlhf is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — safe-rlhf

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=pku-alignment-safe-rlhf)](https://olud.ai/project/pku-alignment-safe-rlhf.html)
More badge options →
🧬 Related projects🧬 View the DNA map →