Home Projects SimPO
SimPO
Python

SimPO

[NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward

by princeton-nlp · GitHub
Stars
Forks
License
Created
Last commit
Category
Language
alignmentlarge-language-modelspreference-alignmentMITPython
View on GitHub
In plain words

Optimize preferences for AI models without needing a reference model, improving their performance on various tasks.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
SimPO — GitHub preview card
📈 Star history
958956
2026-07-202026-08-31
📈 Track SimPO

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

[NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward

SimPO has 958 stars on GitHub. It has been forked 78 times. SimPO is written mainly in Python. It has been in active development since 2024. SimPO is available under the MIT license. Its main topics are alignment, large-language-models, preference-alignment, rlhf.

Frequently asked questions

What is SimPO?

[NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward

Is SimPO open source?

SimPO is an open-source project. It is released under the MIT license.

Is SimPO free?

Yes. SimPO is free and open source — you can use, modify and self-host it.

What license does SimPO use?

SimPO is available under the MIT license.

What language is SimPO written in?

SimPO is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — SimPO

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=princeton-nlp-simpo)](https://olud.ai/project/princeton-nlp-simpo.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.