Home Projects SPPO
SPPO
Python

SPPO

The official implementation of Self-Play Preference Optimization (SPPO)

by uclaml · GitHub
Stars
Forks
License
Created
Last commit
Language
deep-learningfine-tuninglarge-language-modelsApache-2.0Python
View on GitHub
In plain words

Optimize language models for better alignment through self-play techniques and fine-tuning.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
SPPO — GitHub preview card
📈 Star history
590589
2026-07-202026-08-31
📈 Track SPPO

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

The official implementation of Self-Play Preference Optimization (SPPO)

SPPO has 589 stars on GitHub. It has been forked 48 times. SPPO is written mainly in Python. It has been in active development since 2024. SPPO is available under the Apache-2.0 license. Its main topics are deep-learning, fine-tuning, large-language-models, rlhf.

Frequently asked questions

What is SPPO?

The official implementation of Self-Play Preference Optimization (SPPO)

Is SPPO open source?

SPPO is an open-source project. It is released under the Apache-2.0 license.

Is SPPO free?

Yes. SPPO is free and open source — you can use, modify and self-host it.

What license does SPPO use?

SPPO is available under the Apache-2.0 license.

What language is SPPO written in?

SPPO is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — SPPO

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=uclaml-sppo)](https://olud.ai/project/uclaml-sppo.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.