Home Projects Curator
Curator
Python

Curator

Scalable data pre processing and curation toolkit for LLMs

by NVIDIA-NeMo · GitHub
Stars
Forks
License
Created
Last commit
Category
Language
datadata-curationdata-prepApache-2.0Python
View on GitHub
In plain words

Build and manage data processing pipelines for large datasets to prepare them for AI training.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
Curator — GitHub preview card
📈 Star history
1.74k1.67k
2026-07-202026-08-31
📈 Track Curator

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Scalable data pre processing and curation toolkit for LLMs

Curator has 1.7k stars on GitHub. It has been forked 320 times. Curator is written mainly in Python. It has been in active development since 2024. Curator is available under the Apache-2.0 license. Its main topics are data, data-curation, data-prep, data-preparation.

Frequently asked questions

What is Curator?

Scalable data pre processing and curation toolkit for LLMs

Is Curator open source?

Curator is an open-source project. It is released under the Apache-2.0 license.

Is Curator free?

Yes. Curator is free and open source — you can use, modify and self-host it.

What license does Curator use?

Curator is available under the Apache-2.0 license.

What language is Curator written in?

Curator is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — Curator

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=nvidia-nemo-curator)](https://olud.ai/project/nvidia-nemo-curator.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.