data-preparation
Code used for sourcing and cleaning the BigScience ROOTS corpus
Source and clean a large dataset for training language models.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeCode used for sourcing and cleaning the BigScience ROOTS corpus
data-preparation has 318 stars on GitHub. It has been forked 43 times. data-preparation is written mainly in Jupyter Notebook. It has been in active development since 2022. data-preparation is available under the Apache-2.0 license. Its main topics are dataset, large-language-models, multilingual.
What is data-preparation?
Code used for sourcing and cleaning the BigScience ROOTS corpus
Is data-preparation open source?
data-preparation is an open-source project. It is released under the Apache-2.0 license.
Is data-preparation free?
Yes. data-preparation is free and open source — you can use, modify and self-host it.
What license does data-preparation use?
data-preparation is available under the Apache-2.0 license.
What language is data-preparation written in?
data-preparation is written mainly in Jupyter Notebook.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/bigscience-workshop-data-preparation.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.