Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
Train and evaluate deep learning models using datasets stored in Apache Parquet format on your own machine or in a group.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimePetastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
petastorm has 1.9k stars on GitHub. It has been forked 283 times. petastorm is written mainly in Python. It has been in active development since 2018. petastorm is available under the Apache-2.0 license. Its main topics are deep-learning, machine-learning, parquet, parquet-files.
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
petastorm is an open-source project. It is released under the Apache-2.0 license.
Yes. petastorm is free and open source — you can use, modify and self-host it.
petastorm is available under the Apache-2.0 license.
petastorm is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/uber-petastorm.html)