gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
Train large language models on your own GPUs using a collection of techniques and optimizations.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeAn implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
gpt-neox has 7.4k stars on GitHub. It has been forked 1.1k times. gpt-neox is written mainly in Python. It has been in active development since 2020. gpt-neox is available under the Apache-2.0 license. Its main topics are deepspeed-library, gpt-3, language-model, transformers.
What is gpt-neox?
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
Is gpt-neox open source?
gpt-neox is an open-source project. It is released under the Apache-2.0 license.
Is gpt-neox free?
Yes. gpt-neox is free and open source — you can use, modify and self-host it.
What license does gpt-neox use?
gpt-neox is available under the Apache-2.0 license.
What language is gpt-neox written in?
gpt-neox is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/eleutherai-gpt-neox.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.