RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant sp
Run advanced AI language models on your own computer, combining the strengths of different AI architectures.
From the README
- 145+ token/s RWKV-7 7.2B fp16 bsz1 decoding @ RTX5090 (always const speed & vram)
- 10250+ token/s RWKV-7 7.2B fp16 bsz960 decoding @ RTX5090 (always const speed & vram)
- 9650+ token/s RWKV-7 7.2B fp16 bsz320 decoding @ RTX5090 (always const speed & vram)
- 11289 token/s RWKV-7 7.2B fp16 bsz1 prefill @ RTX5090 (always const speed & vram)
Excerpts from the project README on GitHub. Copyright and licensing remain with the respective authors.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeRWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant sp
RWKV-LM has 14.7k stars on GitHub. It has been forked 1k times. RWKV-LM is written mainly in Python. It has been in active development since 2021. RWKV-LM is available under the Apache-2.0 license. Its main topics are attention-mechanism, chatgpt, deep-learning, gpt.
What is RWKV-LM?
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant sp
Is RWKV-LM open source?
RWKV-LM is an open-source project. It is released under the Apache-2.0 license.
Is RWKV-LM free?
Yes. RWKV-LM is free and open source — you can use, modify and self-host it.
What license does RWKV-LM use?
RWKV-LM is available under the Apache-2.0 license.
What language is RWKV-LM written in?
RWKV-LM is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/blinkdl-rwkv-lm.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.