Qwen

Dal README

pip install -r requirements.txt

• Quickstart with Qwen, and enjoy the simple inference.
• Details about the quantization models, including GPTQ and KV cache quantization.
• Statistics of inference performance, including speed and memory.
• Tutorials on finetuning, including full-parameter tuning, LoRA, and Q-LoRA.
• Instructions on deployment, with the example of vLLM and FastChat.
• Instructions on building demos, including WebUI, CLI demo, etc.

Estratti dal README del progetto su GitHub. I diritti d'autore e le licenze rimangono con i rispettivi autori.