llm-inference-capacity-handbook
大模型推理案头手册（开源版）：给定 GPU 算力，一个模型能扛多少 QPS？三层模型 × 三面墙 × 排队论 × 开环压测
Calculate how many requests your AI model can handle based on your GPU capacity with a practical planning guide.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytime大模型推理案头手册（开源版）：给定 GPU 算力，一个模型能扛多少 QPS？三层模型 × 三面墙 × 排队论 × 开环压测
llm-inference-capacity-handbook has 186 stars on GitHub. It has been in active development since 2026. Its main topics are capacity-planning, gpu, llm-inference, llmops.
What is llm-inference-capacity-handbook?
大模型推理案头手册（开源版）：给定 GPU 算力，一个模型能扛多少 QPS？三层模型 × 三面墙 × 排队论 × 开环压测
Is llm-inference-capacity-handbook open source?
llm-inference-capacity-handbook is an open-source project.
Is llm-inference-capacity-handbook free?
Yes. llm-inference-capacity-handbook is free and open source — you can use, modify and self-host it.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/shtjww-llm-inference-capacity-handbook.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.