Home Projects serving
serving
C++

serving

A flexible, high-performance serving system for machine learning models

by tensorflow · GitHub
Stars
Forks
License
Created
Last commit
Category
Language
cppdeep-learningdeep-neural-networksApache-2.0C++
View on GitHub
In plain words

Manage and serve machine learning models efficiently in a production setting.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
serving — GitHub preview card
📈 Star history
6.36k6.35k
2026-07-042026-08-31
📈 Track serving

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

A flexible, high-performance serving system for machine learning models

serving has 6.4k stars on GitHub. It has been forked 2.2k times. serving is written mainly in C++. It has been in active development since 2016. serving is available under the Apache-2.0 license. Its main topics are cpp, deep-learning, deep-neural-networks, machine-learning.

Frequently asked questions

What is serving?

A flexible, high-performance serving system for machine learning models

Is serving open source?

serving is an open-source project. It is released under the Apache-2.0 license.

Is serving free?

Yes. serving is free and open source — you can use, modify and self-host it.

What license does serving use?

serving is available under the Apache-2.0 license.

What language is serving written in?

serving is written mainly in C++.

🏅 Maintainer of this project?
olud.ai badge — serving

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=tensorflow-serving)](https://olud.ai/project/tensorflow-serving.html)
More badge options →
🧬 Related projects