drogonframework / drogonframework/drogon
Deploy Libtorch C++ Model with Drogon
Open
enhancement
- Dominant language
- C++
- Stars
- 14.3k
- Forks
- 1.4k
- Avg merge
- 1d 13h
- Merged PRs (30d)
- 14
Description
Most developers who use PyTorch right now deploy their algorithms into production in python using Django/Flask. With PyTorch 1.0, scientists/developers can now create their algorithms in python, then use touchscript to serialize the model from Python to C++. Libtorch doesn't setup C++ API's but inference the model at a faster speed compared to python. So instead of using python with Django/Flask to set up an API for the model, use C++ with dragon setup an API for the libtorch model.
Contributor guide
Assessment
This issue has not been assessed yet.