PaddlePaddle / PaddlePaddle/FastDeploy
Serving encrypted models
Open
@heliqi is already working on this.
Since Jun 20, 2024.
- Dominant language
- Python
- Stars
- 3.7k
- Forks
- 756
- Avg merge
- 19h 28m
- Merged PRs (30d)
- 4
Description
Hello! Is it possible to run an encrypted model using fastdeploy server?
I have a few guesses.
- The fastdeploy backend looks for 'model.onnx' or 'model.pdmodel'. Perhaps registry "paddlepaddle/fastdeploy:1.0.7-cpu-only-21.10" is compiled with ENABLE_ENTRYPTION=OFF and if I rebuild the image with ENABLE_ENTRYPTION=ON it will work. Or should I just rename the model "model.encrypted" -> "model.onnx"? Then how can I specify the key in the configuration (config.pbtxt)?
- This is only possible through the Python Triton Model.
Thank you in advance.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.