abetlen / abetlen/llama-cpp-python
[FEAT]: TLS Certificate Support
- 主要语言
- Python
- 星标
- 10.6k
- 派生
- 1.4k
- PR 合并指标
- PR 指标待抓取
描述
When trying to use self hosted endpoints running this software, I am encountering issues with other software such as "App Transport Security policy requires the use of a secure connection." My idea is to add functionality to pass in a certificate (e.g. from LetsEncrypt) to allow these other softwares to connect to the llama-cpp-python web server.
I have considered putting something in front of it like nginx or a reverse proxy (that my other self-hosted services use). I think it might be easier to enable TLS support in llama-cpp-python (via https://docs.python.org/3/library/ssl.html) until a few more years when hardware and docker etc. have better support for this technology for containerized solutions to make more sense.
贡献指南
评估
这个 Issue 还没有评估数据。