abetlen / abetlen/llama-cpp-python

[FEAT]: TLS Certificate Support

未關閉
#1,768 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
Python
星號
10.6k
分支
1.4k
PR 合併指標
PR 指標待擷取

描述

When trying to use self hosted endpoints running this software, I am encountering issues with other software such as "App Transport Security policy requires the use of a secure connection." My idea is to add functionality to pass in a certificate (e.g. from LetsEncrypt) to allow these other softwares to connect to the llama-cpp-python web server.

I have considered putting something in front of it like nginx or a reverse proxy (that my other self-hosted services use). I think it might be easier to enable TLS support in llama-cpp-python (via https://docs.python.org/3/library/ssl.html) until a few more years when hardware and docker etc. have better support for this technology for containerized solutions to make more sense.

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。