abetlen / abetlen/llama-cpp-python

[FEAT]: TLS Certificate Support

Offen
#1,768 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
Vorherrschende Sprache
Python
Sterne
10.6k
Forks
1.4k
PR-Merge-Kennzahlen
PR-Kennzahlen ausstehend

Beschreibung

When trying to use self hosted endpoints running this software, I am encountering issues with other software such as "App Transport Security policy requires the use of a secure connection." My idea is to add functionality to pass in a certificate (e.g. from LetsEncrypt) to allow these other softwares to connect to the llama-cpp-python web server.

I have considered putting something in front of it like nginx or a reverse proxy (that my other self-hosted services use). I think it might be easier to enable TLS support in llama-cpp-python (via https://docs.python.org/3/library/ssl.html) until a few more years when hardware and docker etc. have better support for this technology for containerized solutions to make more sense.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.