abetlen / abetlen/llama-cpp-python

[FEAT]: TLS Certificate Support

Abierto
#1,768 0 comentarios 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Python
Estrellas
10.6k
Forks
1.4k
Métricas de merge de PR
Métricas de PR pendientes

Descripción

When trying to use self hosted endpoints running this software, I am encountering issues with other software such as "App Transport Security policy requires the use of a secure connection." My idea is to add functionality to pass in a certificate (e.g. from LetsEncrypt) to allow these other softwares to connect to the llama-cpp-python web server.

I have considered putting something in front of it like nginx or a reverse proxy (that my other self-hosted services use). I think it might be easier to enable TLS support in llama-cpp-python (via https://docs.python.org/3/library/ssl.html) until a few more years when hardware and docker etc. have better support for this technology for containerized solutions to make more sense.

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.