abetlen / abetlen/llama-cpp-python

Support Static File Dir/Root Dir in Server

Đang mở
#1,060 0 bình luận 0 reaction 0 người được giao Xem trên GitHub
enhancement
Ngôn ngữ chính
Python
Star
10.6k
Fork
1.4k
Chỉ số merge pull request
Chỉ số pull request đang chờ

Mô tả

**Is your feature request related to a problem? Please describe.**
The `server` in `llama_cpp_python` did not embed a UI for chat, which would be convenient in debugging/testing.

**Describe the solution you'd like**
While a lightweight web UI could be easily composed in a few hundred lines of vanilla HTML/js, modern browsers usually impose cross origin limitations for many APIs, and force the requests to be proxy-ed to align their origins with the web page, which increased the workload to set up the minimal environment.

However, the FastAPI which was imported in `server` module already provided support for `StaticFiles` which is perfect to host a lightweight web UI and other stuff. To achieve this, server settings should be augmented to include an argument for the path of static files or root, and the FastAPI `app` should `mount` it in `create_app()`.

**Describe alternatives you've considered**
N/A

**Additional context**
N/A

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.