abetlen / abetlen/llama-cpp-python

[Missing documentation/functionality]: choices

Đang mở
#1,130 2 bình luận 0 reaction 0 người được giao Xem trên GitHub
Ngôn ngữ chính
Python
Star
10.6k
Fork
1.4k
Chỉ số merge pull request
Chỉ số pull request đang chờ

Mô tả

When using llama-cpp-python the dict entry `choices` is always created.
I couldn't find any documentation on what `choices` stands for. While skimming the code it looks like there is always only one list entry created. I couldn't find any example or documentation to the choices entry.
Why is it called choices? How can I generate more choices?

Depending on the reason why it's called choices I would like to propose an implementation for it. If it's called choices, because of historical reasons (meaning there is no real rhyme or reason) it would be nice to generate multiple possible responses to the same prompt. You could specify that you want to generate 5 responses and then let some heuristic go over the choices and present the best one/

If there is a reason why it's called choices and a possibility to have more than one choice I would be interested in that as well.

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.