ChatGPTNextWeb / ChatGPTNextWeb/NextChat

[Feature Request] Add Like/Dislike Feedback Buttons for RLHF Training

Open
#6,364 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
TypeScript
Stars
88.8k
Forks
59.1k
PR merge metrics
No merged PRs in 30d

Description

### 🥰 Feature Description

We are running an on-premise LLM and would like to further fine-tune the model using Reinforcement Learning from Human Feedback (RLHF). To facilitate this, we propose adding two buttons below each LLM-generated response: Like and Dislike.

When a user interacts with these buttons, the following data should be logged:

The user's feedback (like/dislike)
The original prompt
The LLM-generated response
This data should be stored in either a log file or a database, allowing us to analyze user preferences and improve the model accordingly.

Use Case:
This feature would help organizations running on-premise LLMs to collect structured user feedback, enabling them to refine their models for better performance and alignment with user expectations.

### 🧐 Proposed Solution

Add two UI buttons (👍 Like, 👎 Dislike) under each response.
Store the feedback, prompt, and response in a structured format (log file or database).
Provide configuration options to specify the storage method (file path or database connection).
This feature would significantly enhance the usability of Next Chat for those looking to continuously improve their LLMs with human feedback.

Thank you for considering this request!

### 📝 Additional Information

_No response_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.