huggingface / huggingface/alignment-handbook

wierd conversation with zephyr-7b-dpo-lora

Open
#78 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.7k
Forks
490
Avg merge
2m
Merged PRs (30d)
1

Description

![VX0N3YSQ@~VU@RPDR5@$KWE](https://github.com/huggingface/alignment-handbook/assets/84949179/cd22f16c-e160-43a9-b2cc-aec5b87b1ada)
When chatting with zephyr-7b-dpo-lora, as shown in the fig above , only the first 'Hello' was I sent, all the following content are generated by zephyr, including the \ prompt. I cannot figure out why.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.