huggingface / huggingface/alignment-handbook

Constitutional AI models do not achieve MT-Bench scores as reported

Open
#145 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.7k
Forks
490
Avg merge
2m
Merged PRs (30d)
1

Description

Hi, thanks for your great work!

I'm especially interested in the recently-introduced constitutional-ai tuning in this [blog post](https://huggingface.co/blog/constitutional_ai). I've found the open-source [SFT model](https://huggingface.co/alignment-handbook/mistral-7b-sft-constitutional-ai) and [DPO model](https://huggingface.co/HuggingFaceH4/mistral-7b-anthropic) on huggingface. However, when I tried to launch the MT-Bench test with them, the returned results are significantly worse than those reported in the blog post, according to the figure below (which I've copied over here for reference):

![image](https://github.com/huggingface/alignment-handbook/assets/53633064/40fe09ad-efe4-4e49-acf7-e702ba1822d0)

The MT-Bench score I've collected are 5.33 / 6.39 for the SFT / DPO model respectively, where the reference figure shows (approximately) 6.5 / 7.2.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.