Reproducing of Lora Model Result on MT-Bench

Recently, I attempted to fit the DPO on my own dataset.
Initially, I tried to reproduce the results of your LORA model( 7.43 on MT-Bench).
However, I encountered some issues.
Despite using all your parameters and data, here are my results on MT-Bench:
| Model | MT-Bench |
|--------|--------|
| Zephyr-SFT-Lora-Own | 6.37 |
| Zephyr-DPO-Lora-Own | 6.95 |

Then, I downloaded your models from [here](https://huggingface.co/alignment-handbook), and the results were nearly the same as mine.
| Model | MT-Bench |
|--------|--------|
| Zephyr-SFT-Lora| 6.4|
| Zephyr-DPO-Lora| 6.93 |

DPO does help improve performance on MT-Bench, but I can't achieve a score of **7.43**. Is there any difference between the model described in your paper and the model available on your homepage?
Or could it be the difference between the full and LORA?

By the way, I truly love the "yaml style" argument parser; it's clear and elegant!
@edbeeching @lewtun