Question about ultrafineweb dataset preparation for tequila/sherry
Open
@WOODchen7 is already working on this.
Since Jan 28, 2026.
- Dominant language
- Python
- Stars
- 1.7k
- Forks
- 181
- Avg merge
- 1d 3h
- Merged PRs (30d)
- 2
Description
Hello,
I'm trying to reproduce the results of tequila/sherry. But I'm not seeing the accuracy reported by the paper (I attached the tequila results here, trained by me). I suspect it's the way I prepare the dataset is not the same as the authors did. Can you share how we can prepare the ultrafineweb dataset for the tequila/sherry QAT.
Thanks very much
Sho
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.