[Feature]: AutoScheme is currently underperforming compared to Unsloth's model for gguf
Open
enhancement
- Dominant language
- Python
- Stars
- 1.6k
- Forks
- 175
- Avg merge
- 1d 18h
- Merged PRs (30d)
- 99
Description
### Feature Description
Based on feedback from @benjamin-marie, AutoScheme has not yet achieved better results than Unsloth's GGUF models. It would be worthwhile to run a thorough evaluation to better understand the gap and identify opportunities for improvement.
@benjamin-marie We'd appreciate you could share some of your data.
### Motivation and Use Case
~
### Alternatives Considered
_No response_
### Definition of Done
_No response_
### Additional Context
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.