huggingface / huggingface/peft
Add EWoRA to PEFT
- Dominant language
- Python
- Stars
- 21.7k
- Forks
- 2.5k
- Avg merge
- 4d 12h
- Merged PRs (30d)
- 59
Description
### Feature request
This is a second attempt (prev. issue #2970 was closed.)
Feature request
We propose to add EWoRA to the peft library -
https://aclanthology.org/2025.findings-ijcnlp.108/
This paper was accepted to the Findings of AACL-IJCNLP. It improves finetuning on a diverse downstream dataset through a mixture-of-experts approach.
Your contribution
I am able to create a PR for this.
### Your contribution
I am able to create a PR for this.
Contributor guide
Research direction
Read the cited EWoRA paper and compare its proposed mixture-of-experts approach with the existing PEFT library. Determine the integration scope and acceptance criteria before starting; done means EWoRA is supported as a PEFT feature with appropriate validation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100