huggingface / huggingface/peft

Add EWoRA to PEFT

Open
#3,400 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
21.7k
Forks
2.5k
Avg merge
4d 12h
Merged PRs (30d)
59

Description

### Feature request

This is a second attempt (prev. issue #2970 was closed.)

Feature request
We propose to add EWoRA to the peft library -
https://aclanthology.org/2025.findings-ijcnlp.108/

This paper was accepted to the Findings of AACL-IJCNLP. It improves finetuning on a diverse downstream dataset through a mixture-of-experts approach.

Your contribution
I am able to create a PR for this.

### Your contribution

I am able to create a PR for this.

Contributor guide

Open the contributing guide

Research direction

Read the cited EWoRA paper and compare its proposed mixture-of-experts approach with the existing PEFT library. Determine the integration scope and acceptance criteria before starting; done means EWoRA is supported as a PEFT feature with appropriate validation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.