kohya-ss / kohya-ss/sd-scripts
[Feature Request] AdaLoRA Implementation
Open
- Dominant language
- Python
- Stars
- 7.2k
- Forks
- 1.2k
- Avg merge
- 11m
- Merged PRs (30d)
- 2
Description
https://zenn.dev/5ei74r0/articles/adalora-explained
According to this article, this AdaLoRA will automatically apply the dim values to each layer.
This may help us to learn a better performing LoRA.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reading the linked AdaLoRA article to understand the proposed automatic per-layer dimension allocation. The issue names no files, tests, entry points, or acceptance criteria, so identify the existing LoRA implementation in the repository before defining the integration scope and how improved learning performance would be evaluated.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100