Some requests for LORA training in ComfyUI.
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 158
Description
### Feature Idea
1: Training with videos for video models. Only images are supported right now.
2: Some optimizers are "schedule free" and some optimizers don't require any hyperparameters, so extra optimizers would be so nice to have access to.
3: There are some methods to improve iteration and convergence speed greatly:
The relatively simple to implement:
https://github.com/compvis/tread | https://github.com/vita-epfl/LayerSync | https://github.com/vvvvvjdy/SRA
Slightly harder to implement:
https://github.com/Martinser/REG
There are some more mentioned here https://x.com/SwayStar123/status/1994673352754270318
Even just TREAD which seems to be the easiest to implement and is tested for LORA training will GREATLY improve convergence and iteration speed.
It would be awesome if some of these get implemented.
@KohakuBlueleaf
### Existing Solutions
_No response_
### Other
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.