huggingface / huggingface/diffusers
Add multi aspect ratio, and multi crop SCM training script
- Ngôn ngữ chính
- Python
- Star
- 34.5k
- Fork
- 7.3k
- Merge trung bình
- 3 ngày 3 giờ
- Pull request đã merge (30 ngày)
- 91
Mô tả
None of the diffusers training scripts support multiple crops or aspect ratios in the data loader. This is mentioned in the tech report for SDXL as a part of their training process.
In my tests diffusion model struggle to do high resolution details. I did this for base SD 1.5 and was planning to port the code to the SDXL SCM scripts.
@sayakpaul I know you wanted to keep the base training scripts simple. Wanted to open a discussion here on whether to upstream. Is this something I should upstream? or better as something like a community script?
The SCM models are fantastic, but full short of the base SDXL model on high resolution details. Hoping this can fix some of that up.
References
------------
SCM vs LDMs inference report ( Need to add multiple aspect ratios to inference report)
https://wandb.ai/nbardy-facet/LCM-Inference-Test/reports/SDXL--Vmlldzo2MDAzNDU1
SCM LORA 4 steps
Base SDXL 30 steps
SDXL technical report aspect ratios.
Hướng dẫn đóng góp
Đánh giá
Issue này chưa được đánh giá.