kohya-ss / kohya-ss/sd-scripts
cache_latents.py vs prepare_buckets_latents.py
- Dominant language
- Python
- Stars
- 7.2k
- Forks
- 1.2k
- Avg merge
- 11m
- Merged PRs (30d)
- 2
Description
I am trying to understand what is the usage difference between these two scripts.
If I understand correctly, then both are used to compute latents and store them to disk in advance, but I can't figure out from the readmes what the difference is and what to use when.
As for my use case, I want to do a full finetuning of SDXL and I'd like to compute and cache the latents on disk in advance because my dataset is quite large. All the images in the dataset have the same size of 1024x1024 px.
Contributor guide
No contributing guide indexed for this repository
Research direction
Read cache_latents.py, prepare_buckets_latents.py, and the README sections describing them; compare their documented inputs, outputs, and intended training cases. Document when to use each script, including the full- fine-tuning SDXL case with a 1024x1024 dataset, so a user can choose without further investigation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- documentation, machine-learning
- Issue type
- Documentation
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100