huggingface / huggingface/diffusers

SD3 dreambooth training - caching of embeddings and vae representations

Aperta
#8,540 2 commenti 0 reazioni 0 assegnatari Vedi su GitHub
stale
Lingua principale
Python
Stelle
34.5k
Fork
7.3k
Merge medio
3g 3h
PR unite (30g)
91

Descrizione

**Is your feature request related to a problem? Please describe.**
The current implementation of the dreambooth trainings for both loras and finetuning is very memory intensive.

**Describe the solution you'd like.**
I would like the option to pre-cache the VAE representations of the images and the text encoder representations so that training could be done without the text encoders being in VRAM.

**Describe alternatives you've considered.**
I don't believe there are alternatives to reducing the VRAM requirement for training.

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.