huggingface / huggingface/diffusers
[Modular] support group offloading in auto offloading
Aperta
- Lingua principale
- Python
- Stelle
- 34.5k
- Fork
- 7.3k
- Merge medio
- 3g 3h
- PR unite (30g)
- 91
Descrizione
Follow-up to #14304.
`enable_auto_cpu_offload` recommends group offloading for a model that OOMs with everything else already offloaded ("it does not fit on the device by itself"). but currently we cannot use group offloading and auto offloading togehter, should add support once #14304 is in
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.