ai-forever / ai-forever/Kandinsky-3
How to use get_T2I_Flash_pipeline with kandinsky3.1 weights to inference in a single 40G A100 GPU or multiple gpus?
Aperta
- Lingua principale
- Python
- Stelle
- 396
- Fork
- 40
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
It seems your get_T2I_Flash_pipeline requires more than 40G memory in a A100 GPU when trying to inference.However,when I tried to load the model in 2*40G A100 GPU,it seems your codes has not supported it yet?
Could you provide a way to load this model with multiple gpus?
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Valutazione
Questa issue non è ancora stata valutata.