huggingface / huggingface/diffusers

Dreambooth Flux with Lora: OOM

Open
#10,145 13 comments 0 reactions 0 assignees View on GitHub
bug stale training
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

### Describe the bug

It is pretty wired that even after I set lora rank to only 2, training the dreambooth_flux with lora still returns OOM. My GPU is three L40s (44G-48G). And data is only one image.

If this is still OOM, I'm wondering why should lora version exist? The next GPU memory capbility is 80G which can train it without lora.

### Reproduction

NA

### Logs

_No response_

### System Info

L40s

### Who can help?

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.