huggingface / huggingface/diffusers
When I use deepspeed_zero3 to train the controlnet on flux, an error occured "RuntimeError: tensor does not have a device".
Offen
stale
- Vorherrschende Sprache
- Python
- Sterne
- 34.5k
- Forks
- 7.3k
- Ø Merge
- 3 T. 3 Std.
- Gemergte PRs (30 T.)
- 91
Beschreibung
[rank0]: File "/home/z/.local/lib/python3.10/site-packages/deepspeed/ops/adam/cpu_adam.py", line 163, in step
[rank0]: self.ds_opt_adam.adam_update(self.opt_id, state['step'], group['lr'], beta1, beta2, group['eps'],
[rank0]: RuntimeError: tensor does not have a device
Steps: 0%| | 0/500000 [00:04
Beitragsleitfaden
Rechercherichtung
Begin with the reported DeepSpeed ZeRO-3 ControlNet-on-FLUX training setup and inspect deepspeed/ops/adam/cpu_adam.py at line 163, where the failure occurs. Reproduce the error, determine which tensor lacks a device, and document a confirmed correction with the reproduction result.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Bewertung
- Tech-Stack
- python, pytorch
- Bereich
- machine-learning
- Issue-Typ
- Bug
- Schwierigkeit
- 4/5
- Geschätzter Aufwand
- 3-5 Tage
- Aktivitätsstatus
- Veraltet
- Klarheit
- Muss geklärt werden
- Anfängerfreundlichkeit
- 25/100