huggingface / huggingface/diffusers
Hidream Model loading takes too long — any way to speed it up?
- Vorherrschende Sprache
- Python
- Sterne
- 34.5k
- Forks
- 7.3k
- Ø Merge
- 3 T. 3 Std.
- Gemergte PRs (30 T.)
- 91
Beschreibung
Hi, thanks for this great project.
I'm running Hidream with this library in a serverless environment and facing major delays during model loading. It can be very frustrating, especially for time-sensitive or ephemeral deployments.
I've tried everything I could think of to reduce the loading time, but nothing has worked so far. Does anyone have any tips, tricks, or even sample code to help speed up the model initialization?
Any guidance would be greatly appreciated!
Beitragsleitfaden
Rechercherichtung
The report names no files, tests, or entry points, and asks generally for tips or sample code. Start by establishing a reproducible Hidream loading measurement in the stated serverless environment and identifying the initialization path involved. Done would require an agreed optimization with demonstrated loading-time improvement.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Bewertung
- Tech-Stack
- python, pytorch
- Bereich
- machine-learning
- Issue-Typ
- Bug
- Schwierigkeit
- 5/5
- Geschätzter Aufwand
- Über eine Woche
- Aktivitätsstatus
- Veraltet
- Klarheit
- Muss geklärt werden
- Anfängerfreundlichkeit
- 20/100