huggingface / huggingface/diffusers
Hidream Model loading takes too long — any way to speed it up?
- Lingua principale
- Python
- Stelle
- 34.5k
- Fork
- 7.3k
- Merge medio
- 3g 3h
- PR unite (30g)
- 91
Descrizione
Hi, thanks for this great project.
I'm running Hidream with this library in a serverless environment and facing major delays during model loading. It can be very frustrating, especially for time-sensitive or ephemeral deployments.
I've tried everything I could think of to reduce the loading time, but nothing has worked so far. Does anyone have any tips, tricks, or even sample code to help speed up the model initialization?
Any guidance would be greatly appreciated!
Guida per i contributori
Apri la guida per i contributori
Direzione di ricerca
The report names no files, tests, or entry points, and asks generally for tips or sample code. Start by establishing a reproducible Hidream loading measurement in the stated serverless environment and identifying the initialization path involved. Done would require an agreed optimization with demonstrated loading-time improvement.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Valutazione
- Stack tecnologico
- python, pytorch
- Ambito
- machine-learning
- Tipo di issue
- Bug
- Difficoltà
- 5/5
- Tempo stimato
- Più di una settimana
- Stato di attività
- Ferma
- Chiarezza
- Da chiarire
- Idoneità per principianti
- 20/100