huggingface / huggingface/diffusers

Hidream Model loading takes too long — any way to speed it up?

Aperta
#11,575 8 commenti 0 reazioni 0 assegnatari Vedi su GitHub
stale
Lingua principale
Python
Stelle
34.5k
Fork
7.3k
Merge medio
3g 3h
PR unite (30g)
91

Descrizione

Hi, thanks for this great project.

I'm running Hidream with this library in a serverless environment and facing major delays during model loading. It can be very frustrating, especially for time-sensitive or ephemeral deployments.

I've tried everything I could think of to reduce the loading time, but nothing has worked so far. Does anyone have any tips, tricks, or even sample code to help speed up the model initialization?

Any guidance would be greatly appreciated!

Guida per i contributori

Apri la guida per i contributori

Direzione di ricerca

The report names no files, tests, or entry points, and asks generally for tips or sample code. Start by establishing a reproducible Hidream loading measurement in the stated serverless environment and identifying the initialization path involved. Done would require an agreed optimization with demonstrated loading-time improvement.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
python, pytorch
Ambito
machine-learning
Tipo di issue
Bug
Difficoltà
5/5
Tempo stimato
Più di una settimana
Stato di attività
Ferma
Chiarezza
Da chiarire
Idoneità per principianti
20/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.