huggingface / huggingface/diffusers
variable (per frame) IP Adapter weights in video
Offen
consider-for-modular-diffusers
low-priority
stale
- Vorherrschende Sprache
- Python
- Sterne
- 34.5k
- Forks
- 7.3k
- Ø Merge
- 3 T. 3 Std.
- Gemergte PRs (30 T.)
- 91
Beschreibung
is there a (planned or existing) way to have variable IP Adapter weights for videos (e.g. with AnimateDiff)?
that means setting different values for different frames, as both scaling and masking currently seem to work with the whole generation at once (be it video or still image).
Beitragsleitfaden
Rechercherichtung
The issue names no files, tests, or entry points; begin by checking the existing IP Adapter scaling and masking paths used with AnimateDiff video generation. Done would require determining whether per-frame weights are supported, or defining the implementation scope if they are not.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Bewertung
- Tech-Stack
- python, pytorch
- Bereich
- machine-learning
- Issue-Typ
- Feature
- Schwierigkeit
- 5/5
- Geschätzter Aufwand
- Über eine Woche
- Aktivitätsstatus
- Veraltet
- Klarheit
- Muss geklärt werden
- Anfängerfreundlichkeit
- 25/100