huggingface / huggingface/diffusers

WAN2.1 FLF2V: Incorrect MASK Creation????

Aperta
#12,241 2 commenti 3 reazioni 0 assegnatari Vedi su GitHub
stale
Lingua principale
Python
Stelle
34.5k
Fork
7.3k
Merge medio
3g 3h
PR unite (30g)
91

Descrizione

Hello! I think that it is maybe error. (Or not, please explain it for me!!)

In **WanImageToVideoPipeline** class in `pipline_wan_i2v.py`,
Image
(the code is the part of `prepare_latents` function)

**For I2V**, masking shape like as below:
```
[[1, 0, 0, ... , 0]
[1, 0, 0, ... , 0]
[1, 0, 0, ... , 0]
[1, 0, 0, ... , 0]]
```
I understood: when the mask is 1, input video frame does not change.
(*Mask shape: [1, 4, 21, 60, 104] = [B, C, F, H, W])

**But in the FLF2V case,** masking shape like as below:
```
[[1, 0, 0, ... , 0]
[1, 0, 0, ... , 0]
[1, 0, 0, ... , 0]
**[1, 0, 0, ... , 1]]**
```
Here, **why the last frame mask has 1 only in last channel??**
Is there anyone who can explain this part?

Guida per i contributori

Apri la guida per i contributori

Direzione di ricerca

Start in pipline_wan_i2v.py at the WanImageToVideoPipeline.prepare_latents function and compare the mask construction for I2V with the FLF2V case. Trace how the [B, C, F, H, W] mask is formed and determine whether the final-channel value is intentional or an error. Done means documenting the reason or identifying the precise behavior that needs correction.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
python
Ambito
machine-learning
Tipo di issue
Bug
Difficoltà
4/5
Tempo stimato
3-5 giorni
Stato di attività
Ferma
Chiarezza
Da chiarire
Idoneità per principianti
35/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.