thu-ml / thu-ml/TurboDiffusion

推理效果

Open
#107 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
3.7k
Forks
277
Avg merge
2h 57m
Merged PRs (30d)
2

Description

您好,我在Wan2.1-T2V-1.3B-480P模型上运行以下推理生成的视频和您提供在github中的视频效果有些差距,请问一下是我哪里需要修改吗
python turbodiffusion/inference/wan2.1_t2v_infer.py
--model Wan2.1-1.3B
--dit_path checkpoints/TurboWan2.1-T2V-1.3B-480P-quant.pth
--resolution 480p
--prompt "A stylish woman walks down a Tokyo street filled with warm glowing neon and animated city signage. She wears a black leather jacket, a long red dress, and black boots, and carries a black purse. She wears sunglasses and red lipstick. She walks confidently and casually. The street is damp and reflective, creating a mirror effect of the colorful lights. Many pedestrians walk about."
--num_samples 1
--num_steps 4
--quant_linear
--attention_type sagesla
--sla_topk 0.1

还有一个问题就是我看您并没有提供使用origin注意力所使用的模型权重,我使用wan2.1的原始模型权重生成的视频噪声很大,请问这个是需要使用您训练的权重吗

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with turbodiffusion/inference/wan2.1_t2v_infer.py and reproduce the reported command using the listed Wan2.1 and TurboWan checkpoints. Compare the generated result with the repository’s reference video, then determine which model weights and attention settings are required for equivalent output. Done means the required configuration or reproducible discrepancy is documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.