modelscope / modelscope/DiffSynth-Studio
是否支持lightx2v的4步蒸馏模型推理呢?Wan2.2-I2V-4step-Distill的,直接加载的话出来的图像噪声很大。
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 13.1k
- Forks
- 1.3k
- Avg merge
- 13h 12m
- Merged PRs (30d)
- 45
Description
pipe = WanVideoPipeline.from_pretrained(
torch_dtype=torch.bfloat16,
device="cuda:7",
model_configs=[
ModelConfig(path="models/Wan-AI/Wan2.2-I2V-4steps-Distill/high_noise_model/wan2.2_i2v_A14b_high_noise_lightx2v_4step.safetensors"),
ModelConfig(path="models/Wan-AI/Wan2.2-I2V-4steps-Distill/low_noise_model/wan2.2_i2v_A14b_low_noise_lightx2v_4step.safetensors"),
ModelConfig(path="models/Wan-AI/Wan2.2-I2V-4steps-Distill/models_t5_umt5-xxl-enc-bf16.pth"),
ModelConfig(path="models/Wan-AI/Wan2.2-I2V-4steps-Distill/Wan2.1_VAE.pth"),
],
tokenizer_config=ModelConfig(path="models/Wan-AI/Wan2.2-I2V-4steps-Distill/google/umt5-xxl"),
)
推理参数:
video_with_lora = pipe(
prompt="...(略)",
negative_prompt="...(略)",
num_inference_steps=4,
input_image=input_image,
seed=0,
tiled=False,
switch_DiT_boundary=0.5,
num_frames = 81,
width=848,
height=1072
)
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start at the WanVideoPipeline.from_pretrained call and reproduce the four-step Wan2.2-I2V LightX2V setup with the listed high- and low-noise model paths and inference parameters. Check how four-step distillation models and switch_DiT_boundary are handled; done means the pipeline supports this configuration and produces an image without the reported heavy noise.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100