modelscope / modelscope/DiffSynth-Studio
Does wan2.1 14b support Lora?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 13.1k
- Forks
- 1.3k
- Avg merge
- 13h 12m
- Merged PRs (30d)
- 45
Description
May I ask if wan2.1 14b supports Lora?
After obtaining the checkpoints after the training, I tried running the modified test. py for wan2.1 14b
`
import torch
from diffsynth import ModelManager, WanVideoPipeline, save_video, VideoData
import os
os.environ["CUDA_VISIBLE_DEVICES"] = "4,5"
model_manager = ModelManager(torch_dtype=torch.bfloat16, device="cpu")
model_manager.load_models([
"/home/tione/notebook/pretrained/Wan2.1-T2V-14B/diffusion_pytorch_model-00001-of-00006.safetensors",
"/home/tione/notebook/pretrained/Wan2.1-T2V-14B/diffusion_pytorch_model-00002-of-00006.safetensors",
"/home/tione/notebook/pretrained/Wan2.1-T2V-14B/diffusion_pytorch_model-00003-of-00006.safetensors",
"/home/tione/notebook/pretrained/Wan2.1-T2V-14B/diffusion_pytorch_model-00004-of-00006.safetensors",
"/home/tione/notebook/pretrained/Wan2.1-T2V-14B/diffusion_pytorch_model-00005-of-00006.safetensors",
"/home/tione/notebook/pretrained/Wan2.1-T2V-14B/diffusion_pytorch_model-00006-of-00006.safetensors",
"/home/tione/notebook/pretrained/Wan2.1-T2V-14B/models_t5_umt5-xxl-enc-bf16.pth",
"/home/tione/notebook/pretrained/Wan2.1-T2V-14B/Wan2.1_VAE.pth",
])`
The output is as follows
Loading models from: /home/tione/notebook/pretrained/Wan2.1-T2V-14B/diffusion_pytorch_model-00001-of-00006.safetensors
We cannot detect the model type. No models are loaded.
Loading models from: /home/tione/notebook/pretrained/Wan2.1-T2V-14B/diffusion_pytorch_model-00002-of-00006.safetensors
We cannot detect the model type. No models are loaded.
Loading models from: /home/tione/notebook/pretrained/Wan2.1-T2V-14B/diffusion_pytorch_model-00003-of-00006.safetensors
We cannot detect the model type. No models are loaded.
Loading models from: /home/tione/notebook/pretrained/Wan2.1-T2V-14B/diffusion_pytorch_model-00004-of-00006.safetensors
We cannot detect the model type. No models are loaded.
Loading models from: /home/tione/notebook/pretrained/Wan2.1-T2V-14B/diffusion_pytorch_model-00005-of-00006.safetensors
We cannot detect the model type. No models are loaded.
Loading models from: /home/tione/notebook/pretrained/Wan2.1-T2V-14B/diffusion_pytorch_model-00006-of-00006.safetensors
We cannot detect the model type. No models are loaded.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the modified test.py reproduction and inspect ModelManager.load_models for how it detects the six Wan2.1-T2V-14B checkpoint shards. Run the example to confirm the detection failure and determine the expected loading behavior for these files; done means the model-loading outcome is reproducible and the supported usage or required change is clear.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100