modelscope / modelscope/DiffSynth-Studio

关于Wan2.1-Fun-V1.1-14B-Control-Camera模型训练

Open
#665 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
13.1k
Forks
1.3k
Avg merge
13h 12m
Merged PRs (30d)
45

Description

您好,
非常感谢你们的杰出工作,我是一名初学者。我想实现在镜头控制的情况下,采用首尾帧生成的形式控制视频内容的生成,可以使用该框架对Control_Camera模型的DiT部分训练一个lora吗?数据集该以什么格式构建呢?是在示例的metadata_camera_control.csv的基础上加入start_frame和end_frame吗?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the Control_Camera training example and its metadata_camera_control.csv format, then trace the DiT LoRA training entry point. Confirm whether first/end-frame fields are supported and document the required dataset format and training workflow; done means the supported path is explicit or the limitation is recorded.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.