modelscope / modelscope/DiffSynth-Studio

How can I achieve inpainting using VACE 1.3B

Open
#851 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
13.1k
Forks
1.3k
Avg merge
13h 12m
Merged PRs (30d)
45

Description

Hi,
我想用vace实现inpainting,对于推理,需要输入的参数是vace_video (待编辑的视频)和vace_video_mask (二值mask)就可以是吗?
另外对于训练inpainting的lora, metadata.csv文件是应该如下配置吗:
video,vace_video,vace_video_mask,prompt
其中video和vace_video都代表ground-truth, vace_video_mask代表二值mask

期待回复,非常感谢~~

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by checking the VACE 1.3B inference documentation or examples for the required vace_video and vace_video_mask inputs. Then inspect the LoRA training documentation or examples for metadata.csv, including the video, vace_video, vace_video_mask, and prompt columns; done means providing a documented, confirmed configuration for both workflows.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, machine-learning
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.