bytedance / bytedance/Video-As-Prompt

Full Examples

Open
#7 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
454
Forks
32
PR merge metrics
No merged PRs in 30d

Description

Hi

Thank you for very interesting work.

I am currently working on a low VRAM implementation of VAP for WanGP (https://github.com/deepbeepmeep/Wan2GP) a low VRAM Wan, Qwen, Flux ... Video Gen.

In order to be able to check if my code works properly I would be grateful if you could answer these questions :
- how should we choose the reference prompt versus the target prompt ? it seems when one tries to copy an effect in the reference video both the ref prompt and target will be similar. If that's the case why do we need two prompts ?
- the video prompt seems to have much less weight than the target video text prompt in the output result : I have tried to use a completely unrelated video to the target text prompt as a reference video and still got the desired output described in the text prompt. A general guide on how to pick the video and text would be greatly appreciated
- can we use a number frames higher than 49 ?

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files or tests; begin by locating the repository’s usage examples and the WanGP integration referenced in the discussion. Document reference-versus-target prompt selection, the relative roles of video and text prompts, and supported frame counts, with complete examples as the done condition.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.