lllyasviel / lllyasviel/FramePack

Higher Deviation from the Starting Image

Open
#57 1 comment 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
17.3k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

Thank you for this project!

One of the main limitations I've noticed is that it's difficult to deviate significantly from the starting image — the final frames tend to stay very close to it. I suspect this is why most examples use a static camera. While it's possible to prompt some camera movement, the motion is usually very subtle, and you can't really pan or move the camera to reveal new areas or objects.

It would be great to have an additional parameter (if possible) that allows for greater deviation from the initial image, even if it comes at the cost of consistency.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue does not name files, tests, or an entry point. Start by tracing the repository's video-generation configuration and conditioning flow, then determine where a deviation control could be defined and how its effect would be measured; done means users can produce substantially different camera motion or newly revealed content without losing acceptable consistency.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.