lllyasviel / lllyasviel/FramePack

New Feature Suggestions: Generation Management / Intergrations

Open
#41 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
17.3k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

PROBLEM: Video Generation Does Not Execute Correctly

DESCRIPTION:
In the sample video, I saw the artifacts happen as soon as they were generated.
What if?...

SUGGESTION:

I think I found the limitations in FramePack. This video attached is the ballerina test, PROMPT:Ballerina does a 360-degree spin. Which tells you if a model can handle action sequences. It's a fail. But it still is better than most! I think this will likely make all other I2V models obsolete.

What would be MORE revolutionary. Would be to have a button during generation that could cancel the current generation, and the previous one and start that again? Each second is saved locally, so could that be used?. This will enable real time ai video generation editing, save hours in pre-production and the best part... Enable us to produce artifact free long ai videos for the first time ever.

This way we could in effect pause a generation and even update the prompt for a degree of control in ai video that we have not seen before. That way, if the model does not get it right, we don't have to dump or spend time processing the video. We could just replace the second in real-time.

You are making history here.
Keep it up!

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue does not name any files, tests, or entry points. Start by defining the required behavior for cancelling, pausing, resuming, and replacing an in-progress generation, including how locally saved seconds and updated prompts should work; done requires an agreed design and verified artifact-free output.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
18/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.