lllyasviel / lllyasviel/FramePack
New Feature Suggestions: Generation Management / Intergrations
- Dominant language
- Python
- Stars
- 17.3k
- Forks
- 1.7k
- PR merge metrics
- No merged PRs in 30d
Description
PROBLEM: Video Generation Does Not Execute Correctly
DESCRIPTION:
In the sample video, I saw the artifacts happen as soon as they were generated.
What if?...
SUGGESTION:
I think I found the limitations in FramePack. This video attached is the ballerina test, PROMPT:Ballerina does a 360-degree spin. Which tells you if a model can handle action sequences. It's a fail. But it still is better than most! I think this will likely make all other I2V models obsolete.
What would be MORE revolutionary. Would be to have a button during generation that could cancel the current generation, and the previous one and start that again? Each second is saved locally, so could that be used?. This will enable real time ai video generation editing, save hours in pre-production and the best part... Enable us to produce artifact free long ai videos for the first time ever.
This way we could in effect pause a generation and even update the prompt for a degree of control in ai video that we have not seen before. That way, if the model does not get it right, we don't have to dump or spend time processing the video. We could just replace the second in real-time.
You are making history here.
Keep it up!
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue does not name any files, tests, or entry points. Start by defining the required behavior for cancelling, pausing, resuming, and replacing an in-progress generation, including how locally saved seconds and updated prompts should work; done requires an agreed design and verified artifact-free output.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 18/100