deforum / deforum/deforum-stable-diffusion
controlnet issues with deforum
- Dominant language
- Python
- Stars
- 2.3k
- Forks
- 412
- PR merge metrics
- No merged PRs in 30d
Description
getting this error when using Deforum with controlnet tile and temporalnet on my videos:
Neither the base nor the masking frames for ControlNet were found. Using the regular pipeline
Im getting inconsistent results suddenly where the first frame looks ok, and then every other frame deteriorates, breaks down, also the style lessens so it shifts to get closer to the input image, and it gets crunchy and nasty.
My process is to find a look with img2img, using controlnet and loras, then transferring the data points over to deforum, with th especific settings and transferring the controlnet nodes, and I was getting pretty decent results till last night.
the render goes through but I net this error for every frame
Neither the base nor the masking frames for ControlNet were found. Using the regular pipeline
any help appreciated!
thanks
Contributor guide
No contributing guide indexed for this repository
Research direction
No file, test, version, or reproducible configuration is named. Start by reproducing the Deforum video workflow with ControlNet tile and temporalnet, then trace why the base or masking frames are not found. Done means the warning is resolved and subsequent frames retain the intended style and quality.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100