deforum / deforum/deforum-stable-diffusion

controlnet issues with deforum

Open
#328 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.3k
Forks
412
PR merge metrics
No merged PRs in 30d

Description

getting this error when using Deforum with controlnet tile and temporalnet on my videos:
Neither the base nor the masking frames for ControlNet were found. Using the regular pipeline

Im getting inconsistent results suddenly where the first frame looks ok, and then every other frame deteriorates, breaks down, also the style lessens so it shifts to get closer to the input image, and it gets crunchy and nasty.

My process is to find a look with img2img, using controlnet and loras, then transferring the data points over to deforum, with th especific settings and transferring the controlnet nodes, and I was getting pretty decent results till last night.

the render goes through but I net this error for every frame
Neither the base nor the masking frames for ControlNet were found. Using the regular pipeline

any help appreciated!
thanks

Contributor guide

No contributing guide indexed for this repository

Research direction

No file, test, version, or reproducible configuration is named. Start by reproducing the Deforum video workflow with ControlNet tile and temporalnet, then trace why the base or masking frames are not found. Done means the warning is resolved and subsequent frames retain the intended style and quality.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.