lllyasviel / lllyasviel/ControlNet

How to calculate the loss

Open
#60 9 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
34.1k
Forks
3k
PR merge metrics
No merged PRs in 30d

Description

i didn't fully understand how the loss is calculated

regular diffusion models takes input image adding noise and during backward stage we learn how to undo that noise
the loss calculate base on how good we learn that noise for every stage in T

so what i don't understand is what the part of the target image ? ( we add the noise to input image )

that is what says in the paper

![image](https://user-images.githubusercontent.com/64726228/219061337-317f971b-ce74-4b6d-b3fb-5d65897f580f.png)

I also not sure what is it "task-specific conditions cf" in the loss , is it the target image ?

thanks

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the linked paper excerpt and the existing comment discussion, focusing on the roles of the noisy input, target image, and task-specific conditions. Done means documenting a clear explanation of how the loss is calculated and resolving whether the target image is the task-specific condition; no repository file or test is named.

Written by the indexing model from the issue text.

Assessment

Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.