kohya-ss / kohya-ss/sd-scripts

ControlNet-LLLite vs. ControlNet-XS

Open
#1,082 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.2k
Forks
1.2k
Avg merge
11m
Merged PRs (30d)
2

Description

When recently I saw [ControlNet-XS](https://github.com/vislearn/ControlNet-XS) and wanted to train a customized ControlNet-XS, I found your ControlNet-LLLite, which is awesome!

I wonder if your work (both of you) share some similarities? I'm not implying who copies who. That's not my concern. What interests me is the properties of ControlNet-XS that were discussed in their paper. They claim ControlNet-XS has better training efficiency, better data efficiency and less impact on generation quality, less bias from training data from ControlNet. And I think those claims are very likely to be valid, which is awesome!

If your works share a great amount of similarities, I guess ControlNet-LLLite will also have these awesome properties. While ControlNet-XS does not yet provide training code, ControlNet-LLLite has reference training code and better integration with ComfyUI and WebUI. ControlNet-LLLite is more technical while ControlNet-XS has more analysis, which makes them complement well.

So I open this, and I hope you can give me some insights. Thanks for the awesome work, as always!

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue compares ControlNet-LLLite with ControlNet-XS and asks about training efficiency, data efficiency, generation quality, and training-data bias. No files, tests, or entry points are mentioned; start with the linked ControlNet-XS project and its paper, then determine whether maintainers want a documented comparison. Done would be a maintainer-backed answer or a clearly scoped follow-up.

Written by the indexing model from the issue text.

Assessment

Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.