invoke-ai / invoke-ai/InvokeAI

[enhancement]: Masked IP adapters, Controlnet, and T2I support.

Open
#6,098 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
28.2k
Forks
3k
Avg merge
6d 5h
Merged PRs (30d)
19

Description

### Is there an existing issue for this?

- [X] I have searched the existing issues

### Contact Details

_No response_

### What should this feature add?

The Forge UI has support for masked IP adapters, Controlnet, and T2I. It would be nice to have this feature in InvokeAI. This would be easily possible in Canvas itself if it supported multiple separate masks at the same time within the bounding box, each taking input from the corresponding IP adapters and controlnet during generation, similar to the regional prompting. The masks could be differentiated by using different colors.
![IPA](https://github.com/invoke-ai/InvokeAI/assets/152368658/5dc02c08-68a5-4b01-9eda-b753c3e3f64f)
![CN](https://github.com/invoke-ai/InvokeAI/assets/152368658/1ec3f0d4-775a-41fb-ae41-a6ab53794aec)

### Alternatives

_No response_

### Additional Content

_No response_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.