invoke-ai / invoke-ai/InvokeAI

[enhancement]: Face Detection & Facial Expression Change

Open
#7,228 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
28.2k
Forks
3k
Avg merge
6d 5h
Merged PRs (30d)
19

Description

### Is there an existing issue for this?

- [X] I have searched the existing issues

### Contact Details

_No response_

### What should this feature add?

I want to suggest a feature that could be extremely useful for all the INVOKE users. Is there a way to integrate a facial detection model and a facial expression editor in to invoke where we can detect faces and then control the expressions within the canvas without loosing the already generated facial features? That would be amazing.
like this on in Comfy UI - https://github.com/PowerHouseMan/ComfyUI-AdvancedLivePortrait

### Alternatives

Currently, I am going through a long route to get this done and it's exhausting.

I generate characters using INVOKE. Then somtimes I want to keep the facial features but only change the facial expression. Inpaint allwyas changes the facial features and yes some control can be applied with Controlnet. But it's never as good as the exsiting libraries like AdvanceLivePortrait or Facepoke.

So from INVOKE canvas, I take a screenshot of the face I want to change, run it through Comfy ui with the AdvanceLivePortrait nodes by PowerHouseMan or run through Facepoke, manually change the values and once satisfied, download the face with the new expression, then import thatto invoke, place it above the original face then try to blend the new one in with the rest of the image. It takes a lot of time and effort.

Given that INVOKE is at the on the top of the GEN AI Art Creation platforms (hands down! there is nothing like it out there at the moment), it would be amazing to have a feature like this inbuilt wich will give immense conrol to the generated character facial expressions and will add a lot of value for INVOKE. Imagine the possibilities for comic artists and such.

### Additional Content

_No response_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.