cosanlab / cosanlab/py-feat

Chiralization/mirroring (new functionality)

Open
#236 3 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
388
Forks
95
Avg merge
54m
Merged PRs (30d)
3

Description

I'm asking you to add a variant analysis that can measure Aus of face sides independently.
Re-training the whole network would be a hassle, but there's an easier method.
The rough algorithm is as follows: take a detected face, mirror it across a middle line, taking the pose into account, then extract AUs for the original and both reflections separately.

Here's the general idea - the face aligned in Openface and mirrored images on both sides.
![faceChi](https://github.com/user-attachments/assets/f3cea0f0-3c9d-416a-86cc-daefd07cbec0)

It can also be seen that here the alignment is rather poor, but mirroring was done manually, without using facial landmarks.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points. Start by locating the face-alignment and action-unit extraction paths, then determine how pose-aware mirroring could produce the original and two reflected faces independently. Done means the variant analysis reports separate AUs for all three images without retraining the network.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.