jwyang / jwyang/face-alignment

Face Tracking?

Open
#15 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
MATLAB
Stars
321
Forks
190
PR merge metrics
No merged PRs in 30d

Description

I tried your program for face tracking.

First, I assumed that one single image is given continuously like a video.
At the first frame, the alignment was successful because it starts with the mean shape.

But the problem happens from the second frame.
After the first frame, current shape is almost close to the ground truth.
The first stage of regressor is trained with the mean shape and augmented data.
Then, the result of regressor contains large displacement from the ground truth.
Therefore, At the second frame, the shape moves largely by first stage of regressor.
As the frame goes, shape diverges smoothly.

Somebody suggests to start with the mean shape at each frame.
But it sometimes fails if face is rotated largely.

Therefore, I think starting with the previous frame's shape is the best way.

Do you have any experience of idea about this problem of face tracking?

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points. Start by locating the MATLAB face-tracking flow and compare mean-shape initialization with previous-frame initialization across consecutive and highly rotated frames; done means the chosen initialization avoids landmark divergence without losing rotated-face cases.

Written by the indexing model from the issue text.

Assessment

Tech stack
matlab
Domain
computer-vision
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.