brownhci / brownhci/WebGazer

Webgazer Prediction reverts back to center on extremes.

Open
#263 1 comment 0 reactions 0 assignees View on GitHub
help wanted
Dominant language
HTML
Stars
3.9k
Forks
578
PR merge metrics
No merged PRs in 30d

Description

The issue is when I move my eyes to the extremes of my vision after a certain point the webgazer prediction reverts back to center. I have depicted the problem via [this](https://drive.google.com/file/d/1wcKxObqjhjA1j-RIHaMsNPQaPxJnwzMn/view?usp=sharing) graph as well.
- In this graph I start looking from the center and gradually move my eyes to the left and as you can see after a certain point the predictions starts to center again.
- I checked this is not only the problem in my build but same can be observed in the official demo on the webgazer website.
- I also checked that it is not a problem with mediapipe facemesh since it is successfully able to get the eye crops and also detect the landmarks of correctly.

I am wondering if there is a certain threshold in prediction which leads to this. Anyways
**Any ideas to why this might be the case ?**

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the extreme-gaze behavior in the official WebGazer demo and compare it with the reported graph. Check whether the prediction returns to center despite MediaPipe Face Mesh continuing to provide eye crops and landmarks; done means identifying and correcting the cause so predictions remain responsive at the extremes.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
computer-vision, web-dev
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.