google-deepmind / google-deepmind/tapnet

Tracking deformable manipulation

Open
#165 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2k
Forks
192
PR merge metrics
No merged PRs in 30d

Description

Thanks for your great work!
I found when using TAPnext++ to track deformable manipulation video, especially a long video, it performs not well.
For example, when folding a towel and then wipe the table, a lot of points on the towel are tracked to wrong positions.
If you have any insight on this, please let me know

Contributor guide

Open the contributing guide

Research direction

Start with TAPnext++ and reproduce the reported failure on a long deformable-manipulation video involving folding a towel and wiping a table. Compare the tracked point positions through those actions; the issue does not identify files, tests, or a defined fix, so done is not yet specified beyond understanding or resolving the tracking failure.

Written by the indexing model from the issue text.

Assessment

Tech stack
computer-vision, machine-learning
Domain
computer-vision
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.