facebookresearch / facebookresearch/sam2

opensource demo get worse after adding corrective points and propagate

Open
#731 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
19.9k
Forks
2.5k
PR merge metrics
No merged PRs in 30d

Description

The online demo (https://sam2.metademolab.com/demo) is good, but my local demo deployed using the github opensource code is bad.

Steps are 1) adding some prompt points in first frame, for example, include palm and exclude arm,
2) in some following frame which get wrong, add some corrective points, it will respect the input points and update current frame's result, which looks good.
3) after press "track objects" button, it propagates the video, in the opensource demo, it will overwrite the result on the frame I just added corrective points, with a worse result.

Anyone knows how to fix this? I makes the local demo almost unable to use.

Left: local demo, Right: online demo
![Image](https://github.com/user-attachments/assets/8043c3bf-e317-4913-b71a-0e74079a6742)

![Image](https://github.com/user-attachments/assets/71976d0a-29e1-443b-a493-11a83f544662)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.