facebookresearch / facebookresearch/sam3

The recognition effect based on text_prompt is poor

Open
#535 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
11.7k
Forks
1.8k
PR merge metrics
No merged PRs in 30d

Description

Image
Image

If you enter the keyword 'beverage', it can be recognized normally . However, when it comes to prompts like 'The white beverage on the upper shelf' or 'White and transparent beverage', the recognition performance is not very good .

I further discovered that the model made incorrect judgments regarding adjectives such as "larger", "smaller", "left", "right", or "first layer" and "second layer". For example, it misidentified the yellow beverage on the left of the blue beverage as belonging to the first column.

Then I tried to label the drinks with numbers. When the prompt word is 'number', it can recognize all numbers normally, but it fails to recognize specific numbers like 123456

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start by reproducing the reported behavior with the attached beverage images and prompts such as “beverage,” “The white beverage on the upper shelf,” positional adjectives, and specific numbers; trace the relevant inference path to determine whether the behavior is actionable. Done requires a confirmed cause and a validated correction or clearly documented model limitation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.