HumanSignal / HumanSignal/label-studio-ml-backend

problem with grounding_dino and sam

Open
#777 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.1k
Forks
490
Avg merge
1d 14h
Merged PRs (30d)
3

Description

Hello, have been tring for some time to get grounding dino and sam to work.

first I need to run this in order for it to run at all:
containers:
- name: label-studio-ml-grounding-dino
image: heartexlabs/label-studio-ml-backend:grnddino-20250430.130621-master-4db70b4
command:
- sh
- -c
- |
pip install "numpy<2"
/app/start.sh

Now i works i can add prompt to the picture and it finds bounding boksens for all my wanted objects and it works perfekt.

But it do not match the labels I have configured. why is that so? also is it possible to keep the prompt for the next picture? So i can just can click next approve next approve?

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the reported setup with the label-studio-ml-backend image and the numpy<2 installation, then inspect how Grounding DINO and SAM results are mapped to configured labels. Verify both requested outcomes: detected objects use the configured labels, and the prompt remains available when advancing to the next picture; the payload names no source files or tests, so locate the relevant backend entry point first.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, python
Domain
backend, computer-vision
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.