roboflow / roboflow/notebooks

Grounding Dino notebook using MMDetection

Open
#211 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Jupyter Notebook
Stars
9.7k
Forks
1.5k
PR merge metrics
No merged PRs in 30d

Description

Search before asking
  • I have searched the Roboflow Notebooks issues and found no similar bug report.
Description

Hello, I saw your interesting colab to run Zero-Shot Object Detection with Grounding DINO

MMDetection now supports Grounding Dino, so I created a simplified version of Colab, to run object detection using this library. It's much simpler, I could run with dog-3.jpeg image with just 5 lines of code.
It seems to perform even better, using prompt chair with man sitting on it it detect only the chair, not even the man.

You can update Colab using MMDetection, to simplify the process. If you need any help, I'm here.

Additional

No response

Are you willing to submit a PR?
  • Yes I'd like to help by submitting a PR!

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Open notebooks/zero-shot-object-detection-with-grounding-dino.ipynb and compare its current Colab flow with the proposed MMDetection approach. Run the notebook with the dog-3.jpeg example and the “chair with man sitting on it” prompt. Done means the notebook uses MMDetection for a simpler Grounding DINO object-detection workflow and produces the expected detections.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook, python
Domain
computer-vision, documentation, machine-learning
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.