HumanSignal / HumanSignal/label-studio-ml-backend

Selected frame index in video Auto-Annotation predict method

Open
#784 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.1k
Forks
490
Avg merge
1d 14h
Merged PRs (30d)
3

Description

I am working on a custom version of the [segment_anything_2_video](https://github.com/HumanSignal/label-studio-ml-backend/tree/7d8171412d7b345e4ae9ed76bc85c7f1d4fc6464/label_studio_ml/examples/segment_anything_2_video) ml backend and I was wondering if there is a way to obtain the currently selected video frame in the annotator in the [predict](https://github.com/HumanSignal/label-studio-ml-backend/blob/7d8171412d7b345e4ae9ed76bc85c7f1d4fc6464/label_studio_ml/examples/segment_anything_2_video/model.py#L216) method. I looked in both the `context` and the `tasks` objects that are passed to the `predict` method, but I could not find it.

For example, if I am doing video annotation, and I have frame 439 currently selected in the annotator window, and then I trigger the Auto-Annotation, I want to be able to have 439 passed to the `predict` method (in the context would make the most sense to me) or call some API or method within the `predict` method to retrieve the currently selected frame 439.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.