HumanSignal / HumanSignal/label-studio-ml-backend
Selected frame index in video Auto-Annotation predict method
- Dominant language
- Python
- Stars
- 1.1k
- Forks
- 490
- Avg merge
- 1d 14h
- Merged PRs (30d)
- 3
Description
I am working on a custom version of the [segment_anything_2_video](https://github.com/HumanSignal/label-studio-ml-backend/tree/7d8171412d7b345e4ae9ed76bc85c7f1d4fc6464/label_studio_ml/examples/segment_anything_2_video) ml backend and I was wondering if there is a way to obtain the currently selected video frame in the annotator in the [predict](https://github.com/HumanSignal/label-studio-ml-backend/blob/7d8171412d7b345e4ae9ed76bc85c7f1d4fc6464/label_studio_ml/examples/segment_anything_2_video/model.py#L216) method. I looked in both the `context` and the `tasks` objects that are passed to the `predict` method, but I could not find it.
For example, if I am doing video annotation, and I have frame 439 currently selected in the annotator window, and then I trigger the Auto-Annotation, I want to be able to have 439 passed to the `predict` method (in the context would make the most sense to me) or call some API or method within the `predict` method to retrieve the currently selected frame 439.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.