HumanSignal / HumanSignal/label-studio

Better video timeline segmentation template/support.

Open
#3,693 7 comments 8 reactions 1 assignee Claimed by @makseq View on GitHub
feature labeling video
Dominant language
TypeScript
Stars
28.3k
Forks
3.7k
Avg merge
14h
Merged PRs (30d)
15

Description

**Is your feature request related to a problem? Please describe.**
The current video timeline segmentation template is deficient in a number of very important features, which result in annotations that are hard to control and an overall poor user experience.

**Describe the solution you'd like**
Most of the above features I'm listing are supported by tools such as [VGG VIA](https://www.robots.ox.ac.uk/~vgg/software/via/) or [Vidat](https://github.com/anucvml/vidat).

To name a few, the template could do with the following features:
- support videos without audio
- the ability to automatically detect the FPS of a video without the need to explicitly specify in the template configs
- the ability to jump between temporal segments
- the ability to increase/decrease the extent of the left or right edge of a selected temporal segment for fine-grained annotation
- the ability to play/pause a video while being locked to the segment boundary.
- the ability to reduce playback speed below 0.5 and above 2.5 and control it on the fly with keyboard shortcuts
- the ability to seek either the start or end of a temporal segment while annotating.

**Describe alternatives you've considered**

Video timeline segmentation is a very specific use case. It is akin to annotating all frames in a video that has an event of note, for example, a part of the video where it's raining or snowing, this use case does not translate well to object-detection or tracking templates as alluded [here](https://github.com/heartexlabs/label-studio/issues/1837#issuecomment-993062982) nor does adding a silent track to potentially thousands of videos a viable solution.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.