HumanSignal / HumanSignal/label-studio
VideoRectangle interpolation (x, y) interpolation gone wrong
- Dominant language
- TypeScript
- Stars
- 28.3k
- Forks
- 3.7k
- Avg merge
- 14h
- Merged PRs (30d)
- 15
Description
**Describe the bug**
At intermediate frames between keyframes, the videorectangles are appearing at (0, 0) instead of between the two that are predicted by the model.
**To Reproduce**
Steps to reproduce the behavior:
1. Create a project with a VideoRectangle (example template below)
2. Import a task with a sequence for this video rectangle (task json below)
3. Check the location of the videorectangle in between keyframes
**Expected behavior**
The location should be interpolated
**Screenshots**
If a video is better (https://github.com/HumanSignal/label-studio/assets/11409469/44cc5461-c313-48c3-90ad-7ed06dd57751)
**Environment (please complete the following information):**
- OS: docker container, latest image
- Label Studio Version: 1.11.0
**Additional context**
*** Project Template
```
```
*** Task JSON (replace with any video, it doesn't matter)
```
{'data': {'video': 'some-video'},
'predictions': [{'model_version': 'v1',
'score': 1,
'result': [{'id': 'H9eXv43Kut',
'from_name': 'box',
'to_name': 'video',
'type': 'videorectangle',
'value': {'framesCount': 49,
'duration': 1.96,
'sequence': [{'frame': 1,
'x': 8.90625,
'y': 55.74074074074075,
'width': 0.9895833333333333,
'height': 1.6666666666666667,
'time': 0.04,
'enabled': True},
{'frame': 25,
'x': 7.395833333333333,
'y': 76.94444444444444,
'width': 1.0416666666666665,
'height': 2.037037037037037,
'time': 1.0,
'enabled': True},
{'frame': 49,
'x': 16.041666666666668,
'y': 27.962962962962962,
'width': 1.0416666666666665,
'height': 2.037037037037037,
'time': 1.96,
'enabled': True}],
'labels': ['Ball']}}]}]}
```
Contributor guide
Assessment
This issue has not been assessed yet.