facebookresearch / facebookresearch/SlowFast

For inference, how do we control the clip size

Open
#304 2 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
7.4k
Forks
1.3k
PR merge metrics
No merged PRs in 30d

Description

Hi,

I have a long video I want to do inference on. I want pyslowfast to do inference every N seconds, or every M frames. How do I control that in the configs yaml file? And how is this related to the config options, if it is? What do the config options really mean for the input video/dataset?

```
# Number of overlapping frames between 2 consecutive clips.
# Increase this number for more frequent action predictions.
# The number of overlapping frames cannot be larger than
# half of the sequence length `cfg.DATA.NUM_FRAMES * cfg.DATA.SAMPLING_RATE`
```
_C.DEMO.BUFFER_SIZE = 0

`# The number of frames of the input clip.
`_C.DATA.NUM_FRAMES = 8

`# The video sampling rate of the input clip.
`_C.DATA.SAMPLING_RATE = 8

Does it mean that with a buffer_size of 16, the demo waits until it has 16 frames, makes a person prediction on the center frame, then uses the predicted bounding boxes from center frame, and the 16 frames for action prediction?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.