facebookresearch / facebookresearch/SlowFast

Correct config to reproduce ssv2 result on multigrid

Open
#256 11 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.4k
Forks
1.3k
PR merge metrics
No merged PRs in 30d

Description

Hi,

I'm trying to reproduce the multigrid result on ssv2. The config I'm using is:
configs/SSv2/SLOWFAST_16x8_R50_multigrid.yaml

The pretrained checkpoint I'm using is:
SLOWFAST_8x8_R50.pkl
per:
https://github.com/facebookresearch/SlowFast/blob/master/MODEL_ZOO.md

Is the config and checkpoint matched correctly? Per my understanding of the paper

1. The number of frames sampled by the Slow pathway as T.
2. The key concept in our Slow pathway is a large temporal stride τ on input frames.
The raw clip length is T × τ frames.

If the number of frames processed by the slow pathways are different, then the config SLOWFAST_16x8_R50_multigrid cannot possibly use a 8x8 pretrained model?

With this mismatched configuration, I'm only able to achieve "min_top1_err": 43.042776, "min_top5_err": 15.907990

Thank you for your explanation!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.