facebookresearch / facebookresearch/SlowFast
Correct config to reproduce ssv2 result on multigrid
- Dominant language
- Python
- Stars
- 7.4k
- Forks
- 1.3k
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
I'm trying to reproduce the multigrid result on ssv2. The config I'm using is:
configs/SSv2/SLOWFAST_16x8_R50_multigrid.yaml
The pretrained checkpoint I'm using is:
SLOWFAST_8x8_R50.pkl
per:
https://github.com/facebookresearch/SlowFast/blob/master/MODEL_ZOO.md
Is the config and checkpoint matched correctly? Per my understanding of the paper
1. The number of frames sampled by the Slow pathway as T.
2. The key concept in our Slow pathway is a large temporal stride τ on input frames.
The raw clip length is T × τ frames.
If the number of frames processed by the slow pathways are different, then the config SLOWFAST_16x8_R50_multigrid cannot possibly use a 8x8 pretrained model?
With this mismatched configuration, I'm only able to achieve "min_top1_err": 43.042776, "min_top5_err": 15.907990
Thank you for your explanation!
Contributor guide
Assessment
This issue has not been assessed yet.