facebookresearch / facebookresearch/fvcore

Feed two batches and then dividing the ended FLOPs by 2 to avoid the batch_norm error?

Open
#132 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.3k
Forks
236
PR merge metrics
No merged PRs in 30d

Description

Hi dear fvcore team,

in my model there is a very special case, where the input tensor only have the shape of `[3, 1, 1]` and `[9, 1, 1]`, thus while estimating the FLOPs by feeding only one batch, the `BatchNorm2d` layer can't handle this sinlge input tensor and also it seems that fvcore lib doesn't consider this case too, so an error will just be threw out.

So I'm just wondering is it possible to feed two batches and get the FLOPs computed over them, then dividing the FLOPs by 2 to have the equivalent FLOPs as feeding one batch? Just as a beginner in computing FLOPs so really have no too much idea if this works in theory.... so I would appreciate if I can have some answers on this question. Big thanks in advance!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.