tensorflow / tensorflow/model-optimization
block_size for pruning 3D weights
@liyunlu0618 is already working on this.
Since Mar 25, 2021.
- Dominant language
- Python
- Stars
- 1.6k
- Forks
- 349
- Avg merge
- 3d 2h
- Merged PRs (30d)
- 1
Description
System information
Ubuntu 18.02
- TensorFlow version (you are using):
2.4.1 - Are you willing to contribute it (Yes/No):
Yes
This relates to the pruning optimization
"block_size: The dimensions (height, weight) for the block sparse pattern
in rank-2 weight tensors."
Currently it seems that the block_size feature during pruning only works for 2D weights and this seems to limit the application to dense layers. Would it be possible to block the 3D weights typically used by conv layers ? Not sure if there is any fundamental technical reason that prohibits this to work ? Since most layers are of the conv type it would speed up execution if the blocks could be used with 3D weights.
Thanks.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.