tensorflow / tensorflow/model-optimization

block_size for pruning 3D weights

Open
#634 1 comment 2 reactions 1 assignee View on GitHub

@liyunlu0618 is already working on this.

Since Mar 25, 2021.

feature request
Dominant language
Python
Stars
1.6k
Forks
349
Avg merge
3d 2h
Merged PRs (30d)
1

Description

System information
Ubuntu 18.02

  • TensorFlow version (you are using):
    2.4.1
  • Are you willing to contribute it (Yes/No):
    Yes
    This relates to the pruning optimization

"block_size: The dimensions (height, weight) for the block sparse pattern
in rank-2 weight tensors."

Currently it seems that the block_size feature during pruning only works for 2D weights and this seems to limit the application to dense layers. Would it be possible to block the 3D weights typically used by conv layers ? Not sure if there is any fundamental technical reason that prohibits this to work ? Since most layers are of the conv type it would speed up execution if the blocks could be used with 3D weights.

Thanks.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.