huggingface / huggingface/pytorch_block_sparse

Any way to bypass constraint of input and output features to be a multiple of block size

Open
#9 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
551
Forks
34
PR merge metrics
No merged PRs in 30d

Description

Hi,

I wanted to know if there is a way to bypass the constraint of the number of input and output features of the Block Sparse Layer being a multiple of a value of the block size. Like is there a generic implementation possible? Something like [https://github.com/rain-neuromorphics/SparseLinear](https://github.com/rain-neuromorphics/SparseLinear) which can have any number of input and output features.

I would love to know if there is a way to make it possible?

Thanks

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.